2024-09-11T23:40:05.748 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:40:05.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:40:05.882 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901496' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync rbytes: false syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwX6Au9yL3Mw0IFQYb7QqC2w6A61GRYfWfn5mO2sKJhhW9Y96parCvbhyK6E+RZyHK/JGLSXg5kbN/+Y2lHrtg= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFbAWQlimxVva79hmcCpMVrxbTi09lstdmA7W7Oz+hY4pna4ceODQKwcWKDg9NZ0AXpX8vF+x5RbkNL/Cnmfhtk= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuYFPUqgf1bEkCV8n3o4bZLcM7J1nEqnL2YoXaPe76pOPNmhy49sX3XAAxjZXP47aGfulYY1mxopATeu3P24Xs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:40:05.883 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T23:40:05.883 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T23:40:05.884 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:40:05.885 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:40:05.907 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T23:40:05.907 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:40:05.907 INFO:teuthology.packaging:ref: None 2024-09-11T23:40:05.907 INFO:teuthology.packaging:tag: None 2024-09-11T23:40:05.907 INFO:teuthology.packaging:branch: squid 2024-09-11T23:40:05.907 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:40:05.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T23:40:06.139 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T23:40:06.141 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:40:06.149 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:40:06.149 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:40:06.275 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:40:06.297 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:40:06.312 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:40:06.345 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:35:05.076315', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFwX6Au9yL3Mw0IFQYb7QqC2w6A61GRYfWfn5mO2sKJhhW9Y96parCvbhyK6E+RZyHK/JGLSXg5kbN/+Y2lHrtg='} 2024-09-11T23:40:06.377 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:35:05.074354', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFbAWQlimxVva79hmcCpMVrxbTi09lstdmA7W7Oz+hY4pna4ceODQKwcWKDg9NZ0AXpX8vF+x5RbkNL/Cnmfhtk='} 2024-09-11T23:40:06.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:35:05.078092', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuYFPUqgf1bEkCV8n3o4bZLcM7J1nEqnL2YoXaPe76pOPNmhy49sX3XAAxjZXP47aGfulYY1mxopATeu3P24Xs='} 2024-09-11T23:40:06.409 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:40:06.415 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-11T23:40:06.415 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-11T23:40:06.415 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-11T23:40:06.415 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:40:06.685 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa51187fbe0>, signals=[15]) 2024-09-11T23:40:06.685 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:40:06.691 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:40:06.691 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-09-11T23:40:06.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:40:06.775 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2024-09-11T23:40:06.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:40:06.856 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-09-11T23:40:06.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:40:06.940 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:40:06.947 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-09-11T23:40:06.965 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-09-11T23:40:06.965 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:40:07.023 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:40:07.024 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:40:07.024 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:40:07.024 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:40:07.024 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-09-11T23:40:07.057 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-09-11T23:40:07.076 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-09-11T23:40:07.076 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:40:07.134 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:40:07.135 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:40:07.135 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:40:07.135 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:40:07.135 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:40:07.135 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-09-11T23:40:07.394 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-09-11T23:40:07.412 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-09-11T23:40:07.412 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:40:07.471 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:40:07.472 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:40:07.472 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:40:07.472 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-09-11T23:40:07.506 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:40:07.517 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:40:07.555 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:40:07.555 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:40:07.558 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:40:07.560 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:40:07.577 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:40:07.598 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:40:07.598 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:40:07.615 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:40:07.617 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:40:07.641 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:40:07.743 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:40:07.757 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:40:07.758 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-11T23:40:07.758 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-11T23:40:07.758 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:40:07.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:40:07.776 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-11T23:40:07.833 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:40:07.833 INFO:teuthology.task.kernel:Running kernel on smithi060: 5.14.0-503.el9.x86_64 2024-09-11T23:40:07.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2024-09-11T23:40:10.182 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-11T23:40:14.641 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-11T23:40:20.308 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-11T23:40:21.809 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-11T23:40:23.005 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-11T23:40:28.719 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T23:40:30.843 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:40:30.843 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:40:30.937 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-11T23:40:30.943 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-11T23:40:30.943 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-11T23:40:30.943 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-11T23:40:30.943 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-11T23:40:30.943 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:40:30.943 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-11T23:40:30.944 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:40:30.944 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:40:30.944 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:40:30.944 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:40:30.944 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-11T23:40:30.944 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-11T23:40:30.944 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-11T23:40:30.944 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:40:30.945 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 79 M 2024-09-11T23:40:30.945 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 126 M 2024-09-11T23:40:30.945 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-11T23:40:31.129 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 161 kB/s | 23 kB 00:00 2024-09-11T23:40:32.021 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-11T23:40:32.571 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-11T23:40:32.897 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 18 MB/s | 35 MB 00:01 2024-09-11T23:40:32.897 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:40:32.897 INFO:teuthology.orchestra.run.smithi060.stdout:Total 40 MB/s | 79 MB 00:01 2024-09-11T23:40:33.611 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-11T23:40:33.989 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-11T23:40:33.989 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-11T23:40:34.996 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-11T23:40:34.997 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-11T23:40:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-11T23:40:38.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:40:38.350 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:40:41.167 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:40:41.294 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:40:46.418 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:40:46.461 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:40:51.608 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:41:30.853 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:41:30.896 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:41:31.266 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:41:31.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:41:31.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:41:31.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:41:32.131 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:41:32.131 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:41:32.131 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-11T23:41:32.131 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:41:32.131 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:41:32.131 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:41:32.131 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:41:32.132 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:41:32.132 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-11T23:41:32.469 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:41:32.594 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:41:32.595 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:41:32.595 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:41:32.595 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:41:32.595 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:41:32.595 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-11T23:41:32.595 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:41:32.595 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:41:32.654 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:41:32.654 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:41:32.655 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 82.el9 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8274670 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:41:32.689 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-09-11T23:41:32.690 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:41:32.691 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:41:32.691 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:41:32.691 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:41:32.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:41:33.305 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-09-11T23:41:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:41:34.562 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-09-11T23:41:34.574 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-11T23:41:34.617 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.XEMwrBBEzu 2024-09-11T23:41:34.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XEMwrBBEzu 2024-09-11T23:41:34.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.XEMwrBBEzu 2024-09-11T23:41:34.820 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.XEMwrBBEzu is 6KB 2024-09-11T23:41:34.868 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.XEMwrBBEzu 2024-09-11T23:41:34.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:41:34.944 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:41:34.945 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:41:34.945 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:41:34.945 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:41:34.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:41:35.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-09-11T23:42:05.125 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T23:42:05.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-11T23:42:05.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:43:05.138 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:43:14.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-11T23:43:14.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:43:14.476 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-11T23:43:14.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-11T23:43:14.821 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:43:14.822 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-11T23:43:14.837 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:43:14.837 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:43:14.837 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:43:14.838 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:43:15.839 DEBUG:teuthology.parallel:result is None 2024-09-11T23:43:15.839 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:43:15.852 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:43:15.852 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:43:15.855 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:43:15.857 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:43:15.876 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:43:15.895 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:43:15.923 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:43:15.924 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:43:15.926 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:43:15.928 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:43:15.965 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:43:15.982 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:43:15.982 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:43:16.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:43:16.014 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:43:16.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:43:16.031 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:43:16.033 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:43:16.056 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:43:16.098 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:43:16.112 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:43:16.117 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:43:16.129 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:43:16.135 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:43:16.208 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:43:16.217 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:43:16.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:43:16.219 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:43:16.221 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:43:16.250 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:43:16.262 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:43:16.262 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:43:16.291 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:43:16.293 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:43:16.310 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:43:16.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:43:16.439 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:43:16.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:43:16.570 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:43:16.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:43:16.641 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:43:16.690 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:43:16.738 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:43:16.829 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:43:16.863 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:43:16.863 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:43:16.929 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:43:16.977 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:43:17.029 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:43:17.120 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:43:17.155 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:43:17.156 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:43:17.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-09-11T23:43:17.225 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2024-09-11T23:43:17.227 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-09-11T23:43:17.265 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:43:17.302 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:43:17.357 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:43:17.824 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:43:17.832 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:43:17.832 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:43:17.875 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:43:17.912 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-11T23:43:17.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-09-11T23:43:18.018 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-09-11T23:43:18.021 DEBUG:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2024-09-11T23:43:18.075 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: 2024-09-11T23:43:18.077 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-09-11T23:43:18.127 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-09-11T23:43:18.129 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:43:18.129 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-09-11T23:43:18.174 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-09-11T23:43:18.174 DEBUG:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2024-09-11T23:43:18.199 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2024-09-11T23:43:18.199 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-09-11T23:43:18.231 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-09-11T23:43:18.231 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi105.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-09-11T23:43:18.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:43:18.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:43:18.296 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:43:18.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:43:18.323 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:43:18.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:43:18.352 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:43:18.352 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:43:18.673 DEBUG:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:43:18.707 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:43:18.736 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:43:18.745 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T23:43:18.749 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T23:43:18.905 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:43:18.915 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:43:18.916 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi105.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:47:21.379 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-09-11T23:47:21.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-11T23:47:21.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:47:21.465 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-11T23:47:21.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-11T23:47:21.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-11T23:47:21.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:47:21.627 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-09-11T23:47:21.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-11T23:47:21.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-11T23:47:21.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:47:21.790 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-11T23:47:21.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-11T23:47:21.875 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:47:21.886 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:47:21.887 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:47:21.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:47:21.889 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:47:21.890 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:47:21.892 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:47:21.892 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:47:21.919 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:47:21.920 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:47:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:47:21.935 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:47:21.947 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:47:21.960 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2024-09-11T23:47:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-09-11T23:47:21.964 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:47:21.971 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2024-09-11T23:47:21.973 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-09-11T23:47:21.985 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:47:21.988 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:47:21.990 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-09-11T23:47:22.000 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:47:22.001 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-09-11T23:47:22.003 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:47:22.016 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:47:22.030 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:47:22.061 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:47:22.063 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:47:22.064 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:47:22.064 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-11T23:47:22.064 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.064 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.064 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.064 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.066 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:47:22.066 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-11T23:47:22.066 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.066 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.066 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.067 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.087 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:47:22.090 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:47:22.090 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-11T23:47:22.090 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.091 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.091 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.091 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:47:22.092 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:47:22.100 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:47:22.101 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T23:47:22.101 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T23:47:22.101 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:47:22.106 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:47:22.107 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T23:47:22.107 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:47:22.108 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:47:22.110 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:47:22.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:47:22.111 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:47:22.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:47:22.259 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:47:22.260 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:47:22.275 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:47:22.275 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:47:22.286 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:47:22.286 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:47:22.382 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:47:22.383 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:47:22.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:47:22.394 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:47:22.394 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:47:22.394 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:47:22.402 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:47:22.402 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:47:22.402 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:47:22.410 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:47:22.410 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:47:22.420 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:47:22.420 DEBUG:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:47:22.429 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:47:22.429 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:47:22.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:47:22.486 DEBUG:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:47:22.496 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:47:22.554 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:47:22.561 DEBUG:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:47:22.572 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:47:22.619 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-09-11T23:47:22.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-09-11T23:47:22.625 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2024-09-11T23:47:22.626 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum clean all 2024-09-11T23:47:22.637 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-09-11T23:47:22.638 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-09-11T23:47:22.849 INFO:teuthology.orchestra.run.smithi105.stdout:45 files removed 2024-09-11T23:47:22.857 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-09-11T23:47:22.864 INFO:teuthology.orchestra.run.smithi192.stdout:45 files removed 2024-09-11T23:47:22.875 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:47:22.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:47:22.892 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:47:23.431 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-11T23:47:23.441 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-11T23:47:23.454 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-11T23:47:23.723 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-11T23:47:23.729 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-11T23:47:23.734 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-11T23:47:23.997 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-11T23:47:23.999 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-11T23:47:24.001 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-11T23:47:24.524 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T23:47:24.543 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-11T23:47:24.647 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T23:47:26.252 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-11T23:47:26.876 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-11T23:47:31.369 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-11T23:47:31.656 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 20 MB 00:05 2024-09-11T23:47:32.236 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-11T23:47:32.853 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-11T23:47:33.612 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 19 kB 00:00 2024-09-11T23:47:33.807 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-11T23:47:34.774 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T23:47:36.290 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.5 MB 00:00 2024-09-11T23:47:37.841 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-11T23:47:38.703 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-11T23:47:39.288 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-11T23:47:40.280 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-11T23:47:41.556 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:47:41.557 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:47:41.568 INFO:teuthology.orchestra.run.smithi105.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:47:41.568 INFO:teuthology.orchestra.run.smithi105.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:47:41.569 INFO:teuthology.orchestra.run.smithi105.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:47:41.570 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:47:41.572 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:47:41.574 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:47:41.575 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:47:41.636 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-09-11T23:47:41.650 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-11T23:47:41.650 INFO:teuthology.orchestra.run.smithi105.stdout: Package Arch Version Repository Size 2024-09-11T23:47:41.650 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-11T23:47:41.650 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-09-11T23:47:41.650 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:47:41.650 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:47:41.651 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:47:41.652 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:47:41.653 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:47:41.654 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:47:41.655 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:47:41.656 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:47:41.657 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:47:41.658 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:47:41.659 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:47:41.660 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:47:41.661 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:47:41.662 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout:Installing weak dependencies: 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout:Install 148 Packages 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 8 Packages 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:47:41.663 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 226 M 2024-09-11T23:47:41.664 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-09-11T23:47:42.281 INFO:teuthology.orchestra.run.smithi105.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-11T23:47:42.479 INFO:teuthology.orchestra.run.smithi105.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.4 MB/s | 897 kB 00:00 2024-09-11T23:47:42.532 INFO:teuthology.orchestra.run.smithi105.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.7 MB/s | 145 kB 00:00 2024-09-11T23:47:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:47:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:47:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:47:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:47:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:47:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:47:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:47:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:47:42.738 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-11T23:47:42.749 INFO:teuthology.orchestra.run.smithi105.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 8.9 MB/s | 5.4 MB 00:00 2024-09-11T23:47:42.753 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-11T23:47:42.753 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:47:42.754 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:47:42.755 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:47:42.756 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:47:42.757 INFO:teuthology.orchestra.run.smithi192.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:47:42.758 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:47:42.759 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:47:42.760 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:47:42.761 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:47:42.762 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:47:42.763 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:47:42.764 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:47:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-09-11T23:47:42.766 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:47:42.767 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:47:42.767 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-11T23:47:42.767 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-11T23:47:42.767 INFO:teuthology.orchestra.run.smithi192.stdout:Install 148 Packages 2024-09-11T23:47:42.767 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 8 Packages 2024-09-11T23:47:42.767 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:47:42.767 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 226 M 2024-09-11T23:47:42.767 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-11T23:47:42.807 INFO:teuthology.orchestra.run.smithi105.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 8.7 MB/s | 2.4 MB 00:00 2024-09-11T23:47:42.908 INFO:teuthology.orchestra.run.smithi105.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 9.6 MB/s | 1.5 MB 00:00 2024-09-11T23:47:43.233 INFO:teuthology.orchestra.run.smithi105.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-11T23:47:43.540 INFO:teuthology.orchestra.run.smithi192.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-11T23:47:43.616 INFO:teuthology.orchestra.run.smithi105.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 21 MB 00:01 2024-09-11T23:47:43.675 INFO:teuthology.orchestra.run.smithi105.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 433 kB/s | 25 kB 00:00 2024-09-11T23:47:43.807 INFO:teuthology.orchestra.run.smithi192.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.3 MB/s | 897 kB 00:00 2024-09-11T23:47:43.857 INFO:teuthology.orchestra.run.smithi192.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-11T23:47:43.942 INFO:teuthology.orchestra.run.smithi105.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 16 MB/s | 17 MB 00:01 2024-09-11T23:47:44.067 INFO:teuthology.orchestra.run.smithi105.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 13 MB/s | 11 MB 00:00 2024-09-11T23:47:44.092 INFO:teuthology.orchestra.run.smithi105.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.5 MB/s | 228 kB 00:00 2024-09-11T23:47:44.117 INFO:teuthology.orchestra.run.smithi105.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 542 kB/s | 27 kB 00:00 2024-09-11T23:47:44.151 INFO:teuthology.orchestra.run.smithi105.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 540 kB/s | 32 kB 00:00 2024-09-11T23:47:44.165 INFO:teuthology.orchestra.run.smithi192.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 7.7 MB/s | 2.4 MB 00:00 2024-09-11T23:47:44.193 INFO:teuthology.orchestra.run.smithi105.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.7 MB/s | 752 kB 00:00 2024-09-11T23:47:44.218 INFO:teuthology.orchestra.run.smithi105.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-11T23:47:44.261 INFO:teuthology.orchestra.run.smithi105.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.8 MB/s | 127 kB 00:00 2024-09-11T23:47:44.282 INFO:teuthology.orchestra.run.smithi192.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 6.1 MB/s | 5.4 MB 00:00 2024-09-11T23:47:44.286 INFO:teuthology.orchestra.run.smithi105.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 7.4 MB/s | 506 kB 00:00 2024-09-11T23:47:44.377 INFO:teuthology.orchestra.run.smithi105.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 493 kB/s | 45 kB 00:00 2024-09-11T23:47:44.392 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T23:47:44.449 INFO:teuthology.orchestra.run.smithi192.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.4 MB/s | 1.5 MB 00:00 2024-09-11T23:47:44.486 INFO:teuthology.orchestra.run.smithi105.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.2 MB/s | 136 kB 00:00 2024-09-11T23:47:44.711 INFO:teuthology.orchestra.run.smithi105.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-11T23:47:44.778 INFO:teuthology.orchestra.run.smithi105.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.7 MB/s | 321 kB 00:00 2024-09-11T23:47:44.845 INFO:teuthology.orchestra.run.smithi105.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-11T23:47:44.895 INFO:teuthology.orchestra.run.smithi105.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T23:47:44.899 INFO:teuthology.orchestra.run.smithi192.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 7.6 MB/s | 4.7 MB 00:00 2024-09-11T23:47:44.921 INFO:teuthology.orchestra.run.smithi105.stdout:(25/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 373 kB/s | 162 kB 00:00 2024-09-11T23:47:44.946 INFO:teuthology.orchestra.run.smithi105.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T23:47:45.030 INFO:teuthology.orchestra.run.smithi105.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-11T23:47:45.105 INFO:teuthology.orchestra.run.smithi105.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 425 kB/s | 32 kB 00:00 2024-09-11T23:47:45.172 INFO:teuthology.orchestra.run.smithi105.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-11T23:47:45.197 INFO:teuthology.orchestra.run.smithi105.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.6 MB/s | 146 kB 00:00 2024-09-11T23:47:45.581 INFO:teuthology.orchestra.run.smithi105.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 8.7 MB/s | 3.6 MB 00:00 2024-09-11T23:47:45.731 INFO:teuthology.orchestra.run.smithi105.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-11T23:47:45.756 INFO:teuthology.orchestra.run.smithi105.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.4 MB/s | 249 kB 00:00 2024-09-11T23:47:45.790 INFO:teuthology.orchestra.run.smithi105.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 843 kB/s | 49 kB 00:00 2024-09-11T23:47:45.816 INFO:teuthology.orchestra.run.smithi105.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 278 kB/s | 16 kB 00:00 2024-09-11T23:47:45.841 INFO:teuthology.orchestra.run.smithi105.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 285 kB 00:00 2024-09-11T23:47:45.901 INFO:teuthology.orchestra.run.smithi105.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 305 kB/s | 18 kB 00:00 2024-09-11T23:47:45.991 INFO:teuthology.orchestra.run.smithi192.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 8.2 MB/s | 21 MB 00:02 2024-09-11T23:47:45.993 INFO:teuthology.orchestra.run.smithi105.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.2 MB/s | 765 kB 00:00 2024-09-11T23:47:46.042 INFO:teuthology.orchestra.run.smithi192.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-11T23:47:46.068 INFO:teuthology.orchestra.run.smithi105.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-11T23:47:46.150 INFO:teuthology.orchestra.run.smithi192.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 8.5 MB/s | 11 MB 00:01 2024-09-11T23:47:46.177 INFO:teuthology.orchestra.run.smithi105.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-11T23:47:46.209 INFO:teuthology.orchestra.run.smithi192.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-11T23:47:46.259 INFO:teuthology.orchestra.run.smithi192.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 541 kB/s | 27 kB 00:00 2024-09-11T23:47:46.260 INFO:teuthology.orchestra.run.smithi105.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-11T23:47:46.309 INFO:teuthology.orchestra.run.smithi192.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 634 kB/s | 32 kB 00:00 2024-09-11T23:47:46.393 INFO:teuthology.orchestra.run.smithi192.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-11T23:47:46.560 INFO:teuthology.orchestra.run.smithi192.stdout:(15/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 8.0 MB/s | 17 MB 00:02 2024-09-11T23:47:46.585 INFO:teuthology.orchestra.run.smithi192.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 852 kB/s | 163 kB 00:00 2024-09-11T23:47:46.610 INFO:teuthology.orchestra.run.smithi192.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-11T23:47:46.644 INFO:teuthology.orchestra.run.smithi192.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.5 MB/s | 506 kB 00:00 2024-09-11T23:47:46.677 INFO:teuthology.orchestra.run.smithi105.stdout:(42/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 16 MB/s | 49 MB 00:03 2024-09-11T23:47:46.694 INFO:teuthology.orchestra.run.smithi192.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 906 kB/s | 45 kB 00:00 2024-09-11T23:47:46.711 INFO:teuthology.orchestra.run.smithi105.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-11T23:47:46.744 INFO:teuthology.orchestra.run.smithi192.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.7 MB/s | 136 kB 00:00 2024-09-11T23:47:46.753 INFO:teuthology.orchestra.run.smithi105.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-09-11T23:47:46.778 INFO:teuthology.orchestra.run.smithi105.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-11T23:47:46.795 INFO:teuthology.orchestra.run.smithi192.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-11T23:47:46.803 INFO:teuthology.orchestra.run.smithi105.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T23:47:46.838 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:47:46.839 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:47:46.845 INFO:teuthology.orchestra.run.smithi105.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-11T23:47:46.851 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:47:46.852 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:47:46.853 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:47:46.853 INFO:teuthology.orchestra.run.smithi192.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-11T23:47:46.854 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:47:46.855 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:47:46.858 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:47:46.859 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:47:46.887 INFO:teuthology.orchestra.run.smithi105.stdout:(48/156): python3-ply-3.11-14.el9.noarch.rpm 509 kB/s | 106 kB 00:00 2024-09-11T23:47:46.912 INFO:teuthology.orchestra.run.smithi192.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.1 MB/s | 301 kB 00:00 2024-09-11T23:47:46.929 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-11T23:47:46.948 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:47:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:47:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:47:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:47:46.952 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:47:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:47:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:47:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:47:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:47:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:47:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:47:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:47:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-09-11T23:47:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:47:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:47:46.962 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-11T23:47:46.962 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-11T23:47:46.962 INFO:teuthology.orchestra.run.smithi060.stdout:Install 148 Packages 2024-09-11T23:47:46.962 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 8 Packages 2024-09-11T23:47:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:47:46.962 INFO:teuthology.orchestra.run.smithi192.stdout:(24/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T23:47:46.963 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 226 M 2024-09-11T23:47:46.963 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-11T23:47:47.037 INFO:teuthology.orchestra.run.smithi192.stdout:(25/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-11T23:47:47.071 INFO:teuthology.orchestra.run.smithi192.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 784 kB/s | 85 kB 00:00 2024-09-11T23:47:47.121 INFO:teuthology.orchestra.run.smithi192.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-11T23:47:47.172 INFO:teuthology.orchestra.run.smithi192.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 637 kB/s | 32 kB 00:00 2024-09-11T23:47:47.222 INFO:teuthology.orchestra.run.smithi192.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T23:47:47.297 INFO:teuthology.orchestra.run.smithi192.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-11T23:47:47.354 INFO:teuthology.orchestra.run.smithi105.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 229 kB/s | 107 kB 00:00 2024-09-11T23:47:47.394 INFO:teuthology.orchestra.run.smithi060.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-11T23:47:47.463 INFO:teuthology.orchestra.run.smithi105.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-11T23:47:47.498 INFO:teuthology.orchestra.run.smithi192.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 13 MB/s | 3.6 MB 00:00 2024-09-11T23:47:47.538 INFO:teuthology.orchestra.run.smithi105.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 938 kB/s | 689 kB 00:00 2024-09-11T23:47:47.556 INFO:teuthology.orchestra.run.smithi192.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-11T23:47:47.588 INFO:teuthology.orchestra.run.smithi105.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-09-11T23:47:47.615 INFO:teuthology.orchestra.run.smithi192.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 851 kB/s | 49 kB 00:00 2024-09-11T23:47:47.627 INFO:teuthology.orchestra.run.smithi060.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.8 MB/s | 897 kB 00:00 2024-09-11T23:47:47.647 INFO:teuthology.orchestra.run.smithi105.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-11T23:47:47.665 INFO:teuthology.orchestra.run.smithi192.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 329 kB/s | 16 kB 00:00 2024-09-11T23:47:47.677 INFO:teuthology.orchestra.run.smithi060.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-11T23:47:47.697 INFO:teuthology.orchestra.run.smithi105.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 313 kB 00:00 2024-09-11T23:47:47.724 INFO:teuthology.orchestra.run.smithi192.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-11T23:47:47.755 INFO:teuthology.orchestra.run.smithi105.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-11T23:47:47.806 INFO:teuthology.orchestra.run.smithi105.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-11T23:47:47.833 INFO:teuthology.orchestra.run.smithi192.stdout:(36/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-11T23:47:47.873 INFO:teuthology.orchestra.run.smithi105.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-11T23:47:47.923 INFO:teuthology.orchestra.run.smithi105.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.9 MB/s | 3.0 MB 00:00 2024-09-11T23:47:47.925 INFO:teuthology.orchestra.run.smithi192.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-11T23:47:47.941 INFO:teuthology.orchestra.run.smithi192.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 168 kB/s | 18 kB 00:00 2024-09-11T23:47:47.948 INFO:teuthology.orchestra.run.smithi105.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 318 kB/s | 45 kB 00:00 2024-09-11T23:47:47.986 INFO:teuthology.orchestra.run.smithi060.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 7.4 MB/s | 5.4 MB 00:00 2024-09-11T23:47:47.990 INFO:teuthology.orchestra.run.smithi105.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-11T23:47:48.037 INFO:teuthology.orchestra.run.smithi060.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 6.6 MB/s | 2.4 MB 00:00 2024-09-11T23:47:48.040 INFO:teuthology.orchestra.run.smithi105.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-11T23:47:48.066 INFO:teuthology.orchestra.run.smithi105.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 209 kB/s | 24 kB 00:00 2024-09-11T23:47:48.075 INFO:teuthology.orchestra.run.smithi192.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-11T23:47:48.099 INFO:teuthology.orchestra.run.smithi105.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-11T23:47:48.137 INFO:teuthology.orchestra.run.smithi060.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-11T23:47:48.150 INFO:teuthology.orchestra.run.smithi105.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-11T23:47:48.158 INFO:teuthology.orchestra.run.smithi192.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-11T23:47:48.175 INFO:teuthology.orchestra.run.smithi105.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-11T23:47:48.209 INFO:teuthology.orchestra.run.smithi105.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 352 kB/s | 38 kB 00:00 2024-09-11T23:47:48.234 INFO:teuthology.orchestra.run.smithi192.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-11T23:47:48.284 INFO:teuthology.orchestra.run.smithi192.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-11T23:47:48.334 INFO:teuthology.orchestra.run.smithi192.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T23:47:48.385 INFO:teuthology.orchestra.run.smithi192.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T23:47:48.426 INFO:teuthology.orchestra.run.smithi105.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-09-11T23:47:48.435 INFO:teuthology.orchestra.run.smithi192.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.5 MB/s | 125 kB 00:00 2024-09-11T23:47:48.479 INFO:teuthology.orchestra.run.smithi060.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-11T23:47:48.518 INFO:teuthology.orchestra.run.smithi192.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-11T23:47:48.559 INFO:teuthology.orchestra.run.smithi105.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-11T23:47:48.560 INFO:teuthology.orchestra.run.smithi192.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-11T23:47:48.685 INFO:teuthology.orchestra.run.smithi105.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-11T23:47:48.752 INFO:teuthology.orchestra.run.smithi105.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 8.2 MB/s | 4.9 MB 00:00 2024-09-11T23:47:48.810 INFO:teuthology.orchestra.run.smithi105.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-11T23:47:48.861 INFO:teuthology.orchestra.run.smithi192.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-11T23:47:48.902 INFO:teuthology.orchestra.run.smithi105.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-11T23:47:48.919 INFO:teuthology.orchestra.run.smithi192.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-11T23:47:48.927 INFO:teuthology.orchestra.run.smithi105.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-09-11T23:47:48.961 INFO:teuthology.orchestra.run.smithi192.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-09-11T23:47:48.962 INFO:teuthology.orchestra.run.smithi060.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 21 MB 00:01 2024-09-11T23:47:48.986 INFO:teuthology.orchestra.run.smithi192.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-11T23:47:49.004 INFO:teuthology.orchestra.run.smithi060.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 606 kB/s | 25 kB 00:00 2024-09-11T23:47:49.028 INFO:teuthology.orchestra.run.smithi192.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-11T23:47:49.036 INFO:teuthology.orchestra.run.smithi105.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-11T23:47:49.054 INFO:teuthology.orchestra.run.smithi192.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-11T23:47:49.104 INFO:teuthology.orchestra.run.smithi192.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-11T23:47:49.197 INFO:teuthology.orchestra.run.smithi192.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-11T23:47:49.211 INFO:teuthology.orchestra.run.smithi105.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-11T23:47:49.263 INFO:teuthology.orchestra.run.smithi060.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 15 MB/s | 17 MB 00:01 2024-09-11T23:47:49.263 INFO:teuthology.orchestra.run.smithi192.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-11T23:47:49.289 INFO:teuthology.orchestra.run.smithi192.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-11T23:47:49.339 INFO:teuthology.orchestra.run.smithi192.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-11T23:47:49.361 INFO:teuthology.orchestra.run.smithi105.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-11T23:47:49.406 INFO:teuthology.orchestra.run.smithi192.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-11T23:47:49.428 INFO:teuthology.orchestra.run.smithi105.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 7.8 MB/s | 5.8 MB 00:00 2024-09-11T23:47:49.430 INFO:teuthology.orchestra.run.smithi060.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 11 MB/s | 11 MB 00:00 2024-09-11T23:47:49.431 INFO:teuthology.orchestra.run.smithi192.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-11T23:47:49.455 INFO:teuthology.orchestra.run.smithi060.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.2 MB/s | 228 kB 00:00 2024-09-11T23:47:49.458 INFO:teuthology.orchestra.run.smithi192.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-11T23:47:49.470 INFO:teuthology.orchestra.run.smithi105.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-11T23:47:49.472 INFO:teuthology.orchestra.run.smithi060.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 648 kB/s | 27 kB 00:00 2024-09-11T23:47:49.482 INFO:teuthology.orchestra.run.smithi192.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-11T23:47:49.489 INFO:teuthology.orchestra.run.smithi060.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 950 kB/s | 32 kB 00:00 2024-09-11T23:47:49.516 INFO:teuthology.orchestra.run.smithi192.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T23:47:49.539 INFO:teuthology.orchestra.run.smithi060.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 3.2 MB/s | 163 kB 00:00 2024-09-11T23:47:49.554 INFO:teuthology.orchestra.run.smithi105.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-09-11T23:47:49.565 INFO:teuthology.orchestra.run.smithi060.stdout:(16/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 8.0 MB/s | 752 kB 00:00 2024-09-11T23:47:49.566 INFO:teuthology.orchestra.run.smithi192.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-11T23:47:49.579 INFO:teuthology.orchestra.run.smithi105.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-11T23:47:49.583 INFO:teuthology.orchestra.run.smithi192.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-11T23:47:49.598 INFO:teuthology.orchestra.run.smithi060.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-11T23:47:49.648 INFO:teuthology.orchestra.run.smithi060.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-11T23:47:49.688 INFO:teuthology.orchestra.run.smithi105.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 7.6 MB/s | 6.0 MB 00:00 2024-09-11T23:47:49.713 INFO:teuthology.orchestra.run.smithi105.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 219 kB/s | 35 kB 00:00 2024-09-11T23:47:49.740 INFO:teuthology.orchestra.run.smithi060.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 493 kB/s | 45 kB 00:00 2024-09-11T23:47:49.741 INFO:teuthology.orchestra.run.smithi192.stdout:(66/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-11T23:47:49.813 INFO:teuthology.orchestra.run.smithi105.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-11T23:47:49.825 INFO:teuthology.orchestra.run.smithi192.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-11T23:47:49.832 INFO:teuthology.orchestra.run.smithi060.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.4 MB/s | 136 kB 00:00 2024-09-11T23:47:49.839 INFO:teuthology.orchestra.run.smithi105.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-11T23:47:49.867 INFO:teuthology.orchestra.run.smithi192.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-11T23:47:49.900 INFO:teuthology.orchestra.run.smithi192.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-11T23:47:49.914 INFO:teuthology.orchestra.run.smithi105.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-11T23:47:49.926 INFO:teuthology.orchestra.run.smithi192.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-11T23:47:49.932 INFO:teuthology.orchestra.run.smithi060.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-11T23:47:49.939 INFO:teuthology.orchestra.run.smithi105.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 615 kB/s | 77 kB 00:00 2024-09-11T23:47:49.956 INFO:teuthology.orchestra.run.smithi105.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-09-11T23:47:49.958 INFO:teuthology.orchestra.run.smithi060.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.3 MB/s | 162 kB 00:00 2024-09-11T23:47:49.991 INFO:teuthology.orchestra.run.smithi060.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-11T23:47:50.001 INFO:teuthology.orchestra.run.smithi192.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-11T23:47:50.017 INFO:teuthology.orchestra.run.smithi060.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-11T23:47:50.031 INFO:teuthology.orchestra.run.smithi105.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-11T23:47:50.034 INFO:teuthology.orchestra.run.smithi060.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 2.3 MB/s | 100 kB 00:00 2024-09-11T23:47:50.056 INFO:teuthology.orchestra.run.smithi105.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-11T23:47:50.067 INFO:teuthology.orchestra.run.smithi060.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T23:47:50.076 INFO:teuthology.orchestra.run.smithi192.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-11T23:47:50.081 INFO:teuthology.orchestra.run.smithi105.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-11T23:47:50.101 INFO:teuthology.orchestra.run.smithi192.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-09-11T23:47:50.134 INFO:teuthology.orchestra.run.smithi060.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-11T23:47:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-11T23:47:50.165 INFO:teuthology.orchestra.run.smithi105.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 381 kB/s | 51 kB 00:00 2024-09-11T23:47:50.190 INFO:teuthology.orchestra.run.smithi105.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 401 kB/s | 54 kB 00:00 2024-09-11T23:47:50.209 INFO:teuthology.orchestra.run.smithi060.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 3.1 MB 00:00 2024-09-11T23:47:50.235 INFO:teuthology.orchestra.run.smithi060.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 318 kB/s | 32 kB 00:00 2024-09-11T23:47:50.235 INFO:teuthology.orchestra.run.smithi192.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-11T23:47:50.260 INFO:teuthology.orchestra.run.smithi060.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.9 MB/s | 146 kB 00:00 2024-09-11T23:47:50.261 INFO:teuthology.orchestra.run.smithi192.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-11T23:47:50.274 INFO:teuthology.orchestra.run.smithi105.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-11T23:47:50.286 INFO:teuthology.orchestra.run.smithi192.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-11T23:47:50.299 INFO:teuthology.orchestra.run.smithi105.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-11T23:47:50.303 INFO:teuthology.orchestra.run.smithi192.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 613 kB/s | 26 kB 00:00 2024-09-11T23:47:50.328 INFO:teuthology.orchestra.run.smithi192.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-11T23:47:50.362 INFO:teuthology.orchestra.run.smithi192.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T23:47:50.378 INFO:teuthology.orchestra.run.smithi192.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-09-11T23:47:50.391 INFO:teuthology.orchestra.run.smithi105.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-11T23:47:50.425 INFO:teuthology.orchestra.run.smithi105.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 286 kB/s | 36 kB 00:00 2024-09-11T23:47:50.500 INFO:teuthology.orchestra.run.smithi105.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 435 kB/s | 47 kB 00:00 2024-09-11T23:47:50.535 INFO:teuthology.orchestra.run.smithi060.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 12 MB/s | 3.6 MB 00:00 2024-09-11T23:47:50.542 INFO:teuthology.orchestra.run.smithi105.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-11T23:47:50.603 INFO:teuthology.orchestra.run.smithi060.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-11T23:47:50.609 INFO:teuthology.orchestra.run.smithi105.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-09-11T23:47:50.651 INFO:teuthology.orchestra.run.smithi105.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 884 kB/s | 96 kB 00:00 2024-09-11T23:47:50.694 INFO:teuthology.orchestra.run.smithi060.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-11T23:47:50.718 INFO:teuthology.orchestra.run.smithi105.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 586 kB/s | 64 kB 00:00 2024-09-11T23:47:50.719 INFO:teuthology.orchestra.run.smithi060.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 422 kB/s | 49 kB 00:00 2024-09-11T23:47:50.745 INFO:teuthology.orchestra.run.smithi060.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 327 kB/s | 16 kB 00:00 2024-09-11T23:47:50.760 INFO:teuthology.orchestra.run.smithi105.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-11T23:47:50.770 INFO:teuthology.orchestra.run.smithi060.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 285 kB 00:00 2024-09-11T23:47:50.812 INFO:teuthology.orchestra.run.smithi060.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-11T23:47:50.821 INFO:teuthology.orchestra.run.smithi192.stdout:(82/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 10 MB/s | 49 MB 00:04 2024-09-11T23:47:50.837 INFO:teuthology.orchestra.run.smithi060.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 273 kB/s | 18 kB 00:00 2024-09-11T23:47:50.844 INFO:teuthology.orchestra.run.smithi105.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-11T23:47:50.846 INFO:teuthology.orchestra.run.smithi192.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 536 kB/s | 250 kB 00:00 2024-09-11T23:47:50.888 INFO:teuthology.orchestra.run.smithi192.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-11T23:47:50.894 INFO:teuthology.orchestra.run.smithi105.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T23:47:50.927 INFO:teuthology.orchestra.run.smithi105.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T23:47:50.953 INFO:teuthology.orchestra.run.smithi105.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-11T23:47:50.955 INFO:teuthology.orchestra.run.smithi192.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.6 MB/s | 5.1 MB 00:00 2024-09-11T23:47:50.980 INFO:teuthology.orchestra.run.smithi192.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 461 kB/s | 42 kB 00:00 2024-09-11T23:47:51.013 INFO:teuthology.orchestra.run.smithi192.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-11T23:47:51.048 INFO:teuthology.orchestra.run.smithi192.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-11T23:47:51.053 INFO:teuthology.orchestra.run.smithi105.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-11T23:47:51.073 INFO:teuthology.orchestra.run.smithi192.stdout:(89/156): python3-oauthlib-3.1.1-5.el9.noarch.r 884 kB/s | 222 kB 00:00 2024-09-11T23:47:51.078 INFO:teuthology.orchestra.run.smithi105.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:47:51.098 INFO:teuthology.orchestra.run.smithi192.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-11T23:47:51.112 INFO:teuthology.orchestra.run.smithi105.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-11T23:47:51.123 INFO:teuthology.orchestra.run.smithi192.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-11T23:47:51.146 INFO:teuthology.orchestra.run.smithi105.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 725 kB/s | 49 kB 00:00 2024-09-11T23:47:51.148 INFO:teuthology.orchestra.run.smithi192.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-11T23:47:51.179 INFO:teuthology.orchestra.run.smithi105.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.7 MB/s | 151 kB 00:00 2024-09-11T23:47:51.199 INFO:teuthology.orchestra.run.smithi192.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-09-11T23:47:51.205 INFO:teuthology.orchestra.run.smithi105.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 730 kB/s | 67 kB 00:00 2024-09-11T23:47:51.224 INFO:teuthology.orchestra.run.smithi192.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 586 kB/s | 44 kB 00:00 2024-09-11T23:47:51.238 INFO:teuthology.orchestra.run.smithi105.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-11T23:47:51.257 INFO:teuthology.orchestra.run.smithi192.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T23:47:51.263 INFO:teuthology.orchestra.run.smithi105.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:47:51.283 INFO:teuthology.orchestra.run.smithi192.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-11T23:47:51.289 INFO:teuthology.orchestra.run.smithi105.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:47:51.314 INFO:teuthology.orchestra.run.smithi105.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-11T23:47:51.316 INFO:teuthology.orchestra.run.smithi192.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-11T23:47:51.339 INFO:teuthology.orchestra.run.smithi105.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-11T23:47:51.365 INFO:teuthology.orchestra.run.smithi105.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:47:51.367 INFO:teuthology.orchestra.run.smithi192.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T23:47:51.390 INFO:teuthology.orchestra.run.smithi105.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-11T23:47:51.413 INFO:teuthology.orchestra.run.smithi060.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 20 MB/s | 49 MB 00:02 2024-09-11T23:47:51.415 INFO:teuthology.orchestra.run.smithi105.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-11T23:47:51.434 INFO:teuthology.orchestra.run.smithi192.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-11T23:47:51.438 INFO:teuthology.orchestra.run.smithi060.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 128 kB/s | 80 kB 00:00 2024-09-11T23:47:51.440 INFO:teuthology.orchestra.run.smithi105.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T23:47:51.459 INFO:teuthology.orchestra.run.smithi192.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-11T23:47:51.474 INFO:teuthology.orchestra.run.smithi105.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T23:47:51.499 INFO:teuthology.orchestra.run.smithi105.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-11T23:47:51.516 INFO:teuthology.orchestra.run.smithi105.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T23:47:51.534 INFO:teuthology.orchestra.run.smithi105.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.3 MB/s | 23 kB 00:00 2024-09-11T23:47:51.538 INFO:teuthology.orchestra.run.smithi060.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-11T23:47:51.551 INFO:teuthology.orchestra.run.smithi105.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-11T23:47:51.567 INFO:teuthology.orchestra.run.smithi105.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-11T23:47:51.580 INFO:teuthology.orchestra.run.smithi060.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-11T23:47:51.618 INFO:teuthology.orchestra.run.smithi192.stdout:(101/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-11T23:47:51.618 INFO:teuthology.orchestra.run.smithi105.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-11T23:47:51.639 INFO:teuthology.orchestra.run.smithi060.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 848 kB/s | 191 kB 00:00 2024-09-11T23:47:51.643 INFO:teuthology.orchestra.run.smithi192.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 244 kB/s | 45 kB 00:00 2024-09-11T23:47:51.643 INFO:teuthology.orchestra.run.smithi105.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:47:51.655 INFO:teuthology.orchestra.run.smithi060.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-11T23:47:51.660 INFO:teuthology.orchestra.run.smithi105.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.6 MB/s | 79 kB 00:00 2024-09-11T23:47:51.668 INFO:teuthology.orchestra.run.smithi192.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 272 kB/s | 64 kB 00:00 2024-09-11T23:47:51.689 INFO:teuthology.orchestra.run.smithi060.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-09-11T23:47:51.693 INFO:teuthology.orchestra.run.smithi105.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-11T23:47:51.714 INFO:teuthology.orchestra.run.smithi060.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-11T23:47:51.718 INFO:teuthology.orchestra.run.smithi192.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T23:47:51.719 INFO:teuthology.orchestra.run.smithi105.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 983 kB/s | 58 kB 00:00 2024-09-11T23:47:51.731 INFO:teuthology.orchestra.run.smithi060.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-11T23:47:51.735 INFO:teuthology.orchestra.run.smithi192.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-11T23:47:51.744 INFO:teuthology.orchestra.run.smithi105.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-11T23:47:51.757 INFO:teuthology.orchestra.run.smithi060.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-11T23:47:51.770 INFO:teuthology.orchestra.run.smithi105.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-11T23:47:51.794 INFO:teuthology.orchestra.run.smithi192.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-09-11T23:47:51.795 INFO:teuthology.orchestra.run.smithi105.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T23:47:51.819 INFO:teuthology.orchestra.run.smithi192.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-09-11T23:47:51.820 INFO:teuthology.orchestra.run.smithi105.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-11T23:47:51.844 INFO:teuthology.orchestra.run.smithi192.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:47:51.854 INFO:teuthology.orchestra.run.smithi105.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-09-11T23:47:51.861 INFO:teuthology.orchestra.run.smithi192.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-11T23:47:51.874 INFO:teuthology.orchestra.run.smithi060.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 916 kB/s | 107 kB 00:00 2024-09-11T23:47:51.879 INFO:teuthology.orchestra.run.smithi105.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T23:47:51.903 INFO:teuthology.orchestra.run.smithi192.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.2 MB/s | 863 kB 00:00 2024-09-11T23:47:51.904 INFO:teuthology.orchestra.run.smithi105.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-11T23:47:51.907 INFO:teuthology.orchestra.run.smithi060.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-11T23:47:51.930 INFO:teuthology.orchestra.run.smithi105.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-11T23:47:51.932 INFO:teuthology.orchestra.run.smithi060.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-11T23:47:51.937 INFO:teuthology.orchestra.run.smithi192.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 897 kB/s | 67 kB 00:00 2024-09-11T23:47:51.955 INFO:teuthology.orchestra.run.smithi105.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-11T23:47:51.966 INFO:teuthology.orchestra.run.smithi060.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-11T23:47:51.970 INFO:teuthology.orchestra.run.smithi192.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-11T23:47:51.980 INFO:teuthology.orchestra.run.smithi105.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-11T23:47:51.991 INFO:teuthology.orchestra.run.smithi060.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-11T23:47:52.016 INFO:teuthology.orchestra.run.smithi060.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-11T23:47:52.029 INFO:teuthology.orchestra.run.smithi192.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 839 kB 00:00 2024-09-11T23:47:52.033 INFO:teuthology.orchestra.run.smithi060.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-11T23:47:52.050 INFO:teuthology.orchestra.run.smithi060.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 331 kB/s | 11 kB 00:00 2024-09-11T23:47:52.054 INFO:teuthology.orchestra.run.smithi192.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-11T23:47:52.071 INFO:teuthology.orchestra.run.smithi192.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-11T23:47:52.088 INFO:teuthology.orchestra.run.smithi192.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 959 kB/s | 32 kB 00:00 2024-09-11T23:47:52.092 INFO:teuthology.orchestra.run.smithi060.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-11T23:47:52.105 INFO:teuthology.orchestra.run.smithi192.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-09-11T23:47:52.109 INFO:teuthology.orchestra.run.smithi060.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-09-11T23:47:52.131 INFO:teuthology.orchestra.run.smithi192.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-11T23:47:52.131 INFO:teuthology.orchestra.run.smithi105.stdout:(143/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.9 MB/s | 16 MB 00:02 2024-09-11T23:47:52.151 INFO:teuthology.orchestra.run.smithi060.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-11T23:47:52.156 INFO:teuthology.orchestra.run.smithi105.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-09-11T23:47:52.164 INFO:teuthology.orchestra.run.smithi192.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T23:47:52.189 INFO:teuthology.orchestra.run.smithi192.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T23:47:52.190 INFO:teuthology.orchestra.run.smithi105.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.3 MB/s | 191 kB 00:00 2024-09-11T23:47:52.210 INFO:teuthology.orchestra.run.smithi060.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-11T23:47:52.214 INFO:teuthology.orchestra.run.smithi192.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T23:47:52.223 INFO:teuthology.orchestra.run.smithi105.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 1.7 MB/s | 427 kB 00:00 2024-09-11T23:47:52.227 INFO:teuthology.orchestra.run.smithi060.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-11T23:47:52.248 INFO:teuthology.orchestra.run.smithi105.stdout:(147/156): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-09-11T23:47:52.249 INFO:teuthology.orchestra.run.smithi192.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T23:47:52.252 INFO:teuthology.orchestra.run.smithi060.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-11T23:47:52.265 INFO:teuthology.orchestra.run.smithi192.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-11T23:47:52.278 INFO:teuthology.orchestra.run.smithi060.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-11T23:47:52.282 INFO:teuthology.orchestra.run.smithi192.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T23:47:52.298 INFO:teuthology.orchestra.run.smithi105.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-11T23:47:52.303 INFO:teuthology.orchestra.run.smithi060.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-11T23:47:52.328 INFO:teuthology.orchestra.run.smithi060.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-11T23:47:52.353 INFO:teuthology.orchestra.run.smithi060.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-11T23:47:52.357 INFO:teuthology.orchestra.run.smithi192.stdout:(125/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-09-11T23:47:52.383 INFO:teuthology.orchestra.run.smithi192.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-09-11T23:47:52.416 INFO:teuthology.orchestra.run.smithi192.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-09-11T23:47:52.420 INFO:teuthology.orchestra.run.smithi060.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-11T23:47:52.442 INFO:teuthology.orchestra.run.smithi192.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-09-11T23:47:52.467 INFO:teuthology.orchestra.run.smithi192.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:47:52.487 INFO:teuthology.orchestra.run.smithi060.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-11T23:47:52.492 INFO:teuthology.orchestra.run.smithi192.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:47:52.516 INFO:teuthology.orchestra.run.smithi105.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-11T23:47:52.518 INFO:teuthology.orchestra.run.smithi192.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:47:52.551 INFO:teuthology.orchestra.run.smithi192.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-11T23:47:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-11T23:47:52.587 INFO:teuthology.orchestra.run.smithi060.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-11T23:47:52.593 INFO:teuthology.orchestra.run.smithi192.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-11T23:47:52.618 INFO:teuthology.orchestra.run.smithi192.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-09-11T23:47:52.630 INFO:teuthology.orchestra.run.smithi060.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-11T23:47:52.643 INFO:teuthology.orchestra.run.smithi192.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-11T23:47:52.669 INFO:teuthology.orchestra.run.smithi192.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-11T23:47:52.671 INFO:teuthology.orchestra.run.smithi060.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-11T23:47:52.694 INFO:teuthology.orchestra.run.smithi192.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-11T23:47:52.697 INFO:teuthology.orchestra.run.smithi060.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-11T23:47:52.736 INFO:teuthology.orchestra.run.smithi192.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-11T23:47:52.739 INFO:teuthology.orchestra.run.smithi060.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-11T23:47:52.757 INFO:teuthology.orchestra.run.smithi105.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.4 MB/s | 3.4 MB 00:00 2024-09-11T23:47:52.761 INFO:teuthology.orchestra.run.smithi192.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 886 kB/s | 59 kB 00:00 2024-09-11T23:47:52.786 INFO:teuthology.orchestra.run.smithi192.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-11T23:47:52.812 INFO:teuthology.orchestra.run.smithi192.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-11T23:47:52.814 INFO:teuthology.orchestra.run.smithi060.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-11T23:47:52.824 INFO:teuthology.orchestra.run.smithi105.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 4.4 MB/s | 2.3 MB 00:00 2024-09-11T23:47:52.837 INFO:teuthology.orchestra.run.smithi192.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-11T23:47:52.839 INFO:teuthology.orchestra.run.smithi060.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-11T23:47:52.862 INFO:teuthology.orchestra.run.smithi192.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T23:47:52.865 INFO:teuthology.orchestra.run.smithi060.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-11T23:47:52.888 INFO:teuthology.orchestra.run.smithi192.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T23:47:52.890 INFO:teuthology.orchestra.run.smithi060.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-11T23:47:52.908 INFO:teuthology.orchestra.run.smithi105.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 271 kB/s | 41 kB 00:00 2024-09-11T23:47:52.913 INFO:teuthology.orchestra.run.smithi192.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T23:47:52.915 INFO:teuthology.orchestra.run.smithi060.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-11T23:47:52.938 INFO:teuthology.orchestra.run.smithi192.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:47:52.940 INFO:teuthology.orchestra.run.smithi060.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-11T23:47:52.971 INFO:teuthology.orchestra.run.smithi192.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-11T23:47:52.974 INFO:teuthology.orchestra.run.smithi060.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-11T23:47:52.991 INFO:teuthology.orchestra.run.smithi105.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.5 MB/s | 249 kB 00:00 2024-09-11T23:47:53.014 INFO:teuthology.orchestra.run.smithi192.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:47:53.058 INFO:teuthology.orchestra.run.smithi060.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-11T23:47:53.083 INFO:teuthology.orchestra.run.smithi060.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-11T23:47:53.092 INFO:teuthology.orchestra.run.smithi105.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 3.1 MB/s | 1.8 MB 00:00 2024-09-11T23:47:53.108 INFO:teuthology.orchestra.run.smithi060.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-11T23:47:53.125 INFO:teuthology.orchestra.run.smithi060.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-11T23:47:53.134 INFO:teuthology.orchestra.run.smithi105.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-11T23:47:53.150 INFO:teuthology.orchestra.run.smithi060.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-11T23:47:53.176 INFO:teuthology.orchestra.run.smithi060.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-11T23:47:53.201 INFO:teuthology.orchestra.run.smithi060.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-11T23:47:53.226 INFO:teuthology.orchestra.run.smithi060.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-11T23:47:53.231 INFO:teuthology.orchestra.run.smithi192.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-11T23:47:53.251 INFO:teuthology.orchestra.run.smithi060.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T23:47:53.277 INFO:teuthology.orchestra.run.smithi060.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-11T23:47:53.315 INFO:teuthology.orchestra.run.smithi192.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-11T23:47:53.360 INFO:teuthology.orchestra.run.smithi060.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-11T23:47:53.386 INFO:teuthology.orchestra.run.smithi060.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-11T23:47:53.411 INFO:teuthology.orchestra.run.smithi060.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-09-11T23:47:53.415 INFO:teuthology.orchestra.run.smithi192.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 409 kB/s | 41 kB 00:00 2024-09-11T23:47:53.436 INFO:teuthology.orchestra.run.smithi060.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-11T23:47:53.461 INFO:teuthology.orchestra.run.smithi060.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-11T23:47:53.487 INFO:teuthology.orchestra.run.smithi060.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-11T23:47:53.512 INFO:teuthology.orchestra.run.smithi060.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-11T23:47:53.523 INFO:teuthology.orchestra.run.smithi192.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 4.6 MB/s | 2.3 MB 00:00 2024-09-11T23:47:53.529 INFO:teuthology.orchestra.run.smithi060.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-09-11T23:47:53.549 INFO:teuthology.orchestra.run.smithi192.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-11T23:47:53.554 INFO:teuthology.orchestra.run.smithi060.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-11T23:47:53.571 INFO:teuthology.orchestra.run.smithi060.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-11T23:47:53.588 INFO:teuthology.orchestra.run.smithi060.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-11T23:47:53.605 INFO:teuthology.orchestra.run.smithi060.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 664 kB/s | 22 kB 00:00 2024-09-11T23:47:53.647 INFO:teuthology.orchestra.run.smithi060.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-09-11T23:47:53.697 INFO:teuthology.orchestra.run.smithi060.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-11T23:47:53.699 INFO:teuthology.orchestra.run.smithi192.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 3.9 MB/s | 1.8 MB 00:00 2024-09-11T23:47:53.714 INFO:teuthology.orchestra.run.smithi060.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-09-11T23:47:53.748 INFO:teuthology.orchestra.run.smithi060.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.1 MB/s | 309 kB 00:00 2024-09-11T23:47:53.765 INFO:teuthology.orchestra.run.smithi192.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.6 MB/s | 1.4 MB 00:00 2024-09-11T23:47:53.773 INFO:teuthology.orchestra.run.smithi060.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:47:53.784 INFO:teuthology.orchestra.run.smithi105.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.0 MB/s | 2.4 MB 00:00 2024-09-11T23:47:53.790 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:47:53.790 INFO:teuthology.orchestra.run.smithi105.stdout:Total 19 MB/s | 226 MB 00:12 2024-09-11T23:47:53.807 INFO:teuthology.orchestra.run.smithi060.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-11T23:47:53.824 INFO:teuthology.orchestra.run.smithi060.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-11T23:47:53.849 INFO:teuthology.orchestra.run.smithi060.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T23:47:53.899 INFO:teuthology.orchestra.run.smithi060.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-11T23:47:53.933 INFO:teuthology.orchestra.run.smithi060.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-11T23:47:53.958 INFO:teuthology.orchestra.run.smithi060.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:47:53.983 INFO:teuthology.orchestra.run.smithi060.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:47:54.009 INFO:teuthology.orchestra.run.smithi060.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-11T23:47:54.034 INFO:teuthology.orchestra.run.smithi060.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-11T23:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 2.4 MB 00:00 2024-09-11T23:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-11T23:47:54.068 INFO:teuthology.orchestra.run.smithi060.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-11T23:47:54.101 INFO:teuthology.orchestra.run.smithi060.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-11T23:47:54.135 INFO:teuthology.orchestra.run.smithi060.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.4 MB/s | 220 kB 00:00 2024-09-11T23:47:54.210 INFO:teuthology.orchestra.run.smithi060.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-11T23:47:54.244 INFO:teuthology.orchestra.run.smithi060.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T23:47:54.269 INFO:teuthology.orchestra.run.smithi060.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-11T23:47:54.295 INFO:teuthology.orchestra.run.smithi060.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-11T23:47:54.320 INFO:teuthology.orchestra.run.smithi060.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-11T23:47:54.345 INFO:teuthology.orchestra.run.smithi060.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-11T23:47:54.371 INFO:teuthology.orchestra.run.smithi060.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-11T23:47:54.563 INFO:teuthology.orchestra.run.smithi060.stdout:(128/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-11T23:47:54.605 INFO:teuthology.orchestra.run.smithi060.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-09-11T23:47:54.630 INFO:teuthology.orchestra.run.smithi060.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:47:54.672 INFO:teuthology.orchestra.run.smithi060.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-11T23:47:54.705 INFO:teuthology.orchestra.run.smithi060.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2024-09-11T23:47:54.731 INFO:teuthology.orchestra.run.smithi060.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-09-11T23:47:54.773 INFO:teuthology.orchestra.run.smithi060.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-09-11T23:47:54.798 INFO:teuthology.orchestra.run.smithi060.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-11T23:47:54.823 INFO:teuthology.orchestra.run.smithi060.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 978 kB/s | 90 kB 00:00 2024-09-11T23:47:54.849 INFO:teuthology.orchestra.run.smithi060.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-11T23:47:54.873 INFO:teuthology.orchestra.run.smithi060.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T23:47:54.899 INFO:teuthology.orchestra.run.smithi060.stdout:(139/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-11T23:47:54.924 INFO:teuthology.orchestra.run.smithi060.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-11T23:47:54.949 INFO:teuthology.orchestra.run.smithi060.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-11T23:47:54.966 INFO:teuthology.orchestra.run.smithi060.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-11T23:47:54.992 INFO:teuthology.orchestra.run.smithi060.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-11T23:47:55.017 INFO:teuthology.orchestra.run.smithi060.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-11T23:47:55.036 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-09-11T23:47:55.042 INFO:teuthology.orchestra.run.smithi060.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-11T23:47:55.067 INFO:teuthology.orchestra.run.smithi060.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:47:55.093 INFO:teuthology.orchestra.run.smithi060.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T23:47:55.143 INFO:teuthology.orchestra.run.smithi060.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:47:55.186 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-09-11T23:47:55.186 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-09-11T23:47:55.274 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-11T23:47:55.377 INFO:teuthology.orchestra.run.smithi060.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-11T23:47:55.426 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-11T23:47:55.426 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-11T23:47:55.427 INFO:teuthology.orchestra.run.smithi060.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.5 MB/s | 3.2 MB 00:00 2024-09-11T23:47:55.477 INFO:teuthology.orchestra.run.smithi060.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 6.9 MB/s | 2.3 MB 00:00 2024-09-11T23:47:55.536 INFO:teuthology.orchestra.run.smithi060.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-11T23:47:55.561 INFO:teuthology.orchestra.run.smithi060.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 304 kB/s | 41 kB 00:00 2024-09-11T23:47:55.611 INFO:teuthology.orchestra.run.smithi060.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-11T23:47:55.653 INFO:teuthology.orchestra.run.smithi060.stdout:(155/156): NetworkManager-libnm-1.49.90-1.el9.x 6.5 MB/s | 1.8 MB 00:00 2024-09-11T23:47:56.195 INFO:teuthology.orchestra.run.smithi060.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 2.4 MB 00:00 2024-09-11T23:47:56.202 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:47:56.202 INFO:teuthology.orchestra.run.smithi060.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-11T23:47:56.984 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-09-11T23:47:56.984 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-09-11T23:47:57.223 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-11T23:47:57.224 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-11T23:47:57.481 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-11T23:47:57.649 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-11T23:47:57.649 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-11T23:47:59.997 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-11T23:47:59.998 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-11T23:48:03.384 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-09-11T23:48:03.479 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:48:03.518 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:48:03.571 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:48:03.605 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:48:03.617 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-11T23:48:03.630 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:48:03.673 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:48:03.736 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:48:03.783 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:48:03.844 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:48:03.878 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:48:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:48:03.957 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:48:04.005 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:48:04.115 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:04.246 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:04.275 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:04.277 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:48:04.366 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:04.388 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:04.396 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:48:04.502 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:04.531 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:04.548 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:48:04.618 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:48:04.622 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:04.643 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:48:04.654 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:04.758 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:04.780 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:48:04.798 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:48:04.842 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:48:04.848 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:48:04.864 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:48:04.876 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:04.885 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:48:04.963 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:04.986 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:48:05.049 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:48:05.070 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:48:05.083 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:48:05.097 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:48:05.235 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:48:05.297 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:48:05.346 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:48:05.436 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:48:05.443 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:05.523 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:05.552 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:48:05.652 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:05.745 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:05.753 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:05.860 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:48:05.948 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:48:05.976 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:05.978 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:48:06.013 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:48:06.085 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:48:06.138 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:48:06.173 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:48:06.186 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:48:06.217 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:48:06.217 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:48:06.250 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:48:06.259 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:48:06.286 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:48:06.323 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:48:06.364 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:48:06.368 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:48:06.400 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:48:06.404 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-11T23:48:06.425 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:48:06.444 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:48:06.456 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:48:06.491 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:48:06.533 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:48:06.567 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:48:06.588 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:48:06.602 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:48:06.643 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:48:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:48:06.674 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:48:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:48:06.710 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:48:06.734 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:48:06.745 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:48:06.784 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:48:06.797 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:48:06.820 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:48:06.820 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:48:06.858 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:48:06.860 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:48:06.872 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:48:06.884 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:48:06.887 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:48:06.943 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:48:06.956 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:48:07.001 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:48:07.005 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:48:07.058 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:48:07.075 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:48:07.205 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:48:07.253 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:48:07.305 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:48:07.402 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:07.527 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:07.561 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:07.576 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:48:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:07.662 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:48:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:48:07.691 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:48:07.725 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:48:07.764 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:48:07.771 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:48:07.805 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:48:07.857 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:48:07.868 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:48:07.887 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:48:07.921 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:48:07.929 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:48:07.948 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:07.968 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:48:07.981 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:48:08.009 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:48:08.034 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:48:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:48:08.098 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:48:08.154 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:48:08.169 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:48:08.171 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:48:08.184 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:48:08.203 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:48:08.211 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:48:08.221 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:48:08.248 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:48:08.275 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:48:08.294 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:48:08.330 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:48:08.350 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:48:08.373 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:48:08.380 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:48:08.415 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:48:08.416 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:48:08.429 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:48:08.462 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:48:08.499 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:48:08.541 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:48:08.561 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:48:08.584 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:48:08.614 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:48:08.717 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:48:08.757 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:48:08.763 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:48:08.793 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:48:08.803 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:48:08.875 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:08.967 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:08.997 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:48:09.019 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:48:09.096 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:48:09.123 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:48:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:48:09.159 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:48:09.162 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:48:09.187 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:48:09.198 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:48:09.208 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:48:09.224 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:48:09.249 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:48:09.260 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:48:09.318 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:48:09.323 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:48:09.386 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:48:09.416 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:48:09.447 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:48:09.450 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:48:09.483 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:48:09.483 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:48:09.519 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:48:09.559 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:48:09.561 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:48:09.608 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:48:09.609 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:48:09.649 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:48:09.649 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:48:09.692 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:48:09.725 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:48:09.752 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:48:09.763 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:48:09.793 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:48:09.797 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:48:09.825 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:48:09.836 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:48:09.868 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:48:09.876 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:48:09.898 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:48:09.905 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:48:09.933 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:48:09.938 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:48:09.949 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:48:09.966 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:48:10.007 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:48:10.028 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:48:10.042 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:48:10.059 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:48:10.072 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:48:10.103 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:48:10.105 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:48:10.127 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:48:10.131 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:48:10.147 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:48:10.171 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:48:10.181 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:48:10.203 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:48:10.216 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:48:10.268 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:48:10.269 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:48:10.303 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:48:10.319 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:48:10.351 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:48:10.351 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:48:10.361 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:48:10.454 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:48:10.507 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:48:10.510 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:48:10.568 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:48:11.069 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:48:11.118 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:48:11.135 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:48:11.152 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:48:11.223 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:48:11.233 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:48:11.249 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:48:11.256 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:48:11.283 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:48:11.298 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:48:11.299 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:48:11.317 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:48:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:48:11.343 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:48:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:48:11.416 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:48:11.421 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:48:11.463 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:48:11.464 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:48:11.509 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:48:11.550 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:48:11.597 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:48:11.599 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:48:11.637 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:48:11.646 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:48:11.656 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:48:11.677 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:48:11.730 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:48:11.755 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:48:11.766 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:48:11.803 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:48:11.830 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:48:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:48:11.867 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:48:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:48:11.945 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:48:12.186 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:48:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:48:12.386 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:48:12.507 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:48:12.520 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:48:12.564 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:48:12.596 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:48:12.606 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:48:12.714 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:48:12.717 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:48:12.747 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:48:12.790 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:48:12.820 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:48:12.845 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:48:12.948 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:48:13.078 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:48:13.114 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:48:13.147 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:48:13.186 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:48:13.224 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:48:13.265 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:48:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:48:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:48:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:48:13.404 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:48:13.446 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:48:13.537 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:48:13.585 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:48:13.624 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:48:13.713 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:48:13.733 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:48:13.784 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:48:13.819 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:48:13.850 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:48:13.883 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:48:13.957 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:48:14.038 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:48:14.066 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:48:14.099 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:48:14.193 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:48:14.238 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:48:14.327 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:48:14.359 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:48:14.395 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:48:14.410 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:48:14.454 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:48:14.545 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:48:14.565 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:48:14.575 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:48:14.611 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:48:14.622 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:48:14.656 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:48:14.762 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:48:14.812 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:48:14.857 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:48:14.874 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:48:14.907 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:48:14.948 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:48:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:48:14.983 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:48:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:48:15.100 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:48:15.140 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:48:15.167 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:48:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:48:15.211 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:48:15.233 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:48:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:48:16.011 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:48:16.144 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:48:17.335 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:17.372 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:48:17.505 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:17.538 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:48:17.599 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:48:17.631 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:48:17.917 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:17.958 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:48:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:48:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:48:18.064 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:48:18.065 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:48:18.065 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:48:18.065 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:18.086 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:18.093 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:48:18.102 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:48:18.125 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:48:18.132 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:48:18.169 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:48:18.218 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:48:18.218 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:48:18.218 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:48:18.218 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:18.251 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:48:18.675 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:48:18.705 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:48:18.777 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:48:18.806 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:48:21.223 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:21.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:21.855 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:48:21.923 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:48:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:48:22.021 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:48:22.021 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:48:22.021 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:22.058 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-09-11T23:48:29.971 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:30.017 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:48:30.017 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2024-09-11T23:48:30.017 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2024-09-11T23:48:30.018 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2024-09-11T23:48:30.018 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2024-09-11T23:48:30.018 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2024-09-11T23:48:30.018 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /root 2024-09-11T23:48:30.018 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2024-09-11T23:48:30.018 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:30.138 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:48:30.156 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:48:30.156 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:30.156 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:48:30.156 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:30.189 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:48:30.205 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:48:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:48:30.206 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:31.632 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:48:31.659 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:48:31.660 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:31.660 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:48:31.660 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:48:31.660 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:48:31.660 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:31.692 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:48:31.719 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:48:31.719 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:31.719 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:48:31.719 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:48:31.719 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:48:31.719 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:31.883 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:48:31.907 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:48:31.907 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:31.907 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:48:31.907 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:48:31.907 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:48:31.907 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:31.952 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:48:31.974 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:48:31.974 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:31.974 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:48:31.974 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:48:31.975 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:48:31.975 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:32.343 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:48:32.366 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:48:32.366 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:32.366 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:48:32.366 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:48:32.367 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:48:32.367 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:32.410 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:48:32.433 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:48:32.433 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:32.433 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:48:32.433 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:48:32.433 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:48:32.433 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:32.464 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:48:32.521 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:48:32.539 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:48:32.576 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:48:32.605 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:48:32.668 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:48:32.760 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:48:32.809 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:48:32.855 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:48:32.886 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:48:32.902 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:48:32.976 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:48:32.987 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:48:33.078 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:48:33.116 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:48:33.168 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:48:33.199 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:48:33.215 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:48:33.227 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:48:33.261 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:48:33.293 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:48:33.320 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:48:33.669 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:48:33.701 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:48:33.732 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:48:33.736 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:48:33.769 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:48:33.795 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:48:33.803 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:48:33.824 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:48:33.880 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:48:34.245 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:48:34.362 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:48:34.362 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-09-11T23:48:34.362 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-09-11T23:48:34.362 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-09-11T23:48:34.362 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-09-11T23:48:34.363 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-09-11T23:48:34.363 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-09-11T23:48:34.363 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-09-11T23:48:34.363 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:34.545 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:48:34.562 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:48:34.562 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:34.562 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:48:34.562 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:34.860 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:48:34.892 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:48:34.954 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:48:34.985 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:48:35.861 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:48:35.884 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:48:35.962 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:48:35.986 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:48:35.994 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:48:36.097 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:48:36.097 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:48:36.126 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:48:36.126 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:36.126 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:48:36.127 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:48:36.127 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:48:36.127 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:36.148 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:48:36.186 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:48:36.211 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:48:36.211 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:36.211 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:48:36.211 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:48:36.211 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:48:36.211 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:36.262 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:48:36.265 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:48:36.273 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:48:36.297 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:48:36.321 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:48:36.321 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:36.321 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:48:36.321 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:48:36.321 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:48:36.322 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:36.365 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:48:36.371 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:48:36.372 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:48:36.384 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:48:36.390 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:48:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:48:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:48:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:48:36.390 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:36.418 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:48:36.483 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:48:36.529 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:48:36.849 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:48:36.874 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:48:36.874 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:36.874 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:48:36.874 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:48:36.874 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:48:36.874 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:36.989 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:48:37.047 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:48:37.111 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:48:37.308 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:48:37.343 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:48:37.367 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:48:37.381 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:48:37.405 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:48:37.405 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:37.406 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:48:37.406 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:48:37.406 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:48:37.406 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:37.448 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:48:37.456 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:48:37.457 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:48:37.471 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:48:37.471 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:37.471 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:48:37.471 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:37.483 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:48:37.507 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:48:37.507 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:37.507 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:48:37.507 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:48:37.507 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:48:37.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:37.515 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:48:37.538 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:48:37.539 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:37.539 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:48:37.539 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:48:37.539 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:48:37.539 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:37.550 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:48:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:48:37.574 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:48:37.574 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:37.574 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:48:37.574 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:37.626 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:48:37.649 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:48:37.650 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:37.650 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:48:37.650 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:48:37.650 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:48:37.650 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:37.701 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:48:37.751 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:48:37.782 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:48:37.809 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:48:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:48:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:48:37.865 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:37.865 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:48:37.865 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:48:37.865 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:48:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:37.960 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:48:37.984 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:48:37.984 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:37.984 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:48:37.984 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:48:37.984 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:48:37.984 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:38.229 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:48:38.262 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:48:38.298 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:48:38.364 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:48:38.397 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:48:39.512 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:48:39.567 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:48:40.586 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:48:40.616 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:48:40.729 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:48:40.894 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:48:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:48:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:48:40.953 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:40.953 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:48:40.953 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:48:40.953 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:48:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:41.002 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:48:41.015 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:48:41.116 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:48:41.175 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:48:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:48:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:48:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:48:42.205 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:42.205 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:48:42.205 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:48:42.205 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:48:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:48:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:48:42.272 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:42.272 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:48:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:48:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:48:42.356 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:42.356 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:48:42.356 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:48:42.356 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:48:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:42.395 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:48:42.437 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:48:42.485 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:48:42.517 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:48:42.547 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:48:42.553 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:48:42.588 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:48:42.629 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:48:42.661 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:48:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:48:42.689 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:48:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:48:42.699 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:48:42.699 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:48:42.699 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:48:42.699 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:48:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:42.734 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:48:42.783 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:48:42.813 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:48:42.843 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:48:42.871 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:48:42.881 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:48:42.919 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:48:42.949 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:48:42.979 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:48:43.017 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:48:43.500 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:43.537 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:43.557 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:43.640 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:43.673 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:43.694 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:48:44.458 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:48:44.499 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:48:44.527 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:48:44.579 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:48:44.619 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:48:44.620 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:48:44.645 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:48:44.660 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:48:44.679 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:48:44.679 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:48:44.743 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:48:44.746 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:48:44.746 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:48:44.781 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:48:44.806 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:48:44.822 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:48:44.840 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:48:44.841 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:48:44.847 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:48:44.852 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:44.852 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:44.933 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:48:44.933 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:48:45.025 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:48:45.032 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:45.032 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:48:45.050 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:48:45.056 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:45.056 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:45.116 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:48:45.188 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:45.235 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:45.235 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:48:45.319 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:48:45.384 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:47.536 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:48:47.578 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:48:47.619 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:48:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:48:47.677 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:48:47.892 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:48:47.932 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:48:47.962 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:48:48.000 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:48:48.046 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:48:48.690 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:48.728 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:48.749 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:48:49.669 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:48:49.749 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:48:49.803 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:48:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:48:49.935 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:48:49.961 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:48:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:48:50.003 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:48:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:48:50.096 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:48:50.171 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:48:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:48:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:50.202 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:48:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:48:50.474 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:48:50.543 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:51.003 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:51.003 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:48:51.003 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:48:51.003 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:48:51.003 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:48:51.003 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:48:51.003 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:48:51.003 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:48:51.004 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:48:51.005 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:48:51.005 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:48:51.005 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:48:51.005 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:48:51.005 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:48:51.005 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:48:51.005 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:48:51.017 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:48:51.018 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:48:51.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:48:51.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:48:51.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:48:51.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:48:51.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:48:51.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:48:51.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:48:51.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:48:51.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:51.200 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:48:51.201 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:48:51.202 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:48:51.202 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:48:51.202 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:48:51.213 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:48:51.213 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:48:51.213 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:48:51.213 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:48:51.213 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:48:51.213 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:48:51.214 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:48:51.215 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:48:51.216 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:48:51.217 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:48:51.218 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:48:51.219 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:48:51.220 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:48:51.221 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:48:51.222 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:48:51.223 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:48:53.495 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:53.495 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:48:53.496 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.497 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.498 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.499 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:48:53.500 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:48:53.501 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:48:53.502 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:48:53.503 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:48:53.504 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:48:53.505 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:48:53.506 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:48:53.507 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:48:53.508 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:48:53.508 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:48:53.508 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:48:53.508 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:48:53.508 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:48:53.508 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:48:53.508 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-11T23:48:53.886 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:53.886 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:53.886 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2024-09-11T23:48:53.886 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:53.886 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:53.886 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.887 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.888 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:48:53.889 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:48:53.890 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:48:53.891 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:48:53.892 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:48:53.893 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:48:53.894 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:48:53.895 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:48:53.896 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:48:53.897 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:48:53.898 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:48:53.899 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:48:53.899 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:48:53.899 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-09-11T23:48:53.913 DEBUG:teuthology.parallel:result is None 2024-09-11T23:48:54.291 DEBUG:teuthology.parallel:result is None 2024-09-11T23:48:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:56.100 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:48:56.101 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:48:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:48:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:48:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:48:56.103 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:48:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:48:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:48:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:48:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:48:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:48:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:48:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:48:56.116 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:48:56.117 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:48:56.118 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:48:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:48:56.120 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:48:56.121 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:48:56.122 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:48:56.123 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:48:56.124 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:48:56.125 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:48:56.126 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:48:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:48:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:58.881 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-09-11T23:48:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:48:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:48:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:48:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:48:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:48:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:48:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:48:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:48:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:48:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:48:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:48:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:48:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:48:58.894 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-11T23:48:59.315 DEBUG:teuthology.parallel:result is None 2024-09-11T23:48:59.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:59.474 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:48:59.498 INFO:teuthology.orchestra.run.smithi060.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:59.498 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:59.498 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:48:59.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:59.646 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:48:59.673 INFO:teuthology.orchestra.run.smithi105.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:59.673 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:59.674 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:48:59.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:48:59.820 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:48:59.847 INFO:teuthology.orchestra.run.smithi192.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:59.847 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:48:59.848 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:48:59.850 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T23:48:59.850 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:48:59.850 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:48:59.881 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:48:59.881 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:48:59.914 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:48:59.914 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:48:59.946 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T23:48:59.946 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:48:59.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:48:59.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:49:00.044 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:49:00.045 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:49:00.074 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:49:00.143 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:49:00.144 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:49:00.174 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:49:00.242 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T23:49:00.242 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:49:00.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:49:00.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:49:00.341 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:49:00.341 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:49:00.371 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:49:00.440 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:49:00.440 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:49:00.469 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:49:00.542 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T23:49:00.542 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:49:00.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:49:00.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:49:00.642 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:49:00.642 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:49:00.672 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:49:00.741 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:49:00.741 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:49:00.770 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:49:00.839 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T23:49:00.934 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T23:49:00.934 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:49:00.934 INFO:tasks.cephadm:Cluster fsid is 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:00.935 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T23:49:00.935 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.60', 'mon.b': '172.21.15.105', 'mon.c': '172.21.15.192'} 2024-09-11T23:49:00.935 INFO:tasks.cephadm:First mon is mon.a on smithi060 2024-09-11T23:49:00.935 INFO:tasks.cephadm:First mgr is x 2024-09-11T23:49:00.935 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T23:49:00.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2024-09-11T23:49:00.967 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname $(hostname -s) 2024-09-11T23:49:00.997 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname $(hostname -s) 2024-09-11T23:49:01.028 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T23:49:01.028 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:49:01.179 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-11T23:49:01.324 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:49:01.326 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T23:49:01.326 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-11T23:49:01.326 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:01.714 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:49 /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:01.714 DEBUG:teuthology.orchestra.run.smithi105:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:02.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:49 /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:02.083 DEBUG:teuthology.orchestra.run.smithi192:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:02.459 INFO:teuthology.orchestra.run.smithi192.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 11 23:49 /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:02.459 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:02.480 DEBUG:teuthology.orchestra.run.smithi105:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:02.500 DEBUG:teuthology.orchestra.run.smithi192:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T23:49:02.534 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-11T23:49:02.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:49:02.537 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:49:02.543 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-11T23:49:04.037 INFO:teuthology.orchestra.run.smithi192.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:49:04.126 INFO:teuthology.orchestra.run.smithi105.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:49:04.237 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:49:31.352 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-11T23:49:31.353 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:49:31.353 INFO:teuthology.orchestra.run.smithi192.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:49:31.353 INFO:teuthology.orchestra.run.smithi192.stdout: "repo_digests": [ 2024-09-11T23:49:31.353 INFO:teuthology.orchestra.run.smithi192.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:49:31.353 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-11T23:49:31.353 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-11T23:49:31.390 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-11T23:49:31.390 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:49:31.390 INFO:teuthology.orchestra.run.smithi105.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:49:31.390 INFO:teuthology.orchestra.run.smithi105.stdout: "repo_digests": [ 2024-09-11T23:49:31.390 INFO:teuthology.orchestra.run.smithi105.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:49:31.390 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-11T23:49:31.390 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-11T23:49:34.219 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:49:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T23:49:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-11T23:49:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2024-09-11T23:49:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-11T23:49:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-11T23:49:34.220 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:49:34.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2024-09-11T23:49:34.295 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph 2024-09-11T23:49:34.328 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph 2024-09-11T23:49:34.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2024-09-11T23:49:34.389 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /etc/ceph 2024-09-11T23:49:34.417 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /etc/ceph 2024-09-11T23:49:34.445 INFO:tasks.cephadm:Writing seed config... 2024-09-11T23:49:34.446 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-11T23:49:34.446 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-11T23:49:34.447 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T23:49:34.448 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-11T23:49:34.449 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T23:49:34.450 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T23:49:34.450 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T23:49:34.450 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T23:49:34.450 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T23:49:34.450 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-11T23:49:34.450 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T23:49:34.450 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-11T23:49:34.451 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:49:34.451 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T23:49:34.467 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6b4d616e-7098-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-11T23:49:34.468 DEBUG:teuthology.orchestra.run.smithi060:mon.a> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T23:49:34.511 DEBUG:teuthology.orchestra.run.smithi060:mgr.x> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T23:49:34.554 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T23:49:34.554 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.60 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:49:34.763 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:49:34.763 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '6b4d616e-7098-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.60', '--skip-admin-label'] 2024-09-11T23:49:34.763 INFO:teuthology.orchestra.run.smithi060.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T23:49:34.763 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying podman|docker is present... 2024-09-11T23:49:34.798 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 5.2.2 2024-09-11T23:49:34.798 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying lvm2 is present... 2024-09-11T23:49:34.799 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying time synchronization is in place... 2024-09-11T23:49:34.807 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T23:49:34.807 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T23:49:34.813 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T23:49:34.813 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-11T23:49:34.820 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2024-09-11T23:49:34.826 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2024-09-11T23:49:34.826 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2024-09-11T23:49:34.827 INFO:teuthology.orchestra.run.smithi060.stdout:Repeating the final host check... 2024-09-11T23:49:34.849 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 5.2.2 2024-09-11T23:49:34.852 INFO:teuthology.orchestra.run.smithi060.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T23:49:34.852 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl is present 2024-09-11T23:49:34.852 INFO:teuthology.orchestra.run.smithi060.stdout:lvcreate is present 2024-09-11T23:49:34.856 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T23:49:34.856 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T23:49:34.862 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T23:49:34.862 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-11T23:49:34.869 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout enabled 2024-09-11T23:49:34.876 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout active 2024-09-11T23:49:34.876 INFO:teuthology.orchestra.run.smithi060.stdout:Unit chronyd.service is enabled and running 2024-09-11T23:49:34.876 INFO:teuthology.orchestra.run.smithi060.stdout:Host looks OK 2024-09-11T23:49:34.876 INFO:teuthology.orchestra.run.smithi060.stdout:Cluster fsid: 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:34.876 INFO:teuthology.orchestra.run.smithi060.stdout:Acquiring lock 139963049251840 on /run/cephadm/6b4d616e-7098-11ef-bcea-c7b262605968.lock 2024-09-11T23:49:34.876 INFO:teuthology.orchestra.run.smithi060.stdout:Lock 139963049251840 acquired on /run/cephadm/6b4d616e-7098-11ef-bcea-c7b262605968.lock 2024-09-11T23:49:34.877 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 3300 ... 2024-09-11T23:49:34.877 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying IP 172.21.15.60 port 6789 ... 2024-09-11T23:49:34.877 INFO:teuthology.orchestra.run.smithi060.stdout:Base mon IP(s) is [172.21.15.60:3300, 172.21.15.60:6789], mon addrv is [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-09-11T23:49:34.880 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.60 metric 100 2024-09-11T23:49:34.880 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.60 metric 100 2024-09-11T23:49:34.883 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T23:49:34.883 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-11T23:49:34.883 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1789sec hoplimit 64 pref medium 2024-09-11T23:49:34.885 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T23:49:34.885 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T23:49:34.885 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T23:49:34.885 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-11T23:49:34.886 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-11T23:49:34.886 INFO:teuthology.orchestra.run.smithi060.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T23:49:34.886 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2024-09-11T23:49:34.886 INFO:teuthology.orchestra.run.smithi060.stdout:Mon IP `172.21.15.60` is in CIDR network `172.21.0.0/20` 2024-09-11T23:49:34.886 INFO:teuthology.orchestra.run.smithi060.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T23:49:34.887 INFO:teuthology.orchestra.run.smithi060.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T23:49:34.887 INFO:teuthology.orchestra.run.smithi060.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:49:35.340 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T23:49:35.340 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-11T23:49:35.340 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T23:49:35.340 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-11T23:49:35.340 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T23:49:35.340 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-11T23:49:35.340 INFO:teuthology.orchestra.run.smithi060.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T23:49:36.228 INFO:teuthology.orchestra.run.smithi060.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T23:49:36.228 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-11T23:49:36.228 INFO:teuthology.orchestra.run.smithi060.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T23:49:37.151 INFO:teuthology.orchestra.run.smithi060.stdout:stat: stdout 167 167 2024-09-11T23:49:37.151 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial keys... 2024-09-11T23:49:38.039 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQCRLOJmDftKGxAAwxrloRnUk0E9XuPzPuSfVg== 2024-09-11T23:49:38.895 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQCSLOJmxQdPFBAAsodVYt8XRlwnntEH/zxOGw== 2024-09-11T23:49:39.802 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph-authtool: stdout AQCTLOJmg5bWDBAAXtJP1Fo4eAICl/m/+eQSqA== 2024-09-11T23:49:39.803 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial monmap... 2024-09-11T23:49:40.684 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T23:49:40.684 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T23:49:40.684 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:40.684 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T23:49:40.684 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool for a [v2:172.21.15.60:3300,v1:172.21.15.60:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T23:49:40.684 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = quincy 2024-09-11T23:49:40.685 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: set fsid to 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:40.685 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T23:49:40.685 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:49:40.685 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mon... 2024-09-11T23:49:41.624 INFO:teuthology.orchestra.run.smithi060.stdout:create mon.a on 2024-09-11T23:49:41.838 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T23:49:41.991 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T23:49:42.354 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6b4d616e-7098-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-6b4d616e-7098-11ef-bcea-c7b262605968.target. 2024-09-11T23:49:42.354 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6b4d616e-7098-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-6b4d616e-7098-11ef-bcea-c7b262605968.target. 2024-09-11T23:49:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a 2024-09-11T23:49:43.045 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T23:49:43.435 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6b4d616e-7098-11ef-bcea-c7b262605968.target.wants/ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-6b4d616e-7098-11ef-bcea-c7b262605968@.service. 2024-09-11T23:49:45.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:44 smithi060 podman[30561]: 2024-09-11 23:49:44.771682664 +0000 UTC m=+1.205125041 container create 916d51698b599c60aa61731860f725530d1bb56786e656a0dc768c98d24c76f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-11T23:49:47.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:46 smithi060 podman[30561]: 2024-09-11 23:49:46.658836952 +0000 UTC m=+3.092279329 container init 916d51698b599c60aa61731860f725530d1bb56786e656a0dc768c98d24c76f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-11T23:49:47.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:46 smithi060 podman[30561]: 2024-09-11 23:49:46.663270916 +0000 UTC m=+3.096713295 container start 916d51698b599c60aa61731860f725530d1bb56786e656a0dc768c98d24c76f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T23:49:47.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:46 smithi060 ceph-mon[30582]: mkfs 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:47.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:46 smithi060 ceph-mon[30582]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:49:47.397 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:49:47.397 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-11T23:49:47.406 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:49:47.406 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-11T23:49:47.406 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-11T23:49:47.406 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T23:49:47.407 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon to start... 2024-09-11T23:49:47.407 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mon... 2024-09-11T23:49:47.712 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 bash[30561]: 916d51698b599c60aa61731860f725530d1bb56786e656a0dc768c98d24c76f5 2024-09-11T23:49:47.713 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 systemd[1]: Started Ceph mon.a for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:49:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:49:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: monmap epoch 1 2024-09-11T23:49:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: last_changed 2024-09-11T23:49:40.118605+0000 2024-09-11T23:49:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:49:48.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: min_mon_release 19 (squid) 2024-09-11T23:49:48.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: election_strategy: 1 2024-09-11T23:49:48.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:49:48.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: fsmap 2024-09-11T23:49:48.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T23:49:48.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:47 smithi060 ceph-mon[30582]: mgrmap e1: no daemons active 2024-09-11T23:49:50.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:50 smithi060 ceph-mon[30582]: from='client.? 172.21.15.60:0/2527581697' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-11T23:49:53.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T23:49:53.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout id: 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:53.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T23:49:53.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:53.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout services: 2024-09-11T23:49:53.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 3s) 2024-09-11T23:49:53.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T23:49:53.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T23:49:53.497 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout data: 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.569+0000 7f8ae3968640 1 Processor -- start 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.570+0000 7f8ae3968640 1 -- start start 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.570+0000 7f8ae3968640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc10a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:53.498 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.570+0000 7f8ae3968640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc07be10 con 0x7f8adc108350 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.570+0000 7f8ae1704640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc10a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.570+0000 7f8ae1704640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc10a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53210/0 (socket says 172.21.15.60:53210) 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.570+0000 7f8ae1704640 1 -- 172.21.15.60:0/386945510 learned_addr learned my addr 172.21.15.60:0/386945510 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.571+0000 7f8ae1704640 1 -- 172.21.15.60:0/386945510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc10ac80 con 0x7f8adc108350 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8ae1704640 1 --2- 172.21.15.60:0/386945510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc10a740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009820 tx=0x7f8ad402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad5bb03a07b7856 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8adbfff640 1 -- 172.21.15.60:0/386945510 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad4037070 con 0x7f8adc108350 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8adbfff640 1 -- 172.21.15.60:0/386945510 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad4032440 con 0x7f8adc108350 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8adbfff640 1 -- 172.21.15.60:0/386945510 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad4032740 con 0x7f8adc108350 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8ae3968640 1 -- 172.21.15.60:0/386945510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 msgr2=0x7f8adc10a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8ae3968640 1 --2- 172.21.15.60:0/386945510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc10a740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009820 tx=0x7f8ad402a270 comp rx=0 tx=0).stop 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8ae3968640 1 -- 172.21.15.60:0/386945510 shutdown_connections 2024-09-11T23:49:53.499 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8ae3968640 1 --2- 172.21.15.60:0/386945510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc10a740 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.573+0000 7f8ae3968640 1 -- 172.21.15.60:0/386945510 >> 172.21.15.60:0/386945510 conn(0x7f8adc101f30 msgr2=0x7f8adc104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.574+0000 7f8ae3968640 1 -- 172.21.15.60:0/386945510 shutdown_connections 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.574+0000 7f8ae3968640 1 -- 172.21.15.60:0/386945510 wait complete. 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.574+0000 7f8ae3968640 1 Processor -- start 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.574+0000 7f8ae3968640 1 -- start start 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.574+0000 7f8ae3968640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.574+0000 7f8ae3968640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc10b0f0 con 0x7f8adc108350 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.574+0000 7f8ae1704640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ae1704640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc19b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53214/0 (socket says 172.21.15.60:53214) 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ae1704640 1 -- 172.21.15.60:0/2527581697 learned_addr learned my addr 172.21.15.60:0/2527581697 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ae1704640 1 -- 172.21.15.60:0/2527581697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc19b590 con 0x7f8adc108350 2024-09-11T23:49:53.500 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ae1704640 1 --2- 172.21.15.60:0/2527581697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc19b050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40090b0 tx=0x7f8ad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ada7fc640 1 -- 172.21.15.60:0/2527581697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad4041070 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ada7fc640 1 -- 172.21.15.60:0/2527581697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad403c7a0 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8adc19b820 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ada7fc640 1 -- 172.21.15.60:0/2527581697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad4037040 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.575+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8adc19e510 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.576+0000 7f8ada7fc640 1 -- 172.21.15.60:0/2527581697 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ad4044070 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.576+0000 7f8ada7fc640 1 -- 172.21.15.60:0/2527581697 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8ad403d3f0 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.576+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8adc1087b0 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.579+0000 7f8ada7fc640 1 -- 172.21.15.60:0/2527581697 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8ad4046450 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.640+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f8adc02d910 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.641+0000 7f8ada7fc640 1 -- 172.21.15.60:0/2527581697 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+310 (secure 0 0 0) 0x7f8ad4046630 con 0x7f8adc108350 2024-09-11T23:49:53.501 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.641+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 msgr2=0x7f8adc19b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:53.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.641+0000 7f8ae3968640 1 --2- 172.21.15.60:0/2527581697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc19b050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40090b0 tx=0x7f8ad40046c0 comp rx=0 tx=0).stop 2024-09-11T23:49:53.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.641+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 shutdown_connections 2024-09-11T23:49:53.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.641+0000 7f8ae3968640 1 --2- 172.21.15.60:0/2527581697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8adc108350 0x7f8adc19b050 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:53.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.641+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 >> 172.21.15.60:0/2527581697 conn(0x7f8adc101f30 msgr2=0x7f8adc1036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:53.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.642+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 shutdown_connections 2024-09-11T23:49:53.502 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:50.642+0000 7f8ae3968640 1 -- 172.21.15.60:0/2527581697 wait complete. 2024-09-11T23:49:53.502 INFO:teuthology.orchestra.run.smithi060.stdout:mon is available 2024-09-11T23:49:53.502 INFO:teuthology.orchestra.run.smithi060.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T23:49:54.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:53 smithi060 ceph-mon[30582]: from='client.? 172.21.15.60:0/872984828' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T23:49:54.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:53 smithi060 ceph-mon[30582]: from='client.? 172.21.15.60:0/872984828' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T23:49:54.477 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:54.477 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T23:49:54.477 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:54.477 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T23:49:54.478 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.865+0000 7f6f21963640 1 Processor -- start 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.865+0000 7f6f21963640 1 -- start start 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.865+0000 7f6f21963640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c10a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.865+0000 7f6f21963640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c07bd90 con 0x7f6f1c1083d0 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.866+0000 7f6f1affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c10a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.866+0000 7f6f1affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c10a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49196/0 (socket says 172.21.15.60:49196) 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.866+0000 7f6f1affd640 1 -- 172.21.15.60:0/2539890340 learned_addr learned my addr 172.21.15.60:0/2539890340 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.866+0000 7f6f1affd640 1 -- 172.21.15.60:0/2539890340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c10ad00 con 0x7f6f1c1083d0 2024-09-11T23:49:54.479 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f1affd640 1 --2- 172.21.15.60:0/2539890340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c10a7c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009e80 tx=0x7f6f0c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d816b41f14bf5c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f19ffb640 1 -- 172.21.15.60:0/2539890340 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c036070 con 0x7f6f1c1083d0 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f19ffb640 1 -- 172.21.15.60:0/2539890340 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c031400 con 0x7f6f1c1083d0 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f19ffb640 1 -- 172.21.15.60:0/2539890340 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c031700 con 0x7f6f1c1083d0 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f21963640 1 -- 172.21.15.60:0/2539890340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 msgr2=0x7f6f1c10a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f21963640 1 --2- 172.21.15.60:0/2539890340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c10a7c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009e80 tx=0x7f6f0c02a7a0 comp rx=0 tx=0).stop 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f21963640 1 -- 172.21.15.60:0/2539890340 shutdown_connections 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f21963640 1 --2- 172.21.15.60:0/2539890340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c10a7c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.867+0000 7f6f21963640 1 -- 172.21.15.60:0/2539890340 >> 172.21.15.60:0/2539890340 conn(0x7f6f1c101f30 msgr2=0x7f6f1c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.868+0000 7f6f21963640 1 -- 172.21.15.60:0/2539890340 shutdown_connections 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.868+0000 7f6f21963640 1 -- 172.21.15.60:0/2539890340 wait complete. 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.868+0000 7f6f21963640 1 Processor -- start 2024-09-11T23:49:54.480 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f21963640 1 -- start start 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f21963640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f21963640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c10b110 con 0x7f6f1c1083d0 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f1affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f1affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c19b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49200/0 (socket says 172.21.15.60:49200) 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f1affd640 1 -- 172.21.15.60:0/872984828 learned_addr learned my addr 172.21.15.60:0/872984828 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f1affd640 1 -- 172.21.15.60:0/872984828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c19b570 con 0x7f6f1c1083d0 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f1affd640 1 --2- 172.21.15.60:0/872984828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c19b030 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c034040 tx=0x7f6f0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f20961640 1 -- 172.21.15.60:0/872984828 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c041070 con 0x7f6f1c1083d0 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f20961640 1 -- 172.21.15.60:0/872984828 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c03c650 con 0x7f6f1c1083d0 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c19b800 con 0x7f6f1c1083d0 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.869+0000 7f6f20961640 1 -- 172.21.15.60:0/872984828 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f0c036040 con 0x7f6f1c1083d0 2024-09-11T23:49:54.481 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.870+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c19e4f0 con 0x7f6f1c1083d0 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.870+0000 7f6f20961640 1 -- 172.21.15.60:0/872984828 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6f0c044070 con 0x7f6f1c1083d0 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.870+0000 7f6f20961640 1 -- 172.21.15.60:0/872984828 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6f0c046c10 con 0x7f6f1c1083d0 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.871+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1c108830 con 0x7f6f1c1083d0 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.873+0000 7f6f20961640 1 -- 172.21.15.60:0/872984828 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6f0c03c950 con 0x7f6f1c1083d0 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.933+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f6f1c02d980 con 0x7f6f1c1083d0 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.937+0000 7f6f20961640 1 -- 172.21.15.60:0/872984828 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f6f0c03cb30 con 0x7f6f1c1083d0 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.937+0000 7f6f20961640 1 -- 172.21.15.60:0/872984828 <== mon.0 v2:172.21.15.60:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6f0c056070 con 0x7f6f1c1083d0 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.938+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 msgr2=0x7f6f1c19b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.938+0000 7f6f21963640 1 --2- 172.21.15.60:0/872984828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c19b030 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c034040 tx=0x7f6f0c004a40 comp rx=0 tx=0).stop 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.938+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 shutdown_connections 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.938+0000 7f6f21963640 1 --2- 172.21.15.60:0/872984828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f1c1083d0 0x7f6f1c19b030 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.938+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 >> 172.21.15.60:0/872984828 conn(0x7f6f1c101f30 msgr2=0x7f6f1c1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:54.482 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.938+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 shutdown_connections 2024-09-11T23:49:54.483 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:53.938+0000 7f6f21963640 1 -- 172.21.15.60:0/872984828 wait complete. 2024-09-11T23:49:54.483 INFO:teuthology.orchestra.run.smithi060.stdout:Generating new minimal ceph.conf... 2024-09-11T23:49:55.249 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:54 smithi060 ceph-mon[30582]: from='client.? 172.21.15.60:0/4258340899' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:49:55.523 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.888+0000 7f08e3632640 1 Processor -- start 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.888+0000 7f08e3632640 1 -- start start 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.889+0000 7f08e3632640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc106ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.889+0000 7f08e3632640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc107170 con 0x7f08dc1067a0 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.889+0000 7f08e13ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc106ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.889+0000 7f08e13ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc106ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49212/0 (socket says 172.21.15.60:49212) 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.889+0000 7f08e13ce640 1 -- 172.21.15.60:0/432629956 learned_addr learned my addr 172.21.15.60:0/432629956 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.889+0000 7f08e13ce640 1 -- 172.21.15.60:0/432629956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc1079a0 con 0x7f08dc1067a0 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.890+0000 7f08e13ce640 1 --2- 172.21.15.60:0/432629956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc106ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009820 tx=0x7f08d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5363af231d70e540 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.890+0000 7f08d3fff640 1 -- 172.21.15.60:0/432629956 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8037070 con 0x7f08dc1067a0 2024-09-11T23:49:55.524 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.890+0000 7f08d3fff640 1 -- 172.21.15.60:0/432629956 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f08d8032920 con 0x7f08dc1067a0 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.890+0000 7f08d3fff640 1 -- 172.21.15.60:0/432629956 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8030950 con 0x7f08dc1067a0 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 -- 172.21.15.60:0/432629956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 msgr2=0x7f08dc106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 --2- 172.21.15.60:0/432629956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc106ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009820 tx=0x7f08d802a270 comp rx=0 tx=0).stop 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 -- 172.21.15.60:0/432629956 shutdown_connections 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 --2- 172.21.15.60:0/432629956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc106ba0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 -- 172.21.15.60:0/432629956 >> 172.21.15.60:0/432629956 conn(0x7f08dc101f30 msgr2=0x7f08dc104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 -- 172.21.15.60:0/432629956 shutdown_connections 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 -- 172.21.15.60:0/432629956 wait complete. 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 Processor -- start 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.891+0000 7f08e3632640 1 -- start start 2024-09-11T23:49:55.525 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e3632640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc1919a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e3632640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08dc10ad50 con 0x7f08dc1067a0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e13ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc1919a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e13ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc1919a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49220/0 (socket says 172.21.15.60:49220) 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e13ce640 1 -- 172.21.15.60:0/4258340899 learned_addr learned my addr 172.21.15.60:0/4258340899 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e13ce640 1 -- 172.21.15.60:0/4258340899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08dc191ee0 con 0x7f08dc1067a0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e13ce640 1 --2- 172.21.15.60:0/4258340899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc1919a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009940 tx=0x7f08d8032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08d27fc640 1 -- 172.21.15.60:0/4258340899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8042070 con 0x7f08dc1067a0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08d27fc640 1 -- 172.21.15.60:0/4258340899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f08d80326b0 con 0x7f08dc1067a0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08dc1900d0 con 0x7f08dc1067a0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08d27fc640 1 -- 172.21.15.60:0/4258340899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d8037040 con 0x7f08dc1067a0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.892+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08dc190610 con 0x7f08dc1067a0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.893+0000 7f08d27fc640 1 -- 172.21.15.60:0/4258340899 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f08d8045070 con 0x7f08dc1067a0 2024-09-11T23:49:55.526 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.893+0000 7f08d27fc640 1 -- 172.21.15.60:0/4258340899 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f08d8047bc0 con 0x7f08dc1067a0 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.893+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08dc10aed0 con 0x7f08dc1067a0 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.896+0000 7f08d27fc640 1 -- 172.21.15.60:0/4258340899 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f08d803dbf0 con 0x7f08dc1067a0 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.956+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f08dc1956a0 con 0x7f08dc1067a0 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.957+0000 7f08d27fc640 1 -- 172.21.15.60:0/4258340899 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f08d803d430 con 0x7f08dc1067a0 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.957+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 msgr2=0x7f08dc1919a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.957+0000 7f08e3632640 1 --2- 172.21.15.60:0/4258340899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc1919a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009940 tx=0x7f08d8032e40 comp rx=0 tx=0).stop 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.957+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 shutdown_connections 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.957+0000 7f08e3632640 1 --2- 172.21.15.60:0/4258340899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08dc1067a0 0x7f08dc1919a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.957+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 >> 172.21.15.60:0/4258340899 conn(0x7f08dc101f30 msgr2=0x7f08dc102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.958+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 shutdown_connections 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:54.958+0000 7f08e3632640 1 -- 172.21.15.60:0/4258340899 wait complete. 2024-09-11T23:49:55.527 INFO:teuthology.orchestra.run.smithi060.stdout:Restarting the monitor... 2024-09-11T23:49:55.788 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:55 smithi060 systemd[1]: Stopping Ceph mon.a for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:49:56.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:55 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a[30577]: 2024-09-11T23:49:55.787+0000 7f7898d68640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T23:49:56.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:55 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a[30577]: 2024-09-11T23:49:55.787+0000 7f7898d68640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T23:49:56.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:55 smithi060 podman[30826]: 2024-09-11 23:49:55.972535943 +0000 UTC m=+0.278647763 container died 916d51698b599c60aa61731860f725530d1bb56786e656a0dc768c98d24c76f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T23:49:56.488 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:56 smithi060 podman[30826]: 2024-09-11 23:49:56.279541976 +0000 UTC m=+0.585653794 container cleanup 916d51698b599c60aa61731860f725530d1bb56786e656a0dc768c98d24c76f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T23:49:56.488 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:56 smithi060 bash[30826]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a 2024-09-11T23:49:56.828 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:56 smithi060 podman[30840]: 2024-09-11 23:49:56.488949748 +0000 UTC m=+0.513880386 container remove 916d51698b599c60aa61731860f725530d1bb56786e656a0dc768c98d24c76f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-11T23:49:56.828 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:56 smithi060 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T23:49:56.828 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:56 smithi060 systemd[1]: Stopped Ceph mon.a for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:49:56.828 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:56 smithi060 systemd[1]: Starting Ceph mon.a for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:49:57.082 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:56 smithi060 podman[30934]: 2024-09-11 23:49:56.731672895 +0000 UTC m=+0.016520717 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:49:57.082 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:56 smithi060 podman[30934]: 2024-09-11 23:49:56.831419737 +0000 UTC m=+0.116267544 container create 7c49f3335b084105e0e86316605416d95560e54866ab831a8c9dbde39e86cc80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-11T23:49:57.082 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 podman[30934]: 2024-09-11 23:49:57.058969272 +0000 UTC m=+0.343817080 container init 7c49f3335b084105e0e86316605416d95560e54866ab831a8c9dbde39e86cc80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:49:57.082 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 podman[30934]: 2024-09-11 23:49:57.06229123 +0000 UTC m=+0.347139048 container start 7c49f3335b084105e0e86316605416d95560e54866ab831a8c9dbde39e86cc80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-11T23:49:57.083 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T23:49:57.083 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T23:49:57.083 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: pidfile_write: ignore empty --pid-file 2024-09-11T23:49:57.146 INFO:teuthology.orchestra.run.smithi060.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: load: jerasure load: lrc 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: RocksDB version: 7.9.2 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Git sha 0 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: DB SUMMARY 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: DB Session ID: 3VEHZZ1IHNNMWC5AZ44A 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: CURRENT file: CURRENT 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T23:49:57.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106625 ; 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.error_if_exists: 0 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.create_if_missing: 0 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.paranoid_checks: 1 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.env: 0x55ff6a74a940 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.info_log: 0x55ff6b77f6e0 2024-09-11T23:49:57.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.statistics: (nil) 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.use_fsync: 0 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_log_file_size: 0 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.allow_fallocate: 1 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T23:49:57.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.use_direct_reads: 0 2024-09-11T23:49:57.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T23:49:57.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T23:49:57.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.db_log_dir: 2024-09-11T23:49:57.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.wal_dir: 2024-09-11T23:49:57.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T23:49:57.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T23:49:57.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T23:49:57.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T23:49:57.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.write_buffer_manager: 0x55ff6b78edc0 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T23:49:57.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T23:49:57.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T23:49:57.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.unordered_write: 0 2024-09-11T23:49:57.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T23:49:57.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T23:49:57.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T23:49:57.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T23:49:57.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.row_cache: None 2024-09-11T23:49:57.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.wal_filter: None 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.two_write_queues: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.wal_compression: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.atomic_flush: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.log_readahead_size: 0 2024-09-11T23:49:57.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_background_jobs: 2 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_background_compactions: -1 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_subcompactions: 1 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T23:49:57.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_open_files: -1 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_background_flushes: -1 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Compression algorithms supported: 2024-09-11T23:49:57.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: kZSTD supported: 0 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: kXpressCompression supported: 0 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: kBZip2Compression supported: 0 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: kLZ4Compression supported: 1 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: kZlibCompression supported: 1 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: kSnappyCompression supported: 1 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.merge_operator: 2024-09-11T23:49:57.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_filter: None 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ff6b77f320) 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout: cache_index_and_filter_blocks: 1 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout: pin_top_level_index_and_filter: 1 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_type: 0 2024-09-11T23:49:57.351 INFO:journalctl@ceph.mon.a.smithi060.stdout: data_block_index_type: 0 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_shortening: 1 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: checksum: 4 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: no_block_cache: 0 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache: 0x55ff6b7731f0 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_name: BinnedLRUCache 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_options: 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: capacity : 536870912 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: num_shard_bits : 4 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: strict_capacity_limit : 0 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: high_pri_pool_ratio: 0.000 2024-09-11T23:49:57.352 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_cache_compressed: (nil) 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: persistent_cache: (nil) 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_size: 4096 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_size_deviation: 10 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_restart_interval: 16 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: index_block_restart_interval: 1 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: metadata_block_size: 4096 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: partition_filters: 0 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: use_delta_encoding: 1 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: filter_policy: bloomfilter 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: whole_key_filtering: 1 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: verify_compression: 0 2024-09-11T23:49:57.353 INFO:journalctl@ceph.mon.a.smithi060.stdout: read_amp_bytes_per_bit: 0 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout: format_version: 5 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout: enable_index_compression: 1 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout: block_align: 0 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout: max_auto_readahead_size: 262144 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout: prepopulate_block_cache: 0 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout: initial_auto_readahead_size: 8192 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression: NoCompression 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T23:49:57.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.num_levels: 7 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:49:57.355 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:49:57.356 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T23:49:57.357 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T23:49:57.358 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.inplace_update_support: 0 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.bloom_locality: 0 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.max_successive_merges: 0 2024-09-11T23:49:57.359 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.ttl: 2592000 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.enable_blob_files: false 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.min_blob_size: 0 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T23:49:57.360 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4afddced-e7b8-4e5a-93b4-92758f09c885 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098597088801, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098597089974, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101496, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 338, "table_properties": {"data_size": 99372, "index_size": 316, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14580, "raw_average_key_size": 49, "raw_value_size": 91436, "raw_average_value_size": 312, "num_data_blocks": 12, "num_entries": 293, "num_filter_entries": 293, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726098597, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4afddced-e7b8-4e5a-93b4-92758f09c885", "db_session_id": "3VEHZZ1IHNNMWC5AZ44A", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098597090048, "job": 1, "event": "recovery_finished"} 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T23:49:57.361 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ff6b7a0e00 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: DB pointer 0x55ff6b89c000 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** DB Stats ** 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:49:57.362 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: L0 2/0 100.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: Sum 2/0 100.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-11T23:49:57.363 INFO:journalctl@ceph.mon.a.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 127.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: Cumulative compaction: 0.00 GB write, 28.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:49:57.364 INFO:journalctl@ceph.mon.a.smithi060.stdout: Interval compaction: 0.00 GB write, 28.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout: Block cache BinnedLRUCache@0x55ff6b7731f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: starting mon.a rank 0 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a@-1(???) e1 preinit fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a@-1(???).mds e1 new map 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a@-1(???).mds e1 print_map 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout: e1 2024-09-11T23:49:57.365 INFO:journalctl@ceph.mon.a.smithi060.stdout: btime 2024-09-11T23:49:46:707418+0000 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout: legacy client fscid: -1 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout: 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout: No filesystems configured 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:49:57.366 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 bash[30934]: 7c49f3335b084105e0e86316605416d95560e54866ab831a8c9dbde39e86cc80 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 systemd[1]: Started Ceph mon.a for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: monmap epoch 1 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: last_changed 2024-09-11T23:49:40.118605+0000 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: min_mon_release 19 (squid) 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: election_strategy: 1 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: fsmap 2024-09-11T23:49:57.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T23:49:57.368 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:57 smithi060 ceph-mon[30953]: mgrmap e1: no daemons active 2024-09-11T23:49:58.240 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.571+0000 7fd20dc6e640 1 Processor -- start 2024-09-11T23:49:58.240 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.572+0000 7fd20dc6e640 1 -- start start 2024-09-11T23:49:58.240 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.572+0000 7fd20dc6e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20810a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:58.240 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.572+0000 7fd20dc6e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd20807be30 con 0x7fd208108330 2024-09-11T23:49:58.240 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.572+0000 7fd2077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20810a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:58.240 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.572+0000 7fd2077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20810a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49222/0 (socket says 172.21.15.60:49222) 2024-09-11T23:49:58.240 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.572+0000 7fd2077fe640 1 -- 172.21.15.60:0/3869471249 learned_addr learned my addr 172.21.15.60:0/3869471249 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:49:58.240 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.573+0000 7fd2077fe640 1 -- 172.21.15.60:0/3869471249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20810ac60 con 0x7fd208108330 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.574+0000 7fd2077fe640 1 --2- 172.21.15.60:0/3869471249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20810a720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009820 tx=0x7fd1f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e431a965e00da40b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.575+0000 7fd206ffd640 1 -- 172.21.15.60:0/3869471249 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1f8037070 con 0x7fd208108330 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.575+0000 7fd206ffd640 1 -- 172.21.15.60:0/3869471249 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd1f8032920 con 0x7fd208108330 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.575+0000 7fd206ffd640 1 -- 172.21.15.60:0/3869471249 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1f8030950 con 0x7fd208108330 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.575+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3869471249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 msgr2=0x7fd20810a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.575+0000 7fd20dc6e640 1 --2- 172.21.15.60:0/3869471249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20810a720 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009820 tx=0x7fd1f802a270 comp rx=0 tx=0).stop 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.575+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3869471249 shutdown_connections 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.575+0000 7fd20dc6e640 1 --2- 172.21.15.60:0/3869471249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20810a720 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.575+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3869471249 >> 172.21.15.60:0/3869471249 conn(0x7fd208101f30 msgr2=0x7fd208104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.576+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3869471249 shutdown_connections 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.576+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3869471249 wait complete. 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.576+0000 7fd20dc6e640 1 Processor -- start 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.576+0000 7fd20dc6e640 1 -- start start 2024-09-11T23:49:58.241 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.576+0000 7fd20dc6e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.576+0000 7fd20dc6e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd20810bc20 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49224/0 (socket says 172.21.15.60:49224) 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2077fe640 1 -- 172.21.15.60:0/3822993482 learned_addr learned my addr 172.21.15.60:0/3822993482 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2077fe640 1 -- 172.21.15.60:0/3822993482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20819bd70 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2077fe640 1 --2- 172.21.15.60:0/3822993482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20819b830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8031000 tx=0x7fd1f8032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2057fa640 1 -- 172.21.15.60:0/3822993482 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1f8042070 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2057fa640 1 -- 172.21.15.60:0/3822993482 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd1f80326b0 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20819c060 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2057fa640 1 -- 172.21.15.60:0/3822993482 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1f8037040 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20819ecf0 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2057fa640 1 -- 172.21.15.60:0/3822993482 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd1f8045070 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.577+0000 7fd2057fa640 1 -- 172.21.15.60:0/3822993482 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd1f8047b70 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.578+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd208108790 con 0x7fd208108330 2024-09-11T23:49:58.242 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.581+0000 7fd2057fa640 1 -- 172.21.15.60:0/3822993482 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd1f803dbf0 con 0x7fd208108330 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.640+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fd20819f340 con 0x7fd208108330 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.641+0000 7fd2057fa640 1 -- 172.21.15.60:0/3822993482 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fd1f803d430 con 0x7fd208108330 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.642+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 msgr2=0x7fd20819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.642+0000 7fd20dc6e640 1 --2- 172.21.15.60:0/3822993482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20819b830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8031000 tx=0x7fd1f8032e40 comp rx=0 tx=0).stop 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.642+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 shutdown_connections 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.642+0000 7fd20dc6e640 1 --2- 172.21.15.60:0/3822993482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd208108330 0x7fd20819b830 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.642+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 >> 172.21.15.60:0/3822993482 conn(0x7fd208101f30 msgr2=0x7fd208102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.642+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 shutdown_connections 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:49:57.642+0000 7fd20dc6e640 1 -- 172.21.15.60:0/3822993482 wait complete. 2024-09-11T23:49:58.243 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T23:49:58.256 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:49:58.256 INFO:teuthology.orchestra.run.smithi060.stdout:Creating mgr... 2024-09-11T23:49:58.256 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T23:49:58.257 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T23:49:58.498 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x 2024-09-11T23:49:58.498 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T23:49:58.703 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6b4d616e-7098-11ef-bcea-c7b262605968.target.wants/ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-6b4d616e-7098-11ef-bcea-c7b262605968@.service. 2024-09-11T23:49:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:49:58 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3822993482' entity='client.admin' 2024-09-11T23:49:58.839 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:49:58 smithi060 systemd[1]: Starting Ceph mgr.x for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:49:59.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:49:58 smithi060 podman[31163]: 2024-09-11 23:49:58.839153592 +0000 UTC m=+0.016379037 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:50:00.425 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 podman[31163]: 2024-09-11 23:50:00.156909743 +0000 UTC m=+1.334135172 container create 7c8c10ab78abe291870593287b92cf1a807b12a4097cd66ea7303d84ab0a65fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T23:50:00.425 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 podman[31163]: 2024-09-11 23:50:00.426077317 +0000 UTC m=+1.603302755 container init 7c8c10ab78abe291870593287b92cf1a807b12a4097cd66ea7303d84ab0a65fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T23:50:00.532 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:50:00.532 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-11T23:50:00.540 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:50:00.540 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-11T23:50:00.540 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-11T23:50:00.540 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T23:50:00.549 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:50:00.549 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-11T23:50:00.557 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:50:00.557 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-11T23:50:00.558 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-11T23:50:00.558 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T23:50:00.558 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr to start... 2024-09-11T23:50:00.558 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr... 2024-09-11T23:50:00.683 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 podman[31163]: 2024-09-11 23:50:00.429190518 +0000 UTC m=+1.606415947 container start 7c8c10ab78abe291870593287b92cf1a807b12a4097cd66ea7303d84ab0a65fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-11T23:50:00.683 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 bash[31163]: 7c8c10ab78abe291870593287b92cf1a807b12a4097cd66ea7303d84ab0a65fc 2024-09-11T23:50:00.683 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 systemd[1]: Started Ceph mgr.x for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:50:00.683 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:00.560+0000 7f36a0d1e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:50:00.683 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:00.622+0000 7f36a0d1e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:50:00.976 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:00.779+0000 7f36a0d1e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:50:00.977 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:00.850+0000 7f36a0d1e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:50:01.332 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:01 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2956155577' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:50:01.332 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:01 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:01.008+0000 7f36a0d1e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:50:01.332 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:01 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:01.158+0000 7f36a0d1e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:50:01.589 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:01 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:01.493+0000 7f36a0d1e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:50:01.589 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:01 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:01.557+0000 7f36a0d1e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:50:01.618 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:50:01.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:50:01.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:50:01.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:50:01.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:50:01.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:50:01.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:50:01.621 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:50:01.622 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:01.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:50:01.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:01.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:50:01.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:50:01.623 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:50:01.631 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:49:46:707418+0000", 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:01.632 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:49:46.708370+0000", 2024-09-11T23:50:01.633 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.976+0000 7f2eaa9b4640 1 Processor -- start 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.976+0000 7f2eaa9b4640 1 -- start start 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.976+0000 7f2eaa9b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.976+0000 7f2eaa9b4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea407c890 con 0x7f2ea407de10 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.977+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.977+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49252/0 (socket says 172.21.15.60:49252) 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.977+0000 7f2ea3fff640 1 -- 172.21.15.60:0/3127067558 learned_addr learned my addr 172.21.15.60:0/3127067558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.977+0000 7f2ea3fff640 1 -- 172.21.15.60:0/3127067558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea407ca10 con 0x7f2ea407de10 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.978+0000 7f2ea3fff640 1 --2- 172.21.15.60:0/3127067558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea407c2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009820 tx=0x7f2e9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18370da82be786b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:01.634 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.978+0000 7f2ea2ffd640 1 -- 172.21.15.60:0/3127067558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e94037070 con 0x7f2ea407de10 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.978+0000 7f2ea2ffd640 1 -- 172.21.15.60:0/3127067558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2e94032920 con 0x7f2ea407de10 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.978+0000 7f2ea2ffd640 1 -- 172.21.15.60:0/3127067558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e94030950 con 0x7f2ea407de10 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.979+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/3127067558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 msgr2=0x7f2ea407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.979+0000 7f2eaa9b4640 1 --2- 172.21.15.60:0/3127067558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea407c2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009820 tx=0x7f2e9402a270 comp rx=0 tx=0).stop 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.979+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/3127067558 shutdown_connections 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.979+0000 7f2eaa9b4640 1 --2- 172.21.15.60:0/3127067558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea407c2c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.979+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/3127067558 >> 172.21.15.60:0/3127067558 conn(0x7f2ea4103050 msgr2=0x7f2ea4105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.979+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/3127067558 shutdown_connections 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.979+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/3127067558 wait complete. 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.980+0000 7f2eaa9b4640 1 Processor -- start 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.980+0000 7f2eaa9b4640 1 -- start start 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.980+0000 7f2eaa9b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:01.635 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.980+0000 7f2eaa9b4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea410deb0 con 0x7f2ea407de10 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49260/0 (socket says 172.21.15.60:49260) 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea3fff640 1 -- 172.21.15.60:0/2956155577 learned_addr learned my addr 172.21.15.60:0/2956155577 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea3fff640 1 -- 172.21.15.60:0/2956155577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea419df90 con 0x7f2ea407de10 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea3fff640 1 --2- 172.21.15.60:0/2956155577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea419da50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2e94006f10 tx=0x7f2e940327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea17fa640 1 -- 172.21.15.60:0/2956155577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e94037040 con 0x7f2ea407de10 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea17fa640 1 -- 172.21.15.60:0/2956155577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2e94040070 con 0x7f2ea407de10 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea419e220 con 0x7f2ea407de10 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea17fa640 1 -- 172.21.15.60:0/2956155577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e9403a630 con 0x7f2ea407de10 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea41a0f10 con 0x7f2ea407de10 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.981+0000 7f2ea17fa640 1 -- 172.21.15.60:0/2956155577 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e9403a870 con 0x7f2ea407de10 2024-09-11T23:50:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.982+0000 7f2ea17fa640 1 -- 172.21.15.60:0/2956155577 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2e94045b90 con 0x7f2ea407de10 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.982+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea407c340 con 0x7f2ea407de10 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:00.984+0000 7f2ea17fa640 1 -- 172.21.15.60:0/2956155577 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2e940328e0 con 0x7f2ea407de10 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.046+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2ea41a1430 con 0x7f2ea407de10 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.047+0000 7f2ea17fa640 1 -- 172.21.15.60:0/2956155577 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f2e94032d00 con 0x7f2ea407de10 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.048+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 msgr2=0x7f2ea419da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.048+0000 7f2eaa9b4640 1 --2- 172.21.15.60:0/2956155577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea419da50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2e94006f10 tx=0x7f2e940327d0 comp rx=0 tx=0).stop 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.048+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 shutdown_connections 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.048+0000 7f2eaa9b4640 1 --2- 172.21.15.60:0/2956155577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ea407de10 0x7f2ea419da50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.048+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 >> 172.21.15.60:0/2956155577 conn(0x7f2ea4103050 msgr2=0x7f2ea4103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.048+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 shutdown_connections 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:01.048+0000 7f2eaa9b4640 1 -- 172.21.15.60:0/2956155577 wait complete. 2024-09-11T23:50:01.637 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (1/15)... 2024-09-11T23:50:02.089 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:01 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:01.750+0000 7f36a0d1e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:50:03.089 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:02 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:02.674+0000 7f36a0d1e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:50:03.089 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:02 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:02.744+0000 7f36a0d1e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:50:03.747 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:03.498+0000 7f36a0d1e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:50:03.747 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:03.618+0000 7f36a0d1e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:50:04.002 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:03.770+0000 7f36a0d1e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:50:04.002 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:03.834+0000 7f36a0d1e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:50:04.002 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:03.996+0000 7f36a0d1e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:50:04.307 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1109367367' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:50:04.308 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:04.069+0000 7f36a0d1e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:50:04.308 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:04.140+0000 7f36a0d1e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:50:04.308 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:04.308+0000 7f36a0d1e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:50:04.589 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:04.376+0000 7f36a0d1e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:50:04.589 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:04.446+0000 7f36a0d1e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:50:04.589 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:04.532+0000 7f36a0d1e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:49:46:707418+0000", 2024-09-11T23:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:49:46.708370+0000", 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.007+0000 7f52bae04640 1 Processor -- start 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.007+0000 7f52bae04640 1 -- start start 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.007+0000 7f52bae04640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b410a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.008+0000 7f52bae04640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f52b407bdf0 con 0x7f52b4108370 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.008+0000 7f52b8ba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b410a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.008+0000 7f52b8ba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b410a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60522/0 (socket says 172.21.15.60:60522) 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.008+0000 7f52b8ba0640 1 -- 172.21.15.60:0/731287410 learned_addr learned my addr 172.21.15.60:0/731287410 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.008+0000 7f52b8ba0640 1 -- 172.21.15.60:0/731287410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b410aca0 con 0x7f52b4108370 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.009+0000 7f52b8ba0640 1 --2- 172.21.15.60:0/731287410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b410a760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009820 tx=0x7f52a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484be8ffbe2d691c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.009+0000 7f52b37fe640 1 -- 172.21.15.60:0/731287410 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a8037070 con 0x7f52b4108370 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.009+0000 7f52b37fe640 1 -- 172.21.15.60:0/731287410 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f52a8032920 con 0x7f52b4108370 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.009+0000 7f52b37fe640 1 -- 172.21.15.60:0/731287410 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a8030950 con 0x7f52b4108370 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.010+0000 7f52bae04640 1 -- 172.21.15.60:0/731287410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 msgr2=0x7f52b410a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.010+0000 7f52bae04640 1 --2- 172.21.15.60:0/731287410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b410a760 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009820 tx=0x7f52a802a270 comp rx=0 tx=0).stop 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.010+0000 7f52bae04640 1 -- 172.21.15.60:0/731287410 shutdown_connections 2024-09-11T23:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.010+0000 7f52bae04640 1 --2- 172.21.15.60:0/731287410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b410a760 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.010+0000 7f52bae04640 1 -- 172.21.15.60:0/731287410 >> 172.21.15.60:0/731287410 conn(0x7f52b4101f30 msgr2=0x7f52b4104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.010+0000 7f52bae04640 1 -- 172.21.15.60:0/731287410 shutdown_connections 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.010+0000 7f52bae04640 1 -- 172.21.15.60:0/731287410 wait complete. 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.011+0000 7f52bae04640 1 Processor -- start 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.011+0000 7f52bae04640 1 -- start start 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.011+0000 7f52bae04640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.011+0000 7f52bae04640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f52b410bcd0 con 0x7f52b4108370 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.011+0000 7f52b8ba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.011+0000 7f52b8ba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60528/0 (socket says 172.21.15.60:60528) 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.011+0000 7f52b8ba0640 1 -- 172.21.15.60:0/1109367367 learned_addr learned my addr 172.21.15.60:0/1109367367 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.011+0000 7f52b8ba0640 1 -- 172.21.15.60:0/1109367367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b419bdd0 con 0x7f52b4108370 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.012+0000 7f52b8ba0640 1 --2- 172.21.15.60:0/1109367367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b419b890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52a8006f10 tx=0x7f52a80327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.012+0000 7f52b1ffb640 1 -- 172.21.15.60:0/1109367367 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a8037040 con 0x7f52b4108370 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.012+0000 7f52b1ffb640 1 -- 172.21.15.60:0/1109367367 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f52a8040070 con 0x7f52b4108370 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.012+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b419c060 con 0x7f52b4108370 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.012+0000 7f52b1ffb640 1 -- 172.21.15.60:0/1109367367 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a803a630 con 0x7f52b4108370 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.012+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b419ed50 con 0x7f52b4108370 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.012+0000 7f52b1ffb640 1 -- 172.21.15.60:0/1109367367 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52a803a820 con 0x7f52b4108370 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.012+0000 7f52b1ffb640 1 -- 172.21.15.60:0/1109367367 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f52a8045af0 con 0x7f52b4108370 2024-09-11T23:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.013+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b41087d0 con 0x7f52b4108370 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.016+0000 7f52b1ffb640 1 -- 172.21.15.60:0/1109367367 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f52a80328e0 con 0x7f52b4108370 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.078+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f52b419f2d0 con 0x7f52b4108370 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.078+0000 7f52b1ffb640 1 -- 172.21.15.60:0/1109367367 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f52a8032d00 con 0x7f52b4108370 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.080+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 msgr2=0x7f52b419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.080+0000 7f52bae04640 1 --2- 172.21.15.60:0/1109367367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b419b890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52a8006f10 tx=0x7f52a80327d0 comp rx=0 tx=0).stop 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.080+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 shutdown_connections 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.080+0000 7f52bae04640 1 --2- 172.21.15.60:0/1109367367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4108370 0x7f52b419b890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.080+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 >> 172.21.15.60:0/1109367367 conn(0x7f52b4101f30 msgr2=0x7f52b4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.080+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 shutdown_connections 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:04.080+0000 7f52bae04640 1 -- 172.21.15.60:0/1109367367 wait complete. 2024-09-11T23:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout:mgr not available, waiting (2/15)... 2024-09-11T23:50:05.089 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:04.594+0000 7f36a0d1e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:50:05.089 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:04.656+0000 7f36a0d1e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:50:05.839 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:05.483+0000 7f36a0d1e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:50:05.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: Activating manager daemon x 2024-09-11T23:50:05.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: mgrmap e2: x(active, starting, since 0.00311648s) 2024-09-11T23:50:05.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:50:05.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:50:05.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:50:05.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:05.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:50:05.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: Manager daemon x is now available 2024-09-11T23:50:05.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:50:05.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:50:05.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' 2024-09-11T23:50:05.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' 2024-09-11T23:50:05.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:05 smithi060 ceph-mon[30953]: from='mgr.14100 172.21.15.60:0/3032138549' entity='mgr.x' 2024-09-11T23:50:07.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:07 smithi060 ceph-mon[30953]: mgrmap e3: x(active, since 1.00731s) 2024-09-11T23:50:07.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:07 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4139204844' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-11T23:50:07.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:50:07.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:50:07.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:50:07.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T23:50:07.968 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 0 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T23:50:07.969 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T23:49:46:707418+0000", 2024-09-11T23:50:07.971 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ], 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:50:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T23:49:46.708370+0000", 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout }, 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.113+0000 7efed263b640 1 Processor -- start 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.114+0000 7efed263b640 1 -- start start 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.114+0000 7efed263b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc07c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.114+0000 7efed263b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efecc07c8b0 con 0x7efecc07de80 2024-09-11T23:50:07.973 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.114+0000 7efecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc07c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.114+0000 7efecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc07c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60612/0 (socket says 172.21.15.60:60612) 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.114+0000 7efecbfff640 1 -- 172.21.15.60:0/2951838523 learned_addr learned my addr 172.21.15.60:0/2951838523 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.114+0000 7efecbfff640 1 -- 172.21.15.60:0/2951838523 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc07ca30 con 0x7efecc07de80 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.115+0000 7efecbfff640 1 --2- 172.21.15.60:0/2951838523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc07c2e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efebc009820 tx=0x7efebc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394c6f682d1b6bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.115+0000 7efecb7fe640 1 -- 172.21.15.60:0/2951838523 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc037070 con 0x7efecc07de80 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.115+0000 7efecb7fe640 1 -- 172.21.15.60:0/2951838523 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efebc032920 con 0x7efecc07de80 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.115+0000 7efecb7fe640 1 -- 172.21.15.60:0/2951838523 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc030950 con 0x7efecc07de80 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.116+0000 7efed263b640 1 -- 172.21.15.60:0/2951838523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 msgr2=0x7efecc07c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.116+0000 7efed263b640 1 --2- 172.21.15.60:0/2951838523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc07c2e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efebc009820 tx=0x7efebc02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.116+0000 7efed263b640 1 -- 172.21.15.60:0/2951838523 shutdown_connections 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.116+0000 7efed263b640 1 --2- 172.21.15.60:0/2951838523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc07c2e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.974 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.116+0000 7efed263b640 1 -- 172.21.15.60:0/2951838523 >> 172.21.15.60:0/2951838523 conn(0x7efecc102ff0 msgr2=0x7efecc105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.116+0000 7efed263b640 1 -- 172.21.15.60:0/2951838523 shutdown_connections 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.116+0000 7efed263b640 1 -- 172.21.15.60:0/2951838523 wait complete. 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.117+0000 7efed263b640 1 Processor -- start 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.117+0000 7efed263b640 1 -- start start 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.117+0000 7efed263b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc19daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.117+0000 7efed263b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efecc10de90 con 0x7efecc07de80 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.117+0000 7efecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc19daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.117+0000 7efecbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc19daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60614/0 (socket says 172.21.15.60:60614) 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.117+0000 7efecbfff640 1 -- 172.21.15.60:0/4139204844 learned_addr learned my addr 172.21.15.60:0/4139204844 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.118+0000 7efecbfff640 1 -- 172.21.15.60:0/4139204844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc19dfe0 con 0x7efecc07de80 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.118+0000 7efecbfff640 1 --2- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc19daa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efebc009940 tx=0x7efebc032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:07.975 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.118+0000 7efec9ffb640 1 -- 172.21.15.60:0/4139204844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc042070 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.118+0000 7efec9ffb640 1 -- 172.21.15.60:0/4139204844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efebc0326b0 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.118+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efecc19e270 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.118+0000 7efec9ffb640 1 -- 172.21.15.60:0/4139204844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc037040 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.118+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efecc1a0f60 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.119+0000 7efec9ffb640 1 -- 172.21.15.60:0/4139204844 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7efebc045070 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.119+0000 7efec9ffb640 1 --2- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7efeb8038e10 0x7efeb803b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.119+0000 7efec9ffb640 1 -- 172.21.15.60:0/4139204844 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efebc06be80 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.119+0000 7efec3fff640 1 --2- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7efeb8038e10 0x7efeb803b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.120+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efecc07c360 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.120+0000 7efec3fff640 1 --2- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7efeb8038e10 0x7efeb803b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efeb40098c0 tx=0x7efeb4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.125+0000 7efec9ffb640 1 -- 172.21.15.60:0/4139204844 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efebc03cd20 con 0x7efecc07de80 2024-09-11T23:50:07.976 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.365+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7efecc1a14c0 con 0x7efecc07de80 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.365+0000 7efec9ffb640 1 -- 172.21.15.60:0/4139204844 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7efebc050030 con 0x7efecc07de80 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.367+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7efeb8038e10 msgr2=0x7efeb803b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.367+0000 7efed263b640 1 --2- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7efeb8038e10 0x7efeb803b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efeb40098c0 tx=0x7efeb4006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.367+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 msgr2=0x7efecc19daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.367+0000 7efed263b640 1 --2- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc19daa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efebc009940 tx=0x7efebc032e40 comp rx=0 tx=0).stop 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.367+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 shutdown_connections 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.367+0000 7efed263b640 1 --2- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7efeb8038e10 0x7efeb803b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.367+0000 7efed263b640 1 --2- 172.21.15.60:0/4139204844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efecc07de80 0x7efecc19daa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.367+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 >> 172.21.15.60:0/4139204844 conn(0x7efecc102ff0 msgr2=0x7efecc103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.368+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 shutdown_connections 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:07.368+0000 7efed263b640 1 -- 172.21.15.60:0/4139204844 wait complete. 2024-09-11T23:50:07.977 INFO:teuthology.orchestra.run.smithi060.stdout:mgr is available 2024-09-11T23:50:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:08 smithi060 ceph-mon[30953]: mgrmap e4: x(active, since 2s) 2024-09-11T23:50:09.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:50:09.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T23:50:09.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout fsid = 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:09.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.60:3300,v1:172.21.15.60:6789] 2024-09-11T23:50:09.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T23:50:09.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.335+0000 7ff3c5b3c640 1 Processor -- start 2024-09-11T23:50:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.335+0000 7ff3c5b3c640 1 -- start start 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.336+0000 7ff3c5b3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c010a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.336+0000 7ff3c5b3c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c007be50 con 0x7ff3c0108310 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.336+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c010a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.336+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c010a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60616/0 (socket says 172.21.15.60:60616) 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.336+0000 7ff3bf7fe640 1 -- 172.21.15.60:0/2738703509 learned_addr learned my addr 172.21.15.60:0/2738703509 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.336+0000 7ff3bf7fe640 1 -- 172.21.15.60:0/2738703509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c010ac40 con 0x7ff3c0108310 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.337+0000 7ff3bf7fe640 1 --2- 172.21.15.60:0/2738703509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c010a700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009820 tx=0x7ff3b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a752ddc7c586a36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.337+0000 7ff3be7fc640 1 -- 172.21.15.60:0/2738703509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b0037070 con 0x7ff3c0108310 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.337+0000 7ff3be7fc640 1 -- 172.21.15.60:0/2738703509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff3b0032920 con 0x7ff3c0108310 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.337+0000 7ff3be7fc640 1 -- 172.21.15.60:0/2738703509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b0030950 con 0x7ff3c0108310 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.338+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/2738703509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 msgr2=0x7ff3c010a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.338+0000 7ff3c5b3c640 1 --2- 172.21.15.60:0/2738703509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c010a700 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009820 tx=0x7ff3b002a270 comp rx=0 tx=0).stop 2024-09-11T23:50:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.338+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/2738703509 shutdown_connections 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.338+0000 7ff3c5b3c640 1 --2- 172.21.15.60:0/2738703509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c010a700 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.338+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/2738703509 >> 172.21.15.60:0/2738703509 conn(0x7ff3c0101f30 msgr2=0x7ff3c0104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.338+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/2738703509 shutdown_connections 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.338+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/2738703509 wait complete. 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.338+0000 7ff3c5b3c640 1 Processor -- start 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.339+0000 7ff3c5b3c640 1 -- start start 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.339+0000 7ff3c5b3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.339+0000 7ff3c5b3c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c010bcd0 con 0x7ff3c0108310 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.339+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.339+0000 7ff3bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60626/0 (socket says 172.21.15.60:60626) 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.339+0000 7ff3bf7fe640 1 -- 172.21.15.60:0/1628994897 learned_addr learned my addr 172.21.15.60:0/1628994897 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.339+0000 7ff3bf7fe640 1 -- 172.21.15.60:0/1628994897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c019be10 con 0x7ff3c0108310 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.339+0000 7ff3bf7fe640 1 --2- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c019b8d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0006f10 tx=0x7ff3b00327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.340+0000 7ff3bcff9640 1 -- 172.21.15.60:0/1628994897 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b0037040 con 0x7ff3c0108310 2024-09-11T23:50:09.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.340+0000 7ff3bcff9640 1 -- 172.21.15.60:0/1628994897 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff3b0040070 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.340+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c019c0a0 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.340+0000 7ff3bcff9640 1 -- 172.21.15.60:0/1628994897 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b003a630 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.340+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c019ed90 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.340+0000 7ff3bcff9640 1 -- 172.21.15.60:0/1628994897 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7ff3b003a820 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.341+0000 7ff3bcff9640 1 --2- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7ff3ac038f70 0x7ff3ac03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.341+0000 7ff3bcff9640 1 -- 172.21.15.60:0/1628994897 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff3b006c310 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.341+0000 7ff3beffd640 1 --2- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7ff3ac038f70 0x7ff3ac03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.341+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c0108770 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.341+0000 7ff3beffd640 1 --2- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7ff3ac038f70 0x7ff3ac03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80098c0 tx=0x7ff3a8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.346+0000 7ff3bcff9640 1 -- 172.21.15.60:0/1628994897 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3b0044c70 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.525+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ff3c01a04c0 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.525+0000 7ff3bcff9640 1 -- 172.21.15.60:0/1628994897 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7ff3b0041270 con 0x7ff3c0108310 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7ff3ac038f70 msgr2=0x7ff3ac03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 --2- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7ff3ac038f70 0x7ff3ac03b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80098c0 tx=0x7ff3a8006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:09.091 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 msgr2=0x7ff3c019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:09.092 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 --2- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c019b8d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0006f10 tx=0x7ff3b00327d0 comp rx=0 tx=0).stop 2024-09-11T23:50:09.092 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 shutdown_connections 2024-09-11T23:50:09.092 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 --2- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7ff3ac038f70 0x7ff3ac03b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:09.092 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 --2- 172.21.15.60:0/1628994897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3c0108310 0x7ff3c019b8d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:09.092 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 >> 172.21.15.60:0/1628994897 conn(0x7ff3c0101f30 msgr2=0x7ff3c0102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:09.092 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 shutdown_connections 2024-09-11T23:50:09.092 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:08.528+0000 7ff3c5b3c640 1 -- 172.21.15.60:0/1628994897 wait complete. 2024-09-11T23:50:09.092 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling cephadm module... 2024-09-11T23:50:09.841 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:09 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1628994897' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-11T23:50:10.744 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:10 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2211230454' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-11T23:50:10.744 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ignoring --setuser ceph since I am not root 2024-09-11T23:50:10.744 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ignoring --setgroup ceph since I am not root 2024-09-11T23:50:10.744 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:10.646+0000 7fcad549e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:50:10.745 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:10.705+0000 7fcad549e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:50:11.081 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:10.859+0000 7fcad549e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:50:11.082 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:10.929+0000 7fcad549e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:50:11.082 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:11.082+0000 7fcad549e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.461+0000 7fa059986640 1 Processor -- start 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.461+0000 7fa059986640 1 -- start start 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.461+0000 7fa059986640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa054106ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.461+0000 7fa059986640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa054107170 con 0x7fa0541067a0 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.462+0000 7fa052ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa054106ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.462+0000 7fa052ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa054106ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60638/0 (socket says 172.21.15.60:60638) 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.462+0000 7fa052ffd640 1 -- 172.21.15.60:0/452825141 learned_addr learned my addr 172.21.15.60:0/452825141 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.462+0000 7fa052ffd640 1 -- 172.21.15.60:0/452825141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0541079a0 con 0x7fa0541067a0 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.463+0000 7fa052ffd640 1 --2- 172.21.15.60:0/452825141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa054106ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009820 tx=0x7fa04c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e45e0de627c4e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.463+0000 7fa051ffb640 1 -- 172.21.15.60:0/452825141 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c037070 con 0x7fa0541067a0 2024-09-11T23:50:11.125 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.463+0000 7fa051ffb640 1 -- 172.21.15.60:0/452825141 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa04c032920 con 0x7fa0541067a0 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.463+0000 7fa051ffb640 1 -- 172.21.15.60:0/452825141 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c030950 con 0x7fa0541067a0 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.463+0000 7fa059986640 1 -- 172.21.15.60:0/452825141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 msgr2=0x7fa054106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.463+0000 7fa059986640 1 --2- 172.21.15.60:0/452825141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa054106ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa04c009820 tx=0x7fa04c02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.464+0000 7fa059986640 1 -- 172.21.15.60:0/452825141 shutdown_connections 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.464+0000 7fa059986640 1 --2- 172.21.15.60:0/452825141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa054106ba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.464+0000 7fa059986640 1 -- 172.21.15.60:0/452825141 >> 172.21.15.60:0/452825141 conn(0x7fa054101f30 msgr2=0x7fa054104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.464+0000 7fa059986640 1 -- 172.21.15.60:0/452825141 shutdown_connections 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.464+0000 7fa059986640 1 -- 172.21.15.60:0/452825141 wait complete. 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.464+0000 7fa059986640 1 Processor -- start 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.464+0000 7fa059986640 1 -- start start 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa059986640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa0541919a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa059986640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa05410ad50 con 0x7fa0541067a0 2024-09-11T23:50:11.126 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa052ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa0541919a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa052ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa0541919a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60654/0 (socket says 172.21.15.60:60654) 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa052ffd640 1 -- 172.21.15.60:0/2211230454 learned_addr learned my addr 172.21.15.60:0/2211230454 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa052ffd640 1 -- 172.21.15.60:0/2211230454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa054191ee0 con 0x7fa0541067a0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa052ffd640 1 --2- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa0541919a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa04c006f10 tx=0x7fa04c0327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa058984640 1 -- 172.21.15.60:0/2211230454 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c037040 con 0x7fa0541067a0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa058984640 1 -- 172.21.15.60:0/2211230454 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa04c040070 con 0x7fa0541067a0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0541900d0 con 0x7fa0541067a0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.465+0000 7fa058984640 1 -- 172.21.15.60:0/2211230454 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa04c03a610 con 0x7fa0541067a0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.466+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa054190610 con 0x7fa0541067a0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.466+0000 7fa058984640 1 -- 172.21.15.60:0/2211230454 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fa04c03a800 con 0x7fa0541067a0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.466+0000 7fa058984640 1 --2- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fa040038f70 0x7fa04003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.466+0000 7fa058984640 1 -- 172.21.15.60:0/2211230454 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa04c06bfc0 con 0x7fa0541067a0 2024-09-11T23:50:11.127 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.467+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05410aed0 con 0x7fa0541067a0 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.467+0000 7fa0527fc640 1 --2- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fa040038f70 0x7fa04003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.467+0000 7fa0527fc640 1 --2- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fa040038f70 0x7fa04003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0098c0 tx=0x7fa03c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.471+0000 7fa058984640 1 -- 172.21.15.60:0/2211230454 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa04c041270 con 0x7fa0541067a0 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:09.693+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fa054195780 con 0x7fa0541067a0 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.495+0000 7fa058984640 1 -- 172.21.15.60:0/2211230454 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fa04c043bb0 con 0x7fa0541067a0 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.497+0000 7fa058984640 1 -- 172.21.15.60:0/2211230454 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fa04c045980 con 0x7fa0541067a0 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fa040038f70 msgr2=0x7fa04003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 --2- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fa040038f70 0x7fa04003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0098c0 tx=0x7fa03c006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 msgr2=0x7fa0541919a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 --2- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa0541919a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa04c006f10 tx=0x7fa04c0327d0 comp rx=0 tx=0).stop 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 shutdown_connections 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 --2- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fa040038f70 0x7fa04003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 --2- 172.21.15.60:0/2211230454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0541067a0 0x7fa0541919a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:11.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 >> 172.21.15.60:0/2211230454 conn(0x7fa054101f30 msgr2=0x7fa054102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:11.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 shutdown_connections 2024-09-11T23:50:11.129 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:10.499+0000 7fa059986640 1 -- 172.21.15.60:0/2211230454 wait complete. 2024-09-11T23:50:11.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:11.232+0000 7fcad549e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:50:11.630 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:11 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2211230454' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T23:50:11.630 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:11 smithi060 ceph-mon[30953]: mgrmap e5: x(active, since 5s) 2024-09-11T23:50:11.630 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:11.566+0000 7fcad549e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:50:11.630 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:11.630+0000 7fcad549e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:50:12.074 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:11.829+0000 7fcad549e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:50:12.366 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:50:12.366 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.542+0000 7fc98a1f1640 1 Processor -- start 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.542+0000 7fc98a1f1640 1 -- start start 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.542+0000 7fc98a1f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98410a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.542+0000 7fc98a1f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc98407be30 con 0x7fc984108300 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.543+0000 7fc9837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98410a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.543+0000 7fc9837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98410a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42556/0 (socket says 172.21.15.60:42556) 2024-09-11T23:50:12.367 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.543+0000 7fc9837fe640 1 -- 172.21.15.60:0/3247904332 learned_addr learned my addr 172.21.15.60:0/3247904332 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.543+0000 7fc9837fe640 1 -- 172.21.15.60:0/3247904332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98410ac30 con 0x7fc984108300 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.544+0000 7fc9837fe640 1 --2- 172.21.15.60:0/3247904332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98410a6f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc974009820 tx=0x7fc97402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2382cbee325c246 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.544+0000 7fc9827fc640 1 -- 172.21.15.60:0/3247904332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc974037070 con 0x7fc984108300 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.544+0000 7fc9827fc640 1 -- 172.21.15.60:0/3247904332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fc974032920 con 0x7fc984108300 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.544+0000 7fc9827fc640 1 -- 172.21.15.60:0/3247904332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc974030950 con 0x7fc984108300 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.545+0000 7fc98a1f1640 1 -- 172.21.15.60:0/3247904332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 msgr2=0x7fc98410a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.545+0000 7fc98a1f1640 1 --2- 172.21.15.60:0/3247904332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98410a6f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc974009820 tx=0x7fc97402a270 comp rx=0 tx=0).stop 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.545+0000 7fc98a1f1640 1 -- 172.21.15.60:0/3247904332 shutdown_connections 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.545+0000 7fc98a1f1640 1 --2- 172.21.15.60:0/3247904332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98410a6f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.545+0000 7fc98a1f1640 1 -- 172.21.15.60:0/3247904332 >> 172.21.15.60:0/3247904332 conn(0x7fc984101f40 msgr2=0x7fc984104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.545+0000 7fc98a1f1640 1 -- 172.21.15.60:0/3247904332 shutdown_connections 2024-09-11T23:50:12.368 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.545+0000 7fc98a1f1640 1 -- 172.21.15.60:0/3247904332 wait complete. 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.546+0000 7fc98a1f1640 1 Processor -- start 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.546+0000 7fc98a1f1640 1 -- start start 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.546+0000 7fc98a1f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.546+0000 7fc98a1f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc98410bbf0 con 0x7fc984108300 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.546+0000 7fc9837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.546+0000 7fc9837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98419b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42564/0 (socket says 172.21.15.60:42564) 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.546+0000 7fc9837fe640 1 -- 172.21.15.60:0/1467699734 learned_addr learned my addr 172.21.15.60:0/1467699734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.547+0000 7fc9837fe640 1 -- 172.21.15.60:0/1467699734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98419bd10 con 0x7fc984108300 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.547+0000 7fc9837fe640 1 --2- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98419b7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc974031000 tx=0x7fc974032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.547+0000 7fc980ff9640 1 -- 172.21.15.60:0/1467699734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc974042070 con 0x7fc984108300 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.547+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98419c000 con 0x7fc984108300 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.547+0000 7fc980ff9640 1 -- 172.21.15.60:0/1467699734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fc9740326b0 con 0x7fc984108300 2024-09-11T23:50:12.369 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.547+0000 7fc980ff9640 1 -- 172.21.15.60:0/1467699734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc974037040 con 0x7fc984108300 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.547+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98419ec90 con 0x7fc984108300 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.548+0000 7fc980ff9640 1 -- 172.21.15.60:0/1467699734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fc974045070 con 0x7fc984108300 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.548+0000 7fc980ff9640 1 --2- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fc96c038fc0 0x7fc96c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.548+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc984108760 con 0x7fc984108300 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.548+0000 7fc980ff9640 1 -- 172.21.15.60:0/1467699734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc97406cff0 con 0x7fc984108300 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.548+0000 7fc982ffd640 1 -- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fc96c038fc0 msgr2=0x7fc96c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2313774435 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.548+0000 7fc982ffd640 1 --2- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fc96c038fc0 0x7fc96c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.553+0000 7fc980ff9640 1 -- 172.21.15.60:0/1467699734 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc97403cd20 con 0x7fc984108300 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.749+0000 7fc982ffd640 1 -- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fc96c038fc0 msgr2=0x7fc96c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2313774435 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.749+0000 7fc982ffd640 1 --2- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fc96c038fc0 0x7fc96c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.779+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fc98419f440 con 0x7fc984108300 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.779+0000 7fc980ff9640 1 -- 172.21.15.60:0/1467699734 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fc97403c800 con 0x7fc984108300 2024-09-11T23:50:12.370 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.781+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fc96c038fc0 msgr2=0x7fc96c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.781+0000 7fc98a1f1640 1 --2- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fc96c038fc0 0x7fc96c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.781+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 msgr2=0x7fc98419b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.781+0000 7fc98a1f1640 1 --2- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98419b7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc974031000 tx=0x7fc974032e40 comp rx=0 tx=0).stop 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.781+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 shutdown_connections 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.781+0000 7fc98a1f1640 1 --2- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7fc96c038fc0 0x7fc96c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.781+0000 7fc98a1f1640 1 --2- 172.21.15.60:0/1467699734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc984108300 0x7fc98419b7d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.781+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 >> 172.21.15.60:0/1467699734 conn(0x7fc984101f40 msgr2=0x7fc984102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.782+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 shutdown_connections 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:11.782+0000 7fc98a1f1640 1 -- 172.21.15.60:0/1467699734 wait complete. 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2024-09-11T23:50:12.371 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 5... 2024-09-11T23:50:12.636 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:12 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1467699734' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T23:50:12.925 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:12.775+0000 7fcad549e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:50:12.925 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:12.848+0000 7fcad549e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:50:13.877 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:13.605+0000 7fcad549e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:50:13.877 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:13.727+0000 7fcad549e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:50:14.127 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:13.877+0000 7fcad549e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:50:14.128 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:13.941+0000 7fcad549e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:50:14.128 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.097+0000 7fcad549e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:50:14.396 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.168+0000 7fcad549e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:50:14.396 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.231+0000 7fcad549e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:50:14.396 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.396+0000 7fcad549e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:50:14.682 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.464+0000 7fcad549e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:50:14.682 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.534+0000 7fcad549e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:50:14.682 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.620+0000 7fcad549e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:50:14.682 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.682+0000 7fcad549e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:50:15.089 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:14.744+0000 7fcad549e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:50:15.839 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:15.572+0000 7fcad549e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:50:15.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: Active manager daemon x restarted 2024-09-11T23:50:15.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: Activating manager daemon x 2024-09-11T23:50:15.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T23:50:15.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: mgrmap e6: x(active, starting, since 0.00330739s) 2024-09-11T23:50:15.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:15.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:50:15.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: Manager daemon x is now available 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:50:15.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:15 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.718+0000 7f44486f0640 1 Processor -- start 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.719+0000 7f44486f0640 1 -- start start 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.719+0000 7f44486f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f4440106590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.719+0000 7f44486f0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f444007bdb0 con 0x7f4440106190 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.719+0000 7f444648c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f4440106590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:17.107 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.719+0000 7f444648c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f4440106590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42572/0 (socket says 172.21.15.60:42572) 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.719+0000 7f444648c640 1 -- 172.21.15.60:0/1835989797 learned_addr learned my addr 172.21.15.60:0/1835989797 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.719+0000 7f444648c640 1 -- 172.21.15.60:0/1835989797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4440106ad0 con 0x7f4440106190 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.720+0000 7f444648c640 1 --2- 172.21.15.60:0/1835989797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f4440106590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f443c009820 tx=0x7f443c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8fb673b7eb8a36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.720+0000 7f444548a640 1 -- 172.21.15.60:0/1835989797 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443c037070 con 0x7f4440106190 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.720+0000 7f444548a640 1 -- 172.21.15.60:0/1835989797 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f443c032920 con 0x7f4440106190 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.720+0000 7f444548a640 1 -- 172.21.15.60:0/1835989797 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443c030950 con 0x7f4440106190 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.721+0000 7f44486f0640 1 -- 172.21.15.60:0/1835989797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 msgr2=0x7f4440106590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.721+0000 7f44486f0640 1 --2- 172.21.15.60:0/1835989797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f4440106590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f443c009820 tx=0x7f443c02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.721+0000 7f44486f0640 1 -- 172.21.15.60:0/1835989797 shutdown_connections 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.721+0000 7f44486f0640 1 --2- 172.21.15.60:0/1835989797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f4440106590 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.721+0000 7f44486f0640 1 -- 172.21.15.60:0/1835989797 >> 172.21.15.60:0/1835989797 conn(0x7f4440101f20 msgr2=0x7f4440104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:17.108 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.721+0000 7f44486f0640 1 -- 172.21.15.60:0/1835989797 shutdown_connections 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.721+0000 7f44486f0640 1 -- 172.21.15.60:0/1835989797 wait complete. 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.722+0000 7f44486f0640 1 Processor -- start 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.722+0000 7f44486f0640 1 -- start start 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.722+0000 7f44486f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f444019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.722+0000 7f44486f0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4440107bc0 con 0x7f4440106190 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.722+0000 7f444648c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f444019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.722+0000 7f444648c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f444019dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42574/0 (socket says 172.21.15.60:42574) 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.722+0000 7f444648c640 1 -- 172.21.15.60:0/1664082543 learned_addr learned my addr 172.21.15.60:0/1664082543 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.723+0000 7f444648c640 1 -- 172.21.15.60:0/1664082543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444019e010 con 0x7f4440106190 2024-09-11T23:50:17.109 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.723+0000 7f444648c640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f444019dad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f443c031000 tx=0x7f443c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.723+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443c042070 con 0x7f4440106190 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.723+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444019e2a0 con 0x7f4440106190 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.723+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f443c0325f0 con 0x7f4440106190 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.723+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f443c037040 con 0x7f4440106190 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.723+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44401a0f90 con 0x7f4440106190 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.724+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f443c045070 con 0x7f4440106190 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.725+0000 7f44377fe640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 0x7f442c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.725+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 --> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f442c03bb40 con 0x7f442c038f70 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.725+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f443c06c140 con 0x7f4440106190 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.725+0000 7f4445c8b640 1 -- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 msgr2=0x7f442c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2313774435 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.725+0000 7f4445c8b640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 0x7f442c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:17.110 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.926+0000 7f4445c8b640 1 -- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 msgr2=0x7f442c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2313774435 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:12.926+0000 7f4445c8b640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 0x7f442c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:13.327+0000 7f4445c8b640 1 -- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 msgr2=0x7f442c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2313774435 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:13.327+0000 7f4445c8b640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 0x7f442c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:14.128+0000 7f4445c8b640 1 -- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 msgr2=0x7f442c03b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2313774435 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:14.128+0000 7f4445c8b640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 0x7f442c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:15.575+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f443c06acc0 con 0x7f4440106190 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:15.575+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 msgr2=0x7f442c03b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:15.575+0000 7f44377fe640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 0x7f442c03b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.576+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f443c045360 con 0x7f4440106190 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.576+0000 7f44377fe640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f442c03c8a0 0x7f442c03ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.576+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f443c03ee50 con 0x7f442c03c8a0 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.577+0000 7f4445c8b640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f442c03c8a0 0x7f442c03ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:17.111 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.578+0000 7f4445c8b640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f442c03c8a0 0x7f442c03ec90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4430003980 tx=0x7f4430006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.578+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mgr.14118 v2:172.21.15.60:6800/2264238576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f443c03ee50 con 0x7f442c03c8a0 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.585+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4440106590 con 0x7f442c03c8a0 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44377fe640 1 -- 172.21.15.60:0/1664082543 <== mgr.14118 v2:172.21.15.60:6800/2264238576 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f4440106590 con 0x7f442c03c8a0 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f442c03c8a0 msgr2=0x7f442c03ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f442c03c8a0 0x7f442c03ec90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4430003980 tx=0x7f4430006e10 comp rx=0 tx=0).stop 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 msgr2=0x7f444019dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f444019dad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f443c031000 tx=0x7f443c032e40 comp rx=0 tx=0).stop 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 shutdown_connections 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2313774435,v1:172.21.15.60:6801/2313774435] conn(0x7f442c038f70 0x7f442c03b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f442c03c8a0 0x7f442c03ec90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 --2- 172.21.15.60:0/1664082543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4440106190 0x7f444019dad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 >> 172.21.15.60:0/1664082543 conn(0x7f4440101f20 msgr2=0x7f4440191dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:17.112 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 shutdown_connections 2024-09-11T23:50:17.113 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:16.586+0000 7f44486f0640 1 -- 172.21.15.60:0/1664082543 wait complete. 2024-09-11T23:50:17.113 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 5 is available 2024-09-11T23:50:17.113 INFO:teuthology.orchestra.run.smithi060.stdout:Setting orchestrator backend to cephadm... 2024-09-11T23:50:17.473 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:17 smithi060 ceph-mon[30953]: Found migration_current of "None". Setting to last migration. 2024-09-11T23:50:17.473 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:17 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:17.473 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:17 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:17.474 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:17 smithi060 ceph-mon[30953]: mgrmap e7: x(active, since 1.00555s) 2024-09-11T23:50:18.305 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:18.150+0000 7fca41fc3640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:50:18] ENGINE Error in HTTPServer.serve 2024-09-11T23:50:18.305 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: Traceback (most recent call last): 2024-09-11T23:50:18.305 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._connections.run(self.expiration_interval) 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._run(expiration_interval) 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: s = self.context.wrap_socket( 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: return self.sslsocket_class._create( 2024-09-11T23:50:18.306 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:50:18.307 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self.do_handshake() 2024-09-11T23:50:18.307 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:50:18.307 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._sslobj.do_handshake() 2024-09-11T23:50:18.307 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:50:18.307 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:18.307 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.474+0000 7f67d8085640 1 Processor -- start 2024-09-11T23:50:18.312 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.474+0000 7f67d8085640 1 -- start start 2024-09-11T23:50:18.312 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.474+0000 7f67d8085640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d0107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:18.312 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.474+0000 7f67d8085640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0108290 con 0x7f67d01078c0 2024-09-11T23:50:18.312 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.474+0000 7f67d5e21640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d0107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:18.312 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.474+0000 7f67d5e21640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d0107cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42642/0 (socket says 172.21.15.60:42642) 2024-09-11T23:50:18.312 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.474+0000 7f67d5e21640 1 -- 172.21.15.60:0/3228830106 learned_addr learned my addr 172.21.15.60:0/3228830106 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:18.312 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.475+0000 7f67d5e21640 1 -- 172.21.15.60:0/3228830106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d0108a70 con 0x7f67d01078c0 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.475+0000 7f67d5e21640 1 --2- 172.21.15.60:0/3228830106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d0107cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009820 tx=0x7f67cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25489f9df0aca737 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d4e1f640 1 -- 172.21.15.60:0/3228830106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc037070 con 0x7f67d01078c0 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d4e1f640 1 -- 172.21.15.60:0/3228830106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f67cc032920 con 0x7f67d01078c0 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d4e1f640 1 -- 172.21.15.60:0/3228830106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc030950 con 0x7f67d01078c0 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d8085640 1 -- 172.21.15.60:0/3228830106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 msgr2=0x7f67d0107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d8085640 1 --2- 172.21.15.60:0/3228830106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d0107cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009820 tx=0x7f67cc02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d8085640 1 -- 172.21.15.60:0/3228830106 shutdown_connections 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d8085640 1 --2- 172.21.15.60:0/3228830106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d0107cc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d8085640 1 -- 172.21.15.60:0/3228830106 >> 172.21.15.60:0/3228830106 conn(0x7f67d0103050 msgr2=0x7f67d0105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d8085640 1 -- 172.21.15.60:0/3228830106 shutdown_connections 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.476+0000 7f67d8085640 1 -- 172.21.15.60:0/3228830106 wait complete. 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.477+0000 7f67d8085640 1 Processor -- start 2024-09-11T23:50:18.313 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.477+0000 7f67d8085640 1 -- start start 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.477+0000 7f67d8085640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d007db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.477+0000 7f67d8085640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67d010be20 con 0x7f67d01078c0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.477+0000 7f67d5e21640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d007db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.477+0000 7f67d5e21640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d007db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42652/0 (socket says 172.21.15.60:42652) 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.477+0000 7f67d5e21640 1 -- 172.21.15.60:0/2626530249 learned_addr learned my addr 172.21.15.60:0/2626530249 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.478+0000 7f67d5e21640 1 -- 172.21.15.60:0/2626530249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d007e050 con 0x7f67d01078c0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.478+0000 7f67d5e21640 1 --2- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d007db10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009940 tx=0x7f67cc032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.478+0000 7f67c6ffd640 1 -- 172.21.15.60:0/2626530249 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc042070 con 0x7f67d01078c0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.478+0000 7f67c6ffd640 1 -- 172.21.15.60:0/2626530249 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f67cc0326b0 con 0x7f67d01078c0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.478+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d007c240 con 0x7f67d01078c0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.478+0000 7f67c6ffd640 1 -- 172.21.15.60:0/2626530249 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67cc037040 con 0x7f67d01078c0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.478+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d007c780 con 0x7f67d01078c0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.479+0000 7f67c6ffd640 1 -- 172.21.15.60:0/2626530249 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f67cc045070 con 0x7f67d01078c0 2024-09-11T23:50:18.314 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.479+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d010bfa0 con 0x7f67d01078c0 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.479+0000 7f67c6ffd640 1 --2- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f67bc038eb0 0x7f67bc03b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.480+0000 7f67c6ffd640 1 -- 172.21.15.60:0/2626530249 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f67cc06bd50 con 0x7f67d01078c0 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.480+0000 7f67d5620640 1 --2- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f67bc038eb0 0x7f67bc03b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.480+0000 7f67d5620640 1 --2- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f67bc038eb0 0x7f67bc03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f67c00098c0 tx=0x7f67c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.489+0000 7f67c6ffd640 1 -- 172.21.15.60:0/2626530249 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67cc045360 con 0x7f67d01078c0 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.707+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f67d007cfa0 con 0x7f67bc038eb0 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.711+0000 7f67c6ffd640 1 -- 172.21.15.60:0/2626530249 <== mgr.14118 v2:172.21.15.60:6800/2264238576 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f67d007cfa0 con 0x7f67bc038eb0 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f67bc038eb0 msgr2=0x7f67bc03b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 --2- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f67bc038eb0 0x7f67bc03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f67c00098c0 tx=0x7f67c0006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 msgr2=0x7f67d007db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 --2- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d007db10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009940 tx=0x7f67cc032e40 comp rx=0 tx=0).stop 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 shutdown_connections 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 --2- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f67bc038eb0 0x7f67bc03b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:18.315 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 --2- 172.21.15.60:0/2626530249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67d01078c0 0x7f67d007db10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:18.316 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 >> 172.21.15.60:0/2626530249 conn(0x7f67d0103050 msgr2=0x7f67d0103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:18.316 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 shutdown_connections 2024-09-11T23:50:18.316 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:17.714+0000 7f67d8085640 1 -- 172.21.15.60:0/2626530249 wait complete. 2024-09-11T23:50:18.565 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-mon[30953]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T23:50:18.565 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-mon[30953]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T23:50:18.565 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:18.565 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:18.565 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:18 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:19 smithi060 ceph-mon[30953]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:19 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:18] ENGINE Bus STARTING 2024-09-11T23:50:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:19 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:18] ENGINE Serving on https://172.21.15.60:7150 2024-09-11T23:50:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:19 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:18] ENGINE Error in HTTPServer.serve 2024-09-11T23:50:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout: Traceback (most recent call last): 2024-09-11T23:50:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._run(expiration_interval) 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: s = self.context.wrap_socket( 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: return self.sslsocket_class._create( 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: self.do_handshake() 2024-09-11T23:50:19.590 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:50:19.591 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._sslobj.do_handshake() 2024-09-11T23:50:19.591 INFO:journalctl@ceph.mon.a.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:50:19.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:19 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:18] ENGINE Serving on http://172.21.15.60:8765 2024-09-11T23:50:19.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:19 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:18] ENGINE Bus STARTED 2024-09-11T23:50:19.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:19 smithi060 ceph-mon[30953]: mgrmap e8: x(active, since 2s) 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.740+0000 7f341239a640 1 Processor -- start 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.740+0000 7f341239a640 1 -- start start 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.741+0000 7f341239a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c10c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.741+0000 7f341239a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f340c10cd60 con 0x7f340c07c4a0 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.741+0000 7f340bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c10c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.741+0000 7f340bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c10c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42654/0 (socket says 172.21.15.60:42654) 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.741+0000 7f340bfff640 1 -- 172.21.15.60:0/1820081813 learned_addr learned my addr 172.21.15.60:0/1820081813 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.741+0000 7f340bfff640 1 -- 172.21.15.60:0/1820081813 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c10cee0 con 0x7f340c07c4a0 2024-09-11T23:50:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.742+0000 7f340bfff640 1 --2- 172.21.15.60:0/1820081813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c10c820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009820 tx=0x7f33fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150fe31e37d09993 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.742+0000 7f340b7fe640 1 -- 172.21.15.60:0/1820081813 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc037070 con 0x7f340c07c4a0 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.742+0000 7f340b7fe640 1 -- 172.21.15.60:0/1820081813 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f33fc032920 con 0x7f340c07c4a0 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.742+0000 7f340b7fe640 1 -- 172.21.15.60:0/1820081813 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc030950 con 0x7f340c07c4a0 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 -- 172.21.15.60:0/1820081813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 msgr2=0x7f340c10c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 --2- 172.21.15.60:0/1820081813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c10c820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009820 tx=0x7f33fc02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 -- 172.21.15.60:0/1820081813 shutdown_connections 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 --2- 172.21.15.60:0/1820081813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c10c820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 -- 172.21.15.60:0/1820081813 >> 172.21.15.60:0/1820081813 conn(0x7f340c101fb0 msgr2=0x7f340c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 -- 172.21.15.60:0/1820081813 shutdown_connections 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 -- 172.21.15.60:0/1820081813 wait complete. 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 Processor -- start 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.743+0000 7f341239a640 1 -- start start 2024-09-11T23:50:19.688 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f341239a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c19da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f341239a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f340c10deb0 con 0x7f340c07c4a0 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f340bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c19da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f340bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c19da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42660/0 (socket says 172.21.15.60:42660) 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f340bfff640 1 -- 172.21.15.60:0/2251572213 learned_addr learned my addr 172.21.15.60:0/2251572213 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f340bfff640 1 -- 172.21.15.60:0/2251572213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c19dfb0 con 0x7f340c07c4a0 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f340bfff640 1 --2- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c19da70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0097f0 tx=0x7f33fc032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f3409ffb640 1 -- 172.21.15.60:0/2251572213 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc037040 con 0x7f340c07c4a0 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f3409ffb640 1 -- 172.21.15.60:0/2251572213 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f33fc040070 con 0x7f340c07c4a0 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c19e240 con 0x7f340c07c4a0 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f3409ffb640 1 -- 172.21.15.60:0/2251572213 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33fc03a6d0 con 0x7f340c07c4a0 2024-09-11T23:50:19.689 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.744+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c1a0f30 con 0x7f340c07c4a0 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.745+0000 7f3409ffb640 1 -- 172.21.15.60:0/2251572213 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f33fc03a8c0 con 0x7f340c07c4a0 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.745+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340c10c8a0 con 0x7f340c07c4a0 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.745+0000 7f3409ffb640 1 --2- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f33f8038f70 0x7f33f803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.746+0000 7f3409ffb640 1 -- 172.21.15.60:0/2251572213 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f33fc06c400 con 0x7f340c07c4a0 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.746+0000 7f3403fff640 1 --2- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f33f8038f70 0x7f33f803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.746+0000 7f3403fff640 1 --2- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f33f8038f70 0x7f33f803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f33f40098c0 tx=0x7f33f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.750+0000 7f3409ffb640 1 -- 172.21.15.60:0/2251572213 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33fc0315e0 con 0x7f340c07c4a0 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.933+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f340c103240 con 0x7f33f8038f70 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.934+0000 7f3409ffb640 1 -- 172.21.15.60:0/2251572213 <== mgr.14118 v2:172.21.15.60:6800/2264238576 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f340c103240 con 0x7f33f8038f70 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f33f8038f70 msgr2=0x7f33f803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 --2- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f33f8038f70 0x7f33f803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f33f40098c0 tx=0x7f33f4006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 msgr2=0x7f340c19da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 --2- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c19da70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0097f0 tx=0x7f33fc032d00 comp rx=0 tx=0).stop 2024-09-11T23:50:19.690 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 shutdown_connections 2024-09-11T23:50:19.691 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 --2- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f33f8038f70 0x7f33f803b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:19.691 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 --2- 172.21.15.60:0/2251572213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c07c4a0 0x7f340c19da70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:19.691 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 >> 172.21.15.60:0/2251572213 conn(0x7f340c101fb0 msgr2=0x7f340c102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:19.691 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 shutdown_connections 2024-09-11T23:50:19.691 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:18.936+0000 7f341239a640 1 -- 172.21.15.60:0/2251572213 wait complete. 2024-09-11T23:50:19.691 INFO:teuthology.orchestra.run.smithi060.stdout:Generating ssh key... 2024-09-11T23:50:20.491 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-mon[30953]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: Generating public/private rsa key pair. 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: Your identification has been saved in /tmp/tmphor82_pw/key 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: Your public key has been saved in /tmp/tmphor82_pw/key.pub 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: The key fingerprint is: 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: SHA256:RozFS+iivW+uByzZfgvXO/fIaDnSt6kAMGYlOOQI9fA ceph-6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: The key's randomart image is: 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: +---[RSA 3072]----+ 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: |o++ . o. | 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: |* * .+o | 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: |.o= E...o. | 2024-09-11T23:50:20.793 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: | o o. ... | 2024-09-11T23:50:20.794 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: | *.. S | 2024-09-11T23:50:20.794 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: | + =. o | 2024-09-11T23:50:20.794 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: | o.oo... | 2024-09-11T23:50:20.794 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: | oo=.*+oo | 2024-09-11T23:50:20.794 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: | .B+++*=o. | 2024-09-11T23:50:20.794 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: +----[SHA256]-----+ 2024-09-11T23:50:21.086 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.023+0000 7f68abdd4640 1 Processor -- start 2024-09-11T23:50:21.086 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.023+0000 7f68abdd4640 1 -- start start 2024-09-11T23:50:21.086 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.023+0000 7f68abdd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a410a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:21.086 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.023+0000 7f68abdd4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68a407be30 con 0x7f68a41082e0 2024-09-11T23:50:21.086 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.023+0000 7f68a9b70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a410a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:21.086 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.024+0000 7f68a9b70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a410a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42662/0 (socket says 172.21.15.60:42662) 2024-09-11T23:50:21.086 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.024+0000 7f68a9b70640 1 -- 172.21.15.60:0/3186619892 learned_addr learned my addr 172.21.15.60:0/3186619892 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:21.086 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.024+0000 7f68a9b70640 1 -- 172.21.15.60:0/3186619892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a410ac10 con 0x7f68a41082e0 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.024+0000 7f68a9b70640 1 --2- 172.21.15.60:0/3186619892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a410a6d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6894009820 tx=0x7f689402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d916f47f7fe6ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68a8b6e640 1 -- 172.21.15.60:0/3186619892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6894037070 con 0x7f68a41082e0 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68a8b6e640 1 -- 172.21.15.60:0/3186619892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6894032920 con 0x7f68a41082e0 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68a8b6e640 1 -- 172.21.15.60:0/3186619892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6894030950 con 0x7f68a41082e0 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68abdd4640 1 -- 172.21.15.60:0/3186619892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 msgr2=0x7f68a410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68abdd4640 1 --2- 172.21.15.60:0/3186619892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a410a6d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6894009820 tx=0x7f689402a270 comp rx=0 tx=0).stop 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68abdd4640 1 -- 172.21.15.60:0/3186619892 shutdown_connections 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68abdd4640 1 --2- 172.21.15.60:0/3186619892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a410a6d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68abdd4640 1 -- 172.21.15.60:0/3186619892 >> 172.21.15.60:0/3186619892 conn(0x7f68a4101f20 msgr2=0x7f68a4104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68abdd4640 1 -- 172.21.15.60:0/3186619892 shutdown_connections 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.025+0000 7f68abdd4640 1 -- 172.21.15.60:0/3186619892 wait complete. 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.026+0000 7f68abdd4640 1 Processor -- start 2024-09-11T23:50:21.087 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.026+0000 7f68abdd4640 1 -- start start 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.026+0000 7f68abdd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a4107b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.026+0000 7f68abdd4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68a410bbd0 con 0x7f68a41082e0 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.026+0000 7f68a9b70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a4107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.026+0000 7f68a9b70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a4107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42676/0 (socket says 172.21.15.60:42676) 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.026+0000 7f68a9b70640 1 -- 172.21.15.60:0/604231338 learned_addr learned my addr 172.21.15.60:0/604231338 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.027+0000 7f68a9b70640 1 -- 172.21.15.60:0/604231338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a41080a0 con 0x7f68a41082e0 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.027+0000 7f68a9b70640 1 --2- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a4107b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6894031000 tx=0x7f6894032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.027+0000 7f689affd640 1 -- 172.21.15.60:0/604231338 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6894042070 con 0x7f68a41082e0 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.027+0000 7f689affd640 1 -- 172.21.15.60:0/604231338 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f68940326b0 con 0x7f68a41082e0 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.027+0000 7f689affd640 1 -- 172.21.15.60:0/604231338 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6894037040 con 0x7f68a41082e0 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.027+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a4106290 con 0x7f68a41082e0 2024-09-11T23:50:21.088 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.027+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a41067d0 con 0x7f68a41082e0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.028+0000 7f689affd640 1 -- 172.21.15.60:0/604231338 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6894045070 con 0x7f68a41082e0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.028+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a4108740 con 0x7f68a41082e0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.028+0000 7f689affd640 1 --2- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6890038fc0 0x7f689003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.028+0000 7f689affd640 1 -- 172.21.15.60:0/604231338 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f689406bf30 con 0x7f68a41082e0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.028+0000 7f68a936f640 1 --2- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6890038fc0 0x7f689003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.029+0000 7f68a936f640 1 --2- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6890038fc0 0x7f689003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68a00098c0 tx=0x7f68a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.033+0000 7f689affd640 1 -- 172.21.15.60:0/604231338 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6894043260 con 0x7f68a41082e0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.210+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f68a41031f0 con 0x7f6890038fc0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.497+0000 7f689affd640 1 -- 172.21.15.60:0/604231338 <== mgr.14118 v2:172.21.15.60:6800/2264238576 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f68a41031f0 con 0x7f6890038fc0 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.499+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6890038fc0 msgr2=0x7f689003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.499+0000 7f68abdd4640 1 --2- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6890038fc0 0x7f689003b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f68a00098c0 tx=0x7f68a0006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:21.089 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.499+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 msgr2=0x7f68a4107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:21.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.499+0000 7f68abdd4640 1 --2- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a4107b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6894031000 tx=0x7f6894032e40 comp rx=0 tx=0).stop 2024-09-11T23:50:21.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.499+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 shutdown_connections 2024-09-11T23:50:21.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.499+0000 7f68abdd4640 1 --2- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6890038fc0 0x7f689003b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:21.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.499+0000 7f68abdd4640 1 --2- 172.21.15.60:0/604231338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a41082e0 0x7f68a4107b60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:21.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.499+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 >> 172.21.15.60:0/604231338 conn(0x7f68a4101f20 msgr2=0x7f68a4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:21.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.500+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 shutdown_connections 2024-09-11T23:50:21.090 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:20.500+0000 7f68abdd4640 1 -- 172.21.15.60:0/604231338 wait complete. 2024-09-11T23:50:21.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:21 smithi060 ceph-mon[30953]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:21.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:21 smithi060 ceph-mon[30953]: Generating ssh key... 2024-09-11T23:50:21.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:21 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:21.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:21 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:22.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxymKSF2E4Yqfuif0iw9oMs93dWqFTFzWsv/yTGijfD27hSsp+gi6asCMzChSbRPScOxWvwWxRM3ChfuooUiT8tP9ngqpwagtp5ycOn+aH5Ja39BRWCdaVt8pPrYmX9RhwpJ6ZO7AE46alkvPJ34b69qwZyWUX9VsMOfFRX3ZD/VTbrIiYjSJmKadDS172kNYlpy7Ep12O4JODmt56zeDwYGEbo45gbzA9vNOJh6Nr9/dcPNke3UIs3SNgBPzcW53mDbSxDe6cDgGihQNwACZnQdZlJe6fZ72yexcPONnLq7tL8rrEf9GTPUcgwXr/zGvyYI5uEdvGR5aVM5f3navb+fHvC3u+89OlsumVSMXS4ZvVVwnGo2JyEqkXoFR+YF9k3piPMNZjzxbIORChiWLV5hwO6gxiI/suA3rZTb6azDeVl0sDDRb1/Bku2KN7YaJ1DAWelDo/ZOFTu2B4BHF5+Tdl/7tEAX5/5eZq7prYhlUu9xMutLpuVrNhoPQwxE= ceph-6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:22.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.406+0000 7f652dbba640 1 Processor -- start 2024-09-11T23:50:22.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.406+0000 7f652dbba640 1 -- start start 2024-09-11T23:50:22.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.406+0000 7f652dbba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:22.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.406+0000 7f652dbba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f652807c850 con 0x7f652807de20 2024-09-11T23:50:22.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.406+0000 7f65277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:22.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.406+0000 7f65277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42678/0 (socket says 172.21.15.60:42678) 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.406+0000 7f65277fe640 1 -- 172.21.15.60:0/2000804758 learned_addr learned my addr 172.21.15.60:0/2000804758 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.406+0000 7f65277fe640 1 -- 172.21.15.60:0/2000804758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652807c9d0 con 0x7f652807de20 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.407+0000 7f65277fe640 1 --2- 172.21.15.60:0/2000804758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652807c280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6518009820 tx=0x7f651802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a95c0b830e9304a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.407+0000 7f65267fc640 1 -- 172.21.15.60:0/2000804758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518037070 con 0x7f652807de20 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.407+0000 7f65267fc640 1 -- 172.21.15.60:0/2000804758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6518032920 con 0x7f652807de20 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.407+0000 7f65267fc640 1 -- 172.21.15.60:0/2000804758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518030950 con 0x7f652807de20 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.408+0000 7f652dbba640 1 -- 172.21.15.60:0/2000804758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 msgr2=0x7f652807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.408+0000 7f652dbba640 1 --2- 172.21.15.60:0/2000804758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652807c280 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6518009820 tx=0x7f651802a270 comp rx=0 tx=0).stop 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.408+0000 7f652dbba640 1 -- 172.21.15.60:0/2000804758 shutdown_connections 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.408+0000 7f652dbba640 1 --2- 172.21.15.60:0/2000804758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652807c280 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.408+0000 7f652dbba640 1 -- 172.21.15.60:0/2000804758 >> 172.21.15.60:0/2000804758 conn(0x7f6528103020 msgr2=0x7f6528105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:22.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.408+0000 7f652dbba640 1 -- 172.21.15.60:0/2000804758 shutdown_connections 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.408+0000 7f652dbba640 1 -- 172.21.15.60:0/2000804758 wait complete. 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.409+0000 7f652dbba640 1 Processor -- start 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.409+0000 7f652dbba640 1 -- start start 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.409+0000 7f652dbba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.409+0000 7f652dbba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f652810de80 con 0x7f652807de20 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.409+0000 7f65277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.409+0000 7f65277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42694/0 (socket says 172.21.15.60:42694) 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.409+0000 7f65277fe640 1 -- 172.21.15.60:0/1135392292 learned_addr learned my addr 172.21.15.60:0/1135392292 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.409+0000 7f65277fe640 1 -- 172.21.15.60:0/1135392292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652819dfa0 con 0x7f652807de20 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.410+0000 7f65277fe640 1 --2- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652819da60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6518031000 tx=0x7f6518032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.410+0000 7f6524ff9640 1 -- 172.21.15.60:0/1135392292 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518042070 con 0x7f652807de20 2024-09-11T23:50:22.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.410+0000 7f6524ff9640 1 -- 172.21.15.60:0/1135392292 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f65180326b0 con 0x7f652807de20 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.410+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652819e230 con 0x7f652807de20 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.410+0000 7f6524ff9640 1 -- 172.21.15.60:0/1135392292 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518037040 con 0x7f652807de20 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.410+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65281a0f20 con 0x7f652807de20 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.411+0000 7f6524ff9640 1 -- 172.21.15.60:0/1135392292 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6518045070 con 0x7f652807de20 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.411+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652807c300 con 0x7f652807de20 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.411+0000 7f6524ff9640 1 --2- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6510038fc0 0x7f651003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.411+0000 7f6524ff9640 1 -- 172.21.15.60:0/1135392292 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f651806c040 con 0x7f652807de20 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.411+0000 7f6526ffd640 1 --2- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6510038fc0 0x7f651003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.412+0000 7f6526ffd640 1 --2- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6510038fc0 0x7f651003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f651c0098c0 tx=0x7f651c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.416+0000 7f6524ff9640 1 -- 172.21.15.60:0/1135392292 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6518045360 con 0x7f652807de20 2024-09-11T23:50:22.146 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.592+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6528104300 con 0x7f6510038fc0 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.593+0000 7f6524ff9640 1 -- 172.21.15.60:0/1135392292 <== mgr.14118 v2:172.21.15.60:6800/2264238576 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f6528104300 con 0x7f6510038fc0 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6510038fc0 msgr2=0x7f651003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 --2- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6510038fc0 0x7f651003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f651c0098c0 tx=0x7f651c006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 msgr2=0x7f652819da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 --2- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652819da60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6518031000 tx=0x7f6518032e40 comp rx=0 tx=0).stop 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 shutdown_connections 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 --2- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f6510038fc0 0x7f651003b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 --2- 172.21.15.60:0/1135392292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f652807de20 0x7f652819da60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 >> 172.21.15.60:0/1135392292 conn(0x7f6528103020 msgr2=0x7f6528103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 shutdown_connections 2024-09-11T23:50:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:21.595+0000 7f652dbba640 1 -- 172.21.15.60:0/1135392292 wait complete. 2024-09-11T23:50:22.148 INFO:teuthology.orchestra.run.smithi060.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T23:50:22.148 INFO:teuthology.orchestra.run.smithi060.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T23:50:22.149 INFO:teuthology.orchestra.run.smithi060.stdout:Adding host smithi060... 2024-09-11T23:50:22.734 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:22 smithi060 ceph-mon[30953]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:23.906 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:23 smithi060 ceph-mon[30953]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "addr": "172.21.15.60", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:24.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:24 smithi060 ceph-mon[30953]: Deploying cephadm binary to smithi060 2024-09-11T23:50:27.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Added host 'smithi060' with addr '172.21.15.60' 2024-09-11T23:50:27.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.546+0000 7fe3ecd87640 1 Processor -- start 2024-09-11T23:50:27.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.546+0000 7fe3ecd87640 1 -- start start 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.546+0000 7fe3ecd87640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8106b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.546+0000 7fe3ecd87640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e8107140 con 0x7fe3e8106770 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.547+0000 7fe3e659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8106b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.547+0000 7fe3e659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8106b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36506/0 (socket says 172.21.15.60:36506) 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.547+0000 7fe3e659c640 1 -- 172.21.15.60:0/3290828134 learned_addr learned my addr 172.21.15.60:0/3290828134 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.547+0000 7fe3e659c640 1 -- 172.21.15.60:0/3290828134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e8107970 con 0x7fe3e8106770 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.548+0000 7fe3e659c640 1 --2- 172.21.15.60:0/3290828134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8106b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000bac0 tx=0x7fe3e002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dca560a068659e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.548+0000 7fe3e559a640 1 -- 172.21.15.60:0/3290828134 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e00326d0 con 0x7fe3e8106770 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.548+0000 7fe3e559a640 1 -- 172.21.15.60:0/3290828134 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fe3e0038070 con 0x7fe3e8106770 2024-09-11T23:50:27.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.548+0000 7fe3e559a640 1 -- 172.21.15.60:0/3290828134 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0033e00 con 0x7fe3e8106770 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.548+0000 7fe3ecd87640 1 -- 172.21.15.60:0/3290828134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 msgr2=0x7fe3e8106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.548+0000 7fe3ecd87640 1 --2- 172.21.15.60:0/3290828134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8106b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000bac0 tx=0x7fe3e002c920 comp rx=0 tx=0).stop 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.549+0000 7fe3ecd87640 1 -- 172.21.15.60:0/3290828134 shutdown_connections 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.549+0000 7fe3ecd87640 1 --2- 172.21.15.60:0/3290828134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8106b70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.549+0000 7fe3ecd87640 1 -- 172.21.15.60:0/3290828134 >> 172.21.15.60:0/3290828134 conn(0x7fe3e8101f40 msgr2=0x7fe3e8104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.549+0000 7fe3ecd87640 1 -- 172.21.15.60:0/3290828134 shutdown_connections 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.549+0000 7fe3ecd87640 1 -- 172.21.15.60:0/3290828134 wait complete. 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.549+0000 7fe3ecd87640 1 Processor -- start 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.549+0000 7fe3ecd87640 1 -- start start 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3ecd87640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3ecd87640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e807b0f0 con 0x7fe3e8106770 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3e659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:27.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3e659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36516/0 (socket says 172.21.15.60:36516) 2024-09-11T23:50:27.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3e659c640 1 -- 172.21.15.60:0/933527037 learned_addr learned my addr 172.21.15.60:0/933527037 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:27.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3e659c640 1 -- 172.21.15.60:0/933527037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e8199bd0 con 0x7fe3e8106770 2024-09-11T23:50:27.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3e659c640 1 --2- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8199690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000b2c0 tx=0x7fe3e0032910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:27.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3df7fe640 1 -- 172.21.15.60:0/933527037 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0042070 con 0x7fe3e8106770 2024-09-11T23:50:27.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3df7fe640 1 -- 172.21.15.60:0/933527037 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fe3e0031950 con 0x7fe3e8106770 2024-09-11T23:50:27.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3df7fe640 1 -- 172.21.15.60:0/933527037 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e003c9a0 con 0x7fe3e8106770 2024-09-11T23:50:27.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.550+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e8199e60 con 0x7fe3e8106770 2024-09-11T23:50:27.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.551+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e819cb50 con 0x7fe3e8106770 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.551+0000 7fe3df7fe640 1 -- 172.21.15.60:0/933527037 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe3e004d060 con 0x7fe3e8106770 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.551+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e8106b70 con 0x7fe3e8106770 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.552+0000 7fe3df7fe640 1 --2- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe3d4038fc0 0x7fe3d403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.552+0000 7fe3df7fe640 1 -- 172.21.15.60:0/933527037 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe3e0030050 con 0x7fe3e8106770 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.552+0000 7fe3e5d9b640 1 --2- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe3d4038fc0 0x7fe3d403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.552+0000 7fe3e5d9b640 1 --2- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe3d4038fc0 0x7fe3d403b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00098c0 tx=0x7fe3d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.557+0000 7fe3df7fe640 1 -- 172.21.15.60:0/933527037 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe3e0042210 con 0x7fe3e8106770 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:22.735+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi060", "addr": "172.21.15.60", "target": ["mon-mgr", ""]}) -- 0x7fe3e8062630 con 0x7fe3d4038fc0 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.621+0000 7fe3df7fe640 1 -- 172.21.15.60:0/933527037 <== mgr.14118 v2:172.21.15.60:6800/2264238576 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fe3e8062630 con 0x7fe3d4038fc0 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe3d4038fc0 msgr2=0x7fe3d403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:27.197 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 --2- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe3d4038fc0 0x7fe3d403b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00098c0 tx=0x7fe3d0006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 msgr2=0x7fe3e8199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 --2- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8199690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000b2c0 tx=0x7fe3e0032910 comp rx=0 tx=0).stop 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 shutdown_connections 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 --2- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe3d4038fc0 0x7fe3d403b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 --2- 172.21.15.60:0/933527037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e8106770 0x7fe3e8199690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 >> 172.21.15.60:0/933527037 conn(0x7fe3e8101f40 msgr2=0x7fe3e818fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 shutdown_connections 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:26.624+0000 7fe3ecd87640 1 -- 172.21.15.60:0/933527037 wait complete. 2024-09-11T23:50:27.198 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying unmanaged mon service... 2024-09-11T23:50:27.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:27 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:27.764 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:27 smithi060 ceph-mon[30953]: Added host smithi060 2024-09-11T23:50:27.765 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:27 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:28.486 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.555+0000 7f082fc3b640 1 Processor -- start 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.555+0000 7f082fc3b640 1 -- start start 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.556+0000 7f082fc3b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f082810a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.556+0000 7f082fc3b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f082807bdb0 con 0x7f08281083b0 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.556+0000 7f082d9d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f082810a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.556+0000 7f082d9d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f082810a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36520/0 (socket says 172.21.15.60:36520) 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.556+0000 7f082d9d7640 1 -- 172.21.15.60:0/7641963 learned_addr learned my addr 172.21.15.60:0/7641963 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.556+0000 7f082d9d7640 1 -- 172.21.15.60:0/7641963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082810ace0 con 0x7f08281083b0 2024-09-11T23:50:28.487 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.557+0000 7f082d9d7640 1 --2- 172.21.15.60:0/7641963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f082810a7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0824009820 tx=0x7f082402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47e99985534ea73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.557+0000 7f082c9d5640 1 -- 172.21.15.60:0/7641963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0824037070 con 0x7f08281083b0 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.557+0000 7f082c9d5640 1 -- 172.21.15.60:0/7641963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0824032920 con 0x7f08281083b0 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.557+0000 7f082c9d5640 1 -- 172.21.15.60:0/7641963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0824030950 con 0x7f08281083b0 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.558+0000 7f082fc3b640 1 -- 172.21.15.60:0/7641963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 msgr2=0x7f082810a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.558+0000 7f082fc3b640 1 --2- 172.21.15.60:0/7641963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f082810a7a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0824009820 tx=0x7f082402a270 comp rx=0 tx=0).stop 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.558+0000 7f082fc3b640 1 -- 172.21.15.60:0/7641963 shutdown_connections 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.558+0000 7f082fc3b640 1 --2- 172.21.15.60:0/7641963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f082810a7a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.558+0000 7f082fc3b640 1 -- 172.21.15.60:0/7641963 >> 172.21.15.60:0/7641963 conn(0x7f0828101f30 msgr2=0x7f0828104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.558+0000 7f082fc3b640 1 -- 172.21.15.60:0/7641963 shutdown_connections 2024-09-11T23:50:28.488 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.558+0000 7f082fc3b640 1 -- 172.21.15.60:0/7641963 wait complete. 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.558+0000 7f082fc3b640 1 Processor -- start 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082fc3b640 1 -- start start 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082fc3b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f0828107c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082fc3b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f082810bcb0 con 0x7f08281083b0 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082d9d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f0828107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082d9d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f0828107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36534/0 (socket says 172.21.15.60:36534) 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082d9d7640 1 -- 172.21.15.60:0/685718564 learned_addr learned my addr 172.21.15.60:0/685718564 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082d9d7640 1 -- 172.21.15.60:0/685718564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0828108170 con 0x7f08281083b0 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082d9d7640 1 --2- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f0828107c30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0824006f10 tx=0x7f08240327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f081effd640 1 -- 172.21.15.60:0/685718564 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0824037040 con 0x7f08281083b0 2024-09-11T23:50:28.489 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0828106360 con 0x7f08281083b0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f081effd640 1 -- 172.21.15.60:0/685718564 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0824040070 con 0x7f08281083b0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.559+0000 7f081effd640 1 -- 172.21.15.60:0/685718564 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082403a630 con 0x7f08281083b0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.560+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08281068a0 con 0x7f08281083b0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.560+0000 7f081effd640 1 -- 172.21.15.60:0/685718564 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f082403b420 con 0x7f08281083b0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.560+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0828108810 con 0x7f08281083b0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.561+0000 7f081effd640 1 --2- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f0814038f70 0x7f081403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.561+0000 7f081effd640 1 -- 172.21.15.60:0/685718564 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f082406c3e0 con 0x7f08281083b0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.561+0000 7f082d1d6640 1 --2- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f0814038f70 0x7f081403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.561+0000 7f082d1d6640 1 --2- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f0814038f70 0x7f081403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f08180098c0 tx=0x7f0818006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.566+0000 7f081effd640 1 -- 172.21.15.60:0/685718564 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0824043360 con 0x7f08281083b0 2024-09-11T23:50:28.490 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.764+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f0828107150 con 0x7f0814038f70 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.769+0000 7f081effd640 1 -- 172.21.15.60:0/685718564 <== mgr.14118 v2:172.21.15.60:6800/2264238576 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0828107150 con 0x7f0814038f70 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.771+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f0814038f70 msgr2=0x7f081403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.771+0000 7f082fc3b640 1 --2- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f0814038f70 0x7f081403b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f08180098c0 tx=0x7f0818006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.771+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 msgr2=0x7f0828107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.771+0000 7f082fc3b640 1 --2- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f0828107c30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0824006f10 tx=0x7f08240327d0 comp rx=0 tx=0).stop 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.771+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 shutdown_connections 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.771+0000 7f082fc3b640 1 --2- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f0814038f70 0x7f081403b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.771+0000 7f082fc3b640 1 --2- 172.21.15.60:0/685718564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08281083b0 0x7f0828107c30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.771+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 >> 172.21.15.60:0/685718564 conn(0x7f0828101f30 msgr2=0x7f0828102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.772+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 shutdown_connections 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:27.772+0000 7f082fc3b640 1 -- 172.21.15.60:0/685718564 wait complete. 2024-09-11T23:50:28.491 INFO:teuthology.orchestra.run.smithi060.stdout:Deploying unmanaged mgr service... 2024-09-11T23:50:29.071 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:28 smithi060 ceph-mon[30953]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:29.071 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:28 smithi060 ceph-mon[30953]: Saving service mon spec with placement count:5 2024-09-11T23:50:29.071 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:28 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:30.298 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T23:50:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.890+0000 7f2e81b50640 1 Processor -- start 2024-09-11T23:50:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.890+0000 7f2e81b50640 1 -- start start 2024-09-11T23:50:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.890+0000 7f2e81b50640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c106ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.890+0000 7f2e81b50640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c107170 con 0x7f2e7c1067a0 2024-09-11T23:50:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.890+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c106ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.890+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c106ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36542/0 (socket says 172.21.15.60:36542) 2024-09-11T23:50:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.890+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/3792706719 learned_addr learned my addr 172.21.15.60:0/3792706719 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.890+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/3792706719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c1079a0 con 0x7f2e7c1067a0 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.891+0000 7f2e7b7fe640 1 --2- 172.21.15.60:0/3792706719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c106ba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009820 tx=0x7f2e6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fb0e4006df97ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.891+0000 7f2e7affd640 1 -- 172.21.15.60:0/3792706719 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e6c037070 con 0x7f2e7c1067a0 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.891+0000 7f2e7affd640 1 -- 172.21.15.60:0/3792706719 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2e6c032920 con 0x7f2e7c1067a0 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.891+0000 7f2e7affd640 1 -- 172.21.15.60:0/3792706719 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e6c030950 con 0x7f2e7c1067a0 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.892+0000 7f2e81b50640 1 -- 172.21.15.60:0/3792706719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 msgr2=0x7f2e7c106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.892+0000 7f2e81b50640 1 --2- 172.21.15.60:0/3792706719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c106ba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009820 tx=0x7f2e6c02a270 comp rx=0 tx=0).stop 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.892+0000 7f2e81b50640 1 -- 172.21.15.60:0/3792706719 shutdown_connections 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.892+0000 7f2e81b50640 1 --2- 172.21.15.60:0/3792706719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c106ba0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.892+0000 7f2e81b50640 1 -- 172.21.15.60:0/3792706719 >> 172.21.15.60:0/3792706719 conn(0x7f2e7c101f30 msgr2=0x7f2e7c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.892+0000 7f2e81b50640 1 -- 172.21.15.60:0/3792706719 shutdown_connections 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.892+0000 7f2e81b50640 1 -- 172.21.15.60:0/3792706719 wait complete. 2024-09-11T23:50:30.300 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e81b50640 1 Processor -- start 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e81b50640 1 -- start start 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e81b50640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c07b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e81b50640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c10ad50 con 0x7f2e7c1067a0 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c07b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c07b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36548/0 (socket says 172.21.15.60:36548) 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/192422716 learned_addr learned my addr 172.21.15.60:0/192422716 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e7b7fe640 1 -- 172.21.15.60:0/192422716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c19e660 con 0x7f2e7c1067a0 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.893+0000 7f2e7b7fe640 1 --2- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c07b9f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009940 tx=0x7f2e6c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.894+0000 7f2e797fa640 1 -- 172.21.15.60:0/192422716 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e6c042070 con 0x7f2e7c1067a0 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.894+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c19e830 con 0x7f2e7c1067a0 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.894+0000 7f2e797fa640 1 -- 172.21.15.60:0/192422716 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2e6c0326b0 con 0x7f2e7c1067a0 2024-09-11T23:50:30.301 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.894+0000 7f2e797fa640 1 -- 172.21.15.60:0/192422716 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e6c037040 con 0x7f2e7c1067a0 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.894+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c19ebd0 con 0x7f2e7c1067a0 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.895+0000 7f2e797fa640 1 -- 172.21.15.60:0/192422716 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2e6c045070 con 0x7f2e7c1067a0 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.895+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c10aed0 con 0x7f2e7c1067a0 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.895+0000 7f2e797fa640 1 --2- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f2e68038f70 0x7f2e6803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.895+0000 7f2e797fa640 1 -- 172.21.15.60:0/192422716 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2e6c06c0a0 con 0x7f2e7c1067a0 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.895+0000 7f2e72ffd640 1 --2- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f2e68038f70 0x7f2e6803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.895+0000 7f2e72ffd640 1 --2- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f2e68038f70 0x7f2e6803b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e640098c0 tx=0x7f2e64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:28.900+0000 7f2e797fa640 1 -- 172.21.15.60:0/192422716 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e6c03c800 con 0x7f2e7c1067a0 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.095+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2e7c103210 con 0x7f2e68038f70 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.099+0000 7f2e797fa640 1 -- 172.21.15.60:0/192422716 <== mgr.14118 v2:172.21.15.60:6800/2264238576 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2e7c103210 con 0x7f2e68038f70 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f2e68038f70 msgr2=0x7f2e6803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:30.302 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 --2- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f2e68038f70 0x7f2e6803b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2e640098c0 tx=0x7f2e64006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:30.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 msgr2=0x7f2e7c07b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:30.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 --2- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c07b9f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009940 tx=0x7f2e6c032e40 comp rx=0 tx=0).stop 2024-09-11T23:50:30.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 shutdown_connections 2024-09-11T23:50:30.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 --2- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f2e68038f70 0x7f2e6803b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:30.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 --2- 172.21.15.60:0/192422716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e7c1067a0 0x7f2e7c07b9f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:30.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 >> 172.21.15.60:0/192422716 conn(0x7f2e7c101f30 msgr2=0x7f2e7c102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:30.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 shutdown_connections 2024-09-11T23:50:30.303 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:29.101+0000 7f2e81b50640 1 -- 172.21.15.60:0/192422716 wait complete. 2024-09-11T23:50:30.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:30 smithi060 ceph-mon[30953]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:30.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:30 smithi060 ceph-mon[30953]: Saving service mgr spec with placement count:2 2024-09-11T23:50:30.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:30 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:30.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:30 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:31.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:31 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:31.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:31 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1669656508' entity='client.admin' 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.704+0000 7fe4f93dc640 1 Processor -- start 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.704+0000 7fe4f93dc640 1 -- start start 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.704+0000 7fe4f93dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f4106ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.704+0000 7fe4f93dc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f4107170 con 0x7fe4f41067a0 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.704+0000 7fe4f2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f4106ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.704+0000 7fe4f2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f4106ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36562/0 (socket says 172.21.15.60:36562) 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.704+0000 7fe4f2ffd640 1 -- 172.21.15.60:0/3555233027 learned_addr learned my addr 172.21.15.60:0/3555233027 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.705+0000 7fe4f2ffd640 1 -- 172.21.15.60:0/3555233027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f41079a0 con 0x7fe4f41067a0 2024-09-11T23:50:32.051 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.705+0000 7fe4f2ffd640 1 --2- 172.21.15.60:0/3555233027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f4106ba0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009820 tx=0x7fe4e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdfddefdd4ac547 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f27fc640 1 -- 172.21.15.60:0/3555233027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e4037070 con 0x7fe4f41067a0 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f27fc640 1 -- 172.21.15.60:0/3555233027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4e4032940 con 0x7fe4f41067a0 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f27fc640 1 -- 172.21.15.60:0/3555233027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e40308b0 con 0x7fe4f41067a0 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f93dc640 1 -- 172.21.15.60:0/3555233027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 msgr2=0x7fe4f4106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f93dc640 1 --2- 172.21.15.60:0/3555233027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f4106ba0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009820 tx=0x7fe4e402a270 comp rx=0 tx=0).stop 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f93dc640 1 -- 172.21.15.60:0/3555233027 shutdown_connections 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f93dc640 1 --2- 172.21.15.60:0/3555233027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f4106ba0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f93dc640 1 -- 172.21.15.60:0/3555233027 >> 172.21.15.60:0/3555233027 conn(0x7fe4f4101f30 msgr2=0x7fe4f4104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f93dc640 1 -- 172.21.15.60:0/3555233027 shutdown_connections 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.706+0000 7fe4f93dc640 1 -- 172.21.15.60:0/3555233027 wait complete. 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.707+0000 7fe4f93dc640 1 Processor -- start 2024-09-11T23:50:32.052 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.707+0000 7fe4f93dc640 1 -- start start 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.707+0000 7fe4f93dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f407b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.707+0000 7fe4f93dc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f410ad50 con 0x7fe4f41067a0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.707+0000 7fe4f2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f407b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.707+0000 7fe4f2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f407b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36564/0 (socket says 172.21.15.60:36564) 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.707+0000 7fe4f2ffd640 1 -- 172.21.15.60:0/1669656508 learned_addr learned my addr 172.21.15.60:0/1669656508 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.708+0000 7fe4f2ffd640 1 -- 172.21.15.60:0/1669656508 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f419e650 con 0x7fe4f41067a0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.708+0000 7fe4f2ffd640 1 --2- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f407b9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009940 tx=0x7fe4e4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.708+0000 7fe4f0ff9640 1 -- 172.21.15.60:0/1669656508 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e4042070 con 0x7fe4f41067a0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.708+0000 7fe4f0ff9640 1 -- 172.21.15.60:0/1669656508 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4e403d930 con 0x7fe4f41067a0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.708+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f419e820 con 0x7fe4f41067a0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.708+0000 7fe4f0ff9640 1 -- 172.21.15.60:0/1669656508 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e4037040 con 0x7fe4f41067a0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.708+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f419ebc0 con 0x7fe4f41067a0 2024-09-11T23:50:32.053 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.709+0000 7fe4f0ff9640 1 -- 172.21.15.60:0/1669656508 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe4e4045070 con 0x7fe4f41067a0 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.709+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f4106ba0 con 0x7fe4f41067a0 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.709+0000 7fe4f0ff9640 1 --2- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe4e0038f70 0x7fe4e003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.709+0000 7fe4f0ff9640 1 -- 172.21.15.60:0/1669656508 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe4e406c190 con 0x7fe4f41067a0 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.709+0000 7fe4ebfff640 1 --2- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe4e0038f70 0x7fe4e003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.709+0000 7fe4ebfff640 1 --2- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe4e0038f70 0x7fe4e003b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0098c0 tx=0x7fe4dc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.714+0000 7fe4f0ff9640 1 -- 172.21.15.60:0/1669656508 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4e403cd70 con 0x7fe4f41067a0 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.898+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fe4f419f420 con 0x7fe4f41067a0 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.901+0000 7fe4f0ff9640 1 -- 172.21.15.60:0/1669656508 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fe4e403c880 con 0x7fe4f41067a0 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.903+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe4e0038f70 msgr2=0x7fe4e003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.903+0000 7fe4f93dc640 1 --2- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe4e0038f70 0x7fe4e003b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc0098c0 tx=0x7fe4dc006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.904+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 msgr2=0x7fe4f407b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:32.054 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.904+0000 7fe4f93dc640 1 --2- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f407b9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009940 tx=0x7fe4e4032670 comp rx=0 tx=0).stop 2024-09-11T23:50:32.055 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.904+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 shutdown_connections 2024-09-11T23:50:32.055 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.904+0000 7fe4f93dc640 1 --2- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fe4e0038f70 0x7fe4e003b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:32.055 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.904+0000 7fe4f93dc640 1 --2- 172.21.15.60:0/1669656508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4f41067a0 0x7fe4f407b9f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:32.055 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.904+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 >> 172.21.15.60:0/1669656508 conn(0x7fe4f4101f30 msgr2=0x7fe4f4102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:32.055 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.904+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 shutdown_connections 2024-09-11T23:50:32.055 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:30.904+0000 7fe4f93dc640 1 -- 172.21.15.60:0/1669656508 wait complete. 2024-09-11T23:50:33.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:32 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:33.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:32 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2567359105' entity='client.admin' 2024-09-11T23:50:33.141 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.443+0000 7f54454bd640 1 Processor -- start 2024-09-11T23:50:33.141 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.443+0000 7f54454bd640 1 -- start start 2024-09-11T23:50:33.141 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.443+0000 7f54454bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544007c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:33.141 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.443+0000 7f54454bd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f544007c850 con 0x7f544007de20 2024-09-11T23:50:33.141 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.443+0000 7f543effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544007c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:33.141 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.443+0000 7f543effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544007c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47758/0 (socket says 172.21.15.60:47758) 2024-09-11T23:50:33.141 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.443+0000 7f543effd640 1 -- 172.21.15.60:0/2310283388 learned_addr learned my addr 172.21.15.60:0/2310283388 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:33.141 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.444+0000 7f543effd640 1 -- 172.21.15.60:0/2310283388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544007c9d0 con 0x7f544007de20 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.444+0000 7f543effd640 1 --2- 172.21.15.60:0/2310283388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544007c280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5430009820 tx=0x7f543002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a97df20a71e5d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f543dffb640 1 -- 172.21.15.60:0/2310283388 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5430037070 con 0x7f544007de20 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f543dffb640 1 -- 172.21.15.60:0/2310283388 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5430032940 con 0x7f544007de20 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f543dffb640 1 -- 172.21.15.60:0/2310283388 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54300308b0 con 0x7f544007de20 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f54454bd640 1 -- 172.21.15.60:0/2310283388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 msgr2=0x7f544007c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f54454bd640 1 --2- 172.21.15.60:0/2310283388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544007c280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5430009820 tx=0x7f543002a270 comp rx=0 tx=0).stop 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f54454bd640 1 -- 172.21.15.60:0/2310283388 shutdown_connections 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f54454bd640 1 --2- 172.21.15.60:0/2310283388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544007c280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f54454bd640 1 -- 172.21.15.60:0/2310283388 >> 172.21.15.60:0/2310283388 conn(0x7f5440103020 msgr2=0x7f5440105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f54454bd640 1 -- 172.21.15.60:0/2310283388 shutdown_connections 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.445+0000 7f54454bd640 1 -- 172.21.15.60:0/2310283388 wait complete. 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.446+0000 7f54454bd640 1 Processor -- start 2024-09-11T23:50:33.142 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.446+0000 7f54454bd640 1 -- start start 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.446+0000 7f54454bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544019da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.446+0000 7f54454bd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f544010ded0 con 0x7f544007de20 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.446+0000 7f543effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544019da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f543effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544019da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47768/0 (socket says 172.21.15.60:47768) 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f543effd640 1 -- 172.21.15.60:0/2567359105 learned_addr learned my addr 172.21.15.60:0/2567359105 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f543effd640 1 -- 172.21.15.60:0/2567359105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544019dfd0 con 0x7f544007de20 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f543effd640 1 --2- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544019da90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f54300097f0 tx=0x7f5430032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f5427fff640 1 -- 172.21.15.60:0/2567359105 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5430042070 con 0x7f544007de20 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f5427fff640 1 -- 172.21.15.60:0/2567359105 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f543003d930 con 0x7f544007de20 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544019e260 con 0x7f544007de20 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f5427fff640 1 -- 172.21.15.60:0/2567359105 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5430037040 con 0x7f544007de20 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.447+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401a0f50 con 0x7f544007de20 2024-09-11T23:50:33.143 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.448+0000 7f5427fff640 1 -- 172.21.15.60:0/2567359105 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f5430045070 con 0x7f544007de20 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.448+0000 7f5427fff640 1 --2- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f5428038fc0 0x7f542803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.448+0000 7f5427fff640 1 -- 172.21.15.60:0/2567359105 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f543006c110 con 0x7f544007de20 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.448+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544007c300 con 0x7f544007de20 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.448+0000 7f543e7fc640 1 --2- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f5428038fc0 0x7f542803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.449+0000 7f543e7fc640 1 --2- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f5428038fc0 0x7f542803b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54340098c0 tx=0x7f5434006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.453+0000 7f5427fff640 1 -- 172.21.15.60:0/2567359105 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f543006ba60 con 0x7f544007de20 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.630+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f54401a14f0 con 0x7f544007de20 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.633+0000 7f5427fff640 1 -- 172.21.15.60:0/2567359105 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f543003cd30 con 0x7f544007de20 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f5428038fc0 msgr2=0x7f542803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 --2- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f5428038fc0 0x7f542803b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54340098c0 tx=0x7f5434006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 msgr2=0x7f544019da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:33.144 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 --2- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544019da90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f54300097f0 tx=0x7f5430032670 comp rx=0 tx=0).stop 2024-09-11T23:50:33.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 shutdown_connections 2024-09-11T23:50:33.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 --2- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f5428038fc0 0x7f542803b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 --2- 172.21.15.60:0/2567359105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f544007de20 0x7f544019da90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:33.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 >> 172.21.15.60:0/2567359105 conn(0x7f5440103020 msgr2=0x7f5440103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:33.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 shutdown_connections 2024-09-11T23:50:33.145 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:32.636+0000 7f54454bd640 1 -- 172.21.15.60:0/2567359105 wait complete. 2024-09-11T23:50:33.145 INFO:teuthology.orchestra.run.smithi060.stdout:Enabling the dashboard module... 2024-09-11T23:50:34.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-mon[30953]: from='mgr.14118 172.21.15.60:0/842549720' entity='mgr.x' 2024-09-11T23:50:34.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1416710766' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-11T23:50:34.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ignoring --setuser ceph since I am not root 2024-09-11T23:50:34.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ignoring --setgroup ceph since I am not root 2024-09-11T23:50:34.645 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:34.361+0000 7f9aa6e87040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:50:34.645 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:34.421+0000 7f9aa6e87040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:50:34.645 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:34.576+0000 7f9aa6e87040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:50:34.645 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:34.646+0000 7f9aa6e87040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:50:34.827 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.523+0000 7f57b8c92640 1 Processor -- start 2024-09-11T23:50:34.827 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.523+0000 7f57b8c92640 1 -- start start 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.523+0000 7f57b8c92640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b410a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.523+0000 7f57b8c92640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57b407be30 con 0x7f57b41082e0 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.523+0000 7f57b259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b410a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.523+0000 7f57b259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b410a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47784/0 (socket says 172.21.15.60:47784) 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.523+0000 7f57b259c640 1 -- 172.21.15.60:0/210401410 learned_addr learned my addr 172.21.15.60:0/210401410 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.524+0000 7f57b259c640 1 -- 172.21.15.60:0/210401410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b410ac10 con 0x7f57b41082e0 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.524+0000 7f57b259c640 1 --2- 172.21.15.60:0/210401410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b410a6d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009820 tx=0x7f57a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244c6416954d1a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.524+0000 7f57b159a640 1 -- 172.21.15.60:0/210401410 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57a4037070 con 0x7f57b41082e0 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.524+0000 7f57b159a640 1 -- 172.21.15.60:0/210401410 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57a4032940 con 0x7f57b41082e0 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.524+0000 7f57b159a640 1 -- 172.21.15.60:0/210401410 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57a40308b0 con 0x7f57b41082e0 2024-09-11T23:50:34.828 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.525+0000 7f57b8c92640 1 -- 172.21.15.60:0/210401410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 msgr2=0x7f57b410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.525+0000 7f57b8c92640 1 --2- 172.21.15.60:0/210401410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b410a6d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009820 tx=0x7f57a402a270 comp rx=0 tx=0).stop 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.525+0000 7f57b8c92640 1 -- 172.21.15.60:0/210401410 shutdown_connections 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.525+0000 7f57b8c92640 1 --2- 172.21.15.60:0/210401410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b410a6d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.525+0000 7f57b8c92640 1 -- 172.21.15.60:0/210401410 >> 172.21.15.60:0/210401410 conn(0x7f57b4101f20 msgr2=0x7f57b4104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.525+0000 7f57b8c92640 1 -- 172.21.15.60:0/210401410 shutdown_connections 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.525+0000 7f57b8c92640 1 -- 172.21.15.60:0/210401410 wait complete. 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.526+0000 7f57b8c92640 1 Processor -- start 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.526+0000 7f57b8c92640 1 -- start start 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.526+0000 7f57b8c92640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.526+0000 7f57b8c92640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57b410bc20 con 0x7f57b41082e0 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.526+0000 7f57b259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.526+0000 7f57b259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47800/0 (socket says 172.21.15.60:47800) 2024-09-11T23:50:34.829 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.526+0000 7f57b259c640 1 -- 172.21.15.60:0/1416710766 learned_addr learned my addr 172.21.15.60:0/1416710766 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.526+0000 7f57b259c640 1 -- 172.21.15.60:0/1416710766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b419bd50 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.527+0000 7f57b259c640 1 --2- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b419b810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f57a4032670 tx=0x7f57a40326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.527+0000 7f57a37fe640 1 -- 172.21.15.60:0/1416710766 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57a4042070 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.527+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b419c040 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.527+0000 7f57a37fe640 1 -- 172.21.15.60:0/1416710766 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57a403d930 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.527+0000 7f57a37fe640 1 -- 172.21.15.60:0/1416710766 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57a4037040 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.527+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b419ecd0 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.528+0000 7f57a37fe640 1 -- 172.21.15.60:0/1416710766 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f57a4045070 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.528+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b4108740 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.528+0000 7f57a37fe640 1 --2- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f579c038f70 0x7f579c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.528+0000 7f57a37fe640 1 -- 172.21.15.60:0/1416710766 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f57a406c060 con 0x7f57b41082e0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.528+0000 7f57b1d9b640 1 --2- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f579c038f70 0x7f579c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.529+0000 7f57b1d9b640 1 --2- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f579c038f70 0x7f579c03b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f57a80098c0 tx=0x7f57a8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:34.830 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.533+0000 7f57a37fe640 1 -- 172.21.15.60:0/1416710766 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57a404b170 con 0x7f57b41082e0 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:33.776+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f57b419f500 con 0x7f57b41082e0 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.210+0000 7f57a37fe640 1 -- 172.21.15.60:0/1416710766 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f57a402fd90 con 0x7f57b41082e0 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.212+0000 7f57a37fe640 1 -- 172.21.15.60:0/1416710766 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f57a403d430 con 0x7f57b41082e0 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f579c038f70 msgr2=0x7f579c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 --2- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f579c038f70 0x7f579c03b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f57a80098c0 tx=0x7f57a8006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 msgr2=0x7f57b419b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 --2- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b419b810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f57a4032670 tx=0x7f57a40326a0 comp rx=0 tx=0).stop 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 shutdown_connections 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 --2- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7f579c038f70 0x7f579c03b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 --2- 172.21.15.60:0/1416710766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57b41082e0 0x7f57b419b810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 >> 172.21.15.60:0/1416710766 conn(0x7f57b4101f20 msgr2=0x7f57b4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 shutdown_connections 2024-09-11T23:50:34.831 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:34.213+0000 7f57b8c92640 1 -- 172.21.15.60:0/1416710766 wait complete. 2024-09-11T23:50:34.949 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:34.800+0000 7f9aa6e87040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:50:35.209 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:34.951+0000 7f9aa6e87040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:50:35.492 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:35 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1416710766' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T23:50:35.492 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:35 smithi060 ceph-mon[30953]: mgrmap e9: x(active, since 18s) 2024-09-11T23:50:35.492 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:35 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:35.287+0000 7f9aa6e87040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:50:35.492 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:35 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:35.351+0000 7f9aa6e87040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:50:35.779 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:35 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:35.548+0000 7f9aa6e87040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:50:36.379 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:36 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/833946056' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-11T23:50:36.387 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:50:36.387 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T23:50:36.387 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T23:50:36.387 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T23:50:36.387 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.572+0000 7fda551ba640 1 Processor -- start 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.573+0000 7fda551ba640 1 -- start start 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.573+0000 7fda551ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda50106b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.573+0000 7fda551ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fda50107120 con 0x7fda50106750 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.573+0000 7fda4ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda50106b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.573+0000 7fda4ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda50106b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47814/0 (socket says 172.21.15.60:47814) 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.573+0000 7fda4ed9d640 1 -- 172.21.15.60:0/2847373067 learned_addr learned my addr 172.21.15.60:0/2847373067 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.573+0000 7fda4ed9d640 1 -- 172.21.15.60:0/2847373067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda50107950 con 0x7fda50106750 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.574+0000 7fda4ed9d640 1 --2- 172.21.15.60:0/2847373067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda50106b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda40009820 tx=0x7fda4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a612ef11b3890f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.574+0000 7fda4dd9b640 1 -- 172.21.15.60:0/2847373067 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda40037070 con 0x7fda50106750 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.574+0000 7fda4dd9b640 1 -- 172.21.15.60:0/2847373067 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda40032940 con 0x7fda50106750 2024-09-11T23:50:36.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.574+0000 7fda4dd9b640 1 -- 172.21.15.60:0/2847373067 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda400308b0 con 0x7fda50106750 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.575+0000 7fda551ba640 1 -- 172.21.15.60:0/2847373067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 msgr2=0x7fda50106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.575+0000 7fda551ba640 1 --2- 172.21.15.60:0/2847373067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda50106b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fda40009820 tx=0x7fda4002a270 comp rx=0 tx=0).stop 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.575+0000 7fda551ba640 1 -- 172.21.15.60:0/2847373067 shutdown_connections 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.575+0000 7fda551ba640 1 --2- 172.21.15.60:0/2847373067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda50106b50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.575+0000 7fda551ba640 1 -- 172.21.15.60:0/2847373067 >> 172.21.15.60:0/2847373067 conn(0x7fda50101f20 msgr2=0x7fda50104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.575+0000 7fda551ba640 1 -- 172.21.15.60:0/2847373067 shutdown_connections 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.575+0000 7fda551ba640 1 -- 172.21.15.60:0/2847373067 wait complete. 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.576+0000 7fda551ba640 1 Processor -- start 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.576+0000 7fda551ba640 1 -- start start 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.576+0000 7fda551ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda5019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.576+0000 7fda551ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fda5010ad00 con 0x7fda50106750 2024-09-11T23:50:36.389 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda4ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda5019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda4ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda5019b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47824/0 (socket says 172.21.15.60:47824) 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda4ed9d640 1 -- 172.21.15.60:0/833946056 learned_addr learned my addr 172.21.15.60:0/833946056 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda4ed9d640 1 -- 172.21.15.60:0/833946056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5019be30 con 0x7fda50106750 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda4ed9d640 1 --2- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda5019b8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda40009940 tx=0x7fda40032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda37fff640 1 -- 172.21.15.60:0/833946056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda40042070 con 0x7fda50106750 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda37fff640 1 -- 172.21.15.60:0/833946056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda4003d930 con 0x7fda50106750 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5019c0c0 con 0x7fda50106750 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda37fff640 1 -- 172.21.15.60:0/833946056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda40037040 con 0x7fda50106750 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.577+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5019edb0 con 0x7fda50106750 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.578+0000 7fda37fff640 1 -- 172.21.15.60:0/833946056 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fda40045070 con 0x7fda50106750 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.578+0000 7fda37fff640 1 --2- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fda38038fc0 0x7fda3803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:36.390 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.579+0000 7fda37fff640 1 -- 172.21.15.60:0/833946056 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fda4006c2b0 con 0x7fda50106750 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.579+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda50106b50 con 0x7fda50106750 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.579+0000 7fda4e59c640 1 -- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fda38038fc0 msgr2=0x7fda3803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2264238576 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.579+0000 7fda4e59c640 1 --2- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fda38038fc0 0x7fda3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.583+0000 7fda37fff640 1 -- 172.21.15.60:0/833946056 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda40045520 con 0x7fda50106750 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.780+0000 7fda4e59c640 1 -- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fda38038fc0 msgr2=0x7fda3803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2264238576 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.780+0000 7fda4e59c640 1 --2- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fda38038fc0 0x7fda3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.807+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fda5002d910 con 0x7fda50106750 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.807+0000 7fda37fff640 1 -- 172.21.15.60:0/833946056 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fda4003cda0 con 0x7fda50106750 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fda38038fc0 msgr2=0x7fda3803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 --2- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fda38038fc0 0x7fda3803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 msgr2=0x7fda5019b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 --2- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda5019b8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda40009940 tx=0x7fda40032670 comp rx=0 tx=0).stop 2024-09-11T23:50:36.391 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 shutdown_connections 2024-09-11T23:50:36.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 --2- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7fda38038fc0 0x7fda3803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:36.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 --2- 172.21.15.60:0/833946056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda50106750 0x7fda5019b8f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:36.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 >> 172.21.15.60:0/833946056 conn(0x7fda50101f20 msgr2=0x7fda50102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:36.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 shutdown_connections 2024-09-11T23:50:36.392 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:35.810+0000 7fda551ba640 1 -- 172.21.15.60:0/833946056 wait complete. 2024-09-11T23:50:36.392 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for the mgr to restart... 2024-09-11T23:50:36.392 INFO:teuthology.orchestra.run.smithi060.stdout:Waiting for mgr epoch 9... 2024-09-11T23:50:36.665 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:36 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:36.499+0000 7f9aa6e87040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:50:36.665 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:36 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:36.570+0000 7f9aa6e87040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:50:37.589 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:37.325+0000 7f9aa6e87040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:50:37.589 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:37.446+0000 7f9aa6e87040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:50:37.884 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:37.595+0000 7f9aa6e87040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:50:37.885 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:37.658+0000 7f9aa6e87040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:50:37.885 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:37.813+0000 7f9aa6e87040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:50:37.885 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:37.884+0000 7f9aa6e87040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:50:38.154 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:37.946+0000 7f9aa6e87040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:50:38.154 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:38.112+0000 7f9aa6e87040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:50:38.460 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:38.181+0000 7f9aa6e87040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:50:38.460 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:38.250+0000 7f9aa6e87040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:50:38.460 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:38.336+0000 7f9aa6e87040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:50:38.460 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:38.398+0000 7f9aa6e87040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:50:38.460 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:38.459+0000 7f9aa6e87040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:50:39.537 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:39.285+0000 7f9aa6e87040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:50:39.537 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: Active manager daemon x restarted 2024-09-11T23:50:39.537 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: Activating manager daemon x 2024-09-11T23:50:39.537 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T23:50:39.537 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: mgrmap e10: x(active, starting, since 0.00321908s) 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: Manager daemon x is now available 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:50:39.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout { 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout } 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.747+0000 7faa5dc9f640 1 Processor -- start 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.747+0000 7faa5dc9f640 1 -- start start 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.747+0000 7faa5dc9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa58106570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.747+0000 7faa5dc9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa5807bdd0 con 0x7faa58106170 2024-09-11T23:50:41.191 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.747+0000 7faa577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa58106570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.747+0000 7faa577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa58106570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47836/0 (socket says 172.21.15.60:47836) 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.747+0000 7faa577fe640 1 -- 172.21.15.60:0/2308115362 learned_addr learned my addr 172.21.15.60:0/2308115362 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.747+0000 7faa577fe640 1 -- 172.21.15.60:0/2308115362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa58106ab0 con 0x7faa58106170 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.748+0000 7faa577fe640 1 --2- 172.21.15.60:0/2308115362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa58106570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa48009820 tx=0x7faa4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6f9c8e6160db85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.748+0000 7faa567fc640 1 -- 172.21.15.60:0/2308115362 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa48037070 con 0x7faa58106170 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.748+0000 7faa567fc640 1 -- 172.21.15.60:0/2308115362 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa48032940 con 0x7faa58106170 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.748+0000 7faa567fc640 1 -- 172.21.15.60:0/2308115362 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa480308b0 con 0x7faa58106170 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.749+0000 7faa5dc9f640 1 -- 172.21.15.60:0/2308115362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 msgr2=0x7faa58106570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.749+0000 7faa5dc9f640 1 --2- 172.21.15.60:0/2308115362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa58106570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa48009820 tx=0x7faa4802a270 comp rx=0 tx=0).stop 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.749+0000 7faa5dc9f640 1 -- 172.21.15.60:0/2308115362 shutdown_connections 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.749+0000 7faa5dc9f640 1 --2- 172.21.15.60:0/2308115362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa58106570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.192 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.749+0000 7faa5dc9f640 1 -- 172.21.15.60:0/2308115362 >> 172.21.15.60:0/2308115362 conn(0x7faa58101f20 msgr2=0x7faa58104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.749+0000 7faa5dc9f640 1 -- 172.21.15.60:0/2308115362 shutdown_connections 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.749+0000 7faa5dc9f640 1 -- 172.21.15.60:0/2308115362 wait complete. 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.750+0000 7faa5dc9f640 1 Processor -- start 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.750+0000 7faa5dc9f640 1 -- start start 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.750+0000 7faa5dc9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa5819dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.750+0000 7faa5dc9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa58107be0 con 0x7faa58106170 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.750+0000 7faa577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa5819dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa5819dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47848/0 (socket says 172.21.15.60:47848) 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa577fe640 1 -- 172.21.15.60:0/1074815110 learned_addr learned my addr 172.21.15.60:0/1074815110 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa577fe640 1 -- 172.21.15.60:0/1074815110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5819e000 con 0x7faa58106170 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa577fe640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa5819dac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa480097f0 tx=0x7faa48032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa48037040 con 0x7faa58106170 2024-09-11T23:50:41.193 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5819e290 con 0x7faa58106170 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa48040070 con 0x7faa58106170 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa581a0f80 con 0x7faa58106170 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.751+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa4803a520 con 0x7faa58106170 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.752+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7faa4803a820 con 0x7faa58106170 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.752+0000 7faa54ff9640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 0x7faa4003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.752+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 --> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faa58106570 con 0x7faa40038f70 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.752+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faa4806d830 con 0x7faa58106170 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.752+0000 7faa56ffd640 1 -- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 msgr2=0x7faa4003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2264238576 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.752+0000 7faa56ffd640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 0x7faa4003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.953+0000 7faa56ffd640 1 -- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 msgr2=0x7faa4003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2264238576 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:36.953+0000 7faa56ffd640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 0x7faa4003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:37.354+0000 7faa56ffd640 1 -- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 msgr2=0x7faa4003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2264238576 2024-09-11T23:50:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:37.354+0000 7faa56ffd640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 0x7faa4003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:38.154+0000 7faa56ffd640 1 -- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 msgr2=0x7faa4003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/2264238576 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:38.154+0000 7faa56ffd640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 0x7faa4003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:39.289+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7faa4802fd60 con 0x7faa58106170 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:39.289+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 msgr2=0x7faa4003b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:39.289+0000 7faa54ff9640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 0x7faa4003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.291+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7faa48041d60 con 0x7faa58106170 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.291+0000 7faa54ff9640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa4003c840 0x7faa4003ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.291+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7faa48032710 con 0x7faa4003c840 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.292+0000 7faa56ffd640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa4003c840 0x7faa4003ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.293+0000 7faa56ffd640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa4003c840 0x7faa4003ec30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faa4c003980 tx=0x7faa4c006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.294+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7faa48032710 con 0x7faa4003c840 2024-09-11T23:50:41.195 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.306+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7faa58062630 con 0x7faa4003c840 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.306+0000 7faa54ff9640 1 -- 172.21.15.60:0/1074815110 <== mgr.14150 v2:172.21.15.60:6800/1180183286 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7faa58062630 con 0x7faa4003c840 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa4003c840 msgr2=0x7faa4003ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa4003c840 0x7faa4003ec30 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7faa4c003980 tx=0x7faa4c006e10 comp rx=0 tx=0).stop 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 msgr2=0x7faa5819dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa5819dac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa480097f0 tx=0x7faa48032e60 comp rx=0 tx=0).stop 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 shutdown_connections 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa4003c840 0x7faa4003ec30 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:6800/2264238576,v1:172.21.15.60:6801/2264238576] conn(0x7faa40038f70 0x7faa4003b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 --2- 172.21.15.60:0/1074815110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa58106170 0x7faa5819dac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 >> 172.21.15.60:0/1074815110 conn(0x7faa58101f20 msgr2=0x7faa58194760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 shutdown_connections 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:40.307+0000 7faa5dc9f640 1 -- 172.21.15.60:0/1074815110 wait complete. 2024-09-11T23:50:41.196 INFO:teuthology.orchestra.run.smithi060.stdout:mgr epoch 9 is available 2024-09-11T23:50:41.197 INFO:teuthology.orchestra.run.smithi060.stdout:Generating a dashboard self-signed certificate... 2024-09-11T23:50:41.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-mon[30953]: mgrmap e11: x(active, since 1.00635s) 2024-09-11T23:50:41.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:41.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:41] ENGINE Bus STARTING 2024-09-11T23:50:41.543 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:41.367+0000 7f9a1219b640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:50:41] ENGINE Error in HTTPServer.serve 2024-09-11T23:50:41.543 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: Traceback (most recent call last): 2024-09-11T23:50:41.543 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._connections.run(self.expiration_interval) 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._run(expiration_interval) 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: s = self.context.wrap_socket( 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: return self.sslsocket_class._create( 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self.do_handshake() 2024-09-11T23:50:41.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:50:41.545 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._sslobj.do_handshake() 2024-09-11T23:50:41.545 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:50:41.545 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:50:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.624+0000 7fc08f1d0640 1 Processor -- start 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.625+0000 7fc08f1d0640 1 -- start start 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.625+0000 7fc08f1d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc088107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.625+0000 7fc08f1d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc088108220 con 0x7fc088107850 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.625+0000 7fc08cf6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc088107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.625+0000 7fc08cf6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc088107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55838/0 (socket says 172.21.15.60:55838) 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.625+0000 7fc08cf6c640 1 -- 172.21.15.60:0/435195879 learned_addr learned my addr 172.21.15.60:0/435195879 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.625+0000 7fc08cf6c640 1 -- 172.21.15.60:0/435195879 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc088108a50 con 0x7fc088107850 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.626+0000 7fc08cf6c640 1 --2- 172.21.15.60:0/435195879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc088107c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc078009820 tx=0x7fc07802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdcc7bb88081386 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:42.439 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.626+0000 7fc0877fe640 1 -- 172.21.15.60:0/435195879 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc078037070 con 0x7fc088107850 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.626+0000 7fc0877fe640 1 -- 172.21.15.60:0/435195879 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc078032940 con 0x7fc088107850 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.626+0000 7fc0877fe640 1 -- 172.21.15.60:0/435195879 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0780308b0 con 0x7fc088107850 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.627+0000 7fc08f1d0640 1 -- 172.21.15.60:0/435195879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 msgr2=0x7fc088107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.627+0000 7fc08f1d0640 1 --2- 172.21.15.60:0/435195879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc088107c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc078009820 tx=0x7fc07802a270 comp rx=0 tx=0).stop 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.627+0000 7fc08f1d0640 1 -- 172.21.15.60:0/435195879 shutdown_connections 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.627+0000 7fc08f1d0640 1 --2- 172.21.15.60:0/435195879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc088107c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.627+0000 7fc08f1d0640 1 -- 172.21.15.60:0/435195879 >> 172.21.15.60:0/435195879 conn(0x7fc088103020 msgr2=0x7fc088105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.627+0000 7fc08f1d0640 1 -- 172.21.15.60:0/435195879 shutdown_connections 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.627+0000 7fc08f1d0640 1 -- 172.21.15.60:0/435195879 wait complete. 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.627+0000 7fc08f1d0640 1 Processor -- start 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08f1d0640 1 -- start start 2024-09-11T23:50:42.440 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08f1d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc08807db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08f1d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc08810be00 con 0x7fc088107850 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08cf6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc08807db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08cf6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc08807db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55848/0 (socket says 172.21.15.60:55848) 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08cf6c640 1 -- 172.21.15.60:0/1174408364 learned_addr learned my addr 172.21.15.60:0/1174408364 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08cf6c640 1 -- 172.21.15.60:0/1174408364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08807e050 con 0x7fc088107850 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08cf6c640 1 --2- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc08807db10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc078009940 tx=0x7fc078032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc085ffb640 1 -- 172.21.15.60:0/1174408364 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc078042070 con 0x7fc088107850 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08807c240 con 0x7fc088107850 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc085ffb640 1 -- 172.21.15.60:0/1174408364 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc07803d930 con 0x7fc088107850 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.628+0000 7fc085ffb640 1 -- 172.21.15.60:0/1174408364 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc078037040 con 0x7fc088107850 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.629+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08807c780 con 0x7fc088107850 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.629+0000 7fc085ffb640 1 -- 172.21.15.60:0/1174408364 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fc078045070 con 0x7fc088107850 2024-09-11T23:50:42.441 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.630+0000 7fc085ffb640 1 --2- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc070038eb0 0x7fc07003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.630+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc088107c50 con 0x7fc088107850 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.630+0000 7fc085ffb640 1 -- 172.21.15.60:0/1174408364 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc07806c0c0 con 0x7fc088107850 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.630+0000 7fc087fff640 1 --2- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc070038eb0 0x7fc07003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.630+0000 7fc087fff640 1 --2- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc070038eb0 0x7fc07003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0098c0 tx=0x7fc07c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.635+0000 7fc085ffb640 1 -- 172.21.15.60:0/1174408364 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc07804b170 con 0x7fc088107850 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.817+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fc08807d0d0 con 0x7fc070038eb0 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.860+0000 7fc085ffb640 1 -- 172.21.15.60:0/1174408364 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fc07803d430 con 0x7fc088107850 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.892+0000 7fc085ffb640 1 -- 172.21.15.60:0/1174408364 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fc08807d0d0 con 0x7fc070038eb0 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.894+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc070038eb0 msgr2=0x7fc07003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.894+0000 7fc08f1d0640 1 --2- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc070038eb0 0x7fc07003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0098c0 tx=0x7fc07c006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.894+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 msgr2=0x7fc08807db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.894+0000 7fc08f1d0640 1 --2- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc08807db10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc078009940 tx=0x7fc078032670 comp rx=0 tx=0).stop 2024-09-11T23:50:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.894+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 shutdown_connections 2024-09-11T23:50:42.443 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.894+0000 7fc08f1d0640 1 --2- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc070038eb0 0x7fc07003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:42.443 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.894+0000 7fc08f1d0640 1 --2- 172.21.15.60:0/1174408364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc088107850 0x7fc08807db10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:42.443 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.894+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 >> 172.21.15.60:0/1174408364 conn(0x7fc088103020 msgr2=0x7fc088103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:42.443 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.895+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 shutdown_connections 2024-09-11T23:50:42.443 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:41.895+0000 7fc08f1d0640 1 -- 172.21.15.60:0/1174408364 wait complete. 2024-09-11T23:50:42.443 INFO:teuthology.orchestra.run.smithi060.stdout:Creating initial admin user... 2024-09-11T23:50:42.926 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:41] ENGINE Serving on https://172.21.15.60:7150 2024-09-11T23:50:42.926 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:41] ENGINE Error in HTTPServer.serve 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: Traceback (most recent call last): 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._run(expiration_interval) 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: s = self.context.wrap_socket( 2024-09-11T23:50:42.927 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout: return self.sslsocket_class._create( 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout: self.do_handshake() 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._sslobj.do_handshake() 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:41] ENGINE Serving on http://172.21.15.60:8765 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: [11/Sep/2024:23:50:41] ENGINE Bus STARTED 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:42.928 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:42.929 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: mgrmap e12: x(active, since 2s) 2024-09-11T23:50:42.929 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:42.929 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:42 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:43.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:43 smithi060 ceph-mon[30953]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:43.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:44.388 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$AAeExLbuD23MiL.uYYqrRu3qVCeH4fsNSb9EhPaJnhtPLmFZ6J71i", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726098643, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T23:50:44.394 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.834+0000 7f990b217640 1 Processor -- start 2024-09-11T23:50:44.394 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.834+0000 7f990b217640 1 -- start start 2024-09-11T23:50:44.394 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.835+0000 7f990b217640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f9904106b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:44.394 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.835+0000 7f990b217640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9904107120 con 0x7f9904106750 2024-09-11T23:50:44.394 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.835+0000 7f9908fb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f9904106b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:44.394 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.835+0000 7f9908fb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f9904106b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55860/0 (socket says 172.21.15.60:55860) 2024-09-11T23:50:44.394 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.835+0000 7f9908fb3640 1 -- 172.21.15.60:0/1892661747 learned_addr learned my addr 172.21.15.60:0/1892661747 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.835+0000 7f9908fb3640 1 -- 172.21.15.60:0/1892661747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9904107950 con 0x7f9904106750 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.836+0000 7f9908fb3640 1 --2- 172.21.15.60:0/1892661747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f9904106b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9900009820 tx=0x7f990002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68edfbe99cb501df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.836+0000 7f98fb7fe640 1 -- 172.21.15.60:0/1892661747 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900037070 con 0x7f9904106750 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.836+0000 7f98fb7fe640 1 -- 172.21.15.60:0/1892661747 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9900032940 con 0x7f9904106750 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.836+0000 7f98fb7fe640 1 -- 172.21.15.60:0/1892661747 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99000308b0 con 0x7f9904106750 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 -- 172.21.15.60:0/1892661747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 msgr2=0x7f9904106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 --2- 172.21.15.60:0/1892661747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f9904106b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9900009820 tx=0x7f990002a270 comp rx=0 tx=0).stop 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 -- 172.21.15.60:0/1892661747 shutdown_connections 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 --2- 172.21.15.60:0/1892661747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f9904106b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 -- 172.21.15.60:0/1892661747 >> 172.21.15.60:0/1892661747 conn(0x7f9904101f20 msgr2=0x7f9904104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 -- 172.21.15.60:0/1892661747 shutdown_connections 2024-09-11T23:50:44.395 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 -- 172.21.15.60:0/1892661747 wait complete. 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 Processor -- start 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.837+0000 7f990b217640 1 -- start start 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f990b217640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f990407b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f990b217640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f990410ad00 con 0x7f9904106750 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f9908fb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f990407b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f9908fb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f990407b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55872/0 (socket says 172.21.15.60:55872) 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f9908fb3640 1 -- 172.21.15.60:0/1796350583 learned_addr learned my addr 172.21.15.60:0/1796350583 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f9908fb3640 1 -- 172.21.15.60:0/1796350583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990419c3f0 con 0x7f9904106750 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f9908fb3640 1 --2- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f990407b9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9900009940 tx=0x7f9900032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f98f9ffb640 1 -- 172.21.15.60:0/1796350583 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900042070 con 0x7f9904106750 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f98f9ffb640 1 -- 172.21.15.60:0/1796350583 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f990003d930 con 0x7f9904106750 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.838+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99041a0a00 con 0x7f9904106750 2024-09-11T23:50:44.396 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.839+0000 7f98f9ffb640 1 -- 172.21.15.60:0/1796350583 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900037040 con 0x7f9904106750 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.839+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99041a0da0 con 0x7f9904106750 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.840+0000 7f98f9ffb640 1 -- 172.21.15.60:0/1796350583 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f9900045070 con 0x7f9904106750 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.840+0000 7f98f9ffb640 1 --2- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98ec038fc0 0x7f98ec03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.840+0000 7f98f9ffb640 1 -- 172.21.15.60:0/1796350583 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f990006c2d0 con 0x7f9904106750 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.840+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9904106b50 con 0x7f9904106750 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.840+0000 7f98fbfff640 1 --2- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98ec038fc0 0x7f98ec03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.840+0000 7f98fbfff640 1 --2- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98ec038fc0 0x7f98ec03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f98f40098c0 tx=0x7f98f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:42.845+0000 7f98f9ffb640 1 -- 172.21.15.60:0/1796350583 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f990003cdc0 con 0x7f9904106750 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.055+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f9904103180 con 0x7f98ec038fc0 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.307+0000 7f98f9ffb640 1 -- 172.21.15.60:0/1796350583 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f9904103180 con 0x7f98ec038fc0 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.309+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98ec038fc0 msgr2=0x7f98ec03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.309+0000 7f990b217640 1 --2- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98ec038fc0 0x7f98ec03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f98f40098c0 tx=0x7f98f4006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.397 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.309+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 msgr2=0x7f990407b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:44.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.309+0000 7f990b217640 1 --2- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f990407b9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9900009940 tx=0x7f9900032670 comp rx=0 tx=0).stop 2024-09-11T23:50:44.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.310+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 shutdown_connections 2024-09-11T23:50:44.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.310+0000 7f990b217640 1 --2- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98ec038fc0 0x7f98ec03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.310+0000 7f990b217640 1 --2- 172.21.15.60:0/1796350583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9904106750 0x7f990407b9f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:44.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.310+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 >> 172.21.15.60:0/1796350583 conn(0x7f9904101f20 msgr2=0x7f9904102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:44.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.310+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 shutdown_connections 2024-09-11T23:50:44.398 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:43.310+0000 7f990b217640 1 -- 172.21.15.60:0/1796350583 wait complete. 2024-09-11T23:50:44.398 INFO:teuthology.orchestra.run.smithi060.stdout:Fetching dashboard port number... 2024-09-11T23:50:45.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:45 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2699701697' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.786+0000 7fe5c469b640 1 Processor -- start 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.787+0000 7fe5c469b640 1 -- start start 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.787+0000 7fe5c469b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.787+0000 7fe5c469b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc108220 con 0x7fe5bc107850 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.787+0000 7fe5c2437640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.787+0000 7fe5c2437640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55884/0 (socket says 172.21.15.60:55884) 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.787+0000 7fe5c2437640 1 -- 172.21.15.60:0/922942048 learned_addr learned my addr 172.21.15.60:0/922942048 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:45.509 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.787+0000 7fe5c2437640 1 -- 172.21.15.60:0/922942048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5bc108a50 con 0x7fe5bc107850 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.788+0000 7fe5c2437640 1 --2- 172.21.15.60:0/922942048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc107c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009820 tx=0x7fe5b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4c4144d37367a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.788+0000 7fe5c1435640 1 -- 172.21.15.60:0/922942048 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5b8037070 con 0x7fe5bc107850 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.788+0000 7fe5c1435640 1 -- 172.21.15.60:0/922942048 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe5b8032940 con 0x7fe5bc107850 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.788+0000 7fe5c1435640 1 -- 172.21.15.60:0/922942048 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5b80308b0 con 0x7fe5bc107850 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.789+0000 7fe5c469b640 1 -- 172.21.15.60:0/922942048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 msgr2=0x7fe5bc107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.789+0000 7fe5c469b640 1 --2- 172.21.15.60:0/922942048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc107c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009820 tx=0x7fe5b802a270 comp rx=0 tx=0).stop 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.789+0000 7fe5c469b640 1 -- 172.21.15.60:0/922942048 shutdown_connections 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.789+0000 7fe5c469b640 1 --2- 172.21.15.60:0/922942048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc107c50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.789+0000 7fe5c469b640 1 -- 172.21.15.60:0/922942048 >> 172.21.15.60:0/922942048 conn(0x7fe5bc103020 msgr2=0x7fe5bc105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.789+0000 7fe5c469b640 1 -- 172.21.15.60:0/922942048 shutdown_connections 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.789+0000 7fe5c469b640 1 -- 172.21.15.60:0/922942048 wait complete. 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c469b640 1 Processor -- start 2024-09-11T23:50:45.510 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c469b640 1 -- start start 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c469b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc07db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c469b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc10be00 con 0x7fe5bc107850 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c2437640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc07db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c2437640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc07db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55898/0 (socket says 172.21.15.60:55898) 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c2437640 1 -- 172.21.15.60:0/2699701697 learned_addr learned my addr 172.21.15.60:0/2699701697 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c2437640 1 -- 172.21.15.60:0/2699701697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5bc07e050 con 0x7fe5bc107850 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.790+0000 7fe5c2437640 1 --2- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc07db10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009940 tx=0x7fe5b8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.791+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2699701697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5b8042070 con 0x7fe5bc107850 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.791+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2699701697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe5b803d930 con 0x7fe5bc107850 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.791+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5bc07c240 con 0x7fe5bc107850 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.791+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2699701697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5b8037040 con 0x7fe5bc107850 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.791+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5bc07c780 con 0x7fe5bc107850 2024-09-11T23:50:45.511 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.791+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2699701697 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fe5b8045070 con 0x7fe5bc107850 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.792+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5bc107c50 con 0x7fe5bc107850 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.792+0000 7fe5b37fe640 1 --2- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe5a8038fc0 0x7fe5a803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.792+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2699701697 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe5b806c290 con 0x7fe5bc107850 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.792+0000 7fe5c1c36640 1 --2- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe5a8038fc0 0x7fe5a803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.792+0000 7fe5c1c36640 1 --2- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe5a8038fc0 0x7fe5a803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0098c0 tx=0x7fe5ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.796+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2699701697 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe5b803ae40 con 0x7fe5bc107850 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.970+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fe5bc07ca00 con 0x7fe5bc107850 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.971+0000 7fe5b37fe640 1 -- 172.21.15.60:0/2699701697 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fe5b8043d00 con 0x7fe5bc107850 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe5a8038fc0 msgr2=0x7fe5a803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 --2- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe5a8038fc0 0x7fe5a803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0098c0 tx=0x7fe5ac006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:45.512 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 msgr2=0x7fe5bc07db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:45.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 --2- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc07db10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009940 tx=0x7fe5b8032670 comp rx=0 tx=0).stop 2024-09-11T23:50:45.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 shutdown_connections 2024-09-11T23:50:45.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 --2- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe5a8038fc0 0x7fe5a803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:45.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 --2- 172.21.15.60:0/2699701697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5bc107850 0x7fe5bc07db10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:45.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 >> 172.21.15.60:0/2699701697 conn(0x7fe5bc103020 msgr2=0x7fe5bc103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:45.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 shutdown_connections 2024-09-11T23:50:45.513 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:44.973+0000 7fe5c469b640 1 -- 172.21.15.60:0/2699701697 wait complete. 2024-09-11T23:50:45.519 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T23:50:45.519 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout disabled 2024-09-11T23:50:45.528 INFO:teuthology.orchestra.run.smithi060.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T23:50:45.528 INFO:teuthology.orchestra.run.smithi060.stdout:systemctl: stdout inactive 2024-09-11T23:50:45.528 INFO:teuthology.orchestra.run.smithi060.stdout:firewalld.service is not enabled 2024-09-11T23:50:45.528 INFO:teuthology.orchestra.run.smithi060.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T23:50:45.531 INFO:teuthology.orchestra.run.smithi060.stdout:Ceph Dashboard is now available at: 2024-09-11T23:50:45.531 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:45.531 INFO:teuthology.orchestra.run.smithi060.stdout: URL: https://smithi060.front.sepia.ceph.com:8443/ 2024-09-11T23:50:45.531 INFO:teuthology.orchestra.run.smithi060.stdout: User: admin 2024-09-11T23:50:45.531 INFO:teuthology.orchestra.run.smithi060.stdout: Password: e02ti9uumf 2024-09-11T23:50:45.531 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:45.531 INFO:teuthology.orchestra.run.smithi060.stdout:Saving cluster configuration to /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config directory 2024-09-11T23:50:46.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.905+0000 7f8b3bc31640 1 Processor -- start 2024-09-11T23:50:46.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.905+0000 7f8b3bc31640 1 -- start start 2024-09-11T23:50:46.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.905+0000 7f8b3bc31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b34107c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:46.715 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.905+0000 7f8b3bc31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b34108220 con 0x7f8b34107850 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.905+0000 7f8b399cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b34107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.905+0000 7f8b399cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b34107c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55900/0 (socket says 172.21.15.60:55900) 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.905+0000 7f8b399cd640 1 -- 172.21.15.60:0/1923459990 learned_addr learned my addr 172.21.15.60:0/1923459990 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.906+0000 7f8b399cd640 1 -- 172.21.15.60:0/1923459990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b34108a50 con 0x7f8b34107850 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.906+0000 7f8b399cd640 1 --2- 172.21.15.60:0/1923459990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b34107c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009820 tx=0x7f8b3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a13cf714ce27eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b389cb640 1 -- 172.21.15.60:0/1923459990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b30037070 con 0x7f8b34107850 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b389cb640 1 -- 172.21.15.60:0/1923459990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b30032940 con 0x7f8b34107850 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b389cb640 1 -- 172.21.15.60:0/1923459990 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b300308b0 con 0x7f8b34107850 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b3bc31640 1 -- 172.21.15.60:0/1923459990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 msgr2=0x7f8b34107c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b3bc31640 1 --2- 172.21.15.60:0/1923459990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b34107c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009820 tx=0x7f8b3002a270 comp rx=0 tx=0).stop 2024-09-11T23:50:46.716 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b3bc31640 1 -- 172.21.15.60:0/1923459990 shutdown_connections 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b3bc31640 1 --2- 172.21.15.60:0/1923459990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b34107c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b3bc31640 1 -- 172.21.15.60:0/1923459990 >> 172.21.15.60:0/1923459990 conn(0x7f8b34103020 msgr2=0x7f8b34105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b3bc31640 1 -- 172.21.15.60:0/1923459990 shutdown_connections 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.907+0000 7f8b3bc31640 1 -- 172.21.15.60:0/1923459990 wait complete. 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.908+0000 7f8b3bc31640 1 Processor -- start 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.908+0000 7f8b3bc31640 1 -- start start 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.908+0000 7f8b3bc31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b3407db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.908+0000 7f8b3bc31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3410be00 con 0x7f8b34107850 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.908+0000 7f8b399cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b3407db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.908+0000 7f8b399cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b3407db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55904/0 (socket says 172.21.15.60:55904) 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.908+0000 7f8b399cd640 1 -- 172.21.15.60:0/892854934 learned_addr learned my addr 172.21.15.60:0/892854934 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:46.717 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.909+0000 7f8b399cd640 1 -- 172.21.15.60:0/892854934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3407e050 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.909+0000 7f8b399cd640 1 --2- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b3407db10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b300097f0 tx=0x7f8b30032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.909+0000 7f8b2affd640 1 -- 172.21.15.60:0/892854934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b30042070 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.909+0000 7f8b2affd640 1 -- 172.21.15.60:0/892854934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8b3003d930 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.909+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3407c240 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.909+0000 7f8b2affd640 1 -- 172.21.15.60:0/892854934 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b30037040 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.909+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3407c780 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.910+0000 7f8b2affd640 1 -- 172.21.15.60:0/892854934 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f8b30045070 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.910+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b34107c50 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.910+0000 7f8b2affd640 1 --2- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f8b20038fc0 0x7f8b2003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.911+0000 7f8b2affd640 1 -- 172.21.15.60:0/892854934 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8b3006c190 con 0x7f8b34107850 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.911+0000 7f8b391cc640 1 --2- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f8b20038fc0 0x7f8b2003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:46.718 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.911+0000 7f8b391cc640 1 --2- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f8b20038fc0 0x7f8b2003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b240098c0 tx=0x7f8b24006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:45.915+0000 7f8b2affd640 1 -- 172.21.15.60:0/892854934 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b3004b170 con 0x7f8b34107850 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.024+0000 7f8b2affd640 1 -- 172.21.15.60:0/892854934 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8b3003d430 con 0x7f8b34107850 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.189+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f8b3407d060 con 0x7f8b34107850 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.192+0000 7f8b2affd640 1 -- 172.21.15.60:0/892854934 <== mon.0 v2:172.21.15.60:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f8b30042210 con 0x7f8b34107850 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f8b20038fc0 msgr2=0x7f8b2003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 --2- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f8b20038fc0 0x7f8b2003b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b240098c0 tx=0x7f8b24006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 msgr2=0x7f8b3407db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 --2- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b3407db10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b300097f0 tx=0x7f8b30032670 comp rx=0 tx=0).stop 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 shutdown_connections 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 --2- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f8b20038fc0 0x7f8b2003b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:46.719 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 --2- 172.21.15.60:0/892854934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b34107850 0x7f8b3407db10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 >> 172.21.15.60:0/892854934 conn(0x7f8b34103020 msgr2=0x7f8b34103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 shutdown_connections 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout:/usr/bin/ceph: stderr 2024-09-11T23:50:46.194+0000 7f8b3bc31640 1 -- 172.21.15.60:0/892854934 wait complete. 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: ceph telemetry on 2024-09-11T23:50:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:46.721 INFO:teuthology.orchestra.run.smithi060.stdout:For more information see: 2024-09-11T23:50:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T23:50:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:46.721 INFO:teuthology.orchestra.run.smithi060.stdout:Bootstrap complete. 2024-09-11T23:50:46.756 INFO:tasks.cephadm:Fetching config... 2024-09-11T23:50:46.756 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:50:46.756 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T23:50:46.773 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T23:50:46.773 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:50:46.773 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T23:50:46.829 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T23:50:46.829 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:50:46.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T23:50:46.895 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T23:50:46.895 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:50:46.895 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T23:50:46.951 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T23:50:46.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxymKSF2E4Yqfuif0iw9oMs93dWqFTFzWsv/yTGijfD27hSsp+gi6asCMzChSbRPScOxWvwWxRM3ChfuooUiT8tP9ngqpwagtp5ycOn+aH5Ja39BRWCdaVt8pPrYmX9RhwpJ6ZO7AE46alkvPJ34b69qwZyWUX9VsMOfFRX3ZD/VTbrIiYjSJmKadDS172kNYlpy7Ep12O4JODmt56zeDwYGEbo45gbzA9vNOJh6Nr9/dcPNke3UIs3SNgBPzcW53mDbSxDe6cDgGihQNwACZnQdZlJe6fZ72yexcPONnLq7tL8rrEf9GTPUcgwXr/zGvyYI5uEdvGR5aVM5f3navb+fHvC3u+89OlsumVSMXS4ZvVVwnGo2JyEqkXoFR+YF9k3piPMNZjzxbIORChiWLV5hwO6gxiI/suA3rZTb6azDeVl0sDDRb1/Bku2KN7YaJ1DAWelDo/ZOFTu2B4BHF5+Tdl/7tEAX5/5eZq7prYhlUu9xMutLpuVrNhoPQwxE= ceph-6b4d616e-7098-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:50:47.028 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxymKSF2E4Yqfuif0iw9oMs93dWqFTFzWsv/yTGijfD27hSsp+gi6asCMzChSbRPScOxWvwWxRM3ChfuooUiT8tP9ngqpwagtp5ycOn+aH5Ja39BRWCdaVt8pPrYmX9RhwpJ6ZO7AE46alkvPJ34b69qwZyWUX9VsMOfFRX3ZD/VTbrIiYjSJmKadDS172kNYlpy7Ep12O4JODmt56zeDwYGEbo45gbzA9vNOJh6Nr9/dcPNke3UIs3SNgBPzcW53mDbSxDe6cDgGihQNwACZnQdZlJe6fZ72yexcPONnLq7tL8rrEf9GTPUcgwXr/zGvyYI5uEdvGR5aVM5f3navb+fHvC3u+89OlsumVSMXS4ZvVVwnGo2JyEqkXoFR+YF9k3piPMNZjzxbIORChiWLV5hwO6gxiI/suA3rZTb6azDeVl0sDDRb1/Bku2KN7YaJ1DAWelDo/ZOFTu2B4BHF5+Tdl/7tEAX5/5eZq7prYhlUu9xMutLpuVrNhoPQwxE= ceph-6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:47.040 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxymKSF2E4Yqfuif0iw9oMs93dWqFTFzWsv/yTGijfD27hSsp+gi6asCMzChSbRPScOxWvwWxRM3ChfuooUiT8tP9ngqpwagtp5ycOn+aH5Ja39BRWCdaVt8pPrYmX9RhwpJ6ZO7AE46alkvPJ34b69qwZyWUX9VsMOfFRX3ZD/VTbrIiYjSJmKadDS172kNYlpy7Ep12O4JODmt56zeDwYGEbo45gbzA9vNOJh6Nr9/dcPNke3UIs3SNgBPzcW53mDbSxDe6cDgGihQNwACZnQdZlJe6fZ72yexcPONnLq7tL8rrEf9GTPUcgwXr/zGvyYI5uEdvGR5aVM5f3navb+fHvC3u+89OlsumVSMXS4ZvVVwnGo2JyEqkXoFR+YF9k3piPMNZjzxbIORChiWLV5hwO6gxiI/suA3rZTb6azDeVl0sDDRb1/Bku2KN7YaJ1DAWelDo/ZOFTu2B4BHF5+Tdl/7tEAX5/5eZq7prYhlUu9xMutLpuVrNhoPQwxE= ceph-6b4d616e-7098-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:50:47.082 INFO:teuthology.orchestra.run.smithi105.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxymKSF2E4Yqfuif0iw9oMs93dWqFTFzWsv/yTGijfD27hSsp+gi6asCMzChSbRPScOxWvwWxRM3ChfuooUiT8tP9ngqpwagtp5ycOn+aH5Ja39BRWCdaVt8pPrYmX9RhwpJ6ZO7AE46alkvPJ34b69qwZyWUX9VsMOfFRX3ZD/VTbrIiYjSJmKadDS172kNYlpy7Ep12O4JODmt56zeDwYGEbo45gbzA9vNOJh6Nr9/dcPNke3UIs3SNgBPzcW53mDbSxDe6cDgGihQNwACZnQdZlJe6fZ72yexcPONnLq7tL8rrEf9GTPUcgwXr/zGvyYI5uEdvGR5aVM5f3navb+fHvC3u+89OlsumVSMXS4ZvVVwnGo2JyEqkXoFR+YF9k3piPMNZjzxbIORChiWLV5hwO6gxiI/suA3rZTb6azDeVl0sDDRb1/Bku2KN7YaJ1DAWelDo/ZOFTu2B4BHF5+Tdl/7tEAX5/5eZq7prYhlUu9xMutLpuVrNhoPQwxE= ceph-6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:47.094 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxymKSF2E4Yqfuif0iw9oMs93dWqFTFzWsv/yTGijfD27hSsp+gi6asCMzChSbRPScOxWvwWxRM3ChfuooUiT8tP9ngqpwagtp5ycOn+aH5Ja39BRWCdaVt8pPrYmX9RhwpJ6ZO7AE46alkvPJ34b69qwZyWUX9VsMOfFRX3ZD/VTbrIiYjSJmKadDS172kNYlpy7Ep12O4JODmt56zeDwYGEbo45gbzA9vNOJh6Nr9/dcPNke3UIs3SNgBPzcW53mDbSxDe6cDgGihQNwACZnQdZlJe6fZ72yexcPONnLq7tL8rrEf9GTPUcgwXr/zGvyYI5uEdvGR5aVM5f3navb+fHvC3u+89OlsumVSMXS4ZvVVwnGo2JyEqkXoFR+YF9k3piPMNZjzxbIORChiWLV5hwO6gxiI/suA3rZTb6azDeVl0sDDRb1/Bku2KN7YaJ1DAWelDo/ZOFTu2B4BHF5+Tdl/7tEAX5/5eZq7prYhlUu9xMutLpuVrNhoPQwxE= ceph-6b4d616e-7098-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T23:50:47.137 INFO:teuthology.orchestra.run.smithi192.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxymKSF2E4Yqfuif0iw9oMs93dWqFTFzWsv/yTGijfD27hSsp+gi6asCMzChSbRPScOxWvwWxRM3ChfuooUiT8tP9ngqpwagtp5ycOn+aH5Ja39BRWCdaVt8pPrYmX9RhwpJ6ZO7AE46alkvPJ34b69qwZyWUX9VsMOfFRX3ZD/VTbrIiYjSJmKadDS172kNYlpy7Ep12O4JODmt56zeDwYGEbo45gbzA9vNOJh6Nr9/dcPNke3UIs3SNgBPzcW53mDbSxDe6cDgGihQNwACZnQdZlJe6fZ72yexcPONnLq7tL8rrEf9GTPUcgwXr/zGvyYI5uEdvGR5aVM5f3navb+fHvC3u+89OlsumVSMXS4ZvVVwnGo2JyEqkXoFR+YF9k3piPMNZjzxbIORChiWLV5hwO6gxiI/suA3rZTb6azDeVl0sDDRb1/Bku2KN7YaJ1DAWelDo/ZOFTu2B4BHF5+Tdl/7tEAX5/5eZq7prYhlUu9xMutLpuVrNhoPQwxE= ceph-6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:50:47.149 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T23:50:47.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:47 smithi060 ceph-mon[30953]: mgrmap e13: x(active, since 6s) 2024-09-11T23:50:47.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:47 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/892854934' entity='client.admin' 2024-09-11T23:50:47.405 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:48.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.904+0000 7f1f7e124640 1 -- 172.21.15.60:0/958789674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 msgr2=0x7f1f78100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.904+0000 7f1f7e124640 1 --2- 172.21.15.60:0/958789674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 0x7f1f78100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009880 tx=0x7f1f6802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.904+0000 7f1f7e124640 1 -- 172.21.15.60:0/958789674 shutdown_connections 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.904+0000 7f1f7e124640 1 --2- 172.21.15.60:0/958789674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 0x7f1f78100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.904+0000 7f1f7e124640 1 -- 172.21.15.60:0/958789674 >> 172.21.15.60:0/958789674 conn(0x7f1f780fbcd0 msgr2=0x7f1f780fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.904+0000 7f1f7e124640 1 -- 172.21.15.60:0/958789674 shutdown_connections 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.904+0000 7f1f7e124640 1 -- 172.21.15.60:0/958789674 wait complete. 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.904+0000 7f1f7e124640 1 Processor -- start 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.905+0000 7f1f7e124640 1 -- start start 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.905+0000 7f1f7e124640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 0x7f1f780fdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.905+0000 7f1f7e124640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1f78106740 con 0x7f1f78100540 2024-09-11T23:50:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.905+0000 7f1f777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 0x7f1f780fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.905+0000 7f1f777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 0x7f1f780fdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55916/0 (socket says 172.21.15.60:55916) 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.905+0000 7f1f777fe640 1 -- 172.21.15.60:0/2209396101 learned_addr learned my addr 172.21.15.60:0/2209396101 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.905+0000 7f1f777fe640 1 -- 172.21.15.60:0/2209396101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f780fe0d0 con 0x7f1f78100540 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.905+0000 7f1f777fe640 1 --2- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 0x7f1f780fdb90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009230 tx=0x7f1f68032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.906+0000 7f1f74ff9640 1 -- 172.21.15.60:0/2209396101 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6803f030 con 0x7f1f78100540 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.906+0000 7f1f74ff9640 1 -- 172.21.15.60:0/2209396101 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f68003d00 con 0x7f1f78100540 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.906+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f780fc2c0 con 0x7f1f78100540 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.906+0000 7f1f74ff9640 1 -- 172.21.15.60:0/2209396101 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f68035070 con 0x7f1f78100540 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.906+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f780fc800 con 0x7f1f78100540 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.907+0000 7f1f74ff9640 1 -- 172.21.15.60:0/2209396101 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1f68042030 con 0x7f1f78100540 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.907+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f78106ec0 con 0x7f1f78100540 2024-09-11T23:50:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.907+0000 7f1f74ff9640 1 --2- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f60039060 0x7f1f6003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.907+0000 7f1f74ff9640 1 -- 172.21.15.60:0/2209396101 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1f68040070 con 0x7f1f78100540 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.907+0000 7f1f76ffd640 1 --2- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f60039060 0x7f1f6003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.907+0000 7f1f76ffd640 1 --2- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f60039060 0x7f1f6003b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0098c0 tx=0x7f1f6c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:47.912+0000 7f1f74ff9640 1 -- 172.21.15.60:0/2209396101 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f6803b640 con 0x7f1f78100540 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.090+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f1f78190390 con 0x7f1f78100540 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.092+0000 7f1f74ff9640 1 -- 172.21.15.60:0/2209396101 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f1f68042d80 con 0x7f1f78100540 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f60039060 msgr2=0x7f1f6003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 --2- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f60039060 0x7f1f6003b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0098c0 tx=0x7f1f6c006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 msgr2=0x7f1f780fdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 --2- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 0x7f1f780fdb90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009230 tx=0x7f1f68032d00 comp rx=0 tx=0).stop 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 shutdown_connections 2024-09-11T23:50:48.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 --2- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f60039060 0x7f1f6003b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:48.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 --2- 172.21.15.60:0/2209396101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f78100540 0x7f1f780fdb90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:48.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 >> 172.21.15.60:0/2209396101 conn(0x7f1f780fbcd0 msgr2=0x7f1f78069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:48.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 shutdown_connections 2024-09-11T23:50:48.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:48.095+0000 7f1f7e124640 1 -- 172.21.15.60:0/2209396101 wait complete. 2024-09-11T23:50:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:49 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2209396101' entity='client.admin' 2024-09-11T23:50:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:50:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:49.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:49.418 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T23:50:49.418 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T23:50:50.172 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.570+0000 7efcf48ad640 1 -- 172.21.15.60:0/288273826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 msgr2=0x7efcf0101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.570+0000 7efcf48ad640 1 --2- 172.21.15.60:0/288273826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 0x7efcf0101a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efce0009880 tx=0x7efce002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.570+0000 7efcf48ad640 1 -- 172.21.15.60:0/288273826 shutdown_connections 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.570+0000 7efcf48ad640 1 --2- 172.21.15.60:0/288273826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 0x7efcf0101a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.570+0000 7efcf48ad640 1 -- 172.21.15.60:0/288273826 >> 172.21.15.60:0/288273826 conn(0x7efcf00fcdb0 msgr2=0x7efcf00ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.570+0000 7efcf48ad640 1 -- 172.21.15.60:0/288273826 shutdown_connections 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.570+0000 7efcf48ad640 1 -- 172.21.15.60:0/288273826 wait complete. 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.571+0000 7efcf48ad640 1 Processor -- start 2024-09-11T23:50:50.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.571+0000 7efcf48ad640 1 -- start start 2024-09-11T23:50:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.571+0000 7efcf48ad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 0x7efcf0196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.571+0000 7efcf48ad640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efcf0107850 con 0x7efcf0101600 2024-09-11T23:50:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcee59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 0x7efcf0196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcee59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 0x7efcf0196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55940/0 (socket says 172.21.15.60:55940) 2024-09-11T23:50:50.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcee59c640 1 -- 172.21.15.60:0/2365133757 learned_addr learned my addr 172.21.15.60:0/2365133757 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcee59c640 1 -- 172.21.15.60:0/2365133757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf01973c0 con 0x7efcf0101600 2024-09-11T23:50:50.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcee59c640 1 --2- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 0x7efcf0196e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efce0009230 tx=0x7efce0032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcdf7fe640 1 -- 172.21.15.60:0/2365133757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efce003f030 con 0x7efcf0101600 2024-09-11T23:50:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcdf7fe640 1 -- 172.21.15.60:0/2365133757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efce0003e30 con 0x7efcf0101600 2024-09-11T23:50:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf0197650 con 0x7efcf0101600 2024-09-11T23:50:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcdf7fe640 1 -- 172.21.15.60:0/2365133757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efce0035070 con 0x7efcf0101600 2024-09-11T23:50:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.572+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf019a340 con 0x7efcf0101600 2024-09-11T23:50:50.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.573+0000 7efcdf7fe640 1 -- 172.21.15.60:0/2365133757 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efce0042030 con 0x7efcf0101600 2024-09-11T23:50:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.573+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf0107fd0 con 0x7efcf0101600 2024-09-11T23:50:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.573+0000 7efcdf7fe640 1 --2- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efcd8039060 0x7efcd803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.573+0000 7efcdf7fe640 1 -- 172.21.15.60:0/2365133757 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efce0040070 con 0x7efcf0101600 2024-09-11T23:50:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.574+0000 7efcedd9b640 1 --2- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efcd8039060 0x7efcd803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:50.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.574+0000 7efcedd9b640 1 --2- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efcd8039060 0x7efcd803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efce40098c0 tx=0x7efce4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:50.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.578+0000 7efcdf7fe640 1 -- 172.21.15.60:0/2365133757 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efce004c350 con 0x7efcf0101600 2024-09-11T23:50:50.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.760+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7efcf002d830 con 0x7efcd8039060 2024-09-11T23:50:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.763+0000 7efcdf7fe640 1 -- 172.21.15.60:0/2365133757 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efcf002d830 con 0x7efcd8039060 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.765+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efcd8039060 msgr2=0x7efcd803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.765+0000 7efcf48ad640 1 --2- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efcd8039060 0x7efcd803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efce40098c0 tx=0x7efce4006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.765+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 msgr2=0x7efcf0196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.765+0000 7efcf48ad640 1 --2- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 0x7efcf0196e80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efce0009230 tx=0x7efce0032d00 comp rx=0 tx=0).stop 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.765+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 shutdown_connections 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.765+0000 7efcf48ad640 1 --2- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efcd8039060 0x7efcd803b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.765+0000 7efcf48ad640 1 --2- 172.21.15.60:0/2365133757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcf0101600 0x7efcf0196e80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.765+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 >> 172.21.15.60:0/2365133757 conn(0x7efcf00fcdb0 msgr2=0x7efcf00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.766+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 shutdown_connections 2024-09-11T23:50:50.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:50.766+0000 7efcf48ad640 1 -- 172.21.15.60:0/2365133757 wait complete. 2024-09-11T23:50:51.513 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi105 2024-09-11T23:50:51.513 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:50:51.513 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/etc/ceph/ceph.conf 2024-09-11T23:50:51.532 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:50:51.532 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:51.593 INFO:tasks.cephadm:Adding host smithi105 to orchestrator... 2024-09-11T23:50:51.594 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch host add smithi105 2024-09-11T23:50:51.844 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:52.048 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:52.049 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:52.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.271+0000 7f6820804640 1 -- 172.21.15.60:0/2466745507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 msgr2=0x7f681c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.271+0000 7f6820804640 1 --2- 172.21.15.60:0/2466745507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 0x7f681c106920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f680c009810 tx=0x7f680c02a540 comp rx=0 tx=0).stop 2024-09-11T23:50:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.271+0000 7f6820804640 1 -- 172.21.15.60:0/2466745507 shutdown_connections 2024-09-11T23:50:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.271+0000 7f6820804640 1 --2- 172.21.15.60:0/2466745507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 0x7f681c106920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.271+0000 7f6820804640 1 -- 172.21.15.60:0/2466745507 >> 172.21.15.60:0/2466745507 conn(0x7f681c077310 msgr2=0x7f681c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.271+0000 7f6820804640 1 -- 172.21.15.60:0/2466745507 shutdown_connections 2024-09-11T23:50:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.271+0000 7f6820804640 1 -- 172.21.15.60:0/2466745507 wait complete. 2024-09-11T23:50:52.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.272+0000 7f6820804640 1 Processor -- start 2024-09-11T23:50:52.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.272+0000 7f6820804640 1 -- start start 2024-09-11T23:50:52.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.272+0000 7f6820804640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 0x7f681c197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.272+0000 7f6820804640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f681c10acb0 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.272+0000 7f681a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 0x7f681c197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.272+0000 7f681a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 0x7f681c197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52964/0 (socket says 172.21.15.60:52964) 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.272+0000 7f681a59c640 1 -- 172.21.15.60:0/2220138109 learned_addr learned my addr 172.21.15.60:0/2220138109 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.272+0000 7f681a59c640 1 -- 172.21.15.60:0/2220138109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681c197750 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.273+0000 7f681a59c640 1 --2- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 0x7f681c197210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f680c0058e0 tx=0x7f680c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.273+0000 7f680b7fe640 1 -- 172.21.15.60:0/2220138109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f680c031400 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.273+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681c1979e0 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.273+0000 7f680b7fe640 1 -- 172.21.15.60:0/2220138109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f680c0035f0 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.273+0000 7f680b7fe640 1 -- 172.21.15.60:0/2220138109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f680c03c480 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.273+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f681c19bae0 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.274+0000 7f680b7fe640 1 -- 172.21.15.60:0/2220138109 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f680c039040 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.274+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681c101bb0 con 0x7f681c106540 2024-09-11T23:50:52.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.274+0000 7f680b7fe640 1 --2- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6804039060 0x7f680403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:52.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.274+0000 7f680b7fe640 1 -- 172.21.15.60:0/2220138109 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f680c06d4a0 con 0x7f681c106540 2024-09-11T23:50:52.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.274+0000 7f6819d9b640 1 --2- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6804039060 0x7f680403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:52.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.275+0000 7f6819d9b640 1 --2- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6804039060 0x7f680403b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68100098c0 tx=0x7f6810006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:52.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.279+0000 7f680b7fe640 1 -- 172.21.15.60:0/2220138109 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f680c040030 con 0x7f681c106540 2024-09-11T23:50:52.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:52.460+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi105", "target": ["mon-mgr", ""]}) -- 0x7f681c1069a0 con 0x7f6804039060 2024-09-11T23:50:53.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:52 smithi060 ceph-mon[30953]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:50:54.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:53 smithi060 ceph-mon[30953]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi105", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:50:55.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:54 smithi060 ceph-mon[30953]: Deploying cephadm binary to smithi105 2024-09-11T23:50:56.270 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi105' with addr '172.21.15.105' 2024-09-11T23:50:56.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.270+0000 7f680b7fe640 1 -- 172.21.15.60:0/2220138109 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f681c1069a0 con 0x7f6804039060 2024-09-11T23:50:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.272+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6804039060 msgr2=0x7f680403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.272+0000 7f6820804640 1 --2- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6804039060 0x7f680403b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68100098c0 tx=0x7f6810006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.272+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 msgr2=0x7f681c197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:56.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.272+0000 7f6820804640 1 --2- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 0x7f681c197210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f680c0058e0 tx=0x7f680c0045e0 comp rx=0 tx=0).stop 2024-09-11T23:50:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.272+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 shutdown_connections 2024-09-11T23:50:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.272+0000 7f6820804640 1 --2- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6804039060 0x7f680403b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.272+0000 7f6820804640 1 --2- 172.21.15.60:0/2220138109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f681c106540 0x7f681c197210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.272+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 >> 172.21.15.60:0/2220138109 conn(0x7f681c077310 msgr2=0x7f681c0696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.273+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 shutdown_connections 2024-09-11T23:50:56.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:56.273+0000 7f6820804640 1 -- 172.21.15.60:0/2220138109 wait complete. 2024-09-11T23:50:56.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T23:50:57.127 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:57.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:57.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:50:57.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:57.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:57.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.592+0000 7f96cbbc4640 1 -- 172.21.15.60:0/4076399338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 msgr2=0x7f96c4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:57.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.592+0000 7f96cbbc4640 1 --2- 172.21.15.60:0/4076399338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 0x7f96c4107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009880 tx=0x7f96c002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:50:57.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.592+0000 7f96cbbc4640 1 -- 172.21.15.60:0/4076399338 shutdown_connections 2024-09-11T23:50:57.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.592+0000 7f96cbbc4640 1 --2- 172.21.15.60:0/4076399338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 0x7f96c4107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.592+0000 7f96cbbc4640 1 -- 172.21.15.60:0/4076399338 >> 172.21.15.60:0/4076399338 conn(0x7f96c40fd2b0 msgr2=0x7f96c40ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.592+0000 7f96cbbc4640 1 -- 172.21.15.60:0/4076399338 shutdown_connections 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.592+0000 7f96cbbc4640 1 -- 172.21.15.60:0/4076399338 wait complete. 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.593+0000 7f96cbbc4640 1 Processor -- start 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.593+0000 7f96cbbc4640 1 -- start start 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.593+0000 7f96cbbc4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 0x7f96c4197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.593+0000 7f96cbbc4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96c410bdd0 con 0x7f96c4107660 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.593+0000 7f96c9960640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 0x7f96c4197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.593+0000 7f96c9960640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 0x7f96c4197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52972/0 (socket says 172.21.15.60:52972) 2024-09-11T23:50:57.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.593+0000 7f96c9960640 1 -- 172.21.15.60:0/1399038832 learned_addr learned my addr 172.21.15.60:0/1399038832 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:57.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.593+0000 7f96c9960640 1 -- 172.21.15.60:0/1399038832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c4197740 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.594+0000 7f96c9960640 1 --2- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 0x7f96c4197200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96c0006010 tx=0x7f96c0003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.594+0000 7f96baffd640 1 -- 172.21.15.60:0/1399038832 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96c003f070 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.594+0000 7f96baffd640 1 -- 172.21.15.60:0/1399038832 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f96c0031c20 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.594+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c41979d0 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.594+0000 7f96baffd640 1 -- 172.21.15.60:0/1399038832 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96c0035030 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.594+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c419bad0 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.595+0000 7f96baffd640 1 -- 172.21.15.60:0/1399038832 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f96c0042070 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.595+0000 7f96baffd640 1 --2- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f96b0039060 0x7f96b003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.595+0000 7f96baffd640 1 -- 172.21.15.60:0/1399038832 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f96c006ccc0 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.595+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c4102cd0 con 0x7f96c4107660 2024-09-11T23:50:57.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.595+0000 7f96c915f640 1 --2- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f96b0039060 0x7f96b003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:57.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.595+0000 7f96c915f640 1 --2- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f96b0039060 0x7f96b003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96b40098c0 tx=0x7f96b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:57.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.600+0000 7f96baffd640 1 -- 172.21.15.60:0/1399038832 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96c004c350 con 0x7f96c4107660 2024-09-11T23:50:57.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.779+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96c4107ac0 con 0x7f96b0039060 2024-09-11T23:50:57.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.780+0000 7f96baffd640 1 -- 172.21.15.60:0/1399038832 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f96c4107ac0 con 0x7f96b0039060 2024-09-11T23:50:57.781 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:50:57.781 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.105", "hostname": "smithi105", "labels": [], "status": ""}] 2024-09-11T23:50:57.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f96b0039060 msgr2=0x7f96b003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:57.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 --2- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f96b0039060 0x7f96b003b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96b40098c0 tx=0x7f96b4006db0 comp rx=0 tx=0).stop 2024-09-11T23:50:57.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 msgr2=0x7f96c4197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:57.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 --2- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 0x7f96c4197200 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96c0006010 tx=0x7f96c0003c00 comp rx=0 tx=0).stop 2024-09-11T23:50:57.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 shutdown_connections 2024-09-11T23:50:57.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 --2- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f96b0039060 0x7f96b003b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:57.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 --2- 172.21.15.60:0/1399038832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4107660 0x7f96c4197200 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:57.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 >> 172.21.15.60:0/1399038832 conn(0x7f96c40fd2b0 msgr2=0x7f96c40feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:57.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 shutdown_connections 2024-09-11T23:50:57.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:57.783+0000 7f96cbbc4640 1 -- 172.21.15.60:0/1399038832 wait complete. 2024-09-11T23:50:58.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:58 smithi060 ceph-mon[30953]: Added host smithi105 2024-09-11T23:50:58.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:50:58.426 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi192 2024-09-11T23:50:58.426 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:50:58.427 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.conf 2024-09-11T23:50:58.445 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:50:58.446 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:50:58.504 INFO:tasks.cephadm:Adding host smithi192 to orchestrator... 2024-09-11T23:50:58.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch host add smithi192 2024-09-11T23:50:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:50:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.143+0000 7f5342234640 1 -- 172.21.15.60:0/2339976560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 msgr2=0x7f533c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:50:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.143+0000 7f5342234640 1 --2- 172.21.15.60:0/2339976560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 0x7f533c102b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f532c009c20 tx=0x7f532c02ab20 comp rx=0 tx=0).stop 2024-09-11T23:50:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.143+0000 7f5342234640 1 -- 172.21.15.60:0/2339976560 shutdown_connections 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.143+0000 7f5342234640 1 --2- 172.21.15.60:0/2339976560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 0x7f533c102b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.143+0000 7f5342234640 1 -- 172.21.15.60:0/2339976560 >> 172.21.15.60:0/2339976560 conn(0x7f533c0fc1b0 msgr2=0x7f533c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.143+0000 7f5342234640 1 -- 172.21.15.60:0/2339976560 shutdown_connections 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.143+0000 7f5342234640 1 -- 172.21.15.60:0/2339976560 wait complete. 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.143+0000 7f5342234640 1 Processor -- start 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.144+0000 7f5342234640 1 -- start start 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.144+0000 7f5342234640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 0x7f533c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.144+0000 7f5342234640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f533c10be00 con 0x7f533c102750 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.144+0000 7f533b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 0x7f533c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.144+0000 7f533b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 0x7f533c197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52998/0 (socket says 172.21.15.60:52998) 2024-09-11T23:50:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.144+0000 7f533b7fe640 1 -- 172.21.15.60:0/4228719551 learned_addr learned my addr 172.21.15.60:0/4228719551 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:50:59.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.144+0000 7f533b7fe640 1 -- 172.21.15.60:0/4228719551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c197790 con 0x7f533c102750 2024-09-11T23:50:59.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.145+0000 7f533b7fe640 1 --2- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 0x7f533c197250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f532c006010 tx=0x7f532c0369a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:59.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.145+0000 7f5338ff9640 1 -- 172.21.15.60:0/4228719551 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c045070 con 0x7f533c102750 2024-09-11T23:50:59.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.145+0000 7f5338ff9640 1 -- 172.21.15.60:0/4228719551 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f532c003b80 con 0x7f533c102750 2024-09-11T23:50:59.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.145+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c197a20 con 0x7f533c102750 2024-09-11T23:50:59.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.145+0000 7f5338ff9640 1 -- 172.21.15.60:0/4228719551 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c040760 con 0x7f533c102750 2024-09-11T23:50:59.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.145+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c197e80 con 0x7f533c102750 2024-09-11T23:50:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.146+0000 7f5338ff9640 1 -- 172.21.15.60:0/4228719551 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f532c048070 con 0x7f533c102750 2024-09-11T23:50:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.146+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c06a7b0 con 0x7f533c102750 2024-09-11T23:50:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.146+0000 7f5338ff9640 1 --2- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f53280390c0 0x7f532803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:50:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.146+0000 7f5338ff9640 1 -- 172.21.15.60:0/4228719551 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f532c03c030 con 0x7f533c102750 2024-09-11T23:50:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.146+0000 7f533affd640 1 --2- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f53280390c0 0x7f532803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:50:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.146+0000 7f533affd640 1 --2- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f53280390c0 0x7f532803b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f53240098c0 tx=0x7f5324006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:50:59.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.151+0000 7f5338ff9640 1 -- 172.21.15.60:0/4228719551 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f532c032030 con 0x7f533c102750 2024-09-11T23:50:59.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:50:59.330+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}) -- 0x7f533c1985b0 con 0x7f53280390c0 2024-09-11T23:50:59.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:50:59 smithi060 ceph-mon[30953]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:51:00.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:00 smithi060 ceph-mon[30953]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:00.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:00 smithi060 ceph-mon[30953]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:01.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: Deploying cephadm binary to smithi192 2024-09-11T23:51:01.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:01.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:01.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:01.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:01.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi105", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:01.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:01.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:01.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-11T23:51:01.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:01.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:51:01.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:51:01.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:01.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:01.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:02.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:02 smithi060 ceph-mon[30953]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:03.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.214+0000 7f5338ff9640 1 -- 172.21.15.60:0/4228719551 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f533c1985b0 con 0x7f53280390c0 2024-09-11T23:51:03.215 INFO:teuthology.orchestra.run.smithi060.stdout:Added host 'smithi192' with addr '172.21.15.192' 2024-09-11T23:51:03.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f53280390c0 msgr2=0x7f532803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:03.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 --2- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f53280390c0 0x7f532803b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f53240098c0 tx=0x7f5324006db0 comp rx=0 tx=0).stop 2024-09-11T23:51:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 msgr2=0x7f533c197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 --2- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 0x7f533c197250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f532c006010 tx=0x7f532c0369a0 comp rx=0 tx=0).stop 2024-09-11T23:51:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 shutdown_connections 2024-09-11T23:51:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 --2- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f53280390c0 0x7f532803b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 --2- 172.21.15.60:0/4228719551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f533c102750 0x7f533c197250 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 >> 172.21.15.60:0/4228719551 conn(0x7f533c0fc1b0 msgr2=0x7f533c1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 shutdown_connections 2024-09-11T23:51:03.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:03.217+0000 7f5342234640 1 -- 172.21.15.60:0/4228719551 wait complete. 2024-09-11T23:51:03.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T23:51:04.121 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:51:04.508 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:04.508 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:04 smithi060 ceph-mon[30953]: Added host smithi192 2024-09-11T23:51:04.508 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:04.508 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:04.508 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.516+0000 7f451315f640 1 -- 172.21.15.60:0/538000861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 msgr2=0x7f450c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.516+0000 7f451315f640 1 --2- 172.21.15.60:0/538000861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 0x7f450c106920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009810 tx=0x7f44fc02a540 comp rx=0 tx=0).stop 2024-09-11T23:51:04.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.516+0000 7f451315f640 1 -- 172.21.15.60:0/538000861 shutdown_connections 2024-09-11T23:51:04.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.516+0000 7f451315f640 1 --2- 172.21.15.60:0/538000861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 0x7f450c106920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:04.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.516+0000 7f451315f640 1 -- 172.21.15.60:0/538000861 >> 172.21.15.60:0/538000861 conn(0x7f450c077310 msgr2=0x7f450c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:04.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.516+0000 7f451315f640 1 -- 172.21.15.60:0/538000861 shutdown_connections 2024-09-11T23:51:04.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.516+0000 7f451315f640 1 -- 172.21.15.60:0/538000861 wait complete. 2024-09-11T23:51:04.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f451315f640 1 Processor -- start 2024-09-11T23:51:04.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f451315f640 1 -- start start 2024-09-11T23:51:04.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f451315f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 0x7f450c195040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:04.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f451315f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f450c109bd0 con 0x7f450c106540 2024-09-11T23:51:04.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f4510efb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 0x7f450c195040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:04.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f4510efb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 0x7f450c195040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45146/0 (socket says 172.21.15.60:45146) 2024-09-11T23:51:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f4510efb640 1 -- 172.21.15.60:0/3111338509 learned_addr learned my addr 172.21.15.60:0/3111338509 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:51:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f4510efb640 1 -- 172.21.15.60:0/3111338509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450c195580 con 0x7f450c106540 2024-09-11T23:51:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f4510efb640 1 --2- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 0x7f450c195040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0058e0 tx=0x7f44fc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.517+0000 7f4509ffb640 1 -- 172.21.15.60:0/3111338509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44fc031400 con 0x7f450c106540 2024-09-11T23:51:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.518+0000 7f4509ffb640 1 -- 172.21.15.60:0/3111338509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44fc0035f0 con 0x7f450c106540 2024-09-11T23:51:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.518+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450c195810 con 0x7f450c106540 2024-09-11T23:51:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.518+0000 7f4509ffb640 1 -- 172.21.15.60:0/3111338509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44fc03c480 con 0x7f450c106540 2024-09-11T23:51:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.518+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450c199910 con 0x7f450c106540 2024-09-11T23:51:04.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.519+0000 7f4509ffb640 1 -- 172.21.15.60:0/3111338509 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f44fc039040 con 0x7f450c106540 2024-09-11T23:51:04.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.519+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450c101bb0 con 0x7f450c106540 2024-09-11T23:51:04.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.519+0000 7f4509ffb640 1 --2- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f44f803b310 0x7f44f803d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:04.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.519+0000 7f4509ffb640 1 -- 172.21.15.60:0/3111338509 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f44fc06d4d0 con 0x7f450c106540 2024-09-11T23:51:04.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.519+0000 7f450bfff640 1 --2- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f44f803b310 0x7f44f803d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:04.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.519+0000 7f450bfff640 1 --2- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f44f803b310 0x7f44f803d7d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44f40098c0 tx=0x7f44f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:04.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.524+0000 7f4509ffb640 1 -- 172.21.15.60:0/3111338509 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44fc040030 con 0x7f450c106540 2024-09-11T23:51:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.705+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f450c1963a0 con 0x7f44f803b310 2024-09-11T23:51:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.706+0000 7f4509ffb640 1 -- 172.21.15.60:0/3111338509 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f450c1963a0 con 0x7f44f803b310 2024-09-11T23:51:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:51:04.707 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.105", "hostname": "smithi105", "labels": [], "status": ""}, {"addr": "172.21.15.192", "hostname": "smithi192", "labels": [], "status": ""}] 2024-09-11T23:51:04.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f44f803b310 msgr2=0x7f44f803d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:04.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 --2- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f44f803b310 0x7f44f803d7d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44f40098c0 tx=0x7f44f4006db0 comp rx=0 tx=0).stop 2024-09-11T23:51:04.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 msgr2=0x7f450c195040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:04.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 --2- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 0x7f450c195040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0058e0 tx=0x7f44fc0045e0 comp rx=0 tx=0).stop 2024-09-11T23:51:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 shutdown_connections 2024-09-11T23:51:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 --2- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f44f803b310 0x7f44f803d7d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 --2- 172.21.15.60:0/3111338509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f450c106540 0x7f450c195040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 >> 172.21.15.60:0/3111338509 conn(0x7f450c077310 msgr2=0x7f450c0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 shutdown_connections 2024-09-11T23:51:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:04.709+0000 7f451315f640 1 -- 172.21.15.60:0/3111338509 wait complete. 2024-09-11T23:51:05.332 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:05 smithi060 ceph-mon[30953]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:05.332 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:05 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:05.333 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T23:51:05.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T23:51:05.584 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:51:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.005+0000 7fc7f350a640 1 -- 172.21.15.60:0/3585155607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 msgr2=0x7fc7ec106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.005+0000 7fc7f350a640 1 --2- 172.21.15.60:0/3585155607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 0x7fc7ec106920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009810 tx=0x7fc7dc02a540 comp rx=0 tx=0).stop 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.005+0000 7fc7f350a640 1 -- 172.21.15.60:0/3585155607 shutdown_connections 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.005+0000 7fc7f350a640 1 --2- 172.21.15.60:0/3585155607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 0x7fc7ec106920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.005+0000 7fc7f350a640 1 -- 172.21.15.60:0/3585155607 >> 172.21.15.60:0/3585155607 conn(0x7fc7ec077310 msgr2=0x7fc7ec0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.005+0000 7fc7f350a640 1 -- 172.21.15.60:0/3585155607 shutdown_connections 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.005+0000 7fc7f350a640 1 -- 172.21.15.60:0/3585155607 wait complete. 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f350a640 1 Processor -- start 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f350a640 1 -- start start 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f350a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 0x7fc7ec0fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f350a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec10acb0 con 0x7fc7ec106540 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f12a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 0x7fc7ec0fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:06.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f12a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 0x7fc7ec0fd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45158/0 (socket says 172.21.15.60:45158) 2024-09-11T23:51:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f12a6640 1 -- 172.21.15.60:0/456308256 learned_addr learned my addr 172.21.15.60:0/456308256 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:51:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f12a6640 1 -- 172.21.15.60:0/456308256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec0ff230 con 0x7fc7ec106540 2024-09-11T23:51:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.006+0000 7fc7f12a6640 1 --2- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 0x7fc7ec0fd340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0058e0 tx=0x7fc7dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.007+0000 7fc7ea7fc640 1 -- 172.21.15.60:0/456308256 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7dc031400 con 0x7fc7ec106540 2024-09-11T23:51:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.007+0000 7fc7ea7fc640 1 -- 172.21.15.60:0/456308256 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc7dc0035f0 con 0x7fc7ec106540 2024-09-11T23:51:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.007+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ec0fd880 con 0x7fc7ec106540 2024-09-11T23:51:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.007+0000 7fc7ea7fc640 1 -- 172.21.15.60:0/456308256 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7dc03c480 con 0x7fc7ec106540 2024-09-11T23:51:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.007+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ec0fdd40 con 0x7fc7ec106540 2024-09-11T23:51:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.007+0000 7fc7ea7fc640 1 -- 172.21.15.60:0/456308256 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc7dc039040 con 0x7fc7ec106540 2024-09-11T23:51:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.008+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ec101bb0 con 0x7fc7ec106540 2024-09-11T23:51:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.008+0000 7fc7ea7fc640 1 --2- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc7d40390c0 0x7fc7d403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.008+0000 7fc7ea7fc640 1 -- 172.21.15.60:0/456308256 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc7dc06d4f0 con 0x7fc7ec106540 2024-09-11T23:51:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.008+0000 7fc7f0aa5640 1 --2- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc7d40390c0 0x7fc7d403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.008+0000 7fc7f0aa5640 1 --2- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc7d40390c0 0x7fc7d403b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000ad30 tx=0x7fc7e00093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:06.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.012+0000 7fc7ea7fc640 1 -- 172.21.15.60:0/456308256 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7dc040030 con 0x7fc7ec106540 2024-09-11T23:51:06.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.192+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc7ec0fe870 con 0x7fc7ec106540 2024-09-11T23:51:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.218+0000 7fc7ea7fc640 1 -- 172.21.15.60:0/456308256 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fc7dc04bb10 con 0x7fc7ec106540 2024-09-11T23:51:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc7d40390c0 msgr2=0x7fc7d403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 --2- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc7d40390c0 0x7fc7d403b580 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000ad30 tx=0x7fc7e00093f0 comp rx=0 tx=0).stop 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 msgr2=0x7fc7ec0fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 --2- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 0x7fc7ec0fd340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0058e0 tx=0x7fc7dc0045e0 comp rx=0 tx=0).stop 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 shutdown_connections 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 --2- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc7d40390c0 0x7fc7d403b580 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 --2- 172.21.15.60:0/456308256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7ec106540 0x7fc7ec0fd340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 >> 172.21.15.60:0/456308256 conn(0x7fc7ec077310 msgr2=0x7fc7ec0696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 shutdown_connections 2024-09-11T23:51:06.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:06.220+0000 7fc7f350a640 1 -- 172.21.15.60:0/456308256 wait complete. 2024-09-11T23:51:06.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:06 smithi060 ceph-mon[30953]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:51:06.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:06 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/456308256' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T23:51:06.790 INFO:tasks.cephadm:Adding mon.a on smithi060 2024-09-11T23:51:06.790 INFO:tasks.cephadm:Adding mon.b on smithi105 2024-09-11T23:51:06.790 INFO:tasks.cephadm:Adding mon.c on smithi192 2024-09-11T23:51:06.790 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c' 2024-09-11T23:51:07.544 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T23:51:07.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:07 smithi060 ceph-mon[30953]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:07.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:07 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/456308256' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T23:51:07.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:07 smithi060 ceph-mon[30953]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:07.589 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-11T23:51:08.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.068+0000 7ff48450b640 1 -- 172.21.15.192:0/4148726311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 msgr2=0x7ff47c104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:08.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.068+0000 7ff48450b640 1 --2- 172.21.15.192:0/4148726311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 0x7ff47c104490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff478009880 tx=0x7ff47802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:51:08.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.068+0000 7ff48450b640 1 -- 172.21.15.192:0/4148726311 shutdown_connections 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.068+0000 7ff48450b640 1 --2- 172.21.15.192:0/4148726311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 0x7ff47c104490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.068+0000 7ff48450b640 1 -- 172.21.15.192:0/4148726311 >> 172.21.15.192:0/4148726311 conn(0x7ff47c0fbc80 msgr2=0x7ff47c0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.068+0000 7ff48450b640 1 -- 172.21.15.192:0/4148726311 shutdown_connections 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.068+0000 7ff48450b640 1 -- 172.21.15.192:0/4148726311 wait complete. 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.069+0000 7ff48450b640 1 Processor -- start 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.069+0000 7ff48450b640 1 -- start start 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.069+0000 7ff48450b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 0x7ff47c101920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.069+0000 7ff48450b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c1077f0 con 0x7ff47c1020a0 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.069+0000 7ff4822a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 0x7ff47c101920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.069+0000 7ff4822a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 0x7ff47c101920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.192:47710/0 (socket says 172.21.15.192:47710) 2024-09-11T23:51:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.069+0000 7ff4822a7640 1 -- 172.21.15.192:0/490726002 learned_addr learned my addr 172.21.15.192:0/490726002 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.069+0000 7ff4822a7640 1 -- 172.21.15.192:0/490726002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47c101e60 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.070+0000 7ff4822a7640 1 --2- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 0x7ff47c101920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff478009230 tx=0x7ff478032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.070+0000 7ff4737fe640 1 -- 172.21.15.192:0/490726002 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff47803f030 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.070+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47c100050 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.070+0000 7ff4737fe640 1 -- 172.21.15.192:0/490726002 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff478003e30 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.070+0000 7ff4737fe640 1 -- 172.21.15.192:0/490726002 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff478035070 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.070+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47c100590 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.071+0000 7ff4737fe640 1 -- 172.21.15.192:0/490726002 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff478042030 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.071+0000 7ff4737fe640 1 --2- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff468039060 0x7ff46803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.071+0000 7ff4737fe640 1 -- 172.21.15.192:0/490726002 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff478040070 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.071+0000 7ff481aa6640 1 --2- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff468039060 0x7ff46803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.071+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47c107f70 con 0x7ff47c1020a0 2024-09-11T23:51:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.072+0000 7ff481aa6640 1 --2- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff468039060 0x7ff46803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0098c0 tx=0x7ff46c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:08.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.077+0000 7ff4737fe640 1 -- 172.21.15.192:0/490726002 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff47804c350 con 0x7ff47c1020a0 2024-09-11T23:51:08.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.270+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}) -- 0x7ff47c190260 con 0x7ff468039060 2024-09-11T23:51:08.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.275+0000 7ff4737fe640 1 -- 172.21.15.192:0/490726002 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff47c190260 con 0x7ff468039060 2024-09-11T23:51:08.275 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mon update... 2024-09-11T23:51:08.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.277+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff468039060 msgr2=0x7ff46803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:08.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.277+0000 7ff48450b640 1 --2- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff468039060 0x7ff46803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0098c0 tx=0x7ff46c006db0 comp rx=0 tx=0).stop 2024-09-11T23:51:08.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.277+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 msgr2=0x7ff47c101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:08.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.277+0000 7ff48450b640 1 --2- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 0x7ff47c101920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff478009230 tx=0x7ff478032d00 comp rx=0 tx=0).stop 2024-09-11T23:51:08.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.277+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 shutdown_connections 2024-09-11T23:51:08.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.277+0000 7ff48450b640 1 --2- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff468039060 0x7ff46803b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:08.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.277+0000 7ff48450b640 1 --2- 172.21.15.192:0/490726002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff47c1020a0 0x7ff47c101920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:08.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.277+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 >> 172.21.15.192:0/490726002 conn(0x7ff47c0fbc80 msgr2=0x7ff47c0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:08.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.278+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 shutdown_connections 2024-09-11T23:51:08.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:08.278+0000 7ff48450b640 1 -- 172.21.15.192:0/490726002 wait complete. 2024-09-11T23:51:08.824 DEBUG:teuthology.orchestra.run.smithi105:mon.b> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T23:51:08.827 DEBUG:teuthology.orchestra.run.smithi192:mon.c> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T23:51:08.830 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:51:08.830 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:51:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:08.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:08.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:09.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:09 smithi060 ceph-mon[30953]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:09.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:09 smithi060 ceph-mon[30953]: Saving service mon spec with placement smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c;count:3 2024-09-11T23:51:09.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:09 smithi060 ceph-mon[30953]: Deploying daemon mon.c on smithi192 2024-09-11T23:51:10.512 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:10.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:10 smithi060 ceph-mon[30953]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:11.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.572+0000 7fcc24e10640 1 -- 172.21.15.192:0/2847778943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 msgr2=0x7fcc201069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:11.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.572+0000 7fcc24e10640 1 --2- 172.21.15.192:0/2847778943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 0x7fcc201069d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009880 tx=0x7fcc1002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:51:11.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.573+0000 7fcc24e10640 1 -- 172.21.15.192:0/2847778943 shutdown_connections 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.573+0000 7fcc24e10640 1 --2- 172.21.15.192:0/2847778943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 0x7fcc201069d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.573+0000 7fcc24e10640 1 -- 172.21.15.192:0/2847778943 >> 172.21.15.192:0/2847778943 conn(0x7fcc200fb930 msgr2=0x7fcc200fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.573+0000 7fcc24e10640 1 -- 172.21.15.192:0/2847778943 shutdown_connections 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.573+0000 7fcc24e10640 1 -- 172.21.15.192:0/2847778943 wait complete. 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.574+0000 7fcc24e10640 1 Processor -- start 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.574+0000 7fcc24e10640 1 -- start start 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.574+0000 7fcc24e10640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 0x7fcc20196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.574+0000 7fcc24e10640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2010ad40 con 0x7fcc201065f0 2024-09-11T23:51:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.574+0000 7fcc1e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 0x7fcc20196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.574+0000 7fcc1e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 0x7fcc20196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.192:47718/0 (socket says 172.21.15.192:47718) 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.574+0000 7fcc1e59c640 1 -- 172.21.15.192:0/3928714977 learned_addr learned my addr 172.21.15.192:0/3928714977 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.575+0000 7fcc1e59c640 1 -- 172.21.15.192:0/3928714977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc20196650 con 0x7fcc201065f0 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.575+0000 7fcc1e59c640 1 --2- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 0x7fcc20196110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc10006010 tx=0x7fcc10003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.575+0000 7fcc0f7fe640 1 -- 172.21.15.192:0/3928714977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc1003f070 con 0x7fcc201065f0 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.575+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc201968e0 con 0x7fcc201065f0 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.575+0000 7fcc0f7fe640 1 -- 172.21.15.192:0/3928714977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc10031c20 con 0x7fcc201065f0 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.575+0000 7fcc0f7fe640 1 -- 172.21.15.192:0/3928714977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc10035030 con 0x7fcc201065f0 2024-09-11T23:51:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.575+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2019a9e0 con 0x7fcc201065f0 2024-09-11T23:51:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.576+0000 7fcc0f7fe640 1 -- 172.21.15.192:0/3928714977 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcc10042070 con 0x7fcc201065f0 2024-09-11T23:51:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.576+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc20101c40 con 0x7fcc201065f0 2024-09-11T23:51:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.577+0000 7fcc0f7fe640 1 --2- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fcc0803b270 0x7fcc0803d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.577+0000 7fcc0f7fe640 1 -- 172.21.15.192:0/3928714977 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcc1006cd70 con 0x7fcc201065f0 2024-09-11T23:51:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.577+0000 7fcc1dd9b640 1 --2- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fcc0803b270 0x7fcc0803d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.578+0000 7fcc1dd9b640 1 --2- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fcc0803b270 0x7fcc0803d730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc140098c0 tx=0x7fcc14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.582+0000 7fcc0f7fe640 1 -- 172.21.15.192:0/3928714977 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc10071070 con 0x7fcc201065f0 2024-09-11T23:51:11.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.843+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fcc201069d0 con 0x7fcc201065f0 2024-09-11T23:51:11.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.844+0000 7fcc0f7fe640 1 -- 172.21.15.192:0/3928714977 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fcc1004c350 con 0x7fcc201065f0 2024-09-11T23:51:11.844 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:51:11.844 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:49:40.118605Z","created":"2024-09-11T23:49:40.118605Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T23:51:11.845 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-11T23:51:11.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fcc0803b270 msgr2=0x7fcc0803d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:11.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 --2- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fcc0803b270 0x7fcc0803d730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc140098c0 tx=0x7fcc14006db0 comp rx=0 tx=0).stop 2024-09-11T23:51:11.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 msgr2=0x7fcc20196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:11.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 --2- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 0x7fcc20196110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc10006010 tx=0x7fcc10003c00 comp rx=0 tx=0).stop 2024-09-11T23:51:11.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 shutdown_connections 2024-09-11T23:51:11.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 --2- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fcc0803b270 0x7fcc0803d730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:11.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 --2- 172.21.15.192:0/3928714977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc201065f0 0x7fcc20196110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:11.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 >> 172.21.15.192:0/3928714977 conn(0x7fcc200fb930 msgr2=0x7fcc200fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:11.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 shutdown_connections 2024-09-11T23:51:11.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:11.846+0000 7fcc24e10640 1 -- 172.21.15.192:0/3928714977 wait complete. 2024-09-11T23:51:12.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 systemd[1]: Starting Ceph mon.c for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:51:12.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:12 smithi060 ceph-mon[30953]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:12.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:12 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/3928714977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:12.972 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 podman[35468]: 2024-09-11 23:51:12.720982295 +0000 UTC m=+0.119671455 container create 6e6cfd1a1b590e304cfe7e74134b7bb43a63da5b0ce5c0fdaf61fdc33da77ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T23:51:12.972 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 podman[35468]: 2024-09-11 23:51:12.627764309 +0000 UTC m=+0.026453486 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:51:12.972 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 podman[35468]: 2024-09-11 23:51:12.92341173 +0000 UTC m=+0.322100893 container init 6e6cfd1a1b590e304cfe7e74134b7bb43a63da5b0ce5c0fdaf61fdc33da77ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T23:51:12.972 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 podman[35468]: 2024-09-11 23:51:12.926530776 +0000 UTC m=+0.325219940 container start 6e6cfd1a1b590e304cfe7e74134b7bb43a63da5b0ce5c0fdaf61fdc33da77ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:51:12.972 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T23:51:12.972 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: pidfile_write: ignore empty --pid-file 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: load: jerasure load: lrc 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: RocksDB version: 7.9.2 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Git sha 0 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: DB SUMMARY 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: DB Session ID: KCE3TNDT5KBL36372K00 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: CURRENT file: CURRENT 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-11T23:51:12.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-11T23:51:12.974 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-11T23:51:12.975 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.error_if_exists: 0 2024-09-11T23:51:12.975 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.create_if_missing: 0 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.paranoid_checks: 1 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.env: 0x560b1a0f4940 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.info_log: 0x560b1c0d16e0 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T23:51:12.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.statistics: (nil) 2024-09-11T23:51:12.977 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.use_fsync: 0 2024-09-11T23:51:12.977 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_log_file_size: 0 2024-09-11T23:51:12.977 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T23:51:12.977 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T23:51:12.977 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T23:51:12.977 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T23:51:12.977 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.allow_fallocate: 1 2024-09-11T23:51:12.978 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T23:51:12.978 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T23:51:12.978 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.use_direct_reads: 0 2024-09-11T23:51:12.978 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T23:51:12.978 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T23:51:12.978 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.db_log_dir: 2024-09-11T23:51:12.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.wal_dir: 2024-09-11T23:51:12.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T23:51:12.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T23:51:12.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T23:51:12.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T23:51:12.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T23:51:12.980 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T23:51:12.980 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T23:51:12.980 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T23:51:12.981 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.write_buffer_manager: 0x560b1c0e0dc0 2024-09-11T23:51:12.981 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T23:51:12.981 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T23:51:12.981 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T23:51:12.981 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T23:51:12.981 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T23:51:12.982 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T23:51:12.982 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T23:51:12.982 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T23:51:12.983 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.unordered_write: 0 2024-09-11T23:51:12.983 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T23:51:12.983 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T23:51:12.983 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T23:51:12.984 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T23:51:12.984 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.row_cache: None 2024-09-11T23:51:12.984 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.wal_filter: None 2024-09-11T23:51:12.984 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T23:51:12.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T23:51:12.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.two_write_queues: 0 2024-09-11T23:51:12.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T23:51:12.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.wal_compression: 0 2024-09-11T23:51:12.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.atomic_flush: 0 2024-09-11T23:51:12.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T23:51:12.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T23:51:12.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T23:51:12.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.log_readahead_size: 0 2024-09-11T23:51:12.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T23:51:12.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T23:51:12.988 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T23:51:12.988 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T23:51:12.988 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T23:51:12.988 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T23:51:12.989 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T23:51:12.989 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_background_jobs: 2 2024-09-11T23:51:12.989 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_background_compactions: -1 2024-09-11T23:51:12.990 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_subcompactions: 1 2024-09-11T23:51:12.990 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T23:51:12.990 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T23:51:12.990 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T23:51:12.991 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T23:51:12.991 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T23:51:12.991 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T23:51:12.991 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T23:51:12.992 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T23:51:12.992 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_open_files: -1 2024-09-11T23:51:12.992 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T23:51:12.993 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T23:51:12.993 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T23:51:12.994 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T23:51:12.994 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_background_flushes: -1 2024-09-11T23:51:12.994 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Compression algorithms supported: 2024-09-11T23:51:12.994 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: kZSTD supported: 0 2024-09-11T23:51:12.995 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: kXpressCompression supported: 0 2024-09-11T23:51:12.995 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: kBZip2Compression supported: 0 2024-09-11T23:51:12.995 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T23:51:12.995 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: kLZ4Compression supported: 1 2024-09-11T23:51:12.995 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: kZlibCompression supported: 1 2024-09-11T23:51:12.996 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T23:51:12.996 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: kSnappyCompression supported: 1 2024-09-11T23:51:12.996 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T23:51:12.996 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T23:51:12.996 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-11T23:51:12.997 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T23:51:12.997 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T23:51:12.997 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.merge_operator: 2024-09-11T23:51:12.998 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_filter: None 2024-09-11T23:51:12.998 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T23:51:12.998 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T23:51:12.998 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T23:51:12.998 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T23:51:12.999 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560b1c0d1320) 2024-09-11T23:51:12.999 INFO:journalctl@ceph.mon.c.smithi192.stdout: cache_index_and_filter_blocks: 1 2024-09-11T23:51:12.999 INFO:journalctl@ceph.mon.c.smithi192.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T23:51:12.999 INFO:journalctl@ceph.mon.c.smithi192.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T23:51:13.000 INFO:journalctl@ceph.mon.c.smithi192.stdout: pin_top_level_index_and_filter: 1 2024-09-11T23:51:13.000 INFO:journalctl@ceph.mon.c.smithi192.stdout: index_type: 0 2024-09-11T23:51:13.000 INFO:journalctl@ceph.mon.c.smithi192.stdout: data_block_index_type: 0 2024-09-11T23:51:13.000 INFO:journalctl@ceph.mon.c.smithi192.stdout: index_shortening: 1 2024-09-11T23:51:13.000 INFO:journalctl@ceph.mon.c.smithi192.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T23:51:13.000 INFO:journalctl@ceph.mon.c.smithi192.stdout: checksum: 4 2024-09-11T23:51:13.000 INFO:journalctl@ceph.mon.c.smithi192.stdout: no_block_cache: 0 2024-09-11T23:51:13.001 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_cache: 0x560b1c0c51f0 2024-09-11T23:51:13.001 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_cache_name: BinnedLRUCache 2024-09-11T23:51:13.001 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_cache_options: 2024-09-11T23:51:13.001 INFO:journalctl@ceph.mon.c.smithi192.stdout: capacity : 536870912 2024-09-11T23:51:13.001 INFO:journalctl@ceph.mon.c.smithi192.stdout: num_shard_bits : 4 2024-09-11T23:51:13.001 INFO:journalctl@ceph.mon.c.smithi192.stdout: strict_capacity_limit : 0 2024-09-11T23:51:13.001 INFO:journalctl@ceph.mon.c.smithi192.stdout: high_pri_pool_ratio: 0.000 2024-09-11T23:51:13.001 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_cache_compressed: (nil) 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: persistent_cache: (nil) 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_size: 4096 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_size_deviation: 10 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_restart_interval: 16 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: index_block_restart_interval: 1 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: metadata_block_size: 4096 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: partition_filters: 0 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: use_delta_encoding: 1 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: filter_policy: bloomfilter 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: whole_key_filtering: 1 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: verify_compression: 0 2024-09-11T23:51:13.002 INFO:journalctl@ceph.mon.c.smithi192.stdout: read_amp_bytes_per_bit: 0 2024-09-11T23:51:13.003 INFO:journalctl@ceph.mon.c.smithi192.stdout: format_version: 5 2024-09-11T23:51:13.003 INFO:journalctl@ceph.mon.c.smithi192.stdout: enable_index_compression: 1 2024-09-11T23:51:13.003 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_align: 0 2024-09-11T23:51:13.003 INFO:journalctl@ceph.mon.c.smithi192.stdout: max_auto_readahead_size: 262144 2024-09-11T23:51:13.003 INFO:journalctl@ceph.mon.c.smithi192.stdout: prepopulate_block_cache: 0 2024-09-11T23:51:13.003 INFO:journalctl@ceph.mon.c.smithi192.stdout: initial_auto_readahead_size: 8192 2024-09-11T23:51:13.003 INFO:journalctl@ceph.mon.c.smithi192.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T23:51:13.003 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression: NoCompression 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.num_levels: 7 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T23:51:13.004 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T23:51:13.005 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T23:51:13.005 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T23:51:13.005 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T23:51:13.005 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:51:13.005 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T23:51:13.005 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T23:51:13.005 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T23:51:13.006 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T23:51:13.007 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:51:13.007 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T23:51:13.007 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T23:51:13.007 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T23:51:13.007 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T23:51:13.008 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T23:51:13.008 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T23:51:13.008 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T23:51:13.008 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T23:51:13.008 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T23:51:13.008 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T23:51:13.008 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T23:51:13.009 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T23:51:13.010 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T23:51:13.010 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T23:51:13.010 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T23:51:13.010 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T23:51:13.010 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T23:51:13.010 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T23:51:13.010 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T23:51:13.010 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.inplace_update_support: 0 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.bloom_locality: 0 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.max_successive_merges: 0 2024-09-11T23:51:13.011 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.ttl: 2592000 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.enable_blob_files: false 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.min_blob_size: 0 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T23:51:13.012 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-11T23:51:13.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b17ad121-e2b0-4839-b966-33493c9ffd43 2024-09-11T23:51:13.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098672953549, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-11T23:51:13.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-11T23:51:13.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098672953946, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726098672, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b17ad121-e2b0-4839-b966-33493c9ffd43", "db_session_id": "KCE3TNDT5KBL36372K00", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-11T23:51:13.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098672954041, "job": 1, "event": "recovery_finished"} 2024-09-11T23:51:13.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-11T23:51:13.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T23:51:13.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560b1c0f2e00 2024-09-11T23:51:13.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: DB pointer 0x560b1c1ee000 2024-09-11T23:51:13.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T23:51:13.015 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T23:51:13.015 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** DB Stats ** 2024-09-11T23:51:13.015 INFO:journalctl@ceph.mon.c.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:51:13.016 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T23:51:13.016 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:51:13.016 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:51:13.016 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T23:51:13.016 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:51:13.016 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:51:13.017 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-11T23:51:13.017 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** Compaction Stats [default] ** 2024-09-11T23:51:13.017 INFO:journalctl@ceph.mon.c.smithi192.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:51:13.017 INFO:journalctl@ceph.mon.c.smithi192.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T23:51:13.017 INFO:journalctl@ceph.mon.c.smithi192.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:51:13.017 INFO:journalctl@ceph.mon.c.smithi192.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:51:13.017 INFO:journalctl@ceph.mon.c.smithi192.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:51:13.018 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-11T23:51:13.018 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** Compaction Stats [default] ** 2024-09-11T23:51:13.018 INFO:journalctl@ceph.mon.c.smithi192.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:51:13.018 INFO:journalctl@ceph.mon.c.smithi192.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T23:51:13.018 INFO:journalctl@ceph.mon.c.smithi192.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:51:13.018 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-11T23:51:13.018 INFO:journalctl@ceph.mon.c.smithi192.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:51:13.019 INFO:journalctl@ceph.mon.c.smithi192.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T23:51:13.020 INFO:journalctl@ceph.mon.c.smithi192.stdout: Block cache BinnedLRUCache@0x560b1c0c51f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-11T23:51:13.020 INFO:journalctl@ceph.mon.c.smithi192.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-11T23:51:13.020 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-11T23:51:13.020 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T23:51:13.020 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-11T23:51:13.020 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: using public_addr v2:172.21.15.192:0/0 -> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-09-11T23:51:13.020 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: starting mon.c rank -1 at public addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] at bind addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:13.020 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(???) e0 preinit fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).mds e1 new map 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout: e1 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout: btime 2024-09-11T23:49:46:707418+0000 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout: legacy client fscid: -1 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout: No filesystems configured 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T23:51:13.021 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T23:51:13.022 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T23:51:13.022 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T23:51:13.022 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T23:51:13.022 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T23:51:13.022 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T23:51:13.022 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:51:13.022 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:51:13.022 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:51:13.023 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.023 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: Added host smithi192 2024-09-11T23:51:13.023 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:13.023 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.023 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.023 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:13.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:51:13.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/456308256' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T23:51:13.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:13.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/456308256' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T23:51:13.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:13.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:13.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:51:13.025 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: Saving service mon spec with placement smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c;count:3 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: Deploying daemon mon.c on smithi192 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/3928714977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:13.026 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:12 smithi192 ceph-mon[35487]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T23:51:13.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:13 smithi192 bash[35468]: 6e6cfd1a1b590e304cfe7e74134b7bb43a63da5b0ce5c0fdaf61fdc33da77ed6 2024-09-11T23:51:13.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:13 smithi192 systemd[1]: Started Ceph mon.c for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:51:13.500 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:51:13.501 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:51:13.757 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:51:18.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:51:18.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: mon.a calling monitor election 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: mon.c calling monitor election 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:51:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: monmap epoch 2 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: last_changed 2024-09-11T23:51:12.978053+0000 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: min_mon_release 19 (squid) 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: election_strategy: 1 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: fsmap 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: mgrmap e13: x(active, since 38s) 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: overall HEALTH_OK 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:18.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:18.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:18.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:18.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:18.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:51:18.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: mon.a calling monitor election 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: mon.c calling monitor election 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:51:18.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: monmap epoch 2 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: last_changed 2024-09-11T23:51:12.978053+0000 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: min_mon_release 19 (squid) 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: election_strategy: 1 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: fsmap 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: mgrmap e13: x(active, since 38s) 2024-09-11T23:51:18.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: overall HEALTH_OK 2024-09-11T23:51:18.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:18.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:18.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:18.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:18.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:18.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.568+0000 7f647a122640 1 -- 172.21.15.192:0/808045952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 msgr2=0x7f6460005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:18.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.568+0000 7f647a122640 1 --2- 172.21.15.192:0/808045952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 0x7f6460005580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6464012c60 tx=0x7f646402c620 comp rx=0 tx=0).stop 2024-09-11T23:51:18.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.568+0000 7f647a122640 1 -- 172.21.15.192:0/808045952 shutdown_connections 2024-09-11T23:51:18.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.568+0000 7f647a122640 1 --2- 172.21.15.192:0/808045952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 0x7f6460005580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:18.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.569+0000 7f647a122640 1 -- 172.21.15.192:0/808045952 >> 172.21.15.192:0/808045952 conn(0x7f64740fc280 msgr2=0x7f64740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:18.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.569+0000 7f647a122640 1 -- 172.21.15.192:0/808045952 shutdown_connections 2024-09-11T23:51:18.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.569+0000 7f647a122640 1 -- 172.21.15.192:0/808045952 wait complete. 2024-09-11T23:51:18.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.569+0000 7f647a122640 1 Processor -- start 2024-09-11T23:51:18.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.569+0000 7f647a122640 1 -- start start 2024-09-11T23:51:18.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f647a122640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 0x7f64741994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f647a122640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 0x7f647419ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f647a122640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f64741087e0 con 0x7f6474106650 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f647a122640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6474108660 con 0x7f6474199a20 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f646bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 0x7f647419ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f646bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 0x7f647419ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:46800/0 (socket says 172.21.15.192:46800) 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f646bfff640 1 -- 172.21.15.192:0/2333204841 learned_addr learned my addr 172.21.15.192:0/2333204841 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f64737fe640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 0x7f64741994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f646bfff640 1 -- 172.21.15.192:0/2333204841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 msgr2=0x7f647419ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f646bfff640 1 -- 172.21.15.192:0/2333204841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 msgr2=0x7f647419ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f646bfff640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 0x7f647419ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:51:18.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.570+0000 7f646bfff640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 0x7f647419ddb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f64737fe640 1 -- 172.21.15.192:0/2333204841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 msgr2=0x7f647419ddb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f64737fe640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 0x7f647419ddb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f64737fe640 1 -- 172.21.15.192:0/2333204841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647419a040 con 0x7f6474106650 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f64737fe640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 0x7f64741994e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6464034000 tx=0x7f64640338e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f64717fa640 1 -- 172.21.15.192:0/2333204841 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6464033c90 con 0x7f6474106650 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f64717fa640 1 -- 172.21.15.192:0/2333204841 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6464033e30 con 0x7f6474106650 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647419e2f0 con 0x7f6474106650 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f64717fa640 1 -- 172.21.15.192:0/2333204841 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f646403daa0 con 0x7f6474106650 2024-09-11T23:51:18.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.571+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647419e8b0 con 0x7f6474106650 2024-09-11T23:51:18.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.572+0000 7f64717fa640 1 -- 172.21.15.192:0/2333204841 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6464044020 con 0x7f6474106650 2024-09-11T23:51:18.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.572+0000 7f64717fa640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6454038e00 0x7f645403b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:18.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.572+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6474101cc0 con 0x7f6474106650 2024-09-11T23:51:18.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.572+0000 7f64717fa640 1 -- 172.21.15.192:0/2333204841 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f646406fc60 con 0x7f6474106650 2024-09-11T23:51:18.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.573+0000 7f646bfff640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6454038e00 0x7f645403b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:18.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.573+0000 7f646bfff640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6454038e00 0x7f645403b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f645c009100 tx=0x7f645c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:18.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.578+0000 7f64717fa640 1 -- 172.21.15.192:0/2333204841 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f646404b020 con 0x7f6474106650 2024-09-11T23:51:18.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.813+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f647419eb90 con 0x7f6474106650 2024-09-11T23:51:18.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.814+0000 7f64717fa640 1 -- 172.21.15.192:0/2333204841 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f646403bbb0 con 0x7f6474106650 2024-09-11T23:51:18.814 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:51:18.814 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:51:12.978053Z","created":"2024-09-11T23:49:40.118605Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:51:18.814 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-09-11T23:51:18.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6454038e00 msgr2=0x7f645403b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:18.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6454038e00 0x7f645403b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f645c009100 tx=0x7f645c008040 comp rx=0 tx=0).stop 2024-09-11T23:51:18.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 msgr2=0x7f64741994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:18.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 0x7f64741994e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6464034000 tx=0x7f64640338e0 comp rx=0 tx=0).stop 2024-09-11T23:51:18.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 shutdown_connections 2024-09-11T23:51:18.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6474199a20 0x7f647419ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:18.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6454038e00 0x7f645403b2c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:18.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 --2- 172.21.15.192:0/2333204841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6474106650 0x7f64741994e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:18.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 >> 172.21.15.192:0/2333204841 conn(0x7f64740fc280 msgr2=0x7f6474069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:18.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 shutdown_connections 2024-09-11T23:51:18.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:18.816+0000 7f647a122640 1 -- 172.21.15.192:0/2333204841 wait complete. 2024-09-11T23:51:19.187 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:19 smithi192 ceph-mon[35487]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:19.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:19 smithi192 ceph-mon[35487]: Deploying daemon mon.b on smithi105 2024-09-11T23:51:19.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:19 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/2333204841' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:19.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:19 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:19 smithi060 ceph-mon[30953]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:19 smithi060 ceph-mon[30953]: Deploying daemon mon.b on smithi105 2024-09-11T23:51:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:19 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/2333204841' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:19 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:20.474 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:51:20.475 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:51:20.727 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:51:21.106 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:21 smithi192 ceph-mon[35487]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:21.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.106+0000 7f3170a99640 1 -- 172.21.15.192:0/714537259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 msgr2=0x7f316c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:21.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.106+0000 7f3170a99640 1 --2- 172.21.15.192:0/714537259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 0x7f316c107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3154009880 tx=0x7f315402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.106+0000 7f3170a99640 1 -- 172.21.15.192:0/714537259 shutdown_connections 2024-09-11T23:51:21.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.106+0000 7f3170a99640 1 --2- 172.21.15.192:0/714537259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 0x7f316c107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.106+0000 7f3170a99640 1 -- 172.21.15.192:0/714537259 >> 172.21.15.192:0/714537259 conn(0x7f316c0fd320 msgr2=0x7f316c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:21.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.106+0000 7f3170a99640 1 -- 172.21.15.192:0/714537259 shutdown_connections 2024-09-11T23:51:21.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.106+0000 7f3170a99640 1 -- 172.21.15.192:0/714537259 wait complete. 2024-09-11T23:51:21.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3170a99640 1 Processor -- start 2024-09-11T23:51:21.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3170a99640 1 -- start start 2024-09-11T23:51:21.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3170a99640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 0x7f316c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:21.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3170a99640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 0x7f316c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:21.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3170a99640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f316c10be60 con 0x7f316c107660 2024-09-11T23:51:21.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3170a99640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f316c10bce0 con 0x7f316c197a80 2024-09-11T23:51:21.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3169d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 0x7f316c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:21.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3169d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 0x7f316c19be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:46802/0 (socket says 172.21.15.192:46802) 2024-09-11T23:51:21.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f3169d9b640 1 -- 172.21.15.192:0/2529351931 learned_addr learned my addr 172.21.15.192:0/2529351931 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:51:21.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.107+0000 7f316a59c640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 0x7f316c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:21.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f3169d9b640 1 -- 172.21.15.192:0/2529351931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 msgr2=0x7f316c19be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T23:51:21.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f3169d9b640 1 -- 172.21.15.192:0/2529351931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 msgr2=0x7f316c19be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:51:21.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f3169d9b640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 0x7f316c19be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:51:21.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f3169d9b640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 0x7f316c19be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:51:21.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f316a59c640 1 -- 172.21.15.192:0/2529351931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 msgr2=0x7f316c19be10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:51:21.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f316a59c640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 0x7f316c19be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f316a59c640 1 -- 172.21.15.192:0/2529351931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c1980a0 con 0x7f316c107660 2024-09-11T23:51:21.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f316a59c640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 0x7f316c197540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3154000c00 tx=0x7f3154004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:21.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f31637fe640 1 -- 172.21.15.192:0/2529351931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3154035030 con 0x7f316c107660 2024-09-11T23:51:21.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f31637fe640 1 -- 172.21.15.192:0/2529351931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31540053d0 con 0x7f316c107660 2024-09-11T23:51:21.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c19c350 con 0x7f316c107660 2024-09-11T23:51:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.108+0000 7f31637fe640 1 -- 172.21.15.192:0/2529351931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3154031890 con 0x7f316c107660 2024-09-11T23:51:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.109+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c19c890 con 0x7f316c107660 2024-09-11T23:51:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.109+0000 7f31637fe640 1 -- 172.21.15.192:0/2529351931 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3154042070 con 0x7f316c107660 2024-09-11T23:51:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.110+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316c102da0 con 0x7f316c107660 2024-09-11T23:51:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.110+0000 7f31637fe640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f3158038e00 0x7f315803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.110+0000 7f31637fe640 1 -- 172.21.15.192:0/2529351931 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f315406cd00 con 0x7f316c107660 2024-09-11T23:51:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.110+0000 7f3169d9b640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f3158038e00 0x7f315803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.110+0000 7f3169d9b640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f3158038e00 0x7f315803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f315c009100 tx=0x7f315c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:21.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.115+0000 7f31637fe640 1 -- 172.21.15.192:0/2529351931 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f315402f300 con 0x7f316c107660 2024-09-11T23:51:21.336 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 systemd[1]: Starting Ceph mon.b for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:51:21.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:21 smithi060 ceph-mon[30953]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:21.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.348+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f316c19cb40 con 0x7f316c107660 2024-09-11T23:51:21.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.349+0000 7f31637fe640 1 -- 172.21.15.192:0/2529351931 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3154031b20 con 0x7f316c107660 2024-09-11T23:51:21.349 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:51:21.350 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:51:12.978053Z","created":"2024-09-11T23:49:40.118605Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:51:21.350 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-09-11T23:51:21.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.351+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f3158038e00 msgr2=0x7f315803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:21.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.351+0000 7f3170a99640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f3158038e00 0x7f315803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f315c009100 tx=0x7f315c008040 comp rx=0 tx=0).stop 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.351+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 msgr2=0x7f316c197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.351+0000 7f3170a99640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 0x7f316c197540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3154000c00 tx=0x7f3154004ef0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.352+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 shutdown_connections 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.352+0000 7f3170a99640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f316c197a80 0x7f316c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.352+0000 7f3170a99640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f3158038e00 0x7f315803b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.352+0000 7f3170a99640 1 --2- 172.21.15.192:0/2529351931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f316c107660 0x7f316c197540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.352+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 >> 172.21.15.192:0/2529351931 conn(0x7f316c0fd320 msgr2=0x7f316c0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.352+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 shutdown_connections 2024-09-11T23:51:21.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:21.352+0000 7f3170a99640 1 -- 172.21.15.192:0/2529351931 wait complete. 2024-09-11T23:51:21.628 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 podman[34786]: 2024-09-11 23:51:21.523115025 +0000 UTC m=+0.103087543 container create 075629e84e6e791bb68933e612a454963628f2e9baf34e76de874c2ad607d4e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T23:51:21.628 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 podman[34786]: 2024-09-11 23:51:21.435697058 +0000 UTC m=+0.015669576 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:51:21.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 podman[34786]: 2024-09-11 23:51:21.767284316 +0000 UTC m=+0.347256834 container init 075629e84e6e791bb68933e612a454963628f2e9baf34e76de874c2ad607d4e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-11T23:51:21.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 podman[34786]: 2024-09-11 23:51:21.77079369 +0000 UTC m=+0.350766203 container start 075629e84e6e791bb68933e612a454963628f2e9baf34e76de874c2ad607d4e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-11T23:51:21.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T23:51:21.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-11T23:51:21.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pidfile_write: ignore empty --pid-file 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: load: jerasure load: lrc 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: RocksDB version: 7.9.2 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Git sha 0 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: DB SUMMARY 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: DB Session ID: AR5QSGJJFSBM1EJJYWHY 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: CURRENT file: CURRENT 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-11T23:51:21.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.error_if_exists: 0 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.create_if_missing: 0 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.paranoid_checks: 1 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.env: 0x55921ff00940 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.info_log: 0x559221a396e0 2024-09-11T23:51:21.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T23:51:21.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.statistics: (nil) 2024-09-11T23:51:21.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.use_fsync: 0 2024-09-11T23:51:21.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_log_file_size: 0 2024-09-11T23:51:21.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T23:51:21.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T23:51:21.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T23:51:21.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.allow_fallocate: 1 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.use_direct_reads: 0 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.db_log_dir: 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.wal_dir: 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T23:51:21.984 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.write_buffer_manager: 0x559221a48dc0 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T23:51:21.985 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.unordered_write: 0 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.row_cache: None 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.wal_filter: None 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.two_write_queues: 0 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.wal_compression: 0 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.atomic_flush: 0 2024-09-11T23:51:21.986 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.log_readahead_size: 0 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_background_jobs: 2 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_background_compactions: -1 2024-09-11T23:51:21.987 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_subcompactions: 1 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_open_files: -1 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T23:51:21.988 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_background_flushes: -1 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Compression algorithms supported: 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: kZSTD supported: 0 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: kXpressCompression supported: 0 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: kBZip2Compression supported: 0 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: kLZ4Compression supported: 1 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: kZlibCompression supported: 1 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: kSnappyCompression supported: 1 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T23:51:21.989 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.merge_operator: 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_filter: None 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559221a39320) 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout: cache_index_and_filter_blocks: 1 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T23:51:21.990 INFO:journalctl@ceph.mon.b.smithi105.stdout: pin_top_level_index_and_filter: 1 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: index_type: 0 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: data_block_index_type: 0 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: index_shortening: 1 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: checksum: 4 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: no_block_cache: 0 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_cache: 0x559221a2d1f0 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_cache_name: BinnedLRUCache 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_cache_options: 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: capacity : 536870912 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: num_shard_bits : 4 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: strict_capacity_limit : 0 2024-09-11T23:51:21.991 INFO:journalctl@ceph.mon.b.smithi105.stdout: high_pri_pool_ratio: 0.000 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_cache_compressed: (nil) 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: persistent_cache: (nil) 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_size: 4096 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_size_deviation: 10 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_restart_interval: 16 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: index_block_restart_interval: 1 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: metadata_block_size: 4096 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: partition_filters: 0 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: use_delta_encoding: 1 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: filter_policy: bloomfilter 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: whole_key_filtering: 1 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: verify_compression: 0 2024-09-11T23:51:21.992 INFO:journalctl@ceph.mon.b.smithi105.stdout: read_amp_bytes_per_bit: 0 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout: format_version: 5 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout: enable_index_compression: 1 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout: block_align: 0 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout: max_auto_readahead_size: 262144 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout: prepopulate_block_cache: 0 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout: initial_auto_readahead_size: 8192 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression: NoCompression 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T23:51:21.993 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.num_levels: 7 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:51:21.994 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T23:51:21.995 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T23:51:21.996 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T23:51:21.996 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T23:51:21.996 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T23:51:21.996 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T23:51:21.997 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T23:51:21.997 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T23:51:21.997 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T23:51:21.997 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T23:51:21.997 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T23:51:21.997 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T23:51:21.997 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T23:51:21.998 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.inplace_update_support: 0 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.bloom_locality: 0 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.max_successive_merges: 0 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T23:51:21.999 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.ttl: 2592000 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.enable_blob_files: false 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.min_blob_size: 0 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T23:51:22.000 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 78b8f12c-13f3-4006-aecd-e69b96cb6151 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098681798066, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098681798471, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726098681, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "78b8f12c-13f3-4006-aecd-e69b96cb6151", "db_session_id": "AR5QSGJJFSBM1EJJYWHY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726098681798561, "job": 1, "event": "recovery_finished"} 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T23:51:22.001 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559221a5ae00 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: DB pointer 0x559221b56000 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: ** DB Stats ** 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T23:51:22.002 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: ** Compaction Stats [default] ** 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: ** Compaction Stats [default] ** 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2024-09-11T23:51:22.003 INFO:journalctl@ceph.mon.b.smithi105.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: Block cache BinnedLRUCache@0x559221a2d1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-11T23:51:22.004 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: using public_addr v2:172.21.15.105:0/0 -> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: starting mon.b rank -1 at public addrs [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] at bind addrs [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(???) e0 preinit fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).mds e1 new map 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout: e1 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout: btime 2024-09-11T23:49:46:707418+0000 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout: legacy client fscid: -1 2024-09-11T23:51:22.005 INFO:journalctl@ceph.mon.b.smithi105.stdout: 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout: No filesystems configured 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.006 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: Added host smithi192 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/456308256' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/456308256' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.007 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.008 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: Saving service mon spec with placement smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c;count:3 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: Deploying daemon mon.c on smithi192 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/3928714977' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.a calling monitor election 2024-09-11T23:51:22.009 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.c calling monitor election 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: monmap epoch 2 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: last_changed 2024-09-11T23:51:12.978053+0000 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: min_mon_release 19 (squid) 2024-09-11T23:51:22.010 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: election_strategy: 1 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: fsmap 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mgrmap e13: x(active, since 38s) 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: overall HEALTH_OK 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.011 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: Deploying daemon mon.b on smithi105 2024-09-11T23:51:22.012 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/2333204841' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:22.012 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:22.012 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:22.012 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 ceph-mon[34805]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T23:51:22.012 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 bash[34786]: 075629e84e6e791bb68933e612a454963628f2e9baf34e76de874c2ad607d4e4 2024-09-11T23:51:22.012 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:21 smithi105 systemd[1]: Started Ceph mon.b for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:51:22.939 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T23:51:22.939 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T23:51:23.190 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:51:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.936+0000 7fb26a421640 1 -- 172.21.15.192:0/1406026005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb24c005740 msgr2=0x7fb24c007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.936+0000 7fb26a421640 1 --2- 172.21.15.192:0/1406026005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb24c005740 0x7fb24c007bd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb2641016d0 tx=0x7fb25402c150 comp rx=0 tx=0).stop 2024-09-11T23:51:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.936+0000 7fb26a421640 1 -- 172.21.15.192:0/1406026005 shutdown_connections 2024-09-11T23:51:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.936+0000 7fb26a421640 1 --2- 172.21.15.192:0/1406026005 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb24c005740 0x7fb24c007bd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.936+0000 7fb26a421640 1 -- 172.21.15.192:0/1406026005 >> 172.21.15.192:0/1406026005 conn(0x7fb2640fc250 msgr2=0x7fb2640fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.936+0000 7fb26a421640 1 -- 172.21.15.192:0/1406026005 shutdown_connections 2024-09-11T23:51:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.936+0000 7fb26a421640 1 -- 172.21.15.192:0/1406026005 wait complete. 2024-09-11T23:51:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.937+0000 7fb26a421640 1 Processor -- start 2024-09-11T23:51:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.937+0000 7fb26a421640 1 -- start start 2024-09-11T23:51:26.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb26a421640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 0x7fb2641951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:26.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb26a421640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 0x7fb264199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:26.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb26a421640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264199fe0 0x7fb26419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:26.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb26a421640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb264107740 con 0x7fb264199fe0 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb26a421640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb2641075c0 con 0x7fb24c005740 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb26a421640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb2641078c0 con 0x7fb264195710 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2637fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 0x7fb264199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2689be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264199fe0 0x7fb26419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2637fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 0x7fb264199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39802/0 (socket says 172.21.15.192:39802) 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2637fe640 1 -- 172.21.15.192:0/2552371441 learned_addr learned my addr 172.21.15.192:0/2552371441 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb263fff640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 0x7fb2641951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2637fe640 1 -- 172.21.15.192:0/2552371441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 msgr2=0x7fb264199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2637fe640 1 -- 172.21.15.192:0/2552371441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 msgr2=0x7fb264199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2637fe640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 0x7fb264199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2637fe640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 0x7fb264199aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:51:26.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb263fff640 1 -- 172.21.15.192:0/2552371441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 msgr2=0x7fb2641951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb263fff640 1 -- 172.21.15.192:0/2552371441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 msgr2=0x7fb2641951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb263fff640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 0x7fb2641951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb263fff640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 0x7fb2641951d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2689be640 1 -- 172.21.15.192:0/2552371441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 msgr2=0x7fb264199aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2689be640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 0x7fb264199aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2689be640 1 -- 172.21.15.192:0/2552371441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 msgr2=0x7fb2641951d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2689be640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 0x7fb2641951d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.938+0000 7fb2689be640 1 -- 172.21.15.192:0/2552371441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2641a1d50 con 0x7fb264199fe0 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.939+0000 7fb2689be640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264199fe0 0x7fb26419a490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00bd50 tx=0x7fb25c00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.939+0000 7fb2617fa640 1 -- 172.21.15.192:0/2552371441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c019070 con 0x7fb264199fe0 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.939+0000 7fb2617fa640 1 -- 172.21.15.192:0/2552371441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb25c014940 con 0x7fb264199fe0 2024-09-11T23:51:26.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.939+0000 7fb2617fa640 1 -- 172.21.15.192:0/2552371441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c012a30 con 0x7fb264199fe0 2024-09-11T23:51:26.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.939+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2641a1f80 con 0x7fb264199fe0 2024-09-11T23:51:26.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.939+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2641a2460 con 0x7fb264199fe0 2024-09-11T23:51:26.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.940+0000 7fb2617fa640 1 -- 172.21.15.192:0/2552371441 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb25c01c070 con 0x7fb264199fe0 2024-09-11T23:51:26.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.940+0000 7fb2617fa640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb2500394f0 0x7fb25003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:26.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.940+0000 7fb2617fa640 1 -- 172.21.15.192:0/2552371441 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb25c04bdb0 con 0x7fb264199fe0 2024-09-11T23:51:26.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.940+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb264108870 con 0x7fb264199fe0 2024-09-11T23:51:26.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.941+0000 7fb263fff640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb2500394f0 0x7fb25003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:26.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.941+0000 7fb263fff640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb2500394f0 0x7fb25003b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb254005dc0 tx=0x7fb254005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:26.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:26.945+0000 7fb2617fa640 1 -- 172.21.15.192:0/2552371441 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb25c00e0a0 con 0x7fb264199fe0 2024-09-11T23:51:27.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.187+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb26418eed0 con 0x7fb264199fe0 2024-09-11T23:51:27.187 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:27.187 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:51:27.187 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: mon.c calling monitor election 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: mon.a calling monitor election 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:51:27.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: monmap epoch 3 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: last_changed 2024-09-11T23:51:21.822379+0000 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: min_mon_release 19 (squid) 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: election_strategy: 1 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: fsmap 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: mgrmap e13: x(active, since 47s) 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: overall HEALTH_OK 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:27.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:27.190 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:27.190 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:27.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.187+0000 7fb2617fa640 1 -- 172.21.15.192:0/2552371441 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fb25c013bf0 con 0x7fb264199fe0 2024-09-11T23:51:27.190 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:51:27.190 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":3,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","modified":"2024-09-11T23:51:21.822379Z","created":"2024-09-11T23:49:40.118605Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:3300","nonce":0},{"type":"v1","addr":"172.21.15.105:6789","nonce":0}]},"addr":"172.21.15.105:6789/0","public_addr":"172.21.15.105:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T23:51:27.191 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 3 2024-09-11T23:51:27.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb2500394f0 msgr2=0x7fb25003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:27.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb2500394f0 0x7fb25003b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb254005dc0 tx=0x7fb254005d10 comp rx=0 tx=0).stop 2024-09-11T23:51:27.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264199fe0 msgr2=0x7fb26419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:27.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264199fe0 0x7fb26419a490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00bd50 tx=0x7fb25c00be40 comp rx=0 tx=0).stop 2024-09-11T23:51:27.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 shutdown_connections 2024-09-11T23:51:27.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb2500394f0 0x7fb25003b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:27.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264199fe0 0x7fb26419a490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:27.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb264195710 0x7fb264199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:27.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 --2- 172.21.15.192:0/2552371441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24c005740 0x7fb2641951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:27.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 >> 172.21.15.192:0/2552371441 conn(0x7fb2640fc250 msgr2=0x7fb2640fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:27.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 shutdown_connections 2024-09-11T23:51:27.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:27.190+0000 7fb26a421640 1 -- 172.21.15.192:0/2552371441 wait complete. 2024-09-11T23:51:27.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:27.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:51:27.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: mon.c calling monitor election 2024-09-11T23:51:27.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: mon.a calling monitor election 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:51:27.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: monmap epoch 3 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: last_changed 2024-09-11T23:51:21.822379+0000 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: min_mon_release 19 (squid) 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: election_strategy: 1 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: fsmap 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: mgrmap e13: x(active, since 47s) 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: overall HEALTH_OK 2024-09-11T23:51:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:27.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:27.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:27.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:27.787 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T23:51:27.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T23:51:28.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:27 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:28.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:27 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/2552371441' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:28.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:27 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:28.054 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:51:28.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:27 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:28.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:27 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/2552371441' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:28.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:27 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.497+0000 7f813e2fa640 1 -- 172.21.15.60:0/1368059387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81381027d0 msgr2=0x7f8138102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.497+0000 7f813e2fa640 1 --2- 172.21.15.60:0/1368059387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81381027d0 0x7f8138102bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8128009810 tx=0x7f812802a540 comp rx=0 tx=0).stop 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.497+0000 7f813e2fa640 1 -- 172.21.15.60:0/1368059387 shutdown_connections 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.497+0000 7f813e2fa640 1 --2- 172.21.15.60:0/1368059387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81381027d0 0x7f8138102bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.497+0000 7f813e2fa640 1 -- 172.21.15.60:0/1368059387 >> 172.21.15.60:0/1368059387 conn(0x7f8138077310 msgr2=0x7f81380fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.497+0000 7f813e2fa640 1 -- 172.21.15.60:0/1368059387 shutdown_connections 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.497+0000 7f813e2fa640 1 -- 172.21.15.60:0/1368059387 wait complete. 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f813e2fa640 1 Processor -- start 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f813e2fa640 1 -- start start 2024-09-11T23:51:28.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f813e2fa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81381027d0 0x7f8138100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f813e2fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138100970 0x7f8138100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f813e2fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81381a3710 0x7f81381a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f813e2fa640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f813810bd80 con 0x7f8138100970 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f813e2fa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f813810bc00 con 0x7f81381a3710 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f813e2fa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f813810bf00 con 0x7f81381027d0 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f812ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138100970 0x7f8138100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f812ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138100970 0x7f8138100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57158/0 (socket says 172.21.15.60:57158) 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f812ffff640 1 -- 172.21.15.60:0/245609666 learned_addr learned my addr 172.21.15.60:0/245609666 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.498+0000 7f8137fff640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81381027d0 0x7f8138100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f812ffff640 1 -- 172.21.15.60:0/245609666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81381027d0 msgr2=0x7f8138100430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f812ffff640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81381027d0 0x7f8138100430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:28.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f812ffff640 1 -- 172.21.15.60:0/245609666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81381a3710 msgr2=0x7f81381a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f812ffff640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81381a3710 0x7f81381a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f812ffff640 1 -- 172.21.15.60:0/245609666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81381a61d0 con 0x7f8138100970 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f8137fff640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81381027d0 0x7f8138100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f812ffff640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138100970 0x7f8138100dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f812000b520 tx=0x7f812000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f8135ffb640 1 -- 172.21.15.60:0/245609666 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120004230 con 0x7f8138100970 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81381a64c0 con 0x7f8138100970 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f8135ffb640 1 -- 172.21.15.60:0/245609666 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81200043d0 con 0x7f8138100970 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f8135ffb640 1 -- 172.21.15.60:0/245609666 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8120003e00 con 0x7f8138100970 2024-09-11T23:51:28.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.499+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381a6a50 con 0x7f8138100970 2024-09-11T23:51:28.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.500+0000 7f8135ffb640 1 -- 172.21.15.60:0/245609666 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f812000e070 con 0x7f8138100970 2024-09-11T23:51:28.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.500+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8138102c30 con 0x7f8138100970 2024-09-11T23:51:28.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.500+0000 7f8135ffb640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f81240394f0 0x7f812403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:28.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.500+0000 7f8135ffb640 1 -- 172.21.15.60:0/245609666 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f812004b8e0 con 0x7f8138100970 2024-09-11T23:51:28.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.500+0000 7f8137fff640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f81240394f0 0x7f812403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:28.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.501+0000 7f8137fff640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f81240394f0 0x7f812403b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f81280058e0 tx=0x7f8128005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:28.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.505+0000 7f8135ffb640 1 -- 172.21.15.60:0/245609666 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8120014020 con 0x7f8138100970 2024-09-11T23:51:28.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.688+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f81381a6d10 con 0x7f8138100970 2024-09-11T23:51:28.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.688+0000 7f8135ffb640 1 -- 172.21.15.60:0/245609666 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f8120020350 con 0x7f8138100970 2024-09-11T23:51:28.689 INFO:teuthology.orchestra.run.smithi060.stdout:# minimal ceph.conf for 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:28.689 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-09-11T23:51:28.689 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:28.689 INFO:teuthology.orchestra.run.smithi060.stdout: mon_host = [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-09-11T23:51:28.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f81240394f0 msgr2=0x7f812403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:28.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f81240394f0 0x7f812403b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f81280058e0 tx=0x7f8128005850 comp rx=0 tx=0).stop 2024-09-11T23:51:28.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138100970 msgr2=0x7f8138100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:28.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138100970 0x7f8138100dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f812000b520 tx=0x7f812000b9e0 comp rx=0 tx=0).stop 2024-09-11T23:51:28.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 shutdown_connections 2024-09-11T23:51:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81381a3710 0x7f81381a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f81240394f0 0x7f812403b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8138100970 0x7f8138100dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 --2- 172.21.15.60:0/245609666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81381027d0 0x7f8138100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 >> 172.21.15.60:0/245609666 conn(0x7f8138077310 msgr2=0x7f8138103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 shutdown_connections 2024-09-11T23:51:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:28.691+0000 7f813e2fa640 1 -- 172.21.15.60:0/245609666 wait complete. 2024-09-11T23:51:29.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:29.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:51:29.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: mon.c calling monitor election 2024-09-11T23:51:29.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: mon.a calling monitor election 2024-09-11T23:51:29.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:29.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: monmap epoch 3 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: last_changed 2024-09-11T23:51:21.822379+0000 2024-09-11T23:51:29.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: min_mon_release 19 (squid) 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: election_strategy: 1 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: fsmap 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: mgrmap e13: x(active, since 47s) 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: overall HEALTH_OK 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.233 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:29.233 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/2552371441' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-11T23:51:29.233 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:29.416 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T23:51:29.417 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:51:29.417 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:51:29.446 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:51:29.446 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:51:29.513 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:51:29.513 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:51:29.541 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:51:29.541 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:51:29.606 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:51:29.606 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T23:51:29.633 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:51:29.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:51:29.698 INFO:tasks.cephadm:Adding mgr.x on smithi060 2024-09-11T23:51:29.698 INFO:tasks.cephadm:Adding mgr.y on smithi105 2024-09-11T23:51:29.699 INFO:tasks.cephadm:Adding mgr.z on smithi192 2024-09-11T23:51:29.699 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi060=x;smithi105=y;smithi192=z' 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: mon.b calling monitor election 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: mon.b calling monitor election 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: mon.c calling monitor election 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: mon.a calling monitor election 2024-09-11T23:51:29.773 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: monmap epoch 3 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: last_changed 2024-09-11T23:51:21.822379+0000 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: min_mon_release 19 (squid) 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: election_strategy: 1 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:29.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: fsmap 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: mgrmap e13: x(active, since 49s) 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: overall HEALTH_OK 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.775 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:29.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: Reconfiguring daemon mon.a on smithi060 2024-09-11T23:51:29.777 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.978 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: mon.b calling monitor election 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: mon.b calling monitor election 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: mon.c calling monitor election 2024-09-11T23:51:29.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: mon.a calling monitor election 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: monmap epoch 3 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: last_changed 2024-09-11T23:51:21.822379+0000 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: min_mon_release 19 (squid) 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: election_strategy: 1 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: fsmap 2024-09-11T23:51:29.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: mgrmap e13: x(active, since 49s) 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: overall HEALTH_OK 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: Reconfiguring daemon mon.a on smithi060 2024-09-11T23:51:29.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: mon.b calling monitor election 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: mon.b calling monitor election 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: mon.c calling monitor election 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: mon.a calling monitor election 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: monmap epoch 3 2024-09-11T23:51:30.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: last_changed 2024-09-11T23:51:21.822379+0000 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: created 2024-09-11T23:49:40.118605+0000 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: min_mon_release 19 (squid) 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: election_strategy: 1 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: 0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: 2: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: fsmap 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: mgrmap e13: x(active, since 49s) 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: overall HEALTH_OK 2024-09-11T23:51:30.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T23:51:30.037 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:30.038 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:30.038 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:30.038 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: Reconfiguring daemon mon.a on smithi060 2024-09-11T23:51:30.038 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- 172.21.15.192:0/1172113590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b6c102180 msgr2=0x7f0b6c104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:30.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 --2- 172.21.15.192:0/1172113590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b6c102180 0x7f0b6c104570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009880 tx=0x7f0b5c02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- 172.21.15.192:0/1172113590 shutdown_connections 2024-09-11T23:51:30.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 --2- 172.21.15.192:0/1172113590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b6c102180 0x7f0b6c104570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- 172.21.15.192:0/1172113590 >> 172.21.15.192:0/1172113590 conn(0x7f0b6c0fbda0 msgr2=0x7f0b6c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- 172.21.15.192:0/1172113590 shutdown_connections 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- 172.21.15.192:0/1172113590 wait complete. 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 Processor -- start 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- start start 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b6c102180 0x7f0b6c197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c197560 0x7f0b6c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c1979e0 0x7f0b6c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c107880 con 0x7f0b6c102180 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c107700 con 0x7f0b6c197560 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b71ba1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c107a00 con 0x7f0b6c1979e0 2024-09-11T23:51:30.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b6bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c1979e0 0x7f0b6c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b6bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c1979e0 0x7f0b6c19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39816/0 (socket says 172.21.15.192:39816) 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b6b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b6c102180 0x7f0b6c197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.452+0000 7f0b6bfff640 1 -- 172.21.15.192:0/2668576066 learned_addr learned my addr 172.21.15.192:0/2668576066 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b6affd640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c197560 0x7f0b6c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b6bfff640 1 -- 172.21.15.192:0/2668576066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c197560 msgr2=0x7f0b6c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b6bfff640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c197560 0x7f0b6c19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b6bfff640 1 -- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b6c102180 msgr2=0x7f0b6c197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b6bfff640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b6c102180 0x7f0b6c197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b6bfff640 1 -- 172.21.15.192:0/2668576066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c19f420 con 0x7f0b6c1979e0 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b6bfff640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c1979e0 0x7f0b6c19eb60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400ba50 tx=0x7f0b6400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b68ff9640 1 -- 172.21.15.192:0/2668576066 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64019070 con 0x7f0b6c1979e0 2024-09-11T23:51:30.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b68ff9640 1 -- 172.21.15.192:0/2668576066 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b6400cbe0 con 0x7f0b6c1979e0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6c19f710 con 0x7f0b6c1979e0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b68ff9640 1 -- 172.21.15.192:0/2668576066 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64007750 con 0x7f0b6c1979e0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.453+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6c19fcd0 con 0x7f0b6c1979e0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.454+0000 7f0b68ff9640 1 -- 172.21.15.192:0/2668576066 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0b6401c070 con 0x7f0b6c1979e0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.454+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6c190640 con 0x7f0b6c1979e0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.454+0000 7f0b68ff9640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0b540394f0 0x7f0b5403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.454+0000 7f0b68ff9640 1 -- 172.21.15.192:0/2668576066 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0b6404bcc0 con 0x7f0b6c1979e0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.454+0000 7f0b6b7fe640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0b540394f0 0x7f0b5403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.455+0000 7f0b6b7fe640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0b540394f0 0x7f0b5403b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009230 tx=0x7f0b5c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.459+0000 7f0b68ff9640 1 -- 172.21.15.192:0/2668576066 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b6400cd90 con 0x7f0b6c1979e0 2024-09-11T23:51:30.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.641+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi105=y;smithi192=z", "target": ["mon-mgr", ""]}) -- 0x7f0b6c0626c0 con 0x7f0b540394f0 2024-09-11T23:51:30.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:30 smithi192 ceph-mon[35487]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:30.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:30.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:30.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:30.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:30.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.647+0000 7f0b68ff9640 1 -- 172.21.15.192:0/2668576066 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0b6c0626c0 con 0x7f0b540394f0 2024-09-11T23:51:30.646 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mgr update... 2024-09-11T23:51:30.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0b540394f0 msgr2=0x7f0b5403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:30.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0b540394f0 0x7f0b5403b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009230 tx=0x7f0b5c0058d0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c1979e0 msgr2=0x7f0b6c19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:30.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c1979e0 0x7f0b6c19eb60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400ba50 tx=0x7f0b6400bf10 comp rx=0 tx=0).stop 2024-09-11T23:51:30.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 shutdown_connections 2024-09-11T23:51:30.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c1979e0 0x7f0b6c19eb60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b6c197560 0x7f0b6c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0b540394f0 0x7f0b5403b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 --2- 172.21.15.192:0/2668576066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b6c102180 0x7f0b6c197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:30.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 >> 172.21.15.192:0/2668576066 conn(0x7f0b6c0fbda0 msgr2=0x7f0b6c0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:30.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.648+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 shutdown_connections 2024-09-11T23:51:30.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:51:30.649+0000 7f0b71ba1640 1 -- 172.21.15.192:0/2668576066 wait complete. 2024-09-11T23:51:30.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:30 smithi060 ceph-mon[30953]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:30.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:30.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:30.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:30.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:30.873 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:30 smithi105 ceph-mon[34805]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:30.873 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:51:30.874 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.874 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:30.874 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:30.874 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:30.874 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:31.224 DEBUG:teuthology.orchestra.run.smithi105:mgr.y> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T23:51:31.227 DEBUG:teuthology.orchestra.run.smithi192:mgr.z> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T23:51:31.229 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T23:51:31.229 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:51:31.230 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:51:31.250 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:51:31.250 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-11 23:50:49.351894160 +0000 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-11 23:46:48.521016918 +0000 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-11 23:46:48.521016918 +0000 2024-09-11T23:51:31.311 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-11 23:46:48.521016918 +0000 2024-09-11T23:51:31.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:51:31.382 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-11T23:51:31.382 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-11T23:51:31.382 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000118494 s, 4.3 MB/s 2024-09-11T23:51:31.383 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:51:31.444 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-09-11T23:51:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:51:31.502 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:31.502 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T23:51:31.502 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:31.503 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:31.503 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-11 23:50:49.384893859 +0000 2024-09-11T23:51:31.503 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-11 23:46:48.843013911 +0000 2024-09-11T23:51:31.503 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-11 23:46:48.843013911 +0000 2024-09-11T23:51:31.503 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-11 23:46:48.843013911 +0000 2024-09-11T23:51:31.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:51:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-11T23:51:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-11T23:51:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000127695 s, 4.0 MB/s 2024-09-11T23:51:31.572 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:51:31.631 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-09-11T23:51:31.689 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:51:31.689 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:31.689 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T23:51:31.689 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:31.689 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:31.689 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-11 23:50:49.419893540 +0000 2024-09-11T23:51:31.689 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-11 23:46:49.166010890 +0000 2024-09-11T23:51:31.690 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-11 23:46:49.166010890 +0000 2024-09-11T23:51:31.690 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-11 23:46:49.166010890 +0000 2024-09-11T23:51:31.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:51:31.756 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-11T23:51:31.757 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-11T23:51:31.757 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000121494 s, 4.2 MB/s 2024-09-11T23:51:31.758 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:51:31.817 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-09-11T23:51:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:51:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:31.874 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-11T23:51:31.874 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:31.874 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:31.874 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-11 23:50:49.452893240 +0000 2024-09-11T23:51:31.874 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-11 23:46:49.496007803 +0000 2024-09-11T23:51:31.874 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-11 23:46:49.496007803 +0000 2024-09-11T23:51:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-11 23:46:49.496007803 +0000 2024-09-11T23:51:31.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:51:31.918 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:31 smithi105 ceph-mon[34805]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:51:31.919 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:31 smithi105 ceph-mon[34805]: Reconfiguring daemon mon.b on smithi105 2024-09-11T23:51:31.919 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:31 smithi105 ceph-mon[34805]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi105=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:31.919 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:31 smithi105 ceph-mon[34805]: Saving service mgr spec with placement smithi060=x;smithi105=y;smithi192=z;count:3 2024-09-11T23:51:31.919 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:31 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:31.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:31 smithi060 ceph-mon[30953]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:51:31.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:31 smithi060 ceph-mon[30953]: Reconfiguring daemon mon.b on smithi105 2024-09-11T23:51:31.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:31 smithi060 ceph-mon[30953]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi105=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:31.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:31 smithi060 ceph-mon[30953]: Saving service mgr spec with placement smithi060=x;smithi105=y;smithi192=z;count:3 2024-09-11T23:51:31.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:31 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-11T23:51:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-11T23:51:31.939 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000112638 s, 4.5 MB/s 2024-09-11T23:51:31.941 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:51:31.998 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-11T23:51:31.998 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:51:32.015 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:51:32.015 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2024-09-11T23:51:32.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:31 smithi192 ceph-mon[35487]: Reconfiguring mon.b (monmap changed)... 2024-09-11T23:51:32.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:31 smithi192 ceph-mon[35487]: Reconfiguring daemon mon.b on smithi105 2024-09-11T23:51:32.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:31 smithi192 ceph-mon[35487]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi060=x;smithi105=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:32.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:31 smithi192 ceph-mon[35487]: Saving service mgr spec with placement smithi060=x;smithi105=y;smithi192=z;count:3 2024-09-11T23:51:32.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:31 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-11 23:51:21.226060342 +0000 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-11 23:47:00.210868114 +0000 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-11 23:47:00.210868114 +0000 2024-09-11T23:51:32.071 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-11 23:47:00.210868114 +0000 2024-09-11T23:51:32.072 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:51:32.135 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-11T23:51:32.135 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-11T23:51:32.135 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000270408 s, 1.9 MB/s 2024-09-11T23:51:32.136 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:51:32.193 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2024-09-11T23:51:32.248 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:51:32.248 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:32.248 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T23:51:32.248 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:32.248 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:32.249 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-11 23:51:21.226060342 +0000 2024-09-11T23:51:32.249 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-11 23:47:00.552861034 +0000 2024-09-11T23:51:32.249 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-11 23:47:00.552861034 +0000 2024-09-11T23:51:32.249 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-11 23:47:00.552861034 +0000 2024-09-11T23:51:32.249 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:51:32.311 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-11T23:51:32.311 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-11T23:51:32.311 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000295681 s, 1.7 MB/s 2024-09-11T23:51:32.313 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:51:32.369 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2024-09-11T23:51:32.424 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:51:32.425 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:32.425 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T23:51:32.425 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:32.425 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:32.425 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-11 23:51:21.227060322 +0000 2024-09-11T23:51:32.425 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-11 23:47:00.906853704 +0000 2024-09-11T23:51:32.425 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-11 23:47:00.906853704 +0000 2024-09-11T23:51:32.425 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-11 23:47:00.906853704 +0000 2024-09-11T23:51:32.425 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:51:32.487 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-11T23:51:32.487 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-11T23:51:32.487 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000231985 s, 2.2 MB/s 2024-09-11T23:51:32.488 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:51:32.544 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2024-09-11T23:51:32.599 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:51:32.599 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:32.599 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T23:51:32.600 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:32.600 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:32.600 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-11 23:51:21.227060322 +0000 2024-09-11T23:51:32.600 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-11 23:47:01.248846623 +0000 2024-09-11T23:51:32.600 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-11 23:47:01.248846623 +0000 2024-09-11T23:51:32.600 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-11 23:47:01.248846623 +0000 2024-09-11T23:51:32.600 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:51:32.662 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-11T23:51:32.662 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-11T23:51:32.662 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000170164 s, 3.0 MB/s 2024-09-11T23:51:32.663 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:51:32.719 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-11T23:51:32.719 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:51:32.736 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:51:32.736 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-11 23:51:11.995633547 +0000 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-11 23:47:00.966062320 +0000 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-11 23:47:00.966062320 +0000 2024-09-11T23:51:32.791 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-11 23:47:00.966062320 +0000 2024-09-11T23:51:32.792 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:51:32.855 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-11T23:51:32.855 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-11T23:51:32.855 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000268761 s, 1.9 MB/s 2024-09-11T23:51:32.856 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:51:32.913 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-09-11T23:51:32.969 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:51:32.969 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:32.969 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T23:51:32.969 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:32.969 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:32.969 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-11 23:51:11.996633527 +0000 2024-09-11T23:51:32.970 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-11 23:47:01.303055314 +0000 2024-09-11T23:51:32.970 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-11 23:47:01.303055314 +0000 2024-09-11T23:51:32.970 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-11 23:47:01.303055314 +0000 2024-09-11T23:51:32.970 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:51:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:32 smithi105 ceph-mon[34805]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:32 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:32 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:32 smithi105 ceph-mon[34805]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:51:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:32 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:32 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:32.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:32 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:32.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:32 smithi105 ceph-mon[34805]: Reconfiguring daemon mon.c on smithi192 2024-09-11T23:51:33.033 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-11T23:51:33.034 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-11T23:51:33.034 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000179375 s, 2.9 MB/s 2024-09-11T23:51:33.035 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:51:33.090 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-11 23:51:11.996633527 +0000 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-11 23:47:01.621048703 +0000 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-11 23:47:01.621048703 +0000 2024-09-11T23:51:33.146 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-11 23:47:01.621048703 +0000 2024-09-11T23:51:33.147 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:51:33.207 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:32 smithi192 ceph-mon[35487]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:33.207 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:32 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:33.208 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:32 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:33.208 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:32 smithi192 ceph-mon[35487]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:51:33.208 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:32 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:33.208 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:32 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:33.208 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:32 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:33.208 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:32 smithi192 ceph-mon[35487]: Reconfiguring daemon mon.c on smithi192 2024-09-11T23:51:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-11T23:51:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-11T23:51:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000197992 s, 2.6 MB/s 2024-09-11T23:51:33.211 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:51:33.267 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-09-11T23:51:33.324 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:51:33.324 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:51:33.324 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T23:51:33.324 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:51:33.324 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:51:33.324 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-11 23:51:11.997633506 +0000 2024-09-11T23:51:33.324 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-11 23:47:01.947041925 +0000 2024-09-11T23:51:33.325 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-11 23:47:01.947041925 +0000 2024-09-11T23:51:33.325 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-11 23:47:01.947041925 +0000 2024-09-11T23:51:33.325 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:51:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:32 smithi060 ceph-mon[30953]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:32 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:32 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:32 smithi060 ceph-mon[30953]: Reconfiguring mon.c (monmap changed)... 2024-09-11T23:51:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:32 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-11T23:51:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:32 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-11T23:51:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:32 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:32 smithi060 ceph-mon[30953]: Reconfiguring daemon mon.c on smithi192 2024-09-11T23:51:33.389 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-11T23:51:33.389 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-11T23:51:33.389 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000223367 s, 2.3 MB/s 2024-09-11T23:51:33.390 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:51:33.446 INFO:tasks.cephadm:Deploying osd.0 on smithi060 with /dev/vg_nvme/lv_4... 2024-09-11T23:51:33.447 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:51:33.708 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:51:34.403 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:34.403 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.403 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.403 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:34.404 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:34.404 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:34.404 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.404 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:34.404 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:34.404 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:34.404 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:34.404 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:34 smithi192 ceph-mon[35487]: Deploying daemon mgr.z on smithi192 2024-09-11T23:51:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:34.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:34.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:34.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:34.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:34 smithi060 ceph-mon[30953]: Deploying daemon mgr.z on smithi192 2024-09-11T23:51:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:34.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:34.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:34.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:34.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:34.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:34.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:34.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:34.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:34 smithi105 ceph-mon[34805]: Deploying daemon mgr.z on smithi192 2024-09-11T23:51:35.027 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 systemd[1]: Starting Ceph mgr.z for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:51:35.284 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 podman[37287]: 2024-09-11 23:51:35.143339003 +0000 UTC m=+0.016018441 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:51:35.641 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 podman[37287]: 2024-09-11 23:51:35.382331126 +0000 UTC m=+0.255010561 container create cae99f383f4e58b288bf75014419de2409c253c9349ef2e7903758b652212b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-11T23:51:35.642 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 podman[37287]: 2024-09-11 23:51:35.576343695 +0000 UTC m=+0.449023128 container init cae99f383f4e58b288bf75014419de2409c253c9349ef2e7903758b652212b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:51:35.642 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 podman[37287]: 2024-09-11 23:51:35.579052945 +0000 UTC m=+0.451732385 container start cae99f383f4e58b288bf75014419de2409c253c9349ef2e7903758b652212b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-11T23:51:35.642 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 ceph-mgr[37306]: -- 172.21.15.192:0/2653176416 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5564d0f870e0 con 0x5564d0f65400 2024-09-11T23:51:35.642 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 bash[37287]: cae99f383f4e58b288bf75014419de2409c253c9349ef2e7903758b652212b8c 2024-09-11T23:51:35.908 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 systemd[1]: Started Ceph mgr.z for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:51:35.908 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:35.702+0000 7fa2586b8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:51:35.908 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:35.760+0000 7fa2586b8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:51:35.908 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:35.909+0000 7fa2586b8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:51:36.258 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:35.974+0000 7fa2586b8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:51:36.258 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:36.118+0000 7fa2586b8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:51:36.258 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:36.258+0000 7fa2586b8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:51:36.312 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:51:36.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2024-09-11T23:51:36.592 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:51:36.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:36.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:36.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:36.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:36.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:36.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:36.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:36.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:36.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:36 smithi105 ceph-mon[34805]: Deploying daemon mgr.y on smithi105 2024-09-11T23:51:37.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:37.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:37.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:37.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:37.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:37.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:37.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:37.019 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:37.020 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:36 smithi060 ceph-mon[30953]: Deploying daemon mgr.y on smithi105 2024-09-11T23:51:37.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 -- 172.21.15.60:0/2375862987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c4107920 msgr2=0x7ff5c4109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:37.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/2375862987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c4107920 0x7ff5c4109d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009ca0 tx=0x7ff5bc02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:51:37.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 -- 172.21.15.60:0/2375862987 shutdown_connections 2024-09-11T23:51:37.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/2375862987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c4107920 0x7ff5c4109d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:37.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/2375862987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5c4104ff0 0x7ff5c41073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:37.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/2375862987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c41026c0 0x7ff5c4104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:37.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 -- 172.21.15.60:0/2375862987 >> 172.21.15.60:0/2375862987 conn(0x7ff5c40fc280 msgr2=0x7ff5c40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:37.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 -- 172.21.15.60:0/2375862987 shutdown_connections 2024-09-11T23:51:37.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.023+0000 7ff5c9f62640 1 -- 172.21.15.60:0/2375862987 wait complete. 2024-09-11T23:51:37.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c9f62640 1 Processor -- start 2024-09-11T23:51:37.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c9f62640 1 -- start start 2024-09-11T23:51:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c9f62640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c41026c0 0x7ff5c4197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c9f62640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5c4104ff0 0x7ff5c4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c9f62640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4107920 0x7ff5c419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c9f62640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c410da00 con 0x7ff5c41026c0 2024-09-11T23:51:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c9f62640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c410d880 con 0x7ff5c4107920 2024-09-11T23:51:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c9f62640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c410db80 con 0x7ff5c4104ff0 2024-09-11T23:51:37.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c41026c0 0x7ff5c4197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c41026c0 0x7ff5c4197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56988/0 (socket says 172.21.15.60:56988) 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c37fe640 1 -- 172.21.15.60:0/488199961 learned_addr learned my addr 172.21.15.60:0/488199961 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c2ffd640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5c4104ff0 0x7ff5c4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c3fff640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4107920 0x7ff5c419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c2ffd640 1 -- 172.21.15.60:0/488199961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4107920 msgr2=0x7ff5c419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c2ffd640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4107920 0x7ff5c419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c2ffd640 1 -- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c41026c0 msgr2=0x7ff5c4197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c2ffd640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c41026c0 0x7ff5c4197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c2ffd640 1 -- 172.21.15.60:0/488199961 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c419fbf0 con 0x7ff5c4104ff0 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.024+0000 7ff5c37fe640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c41026c0 0x7ff5c4197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:51:37.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.025+0000 7ff5c2ffd640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5c4104ff0 0x7ff5c4198500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800e9c0 tx=0x7ff5b800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.025+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b800ccc0 con 0x7ff5c4104ff0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.025+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c419fee0 con 0x7ff5c4104ff0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.025+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5b8005020 con 0x7ff5c4104ff0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.025+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8004a60 con 0x7ff5c4104ff0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.025+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c41a0390 con 0x7ff5c4104ff0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.026+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff5b8004c20 con 0x7ff5c4104ff0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.026+0000 7ff5c0ff9640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff5ac0392c0 0x7ff5ac03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.026+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff5b804c450 con 0x7ff5c4104ff0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.026+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c40fdd70 con 0x7ff5c4104ff0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.026+0000 7ff5c37fe640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff5ac0392c0 0x7ff5ac03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:51:37.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.027+0000 7ff5c37fe640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff5ac0392c0 0x7ff5ac03b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005fd0 tx=0x7ff5b400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:51:37.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.031+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff5b8014230 con 0x7ff5c4104ff0 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:36.569+0000 7fa2586b8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:36.630+0000 7fa2586b8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:36.816+0000 7fa2586b8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:37.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T23:51:37.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:37.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:37.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:36 smithi192 ceph-mon[35487]: Deploying daemon mgr.y on smithi105 2024-09-11T23:51:37.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:37.215+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff5c4062630 con 0x7ff5ac0392c0 2024-09-11T23:51:37.717 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:37 smithi105 systemd[1]: Starting Ceph mgr.y for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:51:37.880 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:37 smithi060 ceph-mon[30953]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:37.880 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:37 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:37.880 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:37 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:37.881 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:37 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:37.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:37 smithi105 ceph-mon[34805]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:37.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:37 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:37.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:37 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:37.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:37 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:37.980 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:37 smithi105 podman[36158]: 2024-09-11 23:51:37.687101706 +0000 UTC m=+0.015900592 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:51:37.980 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:37 smithi105 podman[36158]: 2024-09-11 23:51:37.811479549 +0000 UTC m=+0.140278462 container create 55dbd2b8e62db77395f6c0c46ca4dddb9cd90823a8c8bc6d58e2be20d5d17792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T23:51:38.034 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:37.700+0000 7fa2586b8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:51:38.034 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:37.768+0000 7fa2586b8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:51:38.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:37 smithi192 ceph-mon[35487]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:51:38.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:37 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:51:38.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:37 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:51:38.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:37 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:38.279 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 podman[36158]: 2024-09-11 23:51:38.072604254 +0000 UTC m=+0.401403128 container init 55dbd2b8e62db77395f6c0c46ca4dddb9cd90823a8c8bc6d58e2be20d5d17792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T23:51:38.279 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 podman[36158]: 2024-09-11 23:51:38.076900766 +0000 UTC m=+0.405699638 container start 55dbd2b8e62db77395f6c0c46ca4dddb9cd90823a8c8bc6d58e2be20d5d17792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-11T23:51:38.279 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 ceph-mgr[36178]: -- 172.21.15.105:0/1227819118 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577d5d210e0 con 0x5577d5cfe800 2024-09-11T23:51:38.280 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 bash[36158]: 55dbd2b8e62db77395f6c0c46ca4dddb9cd90823a8c8bc6d58e2be20d5d17792 2024-09-11T23:51:38.280 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 systemd[1]: Started Ceph mgr.y for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:51:38.280 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:38.217+0000 7fad34d32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:51:38.280 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:38.279+0000 7fad34d32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:51:38.667 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:38.436+0000 7fad34d32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:51:38.667 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:38.505+0000 7fad34d32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:51:38.667 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:38.667+0000 7fad34d32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:51:38.784 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:38.499+0000 7fa2586b8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:51:38.784 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:38.631+0000 7fa2586b8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:51:38.979 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:38.815+0000 7fad34d32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:51:39.076 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:38.786+0000 7fa2586b8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:51:39.077 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:38.847+0000 7fa2586b8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:51:39.077 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.001+0000 7fa2586b8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:51:39.077 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.077+0000 7fa2586b8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:51:39.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:39 smithi060 ceph-mon[30953]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:39.441 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.441 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.441 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.441 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.442 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:39.442 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:39.144+0000 7fad34d32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:51:39.443 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:39.206+0000 7fad34d32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:51:39.443 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.139+0000 7fa2586b8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:51:39.443 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.302+0000 7fa2586b8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:51:39.443 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.370+0000 7fa2586b8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:51:39.443 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-mon[34805]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:39.443 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.443 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.443 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.444 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.444 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:39.444 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-mon[35487]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:39.444 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.444 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.444 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.444 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:39.444 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:39.647 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.443+0000 7fa2586b8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:51:39.647 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.528+0000 7fa2586b8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:51:39.647 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.589+0000 7fa2586b8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:51:39.647 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:39.648+0000 7fa2586b8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:51:39.729 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:39.405+0000 7fad34d32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:51:40.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:40.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1828393148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1786002e-18f0-4bcc-97cc-315be3a3995f"}]: dispatch 2024-09-11T23:51:40.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1828393148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1786002e-18f0-4bcc-97cc-315be3a3995f"}]': finished 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:40.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:40.592 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:40.592 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: Reconfiguring daemon mgr.x on smithi060 2024-09-11T23:51:40.592 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:40 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2801092347' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:40.729 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:40.291+0000 7fad34d32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:51:40.729 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:40.360+0000 7fad34d32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1828393148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1786002e-18f0-4bcc-97cc-315be3a3995f"}]: dispatch 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1828393148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1786002e-18f0-4bcc-97cc-315be3a3995f"}]': finished 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:40.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:40.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:51:40.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:40.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:40.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:40.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: Reconfiguring daemon mgr.x on smithi060 2024-09-11T23:51:40.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:40 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2801092347' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:40.784 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:51:40.432+0000 7fa2586b8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:51:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1828393148' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1786002e-18f0-4bcc-97cc-315be3a3995f"}]: dispatch 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1828393148' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1786002e-18f0-4bcc-97cc-315be3a3995f"}]': finished 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-11T23:51:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-11T23:51:40.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:40.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: Reconfiguring daemon mgr.x on smithi060 2024-09-11T23:51:40.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:40 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2801092347' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:51:41.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:41.312+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7ff5b800f3c0 con 0x7ff5c4104ff0 2024-09-11T23:51:41.333 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-mon[34805]: Standby manager daemon z started 2024-09-11T23:51:41.334 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:51:41.334 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:41.334 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:51:41.334 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:41.334 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.073+0000 7fad34d32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:51:41.334 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.189+0000 7fad34d32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:51:41.334 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.334+0000 7fad34d32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:51:41.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:41 smithi060 ceph-mon[30953]: Standby manager daemon z started 2024-09-11T23:51:41.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:41 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:51:41.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:41 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:41.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:41 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:51:41.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:41 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:41.608 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.394+0000 7fad34d32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:51:41.608 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.542+0000 7fad34d32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:51:41.608 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.608+0000 7fad34d32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:51:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:41 smithi192 ceph-mon[35487]: Standby manager daemon z started 2024-09-11T23:51:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:41 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:51:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:41 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:41 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:51:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:41 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.192:0/1415193091' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:41.888 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.667+0000 7fad34d32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:51:41.888 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.822+0000 7fad34d32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:51:41.888 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.888+0000 7fad34d32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:51:42.152 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:41.954+0000 7fad34d32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:51:42.152 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:42.035+0000 7fad34d32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:51:42.152 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:42.094+0000 7fad34d32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:51:42.152 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:42.152+0000 7fad34d32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:51:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:42 smithi105 ceph-mon[34805]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:42 smithi105 ceph-mon[34805]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T23:51:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:42 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:51:42.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:42 smithi060 ceph-mon[30953]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:42.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:42 smithi060 ceph-mon[30953]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T23:51:42.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:42 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:51:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:42 smithi192 ceph-mon[35487]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:42 smithi192 ceph-mon[35487]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-11T23:51:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:42 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:51:43.229 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:51:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:51:42.940+0000 7fad34d32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:51:43.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:43.322+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mon.1 v2:172.21.15.192:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7ff5b80051d0 con 0x7ff5c4104ff0 2024-09-11T23:51:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:43 smithi060 ceph-mon[30953]: Standby manager daemon y started 2024-09-11T23:51:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:43 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:51:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:43 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:43 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:51:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:43 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:43.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:43 smithi105 ceph-mon[34805]: Standby manager daemon y started 2024-09-11T23:51:43.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:43 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:51:43.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:43 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:43.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:43 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:51:43.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:43 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:43.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:43 smithi192 ceph-mon[35487]: Standby manager daemon y started 2024-09-11T23:51:43.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:43 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:51:43.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:43 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:51:43.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:43 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:51:43.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:43 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.105:0/3120645120' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:51:44.585 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:44 smithi060 ceph-mon[30953]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:44.585 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:44 smithi060 ceph-mon[30953]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-11T23:51:44.585 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:51:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:44 smithi105 ceph-mon[34805]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:44 smithi105 ceph-mon[34805]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-11T23:51:44.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:51:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:44 smithi192 ceph-mon[35487]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:44 smithi192 ceph-mon[35487]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-11T23:51:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:51:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:46 smithi060 ceph-mon[30953]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:46 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:46 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:46 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:46.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:46 smithi105 ceph-mon[34805]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:46.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:46 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:46.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:46 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:46.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:46 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:46 smithi192 ceph-mon[35487]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:46 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:46 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:46 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:48.456 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:48 smithi060 ceph-mon[30953]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:48.457 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:48.457 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:48.457 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:48.586 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:48 smithi192 ceph-mon[35487]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:48.586 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:48.587 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:48.587 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:48.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:48 smithi105 ceph-mon[34805]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:48.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:48.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:48.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:49.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:51:49.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:49.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:49 smithi060 ceph-mon[30953]: Deploying daemon osd.0 on smithi060 2024-09-11T23:51:49.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:51:49.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:49.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:49 smithi105 ceph-mon[34805]: Deploying daemon osd.0 on smithi060 2024-09-11T23:51:49.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-11T23:51:49.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:49.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:49 smithi192 ceph-mon[35487]: Deploying daemon osd.0 on smithi060 2024-09-11T23:51:50.429 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:50 smithi060 ceph-mon[30953]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:50.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:50 smithi105 ceph-mon[34805]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:50.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:50 smithi192 ceph-mon[35487]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:52 smithi060 ceph-mon[30953]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:52.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:52 smithi105 ceph-mon[34805]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:52.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:52 smithi192 ceph-mon[35487]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:54.494 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:54 smithi060 ceph-mon[30953]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:54.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:54 smithi105 ceph-mon[34805]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:54.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:54 smithi192 ceph-mon[35487]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:55.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:55 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:55.511 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:55 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:55.511 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:55 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:55.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:55 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:55.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:55 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:55.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:55 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:55.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:55 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:55.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:55 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:55.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:55 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:57.004 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:56 smithi060 ceph-mon[30953]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:56 smithi192 ceph-mon[35487]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:57.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:56 smithi105 ceph-mon[34805]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:58.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:58.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:58.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:58.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:58.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.445 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.446 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.446 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:51:58.446 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:51:58.446 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:58.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.842+0000 7ff5c0ff9640 1 -- 172.21.15.60:0/488199961 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff5c4062630 con 0x7ff5ac0392c0 2024-09-11T23:51:58.842 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 0 on host 'smithi060' 2024-09-11T23:51:58.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff5ac0392c0 msgr2=0x7ff5ac03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:58.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff5ac0392c0 0x7ff5ac03b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005fd0 tx=0x7ff5b400b480 comp rx=0 tx=0).stop 2024-09-11T23:51:58.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5c4104ff0 msgr2=0x7ff5c4198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:51:58.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5c4104ff0 0x7ff5c4198500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800e9c0 tx=0x7ff5b800ee80 comp rx=0 tx=0).stop 2024-09-11T23:51:58.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 shutdown_connections 2024-09-11T23:51:58.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5c4107920 0x7ff5c419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:58.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5c4104ff0 0x7ff5c4198500 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:58.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff5ac0392c0 0x7ff5ac03b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:58.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 --2- 172.21.15.60:0/488199961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5c41026c0 0x7ff5c4197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:51:58.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 >> 172.21.15.60:0/488199961 conn(0x7ff5c40fc280 msgr2=0x7ff5c4102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:51:58.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.844+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 shutdown_connections 2024-09-11T23:51:58.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:51:58.845+0000 7ff5c9f62640 1 -- 172.21.15.60:0/488199961 wait complete. 2024-09-11T23:51:59.144 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:59 smithi060 ceph-mon[30953]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:59.144 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:59 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:59.145 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:59 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:59.145 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:51:59 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:59 smithi192 ceph-mon[35487]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:59 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:59 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:51:59 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:59 smithi105 ceph-mon[34805]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:51:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:59 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:51:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:59 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:51:59 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:51:59.501 DEBUG:teuthology.orchestra.run.smithi060:osd.0> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T23:51:59.504 INFO:tasks.cephadm:Deploying osd.1 on smithi105 with /dev/vg_nvme/lv_4... 2024-09-11T23:51:59.504 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:51:59.740 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:52:00.839 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0[44668]: 2024-09-11T23:52:00.557+0000 7f61feb6b640 -1 osd.0 0 log_to_monitors true 2024-09-11T23:52:01.095 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:01 smithi105 ceph-mon[34805]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:01.096 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:01 smithi105 ceph-mon[34805]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:52:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:01 smithi192 ceph-mon[35487]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:01 smithi192 ceph-mon[35487]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:52:01.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:01 smithi060 ceph-mon[30953]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:01.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:01 smithi060 ceph-mon[30953]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-11T23:52:02.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:02 smithi105 ceph-mon[34805]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:52:02.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:02 smithi105 ceph-mon[34805]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:52:02.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:02 smithi105 ceph-mon[34805]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:52:02.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:02.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:02 smithi105 ceph-mon[34805]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:52:02.188 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:02 smithi105 ceph-mon[34805]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:52:02.188 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:02.190 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:52:02.202 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-mon[30953]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:52:02.202 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-mon[30953]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:52:02.202 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-mon[30953]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:52:02.202 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:02.202 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-mon[30953]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:52:02.202 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-mon[30953]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:52:02.203 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:02.214 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi105:vg_nvme/lv_4 2024-09-11T23:52:02.459 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:52:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:02 smithi192 ceph-mon[35487]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T23:52:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:02 smithi192 ceph-mon[35487]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T23:52:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:02 smithi192 ceph-mon[35487]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:52:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:02 smithi192 ceph-mon[35487]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:52:02.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:02 smithi192 ceph-mon[35487]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T23:52:02.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:02.839 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0[44668]: 2024-09-11T23:52:02.533+0000 7f61faaee640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T23:52:02.839 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:02 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0[44668]: 2024-09-11T23:52:02.536+0000 7f61f290e640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:52:02.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.899+0000 7fd59366d640 1 -- 172.21.15.105:0/3331452553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 msgr2=0x7fd58c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:02.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.899+0000 7fd59366d640 1 --2- 172.21.15.105:0/3331452553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 0x7fd58c103280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009900 tx=0x7fd57c02a410 comp rx=0 tx=0).stop 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.899+0000 7fd59366d640 1 -- 172.21.15.105:0/3331452553 shutdown_connections 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.899+0000 7fd59366d640 1 --2- 172.21.15.105:0/3331452553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c1037c0 0x7fd58c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.899+0000 7fd59366d640 1 --2- 172.21.15.105:0/3331452553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 0x7fd58c103280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.899+0000 7fd59366d640 1 --2- 172.21.15.105:0/3331452553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58c101c00 0x7fd58c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.899+0000 7fd59366d640 1 -- 172.21.15.105:0/3331452553 >> 172.21.15.105:0/3331452553 conn(0x7fd58c0fd390 msgr2=0x7fd58c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.900+0000 7fd59366d640 1 -- 172.21.15.105:0/3331452553 shutdown_connections 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.900+0000 7fd59366d640 1 -- 172.21.15.105:0/3331452553 wait complete. 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.900+0000 7fd59366d640 1 Processor -- start 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.900+0000 7fd59366d640 1 -- start start 2024-09-11T23:52:02.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd59366d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58c101c00 0x7fd58c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd59366d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 0x7fd58c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd59366d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c1037c0 0x7fd58c19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd59366d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c10d9c0 con 0x7fd58c101c00 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd59366d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c10d840 con 0x7fd58c102e00 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd59366d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c10db40 con 0x7fd58c1037c0 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 0x7fd58c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 0x7fd58c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:34402/0 (socket says 172.21.15.105:34402) 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd591409640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58c101c00 0x7fd58c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 -- 172.21.15.105:0/233123318 learned_addr learned my addr 172.21.15.105:0/233123318 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd591c0a640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c1037c0 0x7fd58c19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 -- 172.21.15.105:0/233123318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c1037c0 msgr2=0x7fd58c19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c1037c0 0x7fd58c19f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 -- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58c101c00 msgr2=0x7fd58c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58c101c00 0x7fd58c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 -- 172.21.15.105:0/233123318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58c19fbe0 con 0x7fd58c102e00 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd591409640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58c101c00 0x7fd58c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd590c08640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 0x7fd58c1984f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009a20 tx=0x7fd57c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd5827fc640 1 -- 172.21.15.105:0/233123318 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c03f030 con 0x7fd58c102e00 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd5827fc640 1 -- 172.21.15.105:0/233123318 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd57c003d00 con 0x7fd58c102e00 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58c19fe70 con 0x7fd58c102e00 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd5827fc640 1 -- 172.21.15.105:0/233123318 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c035070 con 0x7fd58c102e00 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.901+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58c1a02c0 con 0x7fd58c102e00 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.902+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58c108f30 con 0x7fd58c102e00 2024-09-11T23:52:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.904+0000 7fd5827fc640 1 -- 172.21.15.105:0/233123318 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fd57c042030 con 0x7fd58c102e00 2024-09-11T23:52:02.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.904+0000 7fd5827fc640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd5780a2b20 0x7fd5780a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:02.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.904+0000 7fd5827fc640 1 -- 172.21.15.105:0/233123318 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fd57c0edda0 con 0x7fd58c102e00 2024-09-11T23:52:02.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.904+0000 7fd591409640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd5780a2b20 0x7fd5780a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:02.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.905+0000 7fd591409640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd5780a2b20 0x7fd5780a4fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd58c102c60 tx=0x7fd588005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:02.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:02.908+0000 7fd5827fc640 1 -- 172.21.15.105:0/233123318 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd57c0bc890 con 0x7fd58c102e00 2024-09-11T23:52:03.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:03.084+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd58c062630 con 0x7fd5780a2b20 2024-09-11T23:52:03.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi060 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:03.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' 2024-09-11T23:52:03.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi060 2024-09-11T23:52:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-11T23:52:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:03.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:03.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' 2024-09-11T23:52:03.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi060 2024-09-11T23:52:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-11T23:52:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481]' entity='osd.0' 2024-09-11T23:52:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:04.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:52:04.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:52:04.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:04.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:04.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:04.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:04.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] boot 2024-09-11T23:52:04.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:52:04.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:04.405 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:52:04.405 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:52:04.405 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:04.405 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:04.405 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:04.406 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:04.406 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] boot 2024-09-11T23:52:04.406 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:52:04.406 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:04.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:52:04.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:52:04.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:04.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:04.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:04.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:04.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: osd.0 [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] boot 2024-09-11T23:52:04.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T23:52:04.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:52:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:05 smithi060 ceph-mon[30953]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:05 smithi060 ceph-mon[30953]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:52:05.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:05 smithi105 ceph-mon[34805]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:05.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:05 smithi105 ceph-mon[34805]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:52:05.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:05 smithi192 ceph-mon[35487]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T23:52:05.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:05 smithi192 ceph-mon[35487]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T23:52:06.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:06 smithi105 ceph-mon[34805]: from='client.? 172.21.15.105:0/3357055860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]: dispatch 2024-09-11T23:52:06.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:06 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]: dispatch 2024-09-11T23:52:06.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:06 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]': finished 2024-09-11T23:52:06.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:06 smithi105 ceph-mon[34805]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:52:06.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:06 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:06.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:06 smithi105 ceph-mon[34805]: from='client.? 172.21.15.105:0/574768956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:06.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:06 smithi060 ceph-mon[30953]: from='client.? 172.21.15.105:0/3357055860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]: dispatch 2024-09-11T23:52:06.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:06 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]: dispatch 2024-09-11T23:52:06.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:06 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]': finished 2024-09-11T23:52:06.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:06 smithi060 ceph-mon[30953]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:52:06.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:06 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:06.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:06 smithi060 ceph-mon[30953]: from='client.? 172.21.15.105:0/574768956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:06.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:06 smithi192 ceph-mon[35487]: from='client.? 172.21.15.105:0/3357055860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]: dispatch 2024-09-11T23:52:06.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:06 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]: dispatch 2024-09-11T23:52:06.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:06 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2"}]': finished 2024-09-11T23:52:06.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:06 smithi192 ceph-mon[35487]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T23:52:06.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:06 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:06.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:06 smithi192 ceph-mon[35487]: from='client.? 172.21.15.105:0/574768956' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:07.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:07 smithi060 ceph-mon[30953]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:07 smithi105 ceph-mon[34805]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:07.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:07 smithi192 ceph-mon[35487]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:09.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:09 smithi060 ceph-mon[30953]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:09.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:09 smithi105 ceph-mon[34805]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:09 smithi192 ceph-mon[35487]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:11.147 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:11 smithi105 ceph-mon[34805]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:11.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:11 smithi060 ceph-mon[30953]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:11.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:11 smithi192 ceph-mon[35487]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:13.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:13 smithi060 ceph-mon[30953]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:13 smithi105 ceph-mon[34805]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:13 smithi192 ceph-mon[35487]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:14.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:14 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:52:14.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:14 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:14.354 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:14 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:52:14.354 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:14 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:14.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:14 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-11T23:52:14.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:14 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:15.123 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:15 smithi105 ceph-mon[34805]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:15.123 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:15 smithi105 ceph-mon[34805]: Deploying daemon osd.1 on smithi105 2024-09-11T23:52:15.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:15 smithi060 ceph-mon[30953]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:15.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:15 smithi060 ceph-mon[30953]: Deploying daemon osd.1 on smithi105 2024-09-11T23:52:15.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:15 smithi192 ceph-mon[35487]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:15.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:15 smithi192 ceph-mon[35487]: Deploying daemon osd.1 on smithi105 2024-09-11T23:52:17.303 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:17 smithi105 ceph-mon[34805]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:17 smithi060 ceph-mon[30953]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:17.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:17 smithi192 ceph-mon[35487]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:19.215 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:19 smithi105 ceph-mon[34805]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:19.336 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:19 smithi192 ceph-mon[35487]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:19 smithi060 ceph-mon[30953]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:20.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:20 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:20.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:20 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:20.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:20 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:20 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:20 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:20 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:20.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:20 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:20.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:20 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:20.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:20 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:21 smithi060 ceph-mon[30953]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:21.349 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:21 smithi105 ceph-mon[34805]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:21.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:21 smithi192 ceph-mon[35487]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:23 smithi060 ceph-mon[30953]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:23.456 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:23 smithi105 ceph-mon[34805]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:23.456 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:23.456 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:23.456 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:23.456 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:23.456 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:23 smithi192 ceph-mon[35487]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:24.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.087+0000 7fd5827fc640 1 -- 172.21.15.105:0/233123318 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd58c062630 con 0x7fd5780a2b20 2024-09-11T23:52:24.087 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 1 on host 'smithi105' 2024-09-11T23:52:24.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.089+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd5780a2b20 msgr2=0x7fd5780a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:24.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.089+0000 7fd59366d640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd5780a2b20 0x7fd5780a4fe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd58c102c60 tx=0x7fd588005f90 comp rx=0 tx=0).stop 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 msgr2=0x7fd58c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 0x7fd58c1984f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009a20 tx=0x7fd57c0042f0 comp rx=0 tx=0).stop 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 shutdown_connections 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c1037c0 0x7fd58c19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58c102e00 0x7fd58c1984f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd5780a2b20 0x7fd5780a4fe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 --2- 172.21.15.105:0/233123318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd58c101c00 0x7fd58c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 >> 172.21.15.105:0/233123318 conn(0x7fd58c0fd390 msgr2=0x7fd58c106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 shutdown_connections 2024-09-11T23:52:24.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:52:24.090+0000 7fd59366d640 1 -- 172.21.15.105:0/233123318 wait complete. 2024-09-11T23:52:24.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:24.396 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:24.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:24.714 DEBUG:teuthology.orchestra.run.smithi105:osd.1> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T23:52:24.716 INFO:tasks.cephadm:Deploying osd.2 on smithi192 with /dev/vg_nvme/lv_4... 2024-09-11T23:52:24.717 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T23:52:24.968 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:52:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:25 smithi060 ceph-mon[30953]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:25 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:25 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:25 smithi192 ceph-mon[35487]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:25 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:25.362 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:25 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:25.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:25 smithi105 ceph-mon[34805]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:25 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:25 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:26.086 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1[39268]: 2024-09-11T23:52:25.818+0000 7fc10e911640 -1 osd.1 0 log_to_monitors true 2024-09-11T23:52:26.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:26 smithi060 ceph-mon[30953]: from='osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:52:26.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:26 smithi060 ceph-mon[30953]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:52:26.356 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:26 smithi105 ceph-mon[34805]: from='osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:52:26.356 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:26 smithi105 ceph-mon[34805]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:52:26.393 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:26 smithi192 ceph-mon[35487]: from='osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:52:26.393 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:26 smithi192 ceph-mon[35487]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-11T23:52:27.218 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:27 smithi105 ceph-mon[34805]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:27.218 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:27 smithi105 ceph-mon[34805]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:52:27.218 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:27 smithi105 ceph-mon[34805]: from='osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:52:27.218 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:27 smithi105 ceph-mon[34805]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:52:27.218 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:27 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:27.218 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:27 smithi105 ceph-mon[34805]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:52:27.324 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:52:27.348 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:27 smithi192 ceph-mon[35487]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:27.348 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:27 smithi192 ceph-mon[35487]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:52:27.348 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:27 smithi192 ceph-mon[35487]: from='osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:52:27.349 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:27 smithi192 ceph-mon[35487]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:52:27.349 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:27 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:27.349 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:27 smithi192 ceph-mon[35487]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:52:27.350 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_4 2024-09-11T23:52:27.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:27 smithi060 ceph-mon[30953]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:27.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:27 smithi060 ceph-mon[30953]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T23:52:27.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:27 smithi060 ceph-mon[30953]: from='osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:52:27.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:27 smithi060 ceph-mon[30953]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T23:52:27.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:27 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:27.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:27 smithi060 ceph-mon[30953]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:52:27.602 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:52:27.979 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1[39268]: 2024-09-11T23:52:27.551+0000 7fc10a894640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T23:52:27.979 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1[39268]: 2024-09-11T23:52:27.555+0000 7fc1026b4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:52:28.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 -- 172.21.15.192:0/1149166648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e8101c20 msgr2=0x7f90e8102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 --2- 172.21.15.192:0/1149166648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e8101c20 0x7f90e8102020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009900 tx=0x7f90e402a410 comp rx=0 tx=0).stop 2024-09-11T23:52:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 -- 172.21.15.192:0/1149166648 shutdown_connections 2024-09-11T23:52:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 --2- 172.21.15.192:0/1149166648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e81037e0 0x7f90e810a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 --2- 172.21.15.192:0/1149166648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90e8102e20 0x7f90e81032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 --2- 172.21.15.192:0/1149166648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e8101c20 0x7f90e8102020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 -- 172.21.15.192:0/1149166648 >> 172.21.15.192:0/1149166648 conn(0x7f90e80fd3b0 msgr2=0x7f90e80ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 -- 172.21.15.192:0/1149166648 shutdown_connections 2024-09-11T23:52:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.061+0000 7f90ef32f640 1 -- 172.21.15.192:0/1149166648 wait complete. 2024-09-11T23:52:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ef32f640 1 Processor -- start 2024-09-11T23:52:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ef32f640 1 -- start start 2024-09-11T23:52:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ef32f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e8101c20 0x7f90e8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ef32f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90e8102e20 0x7f90e81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ef32f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81037e0 0x7f90e819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ef32f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f90e810d9e0 con 0x7f90e8101c20 2024-09-11T23:52:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ef32f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90e810d860 con 0x7f90e8102e20 2024-09-11T23:52:28.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ef32f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f90e810db60 con 0x7f90e81037e0 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed8cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81037e0 0x7f90e819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed8cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81037e0 0x7f90e819f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40726/0 (socket says 172.21.15.192:40726) 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed8cc640 1 -- 172.21.15.192:0/3265727975 learned_addr learned my addr 172.21.15.192:0/3265727975 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed0cb640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e8101c20 0x7f90e8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ec8ca640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90e8102e20 0x7f90e81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed8cc640 1 -- 172.21.15.192:0/3265727975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90e8102e20 msgr2=0x7f90e81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed8cc640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90e8102e20 0x7f90e81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed8cc640 1 -- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e8101c20 msgr2=0x7f90e8197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed8cc640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e8101c20 0x7f90e8197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.062+0000 7f90ed8cc640 1 -- 172.21.15.192:0/3265727975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e819fbb0 con 0x7f90e81037e0 2024-09-11T23:52:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.063+0000 7f90ed8cc640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81037e0 0x7f90e819f540 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90e000cad0 tx=0x7f90e000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.063+0000 7f90de7fc640 1 -- 172.21.15.192:0/3265727975 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e000ae20 con 0x7f90e81037e0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.063+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e819fea0 con 0x7f90e81037e0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.063+0000 7f90de7fc640 1 -- 172.21.15.192:0/3265727975 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90e0004b20 con 0x7f90e81037e0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.063+0000 7f90de7fc640 1 -- 172.21.15.192:0/3265727975 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e000f780 con 0x7f90e81037e0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.063+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e81a0350 con 0x7f90e81037e0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.064+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e8108f50 con 0x7f90e81037e0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.065+0000 7f90de7fc640 1 -- 172.21.15.192:0/3265727975 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f90e0004cd0 con 0x7f90e81037e0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.066+0000 7f90de7fc640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f90d40a2b20 0x7f90d40a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.066+0000 7f90de7fc640 1 -- 172.21.15.192:0/3265727975 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f90e00cd6b0 con 0x7f90e81037e0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.066+0000 7f90ed0cb640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f90d40a2b20 0x7f90d40a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.067+0000 7f90ed0cb640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f90d40a2b20 0x7f90d40a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f90e4031570 tx=0x7f90e4031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.070+0000 7f90de7fc640 1 -- 172.21.15.192:0/3265727975 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90e0014030 con 0x7f90e81037e0 2024-09-11T23:52:28.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:28.252+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f90e8062630 con 0x7f90d40a2b20 2024-09-11T23:52:28.251 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:52:28.251 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:52:28.251 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='osd.1 ' entity='osd.1' 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:28.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:52:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:52:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='osd.1 ' entity='osd.1' 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:28.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:52:28.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T23:52:28.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:28.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:28.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='osd.1 ' entity='osd.1' 2024-09-11T23:52:28.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:28.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:28.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:28.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:28.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:52:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi105 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi105 to 17088M 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] boot 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:52:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi105 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi105 to 17088M 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] boot 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:52:29.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:29.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:52:29.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:52:29.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-11T23:52:29.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi105 2024-09-11T23:52:29.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi105 to 17088M 2024-09-11T23:52:29.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:29.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:29.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:29.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:29.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:29.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: osd.1 [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] boot 2024-09-11T23:52:29.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T23:52:29.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:52:30.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:30 smithi060 ceph-mon[30953]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:30.990 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:30 smithi060 ceph-mon[30953]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:52:30.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:30 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/2556915286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]: dispatch 2024-09-11T23:52:30.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:30 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]: dispatch 2024-09-11T23:52:30.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:30 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]': finished 2024-09-11T23:52:30.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:30 smithi060 ceph-mon[30953]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:52:30.991 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:30.992 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:30 smithi105 ceph-mon[34805]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:30.992 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:30 smithi105 ceph-mon[34805]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:52:30.992 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:30 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/2556915286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]: dispatch 2024-09-11T23:52:30.992 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:30 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]: dispatch 2024-09-11T23:52:30.992 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:30 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]': finished 2024-09-11T23:52:30.992 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:30 smithi105 ceph-mon[34805]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:52:30.992 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:31.000 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:30 smithi192 ceph-mon[35487]: pgmap v58: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:31.000 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:30 smithi192 ceph-mon[35487]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T23:52:31.000 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:30 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/2556915286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]: dispatch 2024-09-11T23:52:31.000 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:30 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]: dispatch 2024-09-11T23:52:31.000 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:30 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c58b9ec-e216-484b-b579-783f4e6a0a23"}]': finished 2024-09-11T23:52:31.000 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:30 smithi192 ceph-mon[35487]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T23:52:31.001 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:31.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:31 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/209328621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:31.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:31 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/209328621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:32.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:31 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/209328621' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:32.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:32 smithi060 ceph-mon[30953]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:32.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:32 smithi105 ceph-mon[34805]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:33.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:32 smithi192 ceph-mon[35487]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:34 smithi060 ceph-mon[30953]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:34.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:34 smithi105 ceph-mon[34805]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:35.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:34 smithi192 ceph-mon[35487]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:36.778 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:36 smithi192 ceph-mon[35487]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:36.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:36 smithi060 ceph-mon[30953]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:36.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:36 smithi105 ceph-mon[34805]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:38.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:38 smithi060 ceph-mon[30953]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:38.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:52:38.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:38.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:38 smithi060 ceph-mon[30953]: Deploying daemon osd.2 on smithi192 2024-09-11T23:52:38.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:38 smithi192 ceph-mon[35487]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:38.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:52:38.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:38.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:38 smithi192 ceph-mon[35487]: Deploying daemon osd.2 on smithi192 2024-09-11T23:52:38.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:38 smithi105 ceph-mon[34805]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:38.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-11T23:52:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:38 smithi105 ceph-mon[34805]: Deploying daemon osd.2 on smithi192 2024-09-11T23:52:40.687 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:40 smithi192 ceph-mon[35487]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:40.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:40 smithi060 ceph-mon[30953]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:40.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:40 smithi105 ceph-mon[34805]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:42.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:42 smithi060 ceph-mon[30953]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:42 smithi105 ceph-mon[34805]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:43.005 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:42 smithi192 ceph-mon[35487]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:44 smithi192 ceph-mon[35487]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:44 smithi060 ceph-mon[30953]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:44.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:44 smithi105 ceph-mon[34805]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:44.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:44.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:44.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:47 smithi192 ceph-mon[35487]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:47 smithi060 ceph-mon[30953]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:47 smithi105 ceph-mon[34805]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:47.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:47.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:47.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:47.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:48.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.083+0000 7f90de7fc640 1 -- 172.21.15.192:0/3265727975 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f90e8062630 con 0x7f90d40a2b20 2024-09-11T23:52:48.083 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 2 on host 'smithi192' 2024-09-11T23:52:48.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f90d40a2b20 msgr2=0x7f90d40a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:48.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f90d40a2b20 0x7f90d40a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f90e4031570 tx=0x7f90e4031640 comp rx=0 tx=0).stop 2024-09-11T23:52:48.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81037e0 msgr2=0x7f90e819f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:48.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81037e0 0x7f90e819f540 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90e000cad0 tx=0x7f90e000cf90 comp rx=0 tx=0).stop 2024-09-11T23:52:48.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 shutdown_connections 2024-09-11T23:52:48.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90e81037e0 0x7f90e819f540 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:48.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90e8102e20 0x7f90e81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:48.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f90d40a2b20 0x7f90d40a4fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:48.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 --2- 172.21.15.192:0/3265727975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90e8101c20 0x7f90e8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:48.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 >> 172.21.15.192:0/3265727975 conn(0x7f90e80fd3b0 msgr2=0x7f90e8106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:48.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 shutdown_connections 2024-09-11T23:52:48.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:52:48.086+0000 7f90ef32f640 1 -- 172.21.15.192:0/3265727975 wait complete. 2024-09-11T23:52:48.393 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:48.393 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:48.394 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:48.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:48.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:48.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:48.655 DEBUG:teuthology.orchestra.run.smithi192:osd.2> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T23:52:48.657 INFO:tasks.cephadm:Deploying osd.3 on smithi060 with /dev/vg_nvme/lv_3... 2024-09-11T23:52:48.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:52:48.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:52:48.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:48.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:48.919 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:52:49.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:49 smithi060 ceph-mon[30953]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:49.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:49 smithi192 ceph-mon[35487]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:49.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:49 smithi105 ceph-mon[34805]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:50.279 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:50 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2[40453]: 2024-09-11T23:52:50.142+0000 7f8c58d72640 -1 osd.2 0 log_to_monitors true 2024-09-11T23:52:50.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:50 smithi192 ceph-mon[35487]: from='osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:50.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:50 smithi192 ceph-mon[35487]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:50.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:50 smithi060 ceph-mon[30953]: from='osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:50.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:50 smithi060 ceph-mon[30953]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:50.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:50 smithi105 ceph-mon[34805]: from='osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:50.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:50 smithi105 ceph-mon[34805]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-11T23:52:51.385 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:51 smithi192 ceph-mon[35487]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:51.385 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:51 smithi192 ceph-mon[35487]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:52:51.385 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:51 smithi192 ceph-mon[35487]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:52:51.385 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:51 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:51.385 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:51 smithi192 ceph-mon[35487]: from='osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:52:51.385 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:51 smithi192 ceph-mon[35487]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:52:51.459 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:51 smithi060 ceph-mon[30953]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:51.460 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:51 smithi060 ceph-mon[30953]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:52:51.460 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:51 smithi060 ceph-mon[30953]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:52:51.460 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:51.460 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:51 smithi060 ceph-mon[30953]: from='osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:52:51.460 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:51 smithi060 ceph-mon[30953]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:52:51.486 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:52:51.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2024-09-11T23:52:51.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:51 smithi105 ceph-mon[34805]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:51.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:51 smithi105 ceph-mon[34805]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T23:52:51.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:51 smithi105 ceph-mon[34805]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T23:52:51.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:51 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:51.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:51 smithi105 ceph-mon[34805]: from='osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:52:51.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:51 smithi105 ceph-mon[34805]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:52:51.770 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:52:52.034 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:51 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2[40453]: 2024-09-11T23:52:51.731+0000 7f8c54cf5640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T23:52:52.034 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:51 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2[40453]: 2024-09-11T23:52:51.734+0000 7f8c4cb15640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:52:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1907562543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64101cd0 msgr2=0x7f1e64102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1907562543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64101cd0 0x7f1e64102150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009900 tx=0x7f1e5802a410 comp rx=0 tx=0).stop 2024-09-11T23:52:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1907562543 shutdown_connections 2024-09-11T23:52:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1907562543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64102690 0x7f1e64108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:52.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1907562543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64101cd0 0x7f1e64102150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1907562543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e64100ad0 0x7f1e64100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1907562543 >> 172.21.15.60:0/1907562543 conn(0x7f1e640fc280 msgr2=0x7f1e640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1907562543 shutdown_connections 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.190+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1907562543 wait complete. 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e6a62d640 1 Processor -- start 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e6a62d640 1 -- start start 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e6a62d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64100ad0 0x7f1e6406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e6a62d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64101cd0 0x7f1e6419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e6a62d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e64102690 0x7f1e6419f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:52.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e6a62d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410c890 con 0x7f1e64100ad0 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e6a62d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410c710 con 0x7f1e64102690 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e6a62d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6410ca10 con 0x7f1e64101cd0 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64100ad0 0x7f1e6406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e637fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64101cd0 0x7f1e6419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64100ad0 0x7f1e6406aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54892/0 (socket says 172.21.15.60:54892) 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.191+0000 7f1e63fff640 1 -- 172.21.15.60:0/1286414404 learned_addr learned my addr 172.21.15.60:0/1286414404 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e68bca640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e64102690 0x7f1e6419f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e637fe640 1 -- 172.21.15.60:0/1286414404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e64102690 msgr2=0x7f1e6419f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e637fe640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e64102690 0x7f1e6419f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e637fe640 1 -- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64100ad0 msgr2=0x7f1e6406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e637fe640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64100ad0 0x7f1e6406aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:52:52.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e637fe640 1 -- 172.21.15.60:0/1286414404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6419fbb0 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e637fe640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64101cd0 0x7f1e6419cc80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e58005ab0 tx=0x7f1e580042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e617fa640 1 -- 172.21.15.60:0/1286414404 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5803f070 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6419fde0 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e617fa640 1 -- 172.21.15.60:0/1286414404 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1e5803b460 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e617fa640 1 -- 172.21.15.60:0/1286414404 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58035070 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.192+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e641a0240 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.193+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e64107e00 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.196+0000 7f1e617fa640 1 -- 172.21.15.60:0/1286414404 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f1e5803b610 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.196+0000 7f1e617fa640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1e4c0a2af0 0x7f1e4c0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.196+0000 7f1e617fa640 1 -- 172.21.15.60:0/1286414404 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f1e580ee1c0 con 0x7f1e64101cd0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.196+0000 7f1e63fff640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1e4c0a2af0 0x7f1e4c0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:52:52.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.197+0000 7f1e63fff640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1e4c0a2af0 0x7f1e4c0a4fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400ace0 tx=0x7f1e5400a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:52:52.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.202+0000 7f1e617fa640 1 -- 172.21.15.60:0/1286414404 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e580bc7d0 con 0x7f1e64101cd0 2024-09-11T23:52:52.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:52.392+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1e64062630 con 0x7f1e4c0a2af0 2024-09-11T23:52:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:52:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:52:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi192 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:52 smithi060 ceph-mon[30953]: from='osd.2 ' entity='osd.2' 2024-09-11T23:52:52.727 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:52:52.727 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:52:52.727 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:52.727 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi192 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.728 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:52 smithi192 ceph-mon[35487]: from='osd.2 ' entity='osd.2' 2024-09-11T23:52:52.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:52:52.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T23:52:52.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi192 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:52.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:52 smithi105 ceph-mon[34805]: from='osd.2 ' entity='osd.2' 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] boot 2024-09-11T23:52:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:52:53.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:53 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:53.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:52:53.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:52:53.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:53.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:53.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:53.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:53.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:53.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] boot 2024-09-11T23:52:53.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:52:53.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:53 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:53.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:52:53.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:52:53.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:53.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: from='client.24193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:52:53.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:52:53.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:52:53.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:52:53.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: osd.2 [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] boot 2024-09-11T23:52:53.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T23:52:53.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:53 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:52:54.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:54 smithi060 ceph-mon[30953]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:54.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:54.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:54.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:54 smithi060 ceph-mon[30953]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:52:54.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:54.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:54 smithi105 ceph-mon[34805]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:54.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:54.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:54.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:54 smithi105 ceph-mon[34805]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:52:54.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:54.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:54 smithi192 ceph-mon[35487]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:54.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:54.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:54.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:54 smithi192 ceph-mon[35487]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T23:52:54.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-11T23:52:55.589 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:55 smithi060 sudo[49532]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:55.589 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:55 smithi060 sudo[49532]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:55.589 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:55 smithi060 sudo[49532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:55.589 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:55 smithi060 sudo[49532]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:55.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:55 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3596158577' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4ea1fe8-4668-4a6b-bef9-b52f838be94b"}]: dispatch 2024-09-11T23:52:55.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:55 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:55.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:55 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3596158577' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4ea1fe8-4668-4a6b-bef9-b52f838be94b"}]': finished 2024-09-11T23:52:55.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:55 smithi060 ceph-mon[30953]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:52:55.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:55 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:55.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:55 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3596158577' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4ea1fe8-4668-4a6b-bef9-b52f838be94b"}]: dispatch 2024-09-11T23:52:55.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:55 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:55.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:55 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3596158577' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4ea1fe8-4668-4a6b-bef9-b52f838be94b"}]': finished 2024-09-11T23:52:55.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:55 smithi105 ceph-mon[34805]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:52:55.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:55 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:55.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:55 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3596158577' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4ea1fe8-4668-4a6b-bef9-b52f838be94b"}]: dispatch 2024-09-11T23:52:55.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:55 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T23:52:55.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:55 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3596158577' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4ea1fe8-4668-4a6b-bef9-b52f838be94b"}]': finished 2024-09-11T23:52:55.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:55 smithi192 ceph-mon[35487]: osdmap e20: 4 total, 3 up, 4 in 2024-09-11T23:52:55.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:55 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:56.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:55 smithi060 sudo[49581]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:56.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:55 smithi060 sudo[49581]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:56.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:55 smithi060 sudo[49581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:56.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 11 23:52:55 smithi060 sudo[49581]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:56.311 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:56 smithi105 sudo[43413]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:56.312 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:56 smithi105 sudo[43413]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:56.312 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:56 smithi105 sudo[43413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:56.312 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:56 smithi105 sudo[43413]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:56.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:52:56.317+0000 7f1e617fa640 1 -- 172.21.15.60:0/1286414404 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1e580b8740 con 0x7f1e64101cd0 2024-09-11T23:52:56.584 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:56 smithi192 ceph-mon[35487]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:56.584 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:56 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/994418892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:56.584 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:56 smithi192 ceph-mon[35487]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:52:56.584 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:56.584 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:56.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:56 smithi060 ceph-mon[30953]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:56.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:56 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/994418892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:56.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:56 smithi060 ceph-mon[30953]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:52:56.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:56.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:56.729 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:56 smithi105 sudo[43416]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:56.729 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:56 smithi105 sudo[43416]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:56.729 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:56 smithi105 sudo[43416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:56.730 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 11 23:52:56 smithi105 sudo[43416]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:56.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:56 smithi105 ceph-mon[34805]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:56.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:56 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/994418892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:52:56.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:56 smithi105 ceph-mon[34805]: osdmap e21: 4 total, 3 up, 4 in 2024-09-11T23:52:56.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:52:56.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:56.841 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:56 smithi192 sudo[44538]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:56.841 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:56 smithi192 sudo[44538]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:56.841 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:56 smithi192 sudo[44538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:56.841 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:56 smithi192 sudo[44538]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:57.284 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:56 smithi192 sudo[44541]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:57.284 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:56 smithi192 sudo[44541]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:57.284 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:56 smithi192 sudo[44541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:57.284 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 11 23:52:56 smithi192 sudo[44541]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:57.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 sudo[49958]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:57.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 sudo[49958]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:57.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 sudo[49958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:57.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 sudo[49958]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:58.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:57 smithi192 ceph-mon[35487]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:52:58.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:58.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:58.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:57 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:58.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 sudo[44544]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:58.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 sudo[44544]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:58.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 sudo[44544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 sudo[50332]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 sudo[50332]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 sudo[50332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 sudo[50332]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 ceph-mon[30953]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:52:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:57 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:58.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:57 smithi105 ceph-mon[34805]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T23:52:58.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:58.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:52:58.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:57 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:58.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 sudo[44544]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:58.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 sudo[44547]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:58.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 sudo[44547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:58.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 sudo[44547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:58.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 sudo[44547]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:58.773 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 sudo[43419]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T23:52:58.773 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 sudo[43419]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:58.774 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 sudo[43419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:58.774 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 sudo[43419]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:59.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:59.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:59.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:59.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:59.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 sudo[43422]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 sudo[43422]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 sudo[43422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 sudo[43422]: pam_unix(sudo:session): session closed for user root 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:52:59.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:52:59.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:52:59.231 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:52:59.993 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:59 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:52:59.994 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:52:59 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:53:00.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:59 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:53:00.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:52:59 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:53:00.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:59 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T23:53:00.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:52:59 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T23:53:00.997 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:00 smithi060 ceph-mon[30953]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:01.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:00 smithi105 ceph-mon[34805]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:00 smithi192 ceph-mon[35487]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:03.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:02 smithi060 ceph-mon[30953]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:03.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:02 smithi105 ceph-mon[34805]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:03.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:02 smithi192 ceph-mon[35487]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:04.023 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:53:04.024 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:04.024 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:03 smithi060 ceph-mon[30953]: Deploying daemon osd.3 on smithi060 2024-09-11T23:53:04.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:53:04.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:04.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:03 smithi105 ceph-mon[34805]: Deploying daemon osd.3 on smithi060 2024-09-11T23:53:04.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-11T23:53:04.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:04.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:03 smithi192 ceph-mon[35487]: Deploying daemon osd.3 on smithi060 2024-09-11T23:53:04.875 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:04 smithi060 ceph-mon[30953]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:04 smithi105 ceph-mon[34805]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:04 smithi192 ceph-mon[35487]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:07.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:06 smithi060 ceph-mon[30953]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:07.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:06 smithi105 ceph-mon[34805]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:07.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:06 smithi192 ceph-mon[35487]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:09.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:08 smithi060 ceph-mon[30953]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:09.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:08 smithi105 ceph-mon[34805]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:09.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:08 smithi192 ceph-mon[35487]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:10.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:09 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:10.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:09 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:10.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:09 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:10.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:09 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:10.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:09 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:10.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:09 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:10.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:09 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:10.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:09 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:10.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:09 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:11.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:11 smithi192 ceph-mon[35487]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:11.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:11 smithi060 ceph-mon[30953]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:11 smithi105 ceph-mon[34805]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:12.888 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:12 smithi060 ceph-mon[30953]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:12.888 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:12 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:12.889 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:12 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:12.889 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:12 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:12.889 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:12 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:12.889 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:12 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:12.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.929+0000 7f1e617fa640 1 -- 172.21.15.60:0/1286414404 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1e64062630 con 0x7f1e4c0a2af0 2024-09-11T23:53:12.929 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 3 on host 'smithi060' 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1e4c0a2af0 msgr2=0x7f1e4c0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1e4c0a2af0 0x7f1e4c0a4fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400ace0 tx=0x7f1e5400a3b0 comp rx=0 tx=0).stop 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64101cd0 msgr2=0x7f1e6419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64101cd0 0x7f1e6419cc80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e58005ab0 tx=0x7f1e580042f0 comp rx=0 tx=0).stop 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 shutdown_connections 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e64102690 0x7f1e6419f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64101cd0 0x7f1e6419cc80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1e4c0a2af0 0x7f1e4c0a4fb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 --2- 172.21.15.60:0/1286414404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e64100ad0 0x7f1e6406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:12.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.931+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 >> 172.21.15.60:0/1286414404 conn(0x7f1e640fc280 msgr2=0x7f1e64104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:12.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.932+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 shutdown_connections 2024-09-11T23:53:12.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:53:12.932+0000 7f1e6a62d640 1 -- 172.21.15.60:0/1286414404 wait complete. 2024-09-11T23:53:12.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:12 smithi105 ceph-mon[34805]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:12.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:12 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:12.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:12 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:12.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:12 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:12.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:12 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:12.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:12 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:13.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:12 smithi192 ceph-mon[35487]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:13.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:13.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:13.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:13.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:13.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:13.568 DEBUG:teuthology.orchestra.run.smithi060:osd.3> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T23:53:13.571 INFO:tasks.cephadm:Deploying osd.4 on smithi105 with /dev/vg_nvme/lv_3... 2024-09-11T23:53:13.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:53:13.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:13.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:13.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:13.825 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:53:13.947 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:13.947 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:13.947 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:14.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:14.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:14.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:14.589 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 11 23:53:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3[51546]: 2024-09-11T23:53:14.334+0000 7f48099a7640 -1 osd.3 0 log_to_monitors true 2024-09-11T23:53:15.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:14 smithi060 ceph-mon[30953]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:15.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:14 smithi060 ceph-mon[30953]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:53:15.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:14 smithi105 ceph-mon[34805]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:15.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:14 smithi105 ceph-mon[34805]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:53:15.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:14 smithi192 ceph-mon[35487]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:15.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:14 smithi192 ceph-mon[35487]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-11T23:53:16.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:15 smithi105 ceph-mon[34805]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:53:16.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:15 smithi105 ceph-mon[34805]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:53:16.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:15 smithi105 ceph-mon[34805]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:53:16.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:15 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:16.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:15 smithi105 ceph-mon[34805]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:53:16.233 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:15 smithi060 ceph-mon[30953]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:53:16.233 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:15 smithi060 ceph-mon[30953]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:53:16.233 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:15 smithi060 ceph-mon[30953]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:53:16.233 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:15 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:16.233 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:15 smithi060 ceph-mon[30953]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:53:16.233 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 11 23:53:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3[51546]: 2024-09-11T23:53:15.936+0000 7f480592a640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T23:53:16.233 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 11 23:53:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3[51546]: 2024-09-11T23:53:15.942+0000 7f4801752640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:53:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:15 smithi192 ceph-mon[35487]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T23:53:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:15 smithi192 ceph-mon[35487]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T23:53:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:15 smithi192 ceph-mon[35487]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:53:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:15 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:15 smithi192 ceph-mon[35487]: from='osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:53:16.400 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:53:16.427 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi105:vg_nvme/lv_3 2024-09-11T23:53:16.688 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:53:17.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 -- 172.21.15.105:0/2420342989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38102df0 msgr2=0x7f1f38103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:17.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/2420342989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38102df0 0x7f1f38103270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c009900 tx=0x7f1f2c02a410 comp rx=0 tx=0).stop 2024-09-11T23:53:17.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 -- 172.21.15.105:0/2420342989 shutdown_connections 2024-09-11T23:53:17.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/2420342989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f381037b0 0x7f1f3810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:17.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/2420342989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38102df0 0x7f1f38103270 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:17.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/2420342989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f38101bf0 0x7f1f38101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:17.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 -- 172.21.15.105:0/2420342989 >> 172.21.15.105:0/2420342989 conn(0x7f1f380fd3c0 msgr2=0x7f1f380ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:17.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 -- 172.21.15.105:0/2420342989 shutdown_connections 2024-09-11T23:53:17.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.137+0000 7f1f3cd72640 1 -- 172.21.15.105:0/2420342989 wait complete. 2024-09-11T23:53:17.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3cd72640 1 Processor -- start 2024-09-11T23:53:17.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3cd72640 1 -- start start 2024-09-11T23:53:17.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3cd72640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38101bf0 0x7f1f38197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3cd72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f38102df0 0x7f1f381984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3cd72640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f381037b0 0x7f1f3819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3cd72640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3810d9b0 con 0x7f1f38102df0 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3cd72640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3810d830 con 0x7f1f38101bf0 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3cd72640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3810db30 con 0x7f1f381037b0 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38101bf0 0x7f1f38197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38101bf0 0x7f1f38197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56744/0 (socket says 172.21.15.105:56744) 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3659c640 1 -- 172.21.15.105:0/3204481189 learned_addr learned my addr 172.21.15.105:0/3204481189 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f35d9b640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f38102df0 0x7f1f381984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f36d9d640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f381037b0 0x7f1f3819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3659c640 1 -- 172.21.15.105:0/3204481189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f381037b0 msgr2=0x7f1f3819f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:17.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3659c640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f381037b0 0x7f1f3819f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3659c640 1 -- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f38102df0 msgr2=0x7f1f381984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3659c640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f38102df0 0x7f1f381984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f3659c640 1 -- 172.21.15.105:0/3204481189 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3819fbb0 con 0x7f1f38101bf0 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.138+0000 7f1f36d9d640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f381037b0 0x7f1f3819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.139+0000 7f1f3659c640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38101bf0 0x7f1f38197f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800d950 tx=0x7f1f2800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.139+0000 7f1f277fe640 1 -- 172.21.15.105:0/3204481189 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28017070 con 0x7f1f38101bf0 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.139+0000 7f1f277fe640 1 -- 172.21.15.105:0/3204481189 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f28009c30 con 0x7f1f38101bf0 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.139+0000 7f1f277fe640 1 -- 172.21.15.105:0/3204481189 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2800f6b0 con 0x7f1f38101bf0 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.139+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3819fea0 con 0x7f1f38101bf0 2024-09-11T23:53:17.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.139+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f381a02f0 con 0x7f1f38101bf0 2024-09-11T23:53:17.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.140+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f38108fa0 con 0x7f1f38101bf0 2024-09-11T23:53:17.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.142+0000 7f1f277fe640 1 -- 172.21.15.105:0/3204481189 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1f2801a070 con 0x7f1f38101bf0 2024-09-11T23:53:17.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.143+0000 7f1f277fe640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f200a2c30 0x7f1f200a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:17.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.143+0000 7f1f277fe640 1 -- 172.21.15.105:0/3204481189 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7f1f280cd7f0 con 0x7f1f38101bf0 2024-09-11T23:53:17.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.143+0000 7f1f35d9b640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f200a2c30 0x7f1f200a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:17.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.143+0000 7f1f35d9b640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f200a2c30 0x7f1f200a50f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c006010 tx=0x7f1f2c031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:17.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.146+0000 7f1f277fe640 1 -- 172.21.15.105:0/3204481189 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f2809b9d0 con 0x7f1f38101bf0 2024-09-11T23:53:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:17.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:17.327+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1f38062630 con 0x7f1f200a2c30 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:17.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:17.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:17.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:18.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:53:18.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi060 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] boot 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:18.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:17 smithi105 ceph-mon[34805]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:53:18.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:53:18.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:53:18.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi060 2024-09-11T23:53:18.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-11T23:53:18.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] boot 2024-09-11T23:53:18.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:53:18.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:18.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:18.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:18.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:18.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:17 smithi192 ceph-mon[35487]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:53:18.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:53:18.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:53:18.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi060 2024-09-11T23:53:18.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-11T23:53:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: osd.3 [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] boot 2024-09-11T23:53:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: osdmap e24: 4 total, 4 up, 4 in 2024-09-11T23:53:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:53:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:18.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:17 smithi060 ceph-mon[30953]: osdmap e25: 4 total, 4 up, 4 in 2024-09-11T23:53:19.060 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:18 smithi105 ceph-mon[34805]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:19.061 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:18 smithi105 ceph-mon[34805]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:19.061 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:18 smithi105 ceph-mon[34805]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:53:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:18 smithi192 ceph-mon[35487]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:18 smithi192 ceph-mon[35487]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:18 smithi192 ceph-mon[35487]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:53:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:18 smithi060 ceph-mon[30953]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-11T23:53:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:18 smithi060 ceph-mon[30953]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:18 smithi060 ceph-mon[30953]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T23:53:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:19 smithi192 ceph-mon[35487]: from='client.? 172.21.15.105:0/995467056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]: dispatch 2024-09-11T23:53:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:19 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]: dispatch 2024-09-11T23:53:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:19 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]': finished 2024-09-11T23:53:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:19 smithi192 ceph-mon[35487]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T23:53:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:19 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:19 smithi060 ceph-mon[30953]: from='client.? 172.21.15.105:0/995467056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]: dispatch 2024-09-11T23:53:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:19 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]: dispatch 2024-09-11T23:53:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:19 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]': finished 2024-09-11T23:53:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:19 smithi060 ceph-mon[30953]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T23:53:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:19 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:20.344 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:19 smithi105 ceph-mon[34805]: from='client.? 172.21.15.105:0/995467056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]: dispatch 2024-09-11T23:53:20.344 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:19 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]: dispatch 2024-09-11T23:53:20.344 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:19 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "877161c8-96cd-4464-92f3-c19d4f06c754"}]': finished 2024-09-11T23:53:20.344 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:19 smithi105 ceph-mon[34805]: osdmap e27: 5 total, 4 up, 5 in 2024-09-11T23:53:20.345 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:19 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:20 smithi192 ceph-mon[35487]: pgmap v96: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:20 smithi192 ceph-mon[35487]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T23:53:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:20 smithi192 ceph-mon[35487]: from='client.? 172.21.15.105:0/3284957081' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:20 smithi192 ceph-mon[35487]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:53:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:20 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:20 smithi060 ceph-mon[30953]: pgmap v96: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:20 smithi060 ceph-mon[30953]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T23:53:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:20 smithi060 ceph-mon[30953]: from='client.? 172.21.15.105:0/3284957081' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:20 smithi060 ceph-mon[30953]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:53:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:20 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:20 smithi105 ceph-mon[34805]: pgmap v96: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:20 smithi105 ceph-mon[34805]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T23:53:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:20 smithi105 ceph-mon[34805]: from='client.? 172.21.15.105:0/3284957081' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:20 smithi105 ceph-mon[34805]: osdmap e28: 5 total, 4 up, 5 in 2024-09-11T23:53:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:20 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:22 smithi192 ceph-mon[35487]: pgmap v99: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:22 smithi060 ceph-mon[30953]: pgmap v99: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:22 smithi105 ceph-mon[34805]: pgmap v99: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:24 smithi105 ceph-mon[34805]: pgmap v100: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:25.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:24 smithi192 ceph-mon[35487]: pgmap v100: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:24 smithi060 ceph-mon[30953]: pgmap v100: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T23:53:26.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:26 smithi060 ceph-mon[30953]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T23:53:26.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:26 smithi060 ceph-mon[30953]: Cluster is now healthy 2024-09-11T23:53:26.352 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:26 smithi105 ceph-mon[34805]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T23:53:26.352 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:26 smithi105 ceph-mon[34805]: Cluster is now healthy 2024-09-11T23:53:26.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:26 smithi192 ceph-mon[35487]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T23:53:26.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:26 smithi192 ceph-mon[35487]: Cluster is now healthy 2024-09-11T23:53:27.114 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:27 smithi105 ceph-mon[34805]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T23:53:27.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:27 smithi060 ceph-mon[30953]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T23:53:27.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:27 smithi192 ceph-mon[35487]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T23:53:29.166 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:29 smithi105 ceph-mon[34805]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:53:29.167 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:53:29.167 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:29 smithi060 ceph-mon[30953]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:53:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:53:29.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:29 smithi192 ceph-mon[35487]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:53:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-11T23:53:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:30.162 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:30 smithi105 ceph-mon[34805]: Deploying daemon osd.4 on smithi105 2024-09-11T23:53:30.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:30 smithi192 ceph-mon[35487]: Deploying daemon osd.4 on smithi105 2024-09-11T23:53:30.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:30 smithi060 ceph-mon[30953]: Deploying daemon osd.4 on smithi105 2024-09-11T23:53:31.193 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:31 smithi105 ceph-mon[34805]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-11T23:53:31.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:31 smithi060 ceph-mon[30953]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-11T23:53:31.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:31 smithi192 ceph-mon[35487]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-11T23:53:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:33 smithi060 ceph-mon[30953]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:53:33.449 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:33 smithi105 ceph-mon[34805]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:53:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:33 smithi192 ceph-mon[35487]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:53:35.332 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:35 smithi105 ceph-mon[34805]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:35.333 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:35.333 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:35.333 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:35 smithi060 ceph-mon[30953]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:35 smithi192 ceph-mon[35487]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:37.098 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:37 smithi105 ceph-mon[34805]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:37.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:37 smithi060 ceph-mon[30953]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:37.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:37 smithi192 ceph-mon[35487]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:53:38.462 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.462 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.462 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:38.462 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:38.462 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:38.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:38.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:38.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:38.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:38.796 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 4 on host 'smithi105' 2024-09-11T23:53:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.795+0000 7f1f277fe640 1 -- 172.21.15.105:0/3204481189 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1f38062630 con 0x7f1f200a2c30 2024-09-11T23:53:38.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f200a2c30 msgr2=0x7f1f200a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f200a2c30 0x7f1f200a50f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c006010 tx=0x7f1f2c031640 comp rx=0 tx=0).stop 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38101bf0 msgr2=0x7f1f38197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38101bf0 0x7f1f38197f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800d950 tx=0x7f1f2800de10 comp rx=0 tx=0).stop 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 shutdown_connections 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f381037b0 0x7f1f3819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1f200a2c30 0x7f1f200a50f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f38102df0 0x7f1f381984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 --2- 172.21.15.105:0/3204481189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f38101bf0 0x7f1f38197f80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 >> 172.21.15.105:0/3204481189 conn(0x7f1f380fd3c0 msgr2=0x7f1f38106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 shutdown_connections 2024-09-11T23:53:38.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:53:38.798+0000 7f1f3cd72640 1 -- 172.21.15.105:0/3204481189 wait complete. 2024-09-11T23:53:39.452 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:39 smithi105 ceph-mon[34805]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:39.452 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:39.452 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:39.453 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:39.481 DEBUG:teuthology.orchestra.run.smithi105:osd.4> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T23:53:39.483 INFO:tasks.cephadm:Deploying osd.5 on smithi192 with /dev/vg_nvme/lv_3... 2024-09-11T23:53:39.483 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T23:53:39.511 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:39 smithi192 ceph-mon[35487]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:39.511 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:39.511 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:39.511 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:39 smithi060 ceph-mon[30953]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:53:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:39.737 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:53:40.929 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 11 23:53:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-11T23:53:40.800+0000 7fb905199640 -1 osd.4 0 log_to_monitors true 2024-09-11T23:53:41.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:41 smithi105 ceph-mon[34805]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:41.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:41 smithi105 ceph-mon[34805]: from='osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:41.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:41 smithi105 ceph-mon[34805]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:41.461 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:41 smithi192 ceph-mon[35487]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:41.462 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:41 smithi192 ceph-mon[35487]: from='osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:41.462 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:41 smithi192 ceph-mon[35487]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:41.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:41 smithi060 ceph-mon[30953]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:41.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:41 smithi060 ceph-mon[30953]: from='osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:41.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:41 smithi060 ceph-mon[30953]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-11T23:53:42.172 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:53:42.198 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:42 smithi192 ceph-mon[35487]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:53:42.198 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:42 smithi192 ceph-mon[35487]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:53:42.199 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:42 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:42.199 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:42 smithi192 ceph-mon[35487]: from='osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:53:42.199 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:42 smithi192 ceph-mon[35487]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:53:42.201 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_3 2024-09-11T23:53:42.479 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 11 23:53:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-11T23:53:42.189+0000 7fb90111c640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T23:53:42.479 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 11 23:53:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-11T23:53:42.194+0000 7fb8fcf44640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:53:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:42 smithi105 ceph-mon[34805]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:53:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:42 smithi105 ceph-mon[34805]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:53:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:42 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:42 smithi105 ceph-mon[34805]: from='osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:53:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:42 smithi105 ceph-mon[34805]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:53:42.490 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:42 smithi060 ceph-mon[30953]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T23:53:42.490 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:42 smithi060 ceph-mon[30953]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T23:53:42.490 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:42 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:42.490 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:42 smithi060 ceph-mon[30953]: from='osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:53:42.490 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:42 smithi060 ceph-mon[30953]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:53:42.506 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:53:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.950+0000 7fed8ce51640 1 -- 172.21.15.192:0/91178358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88105750 msgr2=0x7fed88105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.950+0000 7fed8ce51640 1 --2- 172.21.15.192:0/91178358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88105750 0x7fed88105c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fed80009ca0 tx=0x7fed8002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:53:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 -- 172.21.15.192:0/91178358 shutdown_connections 2024-09-11T23:53:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 --2- 172.21.15.192:0/91178358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88105750 0x7fed88105c00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 --2- 172.21.15.192:0/91178358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed88102da0 0x7fed88105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 --2- 172.21.15.192:0/91178358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed88100450 0x7fed88102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 -- 172.21.15.192:0/91178358 >> 172.21.15.192:0/91178358 conn(0x7fed880fc280 msgr2=0x7fed880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:53:42.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 -- 172.21.15.192:0/91178358 shutdown_connections 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 -- 172.21.15.192:0/91178358 wait complete. 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 Processor -- start 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.951+0000 7fed8ce51640 1 -- start start 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed8ce51640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed88100450 0x7fed8819e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed8ce51640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88102da0 0x7fed8819ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed8ce51640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed88105750 0x7fed881a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed8ce51640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fed88113f80 con 0x7fed88100450 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed8ce51640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed88113e00 con 0x7fed88105750 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed8ce51640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fed88114100 con 0x7fed88102da0 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88102da0 0x7fed8819ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88102da0 0x7fed8819ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33510/0 (socket says 172.21.15.192:33510) 2024-09-11T23:53:42.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 -- 172.21.15.192:0/3808253425 learned_addr learned my addr 172.21.15.192:0/3808253425 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed8659c640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed88100450 0x7fed8819e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed86d9d640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed88105750 0x7fed881a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 -- 172.21.15.192:0/3808253425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed88105750 msgr2=0x7fed881a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed88105750 0x7fed881a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 -- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed88100450 msgr2=0x7fed8819e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed88100450 0x7fed8819e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 -- 172.21.15.192:0/3808253425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed881a6150 con 0x7fed88102da0 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed8659c640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed88100450 0x7fed8819e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed85d9b640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88102da0 0x7fed8819ea60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00d950 tx=0x7fed7c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:42.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.952+0000 7fed777fe640 1 -- 172.21.15.192:0/3808253425 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c017030 con 0x7fed88102da0 2024-09-11T23:53:42.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.953+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed881a6440 con 0x7fed88102da0 2024-09-11T23:53:42.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.953+0000 7fed777fe640 1 -- 172.21.15.192:0/3808253425 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed7c004020 con 0x7fed88102da0 2024-09-11T23:53:42.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.953+0000 7fed777fe640 1 -- 172.21.15.192:0/3808253425 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c004a00 con 0x7fed88102da0 2024-09-11T23:53:42.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.953+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed881a69d0 con 0x7fed88102da0 2024-09-11T23:53:42.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.954+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed880fdd70 con 0x7fed88102da0 2024-09-11T23:53:42.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.955+0000 7fed777fe640 1 -- 172.21.15.192:0/3808253425 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fed7c0041d0 con 0x7fed88102da0 2024-09-11T23:53:42.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.955+0000 7fed777fe640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fed700a2bb0 0x7fed700a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:53:42.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.955+0000 7fed777fe640 1 -- 172.21.15.192:0/3808253425 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7fed7c0cd860 con 0x7fed88102da0 2024-09-11T23:53:42.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.956+0000 7fed8659c640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fed700a2bb0 0x7fed700a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:53:42.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.956+0000 7fed8659c640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fed700a2bb0 0x7fed700a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed78009fc0 tx=0x7fed78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:53:42.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:42.960+0000 7fed777fe640 1 -- 172.21.15.192:0/3808253425 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed7c09b950 con 0x7fed88102da0 2024-09-11T23:53:43.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:53:43.143+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fed88062630 con 0x7fed700a2bb0 2024-09-11T23:53:43.474 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:43.474 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi105 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi105 to 8544M 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:43.475 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:43.476 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.476 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:43.476 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:43.476 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:43 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:53:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi105 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi105 to 8544M 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:43.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:43.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:43 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:53:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T23:53:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi105 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi105 to 8544M 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:53:43.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:53:43.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:53:43.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:53:43.591 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:43 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:44 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:53:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:44 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:53:44.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:44 smithi105 ceph-mon[34805]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:44.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:44 smithi105 ceph-mon[34805]: osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] boot 2024-09-11T23:53:44.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:44 smithi105 ceph-mon[34805]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:53:44.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:44.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:44 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:53:44.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:44 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:53:44.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:44 smithi192 ceph-mon[35487]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:44.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:44 smithi192 ceph-mon[35487]: osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] boot 2024-09-11T23:53:44.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:44 smithi192 ceph-mon[35487]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:53:44.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:44.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:44 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:53:44.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:44 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:53:44.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:44 smithi060 ceph-mon[30953]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:53:44.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:44 smithi060 ceph-mon[30953]: osd.4 [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] boot 2024-09-11T23:53:44.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:44 smithi060 ceph-mon[30953]: osdmap e31: 5 total, 5 up, 5 in 2024-09-11T23:53:44.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:53:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:45 smithi105 ceph-mon[34805]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:45 smithi105 ceph-mon[34805]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:53:45.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:45 smithi192 ceph-mon[35487]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:45.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:45 smithi192 ceph-mon[35487]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:53:45.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:45 smithi060 ceph-mon[30953]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-11T23:53:45.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:45 smithi060 ceph-mon[30953]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T23:53:46.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:46 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/2011805906' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]: dispatch 2024-09-11T23:53:46.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:46 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]: dispatch 2024-09-11T23:53:46.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:46 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]': finished 2024-09-11T23:53:46.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:46 smithi105 ceph-mon[34805]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:53:46.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:46 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:46.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:46 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/718839375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:46.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:46 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/2011805906' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]: dispatch 2024-09-11T23:53:46.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:46 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]: dispatch 2024-09-11T23:53:46.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:46 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]': finished 2024-09-11T23:53:46.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:46 smithi192 ceph-mon[35487]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:53:46.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:46 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:46.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:46 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/718839375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:46 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/2011805906' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]: dispatch 2024-09-11T23:53:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:46 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]: dispatch 2024-09-11T23:53:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:46 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1e7304-48a6-4f9f-aa12-f1384eb2a389"}]': finished 2024-09-11T23:53:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:46 smithi060 ceph-mon[30953]: osdmap e33: 6 total, 5 up, 6 in 2024-09-11T23:53:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:46 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:53:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:46 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/718839375' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:53:47.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:47 smithi105 ceph-mon[34805]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:47 smithi192 ceph-mon[35487]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:47 smithi060 ceph-mon[30953]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:49 smithi105 ceph-mon[34805]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:49.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:49 smithi192 ceph-mon[35487]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:49.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:49 smithi060 ceph-mon[30953]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:51.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:51 smithi105 ceph-mon[34805]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:51.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:51 smithi192 ceph-mon[35487]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:51.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:51 smithi060 ceph-mon[30953]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:53.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:53 smithi192 ceph-mon[35487]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:53.486 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:53 smithi105 ceph-mon[34805]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:53 smithi060 ceph-mon[30953]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:54.472 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:53:54.472 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:54.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:53:54.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:54.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-11T23:53:54.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:53:55.349 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:55 smithi192 ceph-mon[35487]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:55.349 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:55 smithi192 ceph-mon[35487]: Deploying daemon osd.5 on smithi192 2024-09-11T23:53:55.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:55 smithi105 ceph-mon[34805]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:55.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:55 smithi105 ceph-mon[34805]: Deploying daemon osd.5 on smithi192 2024-09-11T23:53:55.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:55 smithi060 ceph-mon[30953]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:55.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:55 smithi060 ceph-mon[30953]: Deploying daemon osd.5 on smithi192 2024-09-11T23:53:57.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:57 smithi192 ceph-mon[35487]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:57 smithi105 ceph-mon[34805]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:57.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:57 smithi060 ceph-mon[30953]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:59.456 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:53:59 smithi192 ceph-mon[35487]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:59.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:53:59 smithi105 ceph-mon[34805]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:53:59.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:53:59 smithi060 ceph-mon[30953]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:01 smithi105 ceph-mon[34805]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:01 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:01 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:01.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:01 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:01.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:01 smithi192 ceph-mon[35487]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:01.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:01 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:01.526 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:01 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:01.526 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:01 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:01.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:01 smithi060 ceph-mon[30953]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:01.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:01.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:01.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:03 smithi192 ceph-mon[35487]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:03.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:03 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.592 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:03 smithi060 ceph-mon[30953]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:03.593 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.593 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.593 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:03.593 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:03.593 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:03 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:03 smithi105 ceph-mon[34805]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:03.736 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.736 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:03.736 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:03.736 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:03.736 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:03 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:04.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.328+0000 7fed777fe640 1 -- 172.21.15.192:0/3808253425 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fed88062630 con 0x7fed700a2bb0 2024-09-11T23:54:04.327 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 5 on host 'smithi192' 2024-09-11T23:54:04.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fed700a2bb0 msgr2=0x7fed700a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:04.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fed700a2bb0 0x7fed700a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed78009fc0 tx=0x7fed78005f90 comp rx=0 tx=0).stop 2024-09-11T23:54:04.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88102da0 msgr2=0x7fed8819ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:04.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88102da0 0x7fed8819ea60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00d950 tx=0x7fed7c00de10 comp rx=0 tx=0).stop 2024-09-11T23:54:04.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 shutdown_connections 2024-09-11T23:54:04.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed88105750 0x7fed881a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:04.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed88102da0 0x7fed8819ea60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:04.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fed700a2bb0 0x7fed700a5070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:04.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 --2- 172.21.15.192:0/3808253425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed88100450 0x7fed8819e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:04.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 >> 172.21.15.192:0/3808253425 conn(0x7fed880fc280 msgr2=0x7fed881036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:04.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 shutdown_connections 2024-09-11T23:54:04.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:04.331+0000 7fed8ce51640 1 -- 172.21.15.192:0/3808253425 wait complete. 2024-09-11T23:54:05.022 DEBUG:teuthology.orchestra.run.smithi192:osd.5> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T23:54:05.025 INFO:tasks.cephadm:Deploying osd.6 on smithi060 with /dev/vg_nvme/lv_2... 2024-09-11T23:54:05.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:54:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:05 smithi192 ceph-mon[35487]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:05 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:05 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:05.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:05 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:05.293 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:54:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:05 smithi060 ceph-mon[30953]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:05 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:05 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:05 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:05.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:05 smithi105 ceph-mon[34805]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:05.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:05 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:05.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:05 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:05.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:05 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:06.394 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:06 smithi192 ceph-mon[35487]: from='osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:54:06.394 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:06 smithi192 ceph-mon[35487]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:54:06.394 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 11 23:54:06 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-11T23:54:06.171+0000 7fa6c7fcb640 -1 osd.5 0 log_to_monitors true 2024-09-11T23:54:06.579 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:06 smithi060 ceph-mon[30953]: from='osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:54:06.580 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:06 smithi060 ceph-mon[30953]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:54:06.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:06 smithi105 ceph-mon[34805]: from='osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:54:06.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:06 smithi105 ceph-mon[34805]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-11T23:54:07.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:07 smithi060 ceph-mon[30953]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:07.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:07 smithi060 ceph-mon[30953]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:54:07.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:07 smithi060 ceph-mon[30953]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:54:07.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:07 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:07.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:07 smithi060 ceph-mon[30953]: from='osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:54:07.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:07 smithi060 ceph-mon[30953]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:54:07.437 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:07 smithi192 ceph-mon[35487]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:07.438 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:07 smithi192 ceph-mon[35487]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:54:07.438 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:07 smithi192 ceph-mon[35487]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:54:07.438 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:07 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:07.438 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:07 smithi192 ceph-mon[35487]: from='osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:54:07.438 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:07 smithi192 ceph-mon[35487]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:54:07.438 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 11 23:54:07 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-11T23:54:07.245+0000 7fa6c3f4e640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T23:54:07.438 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 11 23:54:07 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-11T23:54:07.252+0000 7fa6bfd76640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:54:07.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:07 smithi105 ceph-mon[34805]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:07.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:07 smithi105 ceph-mon[34805]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T23:54:07.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:07 smithi105 ceph-mon[34805]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T23:54:07.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:07 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:07.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:07 smithi105 ceph-mon[34805]: from='osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:54:07.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:07 smithi105 ceph-mon[34805]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:54:07.986 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:54:08.013 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2024-09-11T23:54:08.277 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:54:08.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:54:08.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:54:08.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] boot 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:08.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.542 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:54:08.542 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:54:08.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] boot 2024-09-11T23:54:08.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:54:08.543 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:08.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:08.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:08.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:08.545 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: osd.5 [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] boot 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: osdmap e36: 6 total, 6 up, 6 in 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:08.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:08.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:08.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:08.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.747+0000 7f6e161dd640 1 -- 172.21.15.60:0/1336915797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e101026a0 msgr2=0x7f6e10104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:08.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.747+0000 7f6e161dd640 1 --2- 172.21.15.60:0/1336915797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e101026a0 0x7f6e10104a90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009900 tx=0x7f6e0002a410 comp rx=0 tx=0).stop 2024-09-11T23:54:08.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.747+0000 7f6e161dd640 1 -- 172.21.15.60:0/1336915797 shutdown_connections 2024-09-11T23:54:08.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.747+0000 7f6e161dd640 1 --2- 172.21.15.60:0/1336915797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e10107900 0x7f6e10109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:08.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.747+0000 7f6e161dd640 1 --2- 172.21.15.60:0/1336915797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10104fd0 0x7f6e101073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.747+0000 7f6e161dd640 1 --2- 172.21.15.60:0/1336915797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e101026a0 0x7f6e10104a90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.747+0000 7f6e161dd640 1 -- 172.21.15.60:0/1336915797 >> 172.21.15.60:0/1336915797 conn(0x7f6e100fc2a0 msgr2=0x7f6e100fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 -- 172.21.15.60:0/1336915797 shutdown_connections 2024-09-11T23:54:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 -- 172.21.15.60:0/1336915797 wait complete. 2024-09-11T23:54:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 Processor -- start 2024-09-11T23:54:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 -- start start 2024-09-11T23:54:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e101026a0 0x7f6e10198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e10104fd0 0x7f6e101985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:08.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10107900 0x7f6e1019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:08.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1010da50 con 0x7f6e10104fd0 2024-09-11T23:54:08.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1010d8d0 con 0x7f6e101026a0 2024-09-11T23:54:08.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.748+0000 7f6e161dd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1010dbd0 con 0x7f6e10107900 2024-09-11T23:54:08.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e10104fd0 0x7f6e101985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:08.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e10104fd0 0x7f6e101985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54782/0 (socket says 172.21.15.60:54782) 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 -- 172.21.15.60:0/2160760908 learned_addr learned my addr 172.21.15.60:0/2160760908 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0ffff640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10107900 0x7f6e1019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0f7fe640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e101026a0 0x7f6e10198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 -- 172.21.15.60:0/2160760908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10107900 msgr2=0x7f6e1019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10107900 0x7f6e1019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 -- 172.21.15.60:0/2160760908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e101026a0 msgr2=0x7f6e10198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e101026a0 0x7f6e10198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 -- 172.21.15.60:0/2160760908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1019fca0 con 0x7f6e10104fd0 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0f7fe640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e101026a0 0x7f6e10198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:54:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0effd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e10104fd0 0x7f6e101985b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400d770 tx=0x7f6e0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0cff9640 1 -- 172.21.15.60:0/2160760908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04017070 con 0x7f6e10104fd0 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0cff9640 1 -- 172.21.15.60:0/2160760908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e04009c30 con 0x7f6e10104fd0 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1019ff90 con 0x7f6e10104fd0 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e0cff9640 1 -- 172.21.15.60:0/2160760908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400f6b0 con 0x7f6e10104fd0 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.749+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e101a04c0 con 0x7f6e10104fd0 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.750+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e100fdd90 con 0x7f6e10104fd0 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.752+0000 7f6e0cff9640 1 -- 172.21.15.60:0/2160760908 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6e0401a070 con 0x7f6e10104fd0 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.752+0000 7f6e0cff9640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6df80a2bb0 0x7f6df80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.752+0000 7f6e0f7fe640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6df80a2bb0 0x7f6df80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:08.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.752+0000 7f6e0cff9640 1 -- 172.21.15.60:0/2160760908 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7f6e040cdbd0 con 0x7f6e10104fd0 2024-09-11T23:54:08.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.753+0000 7f6e0f7fe640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6df80a2bb0 0x7f6df80a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e00000c00 tx=0x7f6e00031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:08.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.756+0000 7f6e0cff9640 1 -- 172.21.15.60:0/2160760908 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e0409b9d0 con 0x7f6e10104fd0 2024-09-11T23:54:08.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:08.946+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6e10062630 con 0x7f6df80a2bb0 2024-09-11T23:54:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:54:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:54:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi192 2024-09-11T23:54:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-11T23:54:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:54:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:09 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:09.498 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:54:09.498 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:54:09.498 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:09.499 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi192 2024-09-11T23:54:09.499 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-11T23:54:09.499 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:54:09.499 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:09.499 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:09.499 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:09 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:54:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:54:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-11T23:54:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi192 2024-09-11T23:54:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-11T23:54:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T23:54:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:09.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:09 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:10.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:10 smithi060 ceph-mon[30953]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:10.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:10 smithi060 ceph-mon[30953]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:54:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:10 smithi192 ceph-mon[35487]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:10 smithi192 ceph-mon[35487]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:54:10.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:10 smithi105 ceph-mon[34805]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:10.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:10 smithi105 ceph-mon[34805]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T23:54:11.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:11 smithi060 ceph-mon[30953]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:11.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:11 smithi060 ceph-mon[30953]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T23:54:11.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:11 smithi192 ceph-mon[35487]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:11.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:11 smithi192 ceph-mon[35487]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T23:54:11.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:11 smithi105 ceph-mon[34805]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:11.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:11 smithi105 ceph-mon[34805]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T23:54:12.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:12 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/655580823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb057ead-4a04-43af-a276-78a3ce33a7b2"}]: dispatch 2024-09-11T23:54:12.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:12 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/655580823' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb057ead-4a04-43af-a276-78a3ce33a7b2"}]': finished 2024-09-11T23:54:12.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:12 smithi192 ceph-mon[35487]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:54:12.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:12.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:12 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2600748260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:12.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:12 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/655580823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb057ead-4a04-43af-a276-78a3ce33a7b2"}]: dispatch 2024-09-11T23:54:12.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:12 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/655580823' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb057ead-4a04-43af-a276-78a3ce33a7b2"}]': finished 2024-09-11T23:54:12.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:12 smithi060 ceph-mon[30953]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:54:12.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:12 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:12.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:12 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2600748260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:12.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:12 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/655580823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb057ead-4a04-43af-a276-78a3ce33a7b2"}]: dispatch 2024-09-11T23:54:12.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:12 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/655580823' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb057ead-4a04-43af-a276-78a3ce33a7b2"}]': finished 2024-09-11T23:54:12.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:12 smithi105 ceph-mon[34805]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T23:54:12.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:12 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:12.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:12 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2600748260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:13 smithi192 ceph-mon[35487]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:13.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:13 smithi060 ceph-mon[30953]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:13.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:13 smithi105 ceph-mon[34805]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:15.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:15 smithi192 ceph-mon[35487]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:15.549 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:15 smithi060 ceph-mon[30953]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:15.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:15 smithi105 ceph-mon[34805]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:17.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:17 smithi192 ceph-mon[35487]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:54:17.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:17 smithi060 ceph-mon[30953]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:54:17.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:17 smithi105 ceph-mon[34805]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:54:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:19 smithi192 ceph-mon[35487]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T23:54:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:19 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:54:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:19 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:19 smithi060 ceph-mon[30953]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T23:54:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:19 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:54:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:19 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:19.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:19 smithi105 ceph-mon[34805]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-11T23:54:19.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:19 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-11T23:54:19.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:19 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:20.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:20 smithi192 ceph-mon[35487]: Deploying daemon osd.6 on smithi060 2024-09-11T23:54:20.546 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:20 smithi060 ceph-mon[30953]: Deploying daemon osd.6 on smithi060 2024-09-11T23:54:20.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:20 smithi105 ceph-mon[34805]: Deploying daemon osd.6 on smithi060 2024-09-11T23:54:21.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:21 smithi192 ceph-mon[35487]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T23:54:21.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:21 smithi060 ceph-mon[30953]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T23:54:21.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:21 smithi105 ceph-mon[34805]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T23:54:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:23 smithi192 ceph-mon[35487]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:54:23.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:23 smithi060 ceph-mon[30953]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:54:23.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:23 smithi105 ceph-mon[34805]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:54:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:25 smithi060 ceph-mon[30953]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:54:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:25 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:25 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:25 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:25.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:25 smithi192 ceph-mon[35487]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:54:25.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:25 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:25.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:25 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:25.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:25 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:25.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:25 smithi105 ceph-mon[34805]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:54:25.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:25 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:25.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:25 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:25.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:25 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:27.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:27 smithi060 ceph-mon[30953]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:54:27.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:27 smithi192 ceph-mon[35487]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:54:27.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:27 smithi105 ceph-mon[34805]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:54:29.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.054+0000 7f6e0cff9640 1 -- 172.21.15.60:0/2160760908 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6e10062630 con 0x7f6df80a2bb0 2024-09-11T23:54:29.054 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 6 on host 'smithi060' 2024-09-11T23:54:29.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.056+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6df80a2bb0 msgr2=0x7f6df80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:29.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.056+0000 7f6e161dd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6df80a2bb0 0x7f6df80a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e00000c00 tx=0x7f6e00031640 comp rx=0 tx=0).stop 2024-09-11T23:54:29.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.056+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e10104fd0 msgr2=0x7f6e101985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:29.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.056+0000 7f6e161dd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e10104fd0 0x7f6e101985b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400d770 tx=0x7f6e0400dc30 comp rx=0 tx=0).stop 2024-09-11T23:54:29.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.057+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 shutdown_connections 2024-09-11T23:54:29.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.057+0000 7f6e161dd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e10107900 0x7f6e1019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:29.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.057+0000 7f6e161dd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6df80a2bb0 0x7f6df80a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:29.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.057+0000 7f6e161dd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e10104fd0 0x7f6e101985b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:29.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.057+0000 7f6e161dd640 1 --2- 172.21.15.60:0/2160760908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e101026a0 0x7f6e10198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:29.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.057+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 >> 172.21.15.60:0/2160760908 conn(0x7f6e100fc2a0 msgr2=0x7f6e10102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:29.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.057+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 shutdown_connections 2024-09-11T23:54:29.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:54:29.057+0000 7f6e161dd640 1 -- 172.21.15.60:0/2160760908 wait complete. 2024-09-11T23:54:29.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:28 smithi105 ceph-mon[34805]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:29.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:29.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:29.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:28 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:28 smithi192 ceph-mon[35487]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:29.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:28 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:28 smithi060 ceph-mon[30953]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:28 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:29.705 DEBUG:teuthology.orchestra.run.smithi060:osd.6> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T23:54:29.708 INFO:tasks.cephadm:Deploying osd.7 on smithi105 with /dev/vg_nvme/lv_2... 2024-09-11T23:54:29.708 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:54:29.960 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:54:30.081 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:30.081 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:30.081 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:29 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:30.222 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:30.222 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:30.222 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:29 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:30.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:29 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:31.173 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:31 smithi060 ceph-mon[30953]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:31.332 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:31 smithi105 ceph-mon[34805]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:31.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:31 smithi192 ceph-mon[35487]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:31.839 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 11 23:54:31 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-11T23:54:31.483+0000 7f1fe306f640 -1 osd.6 0 log_to_monitors true 2024-09-11T23:54:32.300 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:32 smithi060 ceph-mon[30953]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:54:32.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:32 smithi105 ceph-mon[34805]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:54:32.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:32 smithi192 ceph-mon[35487]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-11T23:54:32.584 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:54:32.609 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi105:vg_nvme/lv_2 2024-09-11T23:54:32.859 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:54:33.226 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:33.227 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:33.228 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:33 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.326 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 -- 172.21.15.105:0/1655166431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 msgr2=0x7fb794102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:33.326 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 --2- 172.21.15.105:0/1655166431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 0x7fb794102150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb788009900 tx=0x7fb78802a410 comp rx=0 tx=0).stop 2024-09-11T23:54:33.326 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 -- 172.21.15.105:0/1655166431 shutdown_connections 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 --2- 172.21.15.105:0/1655166431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794102690 0x7fb794108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 --2- 172.21.15.105:0/1655166431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 0x7fb794102150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 --2- 172.21.15.105:0/1655166431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794100ad0 0x7fb794100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 -- 172.21.15.105:0/1655166431 >> 172.21.15.105:0/1655166431 conn(0x7fb7940fc280 msgr2=0x7fb7940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 -- 172.21.15.105:0/1655166431 shutdown_connections 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.312+0000 7fb79a414640 1 -- 172.21.15.105:0/1655166431 wait complete. 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb79a414640 1 Processor -- start 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb79a414640 1 -- start start 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb79a414640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794100ad0 0x7fb794198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb79a414640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 0x7fb794198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb79a414640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794102690 0x7fb79419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:33.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb79a414640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410c8f0 con 0x7fb794100ad0 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb79a414640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410c770 con 0x7fb794101cd0 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb79a414640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb79410ca70 con 0x7fb794102690 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 0x7fb794198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 0x7fb794198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39408/0 (socket says 172.21.15.105:39408) 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb793fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794100ad0 0x7fb794198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7937fe640 1 -- 172.21.15.105:0/199546281 learned_addr learned my addr 172.21.15.105:0/199546281 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7989b1640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794102690 0x7fb79419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7937fe640 1 -- 172.21.15.105:0/199546281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794102690 msgr2=0x7fb79419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7937fe640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794102690 0x7fb79419f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7937fe640 1 -- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794100ad0 msgr2=0x7fb794198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:33.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7937fe640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794100ad0 0x7fb794198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb7937fe640 1 -- 172.21.15.105:0/199546281 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79419fc80 con 0x7fb794101cd0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.313+0000 7fb793fff640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794100ad0 0x7fb794198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.314+0000 7fb7937fe640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 0x7fb794198590 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb788009a20 tx=0x7fb788004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.314+0000 7fb7917fa640 1 -- 172.21.15.105:0/199546281 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78803f030 con 0x7fb794101cd0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.314+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79419ff10 con 0x7fb794101cd0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.314+0000 7fb7917fa640 1 -- 172.21.15.105:0/199546281 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb788003d00 con 0x7fb794101cd0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.314+0000 7fb7917fa640 1 -- 172.21.15.105:0/199546281 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788035070 con 0x7fb794101cd0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.314+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7941a03e0 con 0x7fb794101cd0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.315+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7941a0610 con 0x7fb794101cd0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.316+0000 7fb7917fa640 1 -- 172.21.15.105:0/199546281 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb788042030 con 0x7fb794101cd0 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.317+0000 7fb7917fa640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb77c0a2bb0 0x7fb77c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:33.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.317+0000 7fb7917fa640 1 -- 172.21.15.105:0/199546281 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7fb7880eeb90 con 0x7fb794101cd0 2024-09-11T23:54:33.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.317+0000 7fb793fff640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb77c0a2bb0 0x7fb77c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:33.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.317+0000 7fb793fff640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb77c0a2bb0 0x7fb77c0a5070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb794101b30 tx=0x7fb784005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:33.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.320+0000 7fb7917fa640 1 -- 172.21.15.105:0/199546281 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7880bc2d0 con 0x7fb794101cd0 2024-09-11T23:54:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:54:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:54:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:54:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:33.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:33.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:33.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:33.502+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb79406a770 con 0x7fb77c0a2bb0 2024-09-11T23:54:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T23:54:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T23:54:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:33.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:33 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:33.839 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-11T23:54:33.467+0000 7f1fdeff2640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T23:54:33.839 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 11 23:54:33 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-11T23:54:33.477+0000 7f1fd6e12640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:54:34.138 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi060 2024-09-11T23:54:34.138 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-11T23:54:34.138 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:54:34.138 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:54:34.138 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:34.138 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:34.139 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' 2024-09-11T23:54:34.139 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:34.139 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:34.139 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:34.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi060 2024-09-11T23:54:34.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-11T23:54:34.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:54:34.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:54:34.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:34.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:34.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' 2024-09-11T23:54:34.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:34.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:34.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:34.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi060 2024-09-11T23:54:34.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-11T23:54:34.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: from='osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273]' entity='osd.6' 2024-09-11T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:34.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:35.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:35 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:54:35.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:35 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:54:35.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:35 smithi105 ceph-mon[34805]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:35.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:35 smithi105 ceph-mon[34805]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:35.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:35.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:35 smithi105 ceph-mon[34805]: osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] boot 2024-09-11T23:54:35.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:35 smithi105 ceph-mon[34805]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:54:35.187 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:35 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:54:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:35 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:54:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:35 smithi060 ceph-mon[30953]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:35 smithi060 ceph-mon[30953]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:35 smithi060 ceph-mon[30953]: osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] boot 2024-09-11T23:54:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:35 smithi060 ceph-mon[30953]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:54:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:35 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:35 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:35 smithi192 ceph-mon[35487]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-11T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:35 smithi192 ceph-mon[35487]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:35 smithi192 ceph-mon[35487]: osd.6 [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] boot 2024-09-11T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:35 smithi192 ceph-mon[35487]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T23:54:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:54:36.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:36 smithi105 ceph-mon[34805]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:36.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:36 smithi105 ceph-mon[34805]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:54:36.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:36 smithi105 ceph-mon[34805]: from='client.? 172.21.15.105:0/229216731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]: dispatch 2024-09-11T23:54:36.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:36 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]: dispatch 2024-09-11T23:54:36.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:36 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]': finished 2024-09-11T23:54:36.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:36 smithi105 ceph-mon[34805]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:54:36.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:36 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:36.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:36 smithi105 ceph-mon[34805]: from='client.? 172.21.15.105:0/904335260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:36 smithi192 ceph-mon[35487]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:36 smithi192 ceph-mon[35487]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:54:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:36 smithi192 ceph-mon[35487]: from='client.? 172.21.15.105:0/229216731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]: dispatch 2024-09-11T23:54:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:36 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]: dispatch 2024-09-11T23:54:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:36 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]': finished 2024-09-11T23:54:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:36 smithi192 ceph-mon[35487]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:54:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:36 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:36 smithi192 ceph-mon[35487]: from='client.? 172.21.15.105:0/904335260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:36.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:36 smithi060 ceph-mon[30953]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:36.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:36 smithi060 ceph-mon[30953]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T23:54:36.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:36 smithi060 ceph-mon[30953]: from='client.? 172.21.15.105:0/229216731' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]: dispatch 2024-09-11T23:54:36.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:36 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]: dispatch 2024-09-11T23:54:36.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:36 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "619f7189-29d8-481a-ac46-3196f2ecf4cc"}]': finished 2024-09-11T23:54:36.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:36 smithi060 ceph-mon[30953]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T23:54:36.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:36 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:36.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:36 smithi060 ceph-mon[30953]: from='client.? 172.21.15.105:0/904335260' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:54:38.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:38 smithi105 ceph-mon[34805]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:38 smithi192 ceph-mon[35487]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:38.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:38 smithi060 ceph-mon[30953]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:40 smithi105 ceph-mon[34805]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:40 smithi192 ceph-mon[35487]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:40.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:40 smithi060 ceph-mon[30953]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:42 smithi192 ceph-mon[35487]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:42.841 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:42 smithi060 ceph-mon[30953]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:42.883 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:42 smithi105 ceph-mon[34805]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:44 smithi192 ceph-mon[35487]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:54:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:44 smithi192 ceph-mon[35487]: Deploying daemon osd.7 on smithi105 2024-09-11T23:54:44.787 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:44 smithi105 ceph-mon[34805]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:44.787 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:54:44.787 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:44.787 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:44 smithi105 ceph-mon[34805]: Deploying daemon osd.7 on smithi105 2024-09-11T23:54:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:44 smithi060 ceph-mon[30953]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-11T23:54:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:44 smithi060 ceph-mon[30953]: Deploying daemon osd.7 on smithi105 2024-09-11T23:54:46.663 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:46 smithi105 ceph-mon[34805]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:46.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:46 smithi192 ceph-mon[35487]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:46.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:46 smithi060 ceph-mon[30953]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:48.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:48 smithi192 ceph-mon[35487]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:48.823 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:48 smithi105 ceph-mon[34805]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:48.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:48 smithi060 ceph-mon[30953]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:50.758 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:50 smithi105 ceph-mon[34805]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:50.759 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:50 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:50.759 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:50 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:50.759 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:50 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:50.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:50 smithi192 ceph-mon[35487]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:50.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:50 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:50.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:50 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:50.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:50 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:50.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:50 smithi060 ceph-mon[30953]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:50.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:50 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:50.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:50 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:50.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:50 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:52.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:52 smithi192 ceph-mon[35487]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:52.817 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:52 smithi105 ceph-mon[34805]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:52.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:52 smithi060 ceph-mon[30953]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:53.530 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 7 on host 'smithi105' 2024-09-11T23:54:53.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.531+0000 7fb7917fa640 1 -- 172.21.15.105:0/199546281 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb79406a770 con 0x7fb77c0a2bb0 2024-09-11T23:54:53.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb77c0a2bb0 msgr2=0x7fb77c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:53.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb77c0a2bb0 0x7fb77c0a5070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb794101b30 tx=0x7fb784005f90 comp rx=0 tx=0).stop 2024-09-11T23:54:53.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 msgr2=0x7fb794198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:53.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 0x7fb794198590 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb788009a20 tx=0x7fb788004270 comp rx=0 tx=0).stop 2024-09-11T23:54:53.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 shutdown_connections 2024-09-11T23:54:53.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794102690 0x7fb79419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:53.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb794101cd0 0x7fb794198590 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:53.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb77c0a2bb0 0x7fb77c0a5070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:53.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 --2- 172.21.15.105:0/199546281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb794100ad0 0x7fb794198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:53.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 >> 172.21.15.105:0/199546281 conn(0x7fb7940fc280 msgr2=0x7fb79406a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:53.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 shutdown_connections 2024-09-11T23:54:53.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:54:53.533+0000 7fb79a414640 1 -- 172.21.15.105:0/199546281 wait complete. 2024-09-11T23:54:54.128 DEBUG:teuthology.orchestra.run.smithi105:osd.7> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T23:54:54.131 INFO:tasks.cephadm:Deploying osd.8 on smithi192 with /dev/vg_nvme/lv_2... 2024-09-11T23:54:54.131 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T23:54:54.388 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:54:54.761 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:54 smithi192 ceph-mon[35487]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:54.761 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.761 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.761 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.761 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:54 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:54 smithi060 ceph-mon[30953]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:54.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:54 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.886 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:54 smithi105 ceph-mon[34805]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:54.887 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.887 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.887 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:54.887 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:54 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:56.480 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 11 23:54:56 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-11T23:54:56.150+0000 7f62d293e640 -1 osd.7 0 log_to_monitors true 2024-09-11T23:54:56.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:56 smithi192 ceph-mon[35487]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:56.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:56 smithi192 ceph-mon[35487]: from='osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:56.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:56 smithi192 ceph-mon[35487]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:56.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:56 smithi060 ceph-mon[30953]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:56.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:56 smithi060 ceph-mon[30953]: from='osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:56.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:56 smithi060 ceph-mon[30953]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:56.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:56 smithi105 ceph-mon[34805]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:56.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:56 smithi105 ceph-mon[34805]: from='osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:56.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:56 smithi105 ceph-mon[34805]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-11T23:54:57.037 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:54:57.062 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_2 2024-09-11T23:54:57.306 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.680 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:54:57.681 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:57 smithi192 ceph-mon[35487]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:54:57.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-11T23:54:57.537+0000 7f62ce8c1640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T23:54:57.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-11T23:54:57.547+0000 7f62ca6e9640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:57.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:57.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:54:57.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:57 smithi105 ceph-mon[34805]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:54:57.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 -- 172.21.15.192:0/2000221384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8102e00 msgr2=0x7fbcb8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:57.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 --2- 172.21.15.192:0/2000221384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8102e00 0x7fbcb8103280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009900 tx=0x7fbca802a410 comp rx=0 tx=0).stop 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 -- 172.21.15.192:0/2000221384 shutdown_connections 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 --2- 172.21.15.192:0/2000221384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb81037c0 0x7fbcb810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 --2- 172.21.15.192:0/2000221384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8102e00 0x7fbcb8103280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 --2- 172.21.15.192:0/2000221384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcb8101c00 0x7fbcb8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 -- 172.21.15.192:0/2000221384 >> 172.21.15.192:0/2000221384 conn(0x7fbcb80fd390 msgr2=0x7fbcb80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 -- 172.21.15.192:0/2000221384 shutdown_connections 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.763+0000 7fbcbe169640 1 -- 172.21.15.192:0/2000221384 wait complete. 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcbe169640 1 Processor -- start 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcbe169640 1 -- start start 2024-09-11T23:54:57.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcbe169640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8101c00 0x7fbcb8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcbe169640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb8102e00 0x7fbcb8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcbe169640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcb81037c0 0x7fbcb819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcbe169640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb810d9c0 con 0x7fbcb8102e00 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcbe169640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb810d840 con 0x7fbcb81037c0 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcbe169640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb810db40 con 0x7fbcb8101c00 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8101c00 0x7fbcb8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8101c00 0x7fbcb8197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38636/0 (socket says 172.21.15.192:38636) 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcb77fe640 1 -- 172.21.15.192:0/3260454381 learned_addr learned my addr 172.21.15.192:0/3260454381 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcb6ffd640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb8102e00 0x7fbcb8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.764+0000 7fbcb7fff640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcb81037c0 0x7fbcb819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb77fe640 1 -- 172.21.15.192:0/3260454381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcb81037c0 msgr2=0x7fbcb819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:57.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb77fe640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcb81037c0 0x7fbcb819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:57.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb77fe640 1 -- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb8102e00 msgr2=0x7fbcb8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:54:57.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb77fe640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb8102e00 0x7fbcb8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:54:57.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb77fe640 1 -- 172.21.15.192:0/3260454381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb819fb70 con 0x7fbcb8101c00 2024-09-11T23:54:57.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb77fe640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8101c00 0x7fbcb8197f40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c970 tx=0x7fbca000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:57.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb4ff9640 1 -- 172.21.15.192:0/3260454381 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0007c10 con 0x7fbcb8101c00 2024-09-11T23:54:57.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb4ff9640 1 -- 172.21.15.192:0/3260454381 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbca0007db0 con 0x7fbcb8101c00 2024-09-11T23:54:57.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb819fe60 con 0x7fbcb8101c00 2024-09-11T23:54:57.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcb4ff9640 1 -- 172.21.15.192:0/3260454381 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca000f9b0 con 0x7fbcb8101c00 2024-09-11T23:54:57.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.765+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb81a02b0 con 0x7fbcb8101c00 2024-09-11T23:54:57.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.766+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb8108f30 con 0x7fbcb8101c00 2024-09-11T23:54:57.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.767+0000 7fbcb4ff9640 1 -- 172.21.15.192:0/3260454381 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbca000fb50 con 0x7fbcb8101c00 2024-09-11T23:54:57.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.768+0000 7fbcb4ff9640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbca40a2bb0 0x7fbca40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:54:57.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.768+0000 7fbcb4ff9640 1 -- 172.21.15.192:0/3260454381 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7fbca00ce870 con 0x7fbcb8101c00 2024-09-11T23:54:57.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.768+0000 7fbcb6ffd640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbca40a2bb0 0x7fbca40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:54:57.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.769+0000 7fbcb6ffd640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbca40a2bb0 0x7fbca40a5070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbca8006010 tx=0x7fbca8031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:54:57.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.771+0000 7fbcb4ff9640 1 -- 172.21.15.192:0/3260454381 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbca009c570 con 0x7fbcb8101c00 2024-09-11T23:54:57.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T23:54:57.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T23:54:57.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:54:57.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:57.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:54:57.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:54:57.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:57 smithi060 ceph-mon[30953]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T23:54:57.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:54:57.949+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbcb8062630 con 0x7fbca40a2bb0 2024-09-11T23:54:58.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:58.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi105 2024-09-11T23:54:58.691 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi105 to 5696M 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] boot 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:58.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:58.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:58.693 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi105 2024-09-11T23:54:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi105 to 5696M 2024-09-11T23:54:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] boot 2024-09-11T23:54:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:54:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:58.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-11T23:54:58.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi105 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi105 to 5696M 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: osd.7 [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] boot 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: osdmap e48: 8 total, 8 up, 8 in 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:54:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:54:58.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:54:58.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:54:59.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:59 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:54:59.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:59 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:54:59.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:54:59 smithi192 ceph-mon[35487]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:55:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:59 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:55:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:59 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:55:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:54:59 smithi060 ceph-mon[30953]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:55:00.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:59 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:55:00.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:59 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:55:00.155 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:54:59 smithi105 ceph-mon[34805]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T23:55:01.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:00 smithi060 ceph-mon[30953]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:01.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:00 smithi060 ceph-mon[30953]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:55:01.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:00 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/2823777211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]: dispatch 2024-09-11T23:55:01.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:00 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]: dispatch 2024-09-11T23:55:01.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:00 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]': finished 2024-09-11T23:55:01.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:00 smithi060 ceph-mon[30953]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:55:01.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:00 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:01.117 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:00 smithi105 ceph-mon[34805]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:01.117 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:00 smithi105 ceph-mon[34805]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:55:01.117 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:00 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/2823777211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]: dispatch 2024-09-11T23:55:01.117 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:00 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]: dispatch 2024-09-11T23:55:01.117 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:00 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]': finished 2024-09-11T23:55:01.118 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:00 smithi105 ceph-mon[34805]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:55:01.118 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:00 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:00 smithi192 ceph-mon[35487]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:00 smithi192 ceph-mon[35487]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T23:55:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:00 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/2823777211' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]: dispatch 2024-09-11T23:55:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:00 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]: dispatch 2024-09-11T23:55:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:00 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e3058f6-2733-4939-bc0e-5eb46604ee41"}]': finished 2024-09-11T23:55:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:00 smithi192 ceph-mon[35487]: osdmap e51: 9 total, 8 up, 9 in 2024-09-11T23:55:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:00 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:02.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:01 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/2800690088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:02.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:01 smithi060 ceph-mon[30953]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:55:02.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:01 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:02.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:01 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/2800690088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:02.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:01 smithi105 ceph-mon[34805]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:55:02.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:01 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:02.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:01 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/2800690088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:02.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:01 smithi192 ceph-mon[35487]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T23:55:02.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:01 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:03 smithi192 ceph-mon[35487]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:03.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:03 smithi060 ceph-mon[30953]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:03.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:03 smithi105 ceph-mon[34805]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:05.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:05 smithi192 ceph-mon[35487]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:05.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:05 smithi060 ceph-mon[30953]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:05.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:05 smithi105 ceph-mon[34805]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:07.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:07 smithi192 ceph-mon[35487]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:07.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:07 smithi060 ceph-mon[30953]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:07.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:07 smithi105 ceph-mon[34805]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:08.528 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:55:08.528 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:08 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:08.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:55:08.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:08 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:08.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-11T23:55:08.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:08 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:09 smithi192 ceph-mon[35487]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:09.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:09 smithi192 ceph-mon[35487]: Deploying daemon osd.8 on smithi192 2024-09-11T23:55:09.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:09 smithi060 ceph-mon[30953]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:09.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:09 smithi060 ceph-mon[30953]: Deploying daemon osd.8 on smithi192 2024-09-11T23:55:09.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:09 smithi105 ceph-mon[34805]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:09.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:09 smithi105 ceph-mon[34805]: Deploying daemon osd.8 on smithi192 2024-09-11T23:55:11.465 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:11 smithi192 ceph-mon[35487]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:11 smithi105 ceph-mon[34805]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:11.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:11 smithi060 ceph-mon[30953]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:13.427 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:13 smithi192 ceph-mon[35487]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:13.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:13 smithi060 ceph-mon[30953]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:13.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:13 smithi105 ceph-mon[34805]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:14.563 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:14 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:14.563 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:14 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:14.563 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:14 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:14 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:14 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:14 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:14.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:14 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:14.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:14 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:14.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:14 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:15.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:15 smithi060 ceph-mon[30953]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:15.602 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:15 smithi192 ceph-mon[35487]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:15.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:15 smithi105 ceph-mon[34805]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:17.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:17 smithi192 ceph-mon[35487]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:17.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:17.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:17.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:17 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:17 smithi060 ceph-mon[30953]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:17.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:17.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:17.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:17 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:17 smithi105 ceph-mon[34805]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:17.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:17.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:17.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:17 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:17.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.782+0000 7fbcb4ff9640 1 -- 172.21.15.192:0/3260454381 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbcb8062630 con 0x7fbca40a2bb0 2024-09-11T23:55:17.783 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 8 on host 'smithi192' 2024-09-11T23:55:17.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbca40a2bb0 msgr2=0x7fbca40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:17.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbca40a2bb0 0x7fbca40a5070 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbca8006010 tx=0x7fbca8031640 comp rx=0 tx=0).stop 2024-09-11T23:55:17.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8101c00 msgr2=0x7fbcb8197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8101c00 0x7fbcb8197f40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c970 tx=0x7fbca000ce30 comp rx=0 tx=0).stop 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 shutdown_connections 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcb81037c0 0x7fbcb819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbca40a2bb0 0x7fbca40a5070 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcb8102e00 0x7fbcb8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 --2- 172.21.15.192:0/3260454381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbcb8101c00 0x7fbcb8197f40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 >> 172.21.15.192:0/3260454381 conn(0x7fbcb80fd390 msgr2=0x7fbcb8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 shutdown_connections 2024-09-11T23:55:17.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:55:17.784+0000 7fbcbe169640 1 -- 172.21.15.192:0/3260454381 wait complete. 2024-09-11T23:55:18.379 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:18.379 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:18.379 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:18.406 DEBUG:teuthology.orchestra.run.smithi192:osd.8> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T23:55:18.408 INFO:tasks.cephadm:Deploying osd.9 on smithi060 with /dev/vg_nvme/lv_1... 2024-09-11T23:55:18.408 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:55:18.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:18.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:18.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:55:18.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:18.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:18.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:19.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:19 smithi060 ceph-mon[30953]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:19.644 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:19 smithi192 ceph-mon[35487]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:19.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:19 smithi105 ceph-mon[34805]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:20.284 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 11 23:55:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-11T23:55:20.031+0000 7fbb39dfe640 -1 osd.8 0 log_to_monitors true 2024-09-11T23:55:20.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:20 smithi060 ceph-mon[30953]: from='osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:55:20.538 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:20 smithi060 ceph-mon[30953]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:55:20.558 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:20 smithi192 ceph-mon[35487]: from='osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:55:20.558 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:20 smithi192 ceph-mon[35487]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:55:20.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:20 smithi105 ceph-mon[34805]: from='osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:55:20.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:20 smithi105 ceph-mon[34805]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-11T23:55:21.461 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:21 smithi192 ceph-mon[35487]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:21.461 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:21 smithi192 ceph-mon[35487]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:55:21.461 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:21 smithi192 ceph-mon[35487]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:55:21.461 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:21.462 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:21 smithi192 ceph-mon[35487]: from='osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:55:21.462 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:21 smithi192 ceph-mon[35487]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:55:21.462 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 11 23:55:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-11T23:55:21.312+0000 7fbb35d81640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T23:55:21.462 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 11 23:55:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-11T23:55:21.320+0000 7fbb31ba9640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:55:21.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:21 smithi060 ceph-mon[30953]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:21.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:21 smithi060 ceph-mon[30953]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:55:21.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:21 smithi060 ceph-mon[30953]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:55:21.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:21.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:21 smithi060 ceph-mon[30953]: from='osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:55:21.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:21 smithi060 ceph-mon[30953]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:55:21.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:21 smithi105 ceph-mon[34805]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:21.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:21 smithi105 ceph-mon[34805]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T23:55:21.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:21 smithi105 ceph-mon[34805]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T23:55:21.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:21.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:21 smithi105 ceph-mon[34805]: from='osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:55:21.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:21 smithi105 ceph-mon[34805]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:55:21.747 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:55:21.773 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_1 2024-09-11T23:55:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.540 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.541 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:22.541 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:22.541 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:22 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 -- 172.21.15.60:0/3866198737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8102690 msgr2=0x7f82e8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:22.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 --2- 172.21.15.60:0/3866198737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8102690 0x7f82e8108f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009ca0 tx=0x7f82e002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:55:22.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 -- 172.21.15.60:0/3866198737 shutdown_connections 2024-09-11T23:55:22.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 --2- 172.21.15.60:0/3866198737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8102690 0x7f82e8108f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:22.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 --2- 172.21.15.60:0/3866198737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82e8101cd0 0x7f82e8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:22.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 --2- 172.21.15.60:0/3866198737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8100ad0 0x7f82e8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 -- 172.21.15.60:0/3866198737 >> 172.21.15.60:0/3866198737 conn(0x7f82e80fc280 msgr2=0x7f82e80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 -- 172.21.15.60:0/3866198737 shutdown_connections 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.552+0000 7f82eca67640 1 -- 172.21.15.60:0/3866198737 wait complete. 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82eca67640 1 Processor -- start 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82eca67640 1 -- start start 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82eca67640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8100ad0 0x7f82e8197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82eca67640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101cd0 0x7f82e81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82eca67640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82e8102690 0x7f82e819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82eca67640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82e810c890 con 0x7f82e8101cd0 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82eca67640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82e810c710 con 0x7f82e8100ad0 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82eca67640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f82e810ca10 con 0x7f82e8102690 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101cd0 0x7f82e81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:22.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101cd0 0x7f82e81984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:58986/0 (socket says 172.21.15.60:58986) 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82dffff640 1 -- 172.21.15.60:0/1685478979 learned_addr learned my addr 172.21.15.60:0/1685478979 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.553+0000 7f82e6d9d640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82e8102690 0x7f82e819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82e659c640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8100ad0 0x7f82e8197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82dffff640 1 -- 172.21.15.60:0/1685478979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82e8102690 msgr2=0x7f82e819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82dffff640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82e8102690 0x7f82e819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82dffff640 1 -- 172.21.15.60:0/1685478979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8100ad0 msgr2=0x7f82e8197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82dffff640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8100ad0 0x7f82e8197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82dffff640 1 -- 172.21.15.60:0/1685478979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e819fba0 con 0x7f82e8101cd0 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82e6d9d640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82e8102690 0x7f82e819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82dffff640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101cd0 0x7f82e81984b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82d000d770 tx=0x7f82d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82df7fe640 1 -- 172.21.15.60:0/1685478979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0017070 con 0x7f82e8101cd0 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e819fe90 con 0x7f82e8101cd0 2024-09-11T23:55:22.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82df7fe640 1 -- 172.21.15.60:0/1685478979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f82d0005520 con 0x7f82e8101cd0 2024-09-11T23:55:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82df7fe640 1 -- 172.21.15.60:0/1685478979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0010460 con 0x7f82e8101cd0 2024-09-11T23:55:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.554+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e81a0340 con 0x7f82e8101cd0 2024-09-11T23:55:22.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.555+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e81a0570 con 0x7f82e8101cd0 2024-09-11T23:55:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.556+0000 7f82df7fe640 1 -- 172.21.15.60:0/1685478979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f82d0004ea0 con 0x7f82e8101cd0 2024-09-11T23:55:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.557+0000 7f82df7fe640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f82d40a2bb0 0x7f82d40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.557+0000 7f82e659c640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f82d40a2bb0 0x7f82d40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.557+0000 7f82df7fe640 1 -- 172.21.15.60:0/1685478979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5862+0+0 (secure 0 0 0) 0x7f82d00ce210 con 0x7f82e8101cd0 2024-09-11T23:55:22.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.558+0000 7f82e659c640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f82d40a2bb0 0x7f82d40a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82e8101b30 tx=0x7f82d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:55:22.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.562+0000 7f82df7fe640 1 -- 172.21.15.60:0/1685478979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82d009bb00 con 0x7f82e8101cd0 2024-09-11T23:55:22.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:22.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:22 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:22.747+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f82e80fe430 con 0x7f82d40a2bb0 2024-09-11T23:55:22.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:55:22.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T23:55:22.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:22.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:22.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:22.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:22.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:22.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:22.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:22 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:23.452 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:55:23.452 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:55:23.452 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:23.452 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi192 2024-09-11T23:55:23.452 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-11T23:55:23.452 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:23.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] boot 2024-09-11T23:55:23.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:55:23.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:23.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:23.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:23.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:23.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:23.453 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:23 smithi060 ceph-mon[30953]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:55:23.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:55:23.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:55:23.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:23.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi192 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] boot 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:23.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:23 smithi105 ceph-mon[34805]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:55:23.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:55:23.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:55:23.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 248 MiB used, 715 GiB / 715 GiB avail 2024-09-11T23:55:23.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi192 2024-09-11T23:55:23.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-11T23:55:23.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:23.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: osd.8 [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] boot 2024-09-11T23:55:23.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T23:55:23.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:55:23.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:23.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:23.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:23.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:23.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:23 smithi192 ceph-mon[35487]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T23:55:25.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:24 smithi060 ceph-mon[30953]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:25.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:24 smithi060 ceph-mon[30953]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:55:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:24 smithi105 ceph-mon[34805]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:24 smithi105 ceph-mon[34805]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:55:25.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:24 smithi192 ceph-mon[35487]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:25.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:24 smithi192 ceph-mon[35487]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T23:55:26.040 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:25 smithi060 ceph-mon[30953]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:55:26.041 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:25 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1310723571' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0037e8d4-e270-4ac3-a8f0-24e19d972822"}]: dispatch 2024-09-11T23:55:26.041 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:25 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1310723571' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0037e8d4-e270-4ac3-a8f0-24e19d972822"}]': finished 2024-09-11T23:55:26.041 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:25 smithi060 ceph-mon[30953]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:55:26.041 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:25 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:26.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:25 smithi105 ceph-mon[34805]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:55:26.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:25 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1310723571' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0037e8d4-e270-4ac3-a8f0-24e19d972822"}]: dispatch 2024-09-11T23:55:26.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:25 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1310723571' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0037e8d4-e270-4ac3-a8f0-24e19d972822"}]': finished 2024-09-11T23:55:26.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:25 smithi105 ceph-mon[34805]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:55:26.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:25 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:26.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:25 smithi192 ceph-mon[35487]: osdmap e58: 9 total, 9 up, 9 in 2024-09-11T23:55:26.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:25 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1310723571' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0037e8d4-e270-4ac3-a8f0-24e19d972822"}]: dispatch 2024-09-11T23:55:26.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:25 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1310723571' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0037e8d4-e270-4ac3-a8f0-24e19d972822"}]': finished 2024-09-11T23:55:26.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:25 smithi192 ceph-mon[35487]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T23:55:26.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:25 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:27.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:26 smithi060 ceph-mon[30953]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:27.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:26 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2206401157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:27.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:26 smithi105 ceph-mon[34805]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:27.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:26 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2206401157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:27.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:26 smithi192 ceph-mon[35487]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:27.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:26 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2206401157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:29.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:28 smithi060 ceph-mon[30953]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:29.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:28 smithi105 ceph-mon[34805]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:28 smithi192 ceph-mon[35487]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:31.075 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:30 smithi192 ceph-mon[35487]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:55:31.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:30 smithi060 ceph-mon[30953]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:55:31.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:30 smithi105 ceph-mon[34805]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T23:55:32.978 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:32 smithi060 ceph-mon[30953]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-11T23:55:33.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:32 smithi105 ceph-mon[34805]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-11T23:55:33.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:32 smithi192 ceph-mon[35487]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-11T23:55:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:34 smithi060 ceph-mon[30953]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T23:55:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:55:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:34 smithi060 ceph-mon[30953]: Deploying daemon osd.9 on smithi060 2024-09-11T23:55:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:34 smithi105 ceph-mon[34805]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T23:55:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:55:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:34 smithi105 ceph-mon[34805]: Deploying daemon osd.9 on smithi060 2024-09-11T23:55:35.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:34 smithi192 ceph-mon[35487]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-11T23:55:35.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-11T23:55:35.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:35.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:34 smithi192 ceph-mon[35487]: Deploying daemon osd.9 on smithi060 2024-09-11T23:55:37.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:36 smithi060 ceph-mon[30953]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:55:37.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:36 smithi105 ceph-mon[34805]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:55:37.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:36 smithi192 ceph-mon[35487]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T23:55:39.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:38 smithi060 ceph-mon[30953]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:39.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:38 smithi105 ceph-mon[34805]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:39.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:38 smithi192 ceph-mon[35487]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:41.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:40 smithi060 ceph-mon[30953]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:41.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:41.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:41.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:41.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:40 smithi105 ceph-mon[34805]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:41.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:41.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:41.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:41.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:40 smithi192 ceph-mon[35487]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:55:41.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:41.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:41.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:43.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:42 smithi060 ceph-mon[30953]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:43.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:42 smithi105 ceph-mon[34805]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:43.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:42 smithi192 ceph-mon[35487]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:43.665 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 9 on host 'smithi060' 2024-09-11T23:55:43.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.665+0000 7f82df7fe640 1 -- 172.21.15.60:0/1685478979 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f82e80fe430 con 0x7f82d40a2bb0 2024-09-11T23:55:43.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f82d40a2bb0 msgr2=0x7f82d40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:43.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f82d40a2bb0 0x7f82d40a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82e8101b30 tx=0x7f82d8005f90 comp rx=0 tx=0).stop 2024-09-11T23:55:43.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101cd0 msgr2=0x7f82e81984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:43.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101cd0 0x7f82e81984b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82d000d770 tx=0x7f82d000dc30 comp rx=0 tx=0).stop 2024-09-11T23:55:43.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 shutdown_connections 2024-09-11T23:55:43.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82e8102690 0x7f82e819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:43.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f82d40a2bb0 0x7f82d40a5070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:43.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82e8101cd0 0x7f82e81984b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:43.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 --2- 172.21.15.60:0/1685478979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8100ad0 0x7f82e8197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:43.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 >> 172.21.15.60:0/1685478979 conn(0x7f82e80fc280 msgr2=0x7f82e80fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:55:43.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 shutdown_connections 2024-09-11T23:55:43.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:55:43.667+0000 7f82eca67640 1 -- 172.21.15.60:0/1685478979 wait complete. 2024-09-11T23:55:44.429 DEBUG:teuthology.orchestra.run.smithi060:osd.9> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T23:55:44.432 INFO:tasks.cephadm:Deploying osd.10 on smithi105 with /dev/vg_nvme/lv_1... 2024-09-11T23:55:44.432 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:55:44.686 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:55:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:44 smithi105 ceph-mon[34805]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:44.950 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:44 smithi060 ceph-mon[30953]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:44.950 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:44.950 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:44.950 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:44.951 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:45.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:44 smithi192 ceph-mon[35487]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:45.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:45.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:45.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:45.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:46.339 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 11 23:55:46 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-11T23:55:46.198+0000 7f09fb7ea640 -1 osd.9 0 log_to_monitors true 2024-09-11T23:55:46.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:46 smithi105 ceph-mon[34805]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:46.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:46 smithi105 ceph-mon[34805]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:55:47.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:46 smithi192 ceph-mon[35487]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:47.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:46 smithi192 ceph-mon[35487]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:55:47.057 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:46 smithi060 ceph-mon[30953]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:47.058 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:46 smithi060 ceph-mon[30953]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-11T23:55:47.275 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-11T23:55:47.302 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi105:vg_nvme/lv_1 2024-09-11T23:55:47.555 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T23:55:47.831 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:47 smithi105 ceph-mon[34805]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:55:47.831 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:47 smithi105 ceph-mon[34805]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:55:47.831 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:47 smithi105 ceph-mon[34805]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:55:47.831 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:47 smithi192 ceph-mon[35487]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:55:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:47 smithi192 ceph-mon[35487]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:55:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:47 smithi192 ceph-mon[35487]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:55:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:48.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 -- 172.21.15.105:0/2018574936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88301078c0 msgr2=0x7f8830109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:48.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 --2- 172.21.15.105:0/2018574936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88301078c0 0x7f8830109d10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8828009ca0 tx=0x7f882802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 -- 172.21.15.105:0/2018574936 shutdown_connections 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 --2- 172.21.15.105:0/2018574936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88301078c0 0x7f8830109d10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 --2- 172.21.15.105:0/2018574936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8830104f90 0x7f8830107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 --2- 172.21.15.105:0/2018574936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8830102660 0x7f8830104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 -- 172.21.15.105:0/2018574936 >> 172.21.15.105:0/2018574936 conn(0x7f88300fc280 msgr2=0x7f88300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 -- 172.21.15.105:0/2018574936 shutdown_connections 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.046+0000 7f883797d640 1 -- 172.21.15.105:0/2018574936 wait complete. 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.047+0000 7f883797d640 1 Processor -- start 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.047+0000 7f883797d640 1 -- start start 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.047+0000 7f883797d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8830102660 0x7f8830197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:48.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.047+0000 7f883797d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8830104f90 0x7f88301984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.047+0000 7f883797d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88301078c0 0x7f883019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.047+0000 7f883797d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f883010d990 con 0x7f8830102660 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.047+0000 7f883797d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f883010d810 con 0x7f88301078c0 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.047+0000 7f883797d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f883010db10 con 0x7f8830104f90 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8830102660 0x7f8830197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835f1a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88301078c0 0x7f883019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8830102660 0x7f8830197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.105:41274/0 (socket says 172.21.15.105:41274) 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 -- 172.21.15.105:0/2818838726 learned_addr learned my addr 172.21.15.105:0/2818838726 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8834f18640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8830104f90 0x7f88301984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:48.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 -- 172.21.15.105:0/2818838726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8830104f90 msgr2=0x7f88301984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8830104f90 0x7f88301984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 -- 172.21.15.105:0/2818838726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88301078c0 msgr2=0x7f883019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88301078c0 0x7f883019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 -- 172.21.15.105:0/2818838726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883019fb90 con 0x7f8830102660 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f8835719640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8830102660 0x7f8830197f60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f882c00e9f0 tx=0x7f882c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f88267fc640 1 -- 172.21.15.105:0/2818838726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c00cd80 con 0x7f8830102660 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88301004b0 con 0x7f8830102660 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f88267fc640 1 -- 172.21.15.105:0/2818838726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f882c010930 con 0x7f8830102660 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f88267fc640 1 -- 172.21.15.105:0/2818838726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c018b00 con 0x7f8830102660 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.048+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8830100a40 con 0x7f8830102660 2024-09-11T23:55:48.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.049+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88300fdd70 con 0x7f8830102660 2024-09-11T23:55:48.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.050+0000 7f88267fc640 1 -- 172.21.15.105:0/2818838726 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f882c018ca0 con 0x7f8830102660 2024-09-11T23:55:48.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.051+0000 7f88267fc640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f881c0a2c30 0x7f881c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:55:48.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.051+0000 7f88267fc640 1 -- 172.21.15.105:0/2818838726 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f882c0cef20 con 0x7f8830102660 2024-09-11T23:55:48.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.051+0000 7f8834f18640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f881c0a2c30 0x7f881c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:55:48.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.052+0000 7f8834f18640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f881c0a2c30 0x7f881c0a50f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8830199480 tx=0x7f882000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:55:48.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.055+0000 7f88267fc640 1 -- 172.21.15.105:0/2818838726 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f882c09c0b0 con 0x7f8830102660 2024-09-11T23:55:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:47 smithi060 ceph-mon[30953]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T23:55:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:47 smithi060 ceph-mon[30953]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T23:55:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:47 smithi060 ceph-mon[30953]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-09-11T23:55:48.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:48.089 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 11 23:55:47 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-11T23:55:47.678+0000 7f09f776d640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T23:55:48.089 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 11 23:55:47 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-11T23:55:47.691+0000 7f09f3595640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:55:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:55:48.237+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8830101e30 con 0x7f881c0a2c30 2024-09-11T23:55:48.814 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:48.814 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi060 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:48.815 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:48.816 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:48 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:49.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:49.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:55:49.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:55:49.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:49.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:49.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi060 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:49.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:49.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:49.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:49.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:49.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:49.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:48 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:49.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:49.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: osdmap e61: 10 total, 9 up, 10 in 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi060 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:55:49.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi105:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:55:49.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:55:49.092 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:48 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:49.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:49 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:55:49.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:49 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:55:49.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:49.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:49 smithi105 ceph-mon[34805]: osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] boot 2024-09-11T23:55:49.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:49 smithi105 ceph-mon[34805]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:55:49.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:49 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:55:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:49 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:55:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:49 smithi192 ceph-mon[35487]: osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] boot 2024-09-11T23:55:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:49 smithi192 ceph-mon[35487]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:55:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:50.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:49 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:55:50.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:49 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:55:50.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:50.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:49 smithi060 ceph-mon[30953]: osd.9 [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] boot 2024-09-11T23:55:50.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:49 smithi060 ceph-mon[30953]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T23:55:50.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:55:50.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:50 smithi105 ceph-mon[34805]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:50.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:50 smithi105 ceph-mon[34805]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:55:50.949 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:50 smithi192 ceph-mon[35487]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:50.949 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:50 smithi192 ceph-mon[35487]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:55:51.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:50 smithi060 ceph-mon[30953]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-09-11T23:55:51.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:50 smithi060 ceph-mon[30953]: osdmap e63: 10 total, 10 up, 10 in 2024-09-11T23:55:51.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:51 smithi105 ceph-mon[34805]: from='client.? 172.21.15.105:0/1396838609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]: dispatch 2024-09-11T23:55:51.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:51 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]: dispatch 2024-09-11T23:55:51.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:51 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]': finished 2024-09-11T23:55:51.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:51 smithi105 ceph-mon[34805]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:55:51.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:51 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:51.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:51 smithi105 ceph-mon[34805]: from='client.? 172.21.15.105:0/3960457071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:52.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:51 smithi192 ceph-mon[35487]: from='client.? 172.21.15.105:0/1396838609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]: dispatch 2024-09-11T23:55:52.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:51 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]: dispatch 2024-09-11T23:55:52.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:51 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]': finished 2024-09-11T23:55:52.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:51 smithi192 ceph-mon[35487]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:55:52.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:51 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:52.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:51 smithi192 ceph-mon[35487]: from='client.? 172.21.15.105:0/3960457071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:52.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:51 smithi060 ceph-mon[30953]: from='client.? 172.21.15.105:0/1396838609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]: dispatch 2024-09-11T23:55:52.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:51 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]: dispatch 2024-09-11T23:55:52.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:51 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d94bbac-c12a-441d-b9b7-512ad1320413"}]': finished 2024-09-11T23:55:52.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:51 smithi060 ceph-mon[30953]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T23:55:52.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:51 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:55:52.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:51 smithi060 ceph-mon[30953]: from='client.? 172.21.15.105:0/3960457071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:55:53.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:52 smithi060 ceph-mon[30953]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:53.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:52 smithi105 ceph-mon[34805]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:53.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:52 smithi192 ceph-mon[35487]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:55.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:54 smithi060 ceph-mon[30953]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:54 smithi105 ceph-mon[34805]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:54 smithi192 ceph-mon[35487]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:56 smithi060 ceph-mon[30953]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:57.097 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:56 smithi105 ceph-mon[34805]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:57.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:56 smithi192 ceph-mon[35487]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:59.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:58 smithi060 ceph-mon[30953]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:59.121 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:58 smithi105 ceph-mon[34805]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:58 smithi192 ceph-mon[35487]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:55:59.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:59 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:55:59.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:59 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:55:59.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:55:59 smithi105 ceph-mon[34805]: Deploying daemon osd.10 on smithi105 2024-09-11T23:56:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:59 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:56:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:59 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:55:59 smithi060 ceph-mon[30953]: Deploying daemon osd.10 on smithi105 2024-09-11T23:56:00.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:59 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-11T23:56:00.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:59 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:00.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:55:59 smithi192 ceph-mon[35487]: Deploying daemon osd.10 on smithi105 2024-09-11T23:56:01.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:00 smithi060 ceph-mon[30953]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:01.126 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:00 smithi105 ceph-mon[34805]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:00 smithi192 ceph-mon[35487]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:03.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:02 smithi060 ceph-mon[30953]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:03.131 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:02 smithi105 ceph-mon[34805]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:03.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:02 smithi192 ceph-mon[35487]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:04.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:04 smithi105 ceph-mon[34805]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:04 smithi060 ceph-mon[30953]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:05.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:04 smithi192 ceph-mon[35487]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:05.960 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:05 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:05.960 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:05 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:05.960 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:05 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:06.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:05 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:06.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:05 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:06.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:05 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:06.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:05 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:06.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:05 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:06.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:05 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:07.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:07 smithi192 ceph-mon[35487]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:07.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:07 smithi060 ceph-mon[30953]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:07.641 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:07 smithi105 ceph-mon[34805]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:08.627 INFO:teuthology.orchestra.run.smithi105.stdout:Created osd(s) 10 on host 'smithi105' 2024-09-11T23:56:08.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.627+0000 7f88267fc640 1 -- 172.21.15.105:0/2818838726 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f8830101e30 con 0x7f881c0a2c30 2024-09-11T23:56:08.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f881c0a2c30 msgr2=0x7f881c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:08.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f881c0a2c30 0x7f881c0a50f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8830199480 tx=0x7f882000b410 comp rx=0 tx=0).stop 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8830102660 msgr2=0x7f8830197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8830102660 0x7f8830197f60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f882c00e9f0 tx=0x7f882c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 shutdown_connections 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88301078c0 0x7f883019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8830104f90 0x7f88301984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f881c0a2c30 0x7f881c0a50f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 --2- 172.21.15.105:0/2818838726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8830102660 0x7f8830197f60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 >> 172.21.15.105:0/2818838726 conn(0x7f88300fc280 msgr2=0x7f8830102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 shutdown_connections 2024-09-11T23:56:08.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-11T23:56:08.630+0000 7f883797d640 1 -- 172.21.15.105:0/2818838726 wait complete. 2024-09-11T23:56:09.244 DEBUG:teuthology.orchestra.run.smithi105:osd.10> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T23:56:09.246 INFO:tasks.cephadm:Deploying osd.11 on smithi192 with /dev/vg_nvme/lv_1... 2024-09-11T23:56:09.246 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T23:56:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:09 smithi105 ceph-mon[34805]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:09 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:09 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:09.503 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:56:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:09 smithi192 ceph-mon[35487]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:09 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:09 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:09.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:09 smithi060 ceph-mon[30953]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:09.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:09 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:09.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:09 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:10.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:10 smithi105 ceph-mon[34805]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:10.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:10.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:10.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:10 smithi192 ceph-mon[35487]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:10.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:10.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:10.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:10 smithi060 ceph-mon[30953]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:10.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:10.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:11.196 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 11 23:56:11 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-11T23:56:11.001+0000 7fb412fda640 -1 osd.10 0 log_to_monitors true 2024-09-11T23:56:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:11 smithi105 ceph-mon[34805]: from='osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:56:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:11 smithi105 ceph-mon[34805]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:56:11.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:11 smithi192 ceph-mon[35487]: from='osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:56:11.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:11 smithi192 ceph-mon[35487]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:56:11.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:11 smithi060 ceph-mon[30953]: from='osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:56:11.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:11 smithi060 ceph-mon[30953]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-11T23:56:12.362 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-11T23:56:12.388 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_1 2024-09-11T23:56:12.581 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 11 23:56:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-11T23:56:12.451+0000 7fb40ef5d640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T23:56:12.581 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 11 23:56:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-11T23:56:12.461+0000 7fb40ad85640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:56:12.581 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:12 smithi105 ceph-mon[34805]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:12.582 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:12 smithi105 ceph-mon[34805]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:56:12.582 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:12 smithi105 ceph-mon[34805]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:56:12.582 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:12 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:12.582 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:12 smithi105 ceph-mon[34805]: from='osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:56:12.582 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:12 smithi105 ceph-mon[34805]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:56:12.643 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:56:12.764 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:12 smithi192 ceph-mon[35487]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:12.764 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:12 smithi192 ceph-mon[35487]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:56:12.764 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:12 smithi192 ceph-mon[35487]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:56:12.764 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:12 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:12.764 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:12 smithi192 ceph-mon[35487]: from='osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:56:12.765 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:12 smithi192 ceph-mon[35487]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:56:12.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:12 smithi060 ceph-mon[30953]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:12.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:12 smithi060 ceph-mon[30953]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T23:56:12.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:12 smithi060 ceph-mon[30953]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T23:56:12.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:12 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:12.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:12 smithi060 ceph-mon[30953]: from='osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:56:12.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:12 smithi060 ceph-mon[30953]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]: dispatch 2024-09-11T23:56:13.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 -- 172.21.15.192:0/749884615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8100b00 msgr2=0x7f9ac8100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:13.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 --2- 172.21.15.192:0/749884615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8100b00 0x7f9ac8100f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009900 tx=0x7f9ab802a410 comp rx=0 tx=0).stop 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 -- 172.21.15.192:0/749884615 shutdown_connections 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 --2- 172.21.15.192:0/749884615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac81026c0 0x7f9ac8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 --2- 172.21.15.192:0/749884615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac8101d00 0x7f9ac8102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 --2- 172.21.15.192:0/749884615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8100b00 0x7f9ac8100f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 -- 172.21.15.192:0/749884615 >> 172.21.15.192:0/749884615 conn(0x7f9ac80fc290 msgr2=0x7f9ac80fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 -- 172.21.15.192:0/749884615 shutdown_connections 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 -- 172.21.15.192:0/749884615 wait complete. 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 Processor -- start 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.130+0000 7f9ad079c640 1 -- start start 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9ad079c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac8100b00 0x7f9ac8198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:13.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9ad079c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8101d00 0x7f9ac81985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9ad079c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac81026c0 0x7f9ac819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9ad079c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac810c920 con 0x7f9ac81026c0 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9ad079c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac810c7a0 con 0x7f9ac8100b00 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9ad079c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac810caa0 con 0x7f9ac8101d00 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8101d00 0x7f9ac81985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8101d00 0x7f9ac81985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50488/0 (socket says 172.21.15.192:50488) 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 -- 172.21.15.192:0/1701008085 learned_addr learned my addr 172.21.15.192:0/1701008085 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9aced39640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac81026c0 0x7f9ac819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 -- 172.21.15.192:0/1701008085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac8100b00 msgr2=0x7f9ac8198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac8100b00 0x7f9ac8198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 -- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac81026c0 msgr2=0x7f9ac819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:13.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac81026c0 0x7f9ac819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 -- 172.21.15.192:0/1701008085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac819fcc0 con 0x7f9ac8101d00 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9aced39640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac81026c0 0x7f9ac819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9acdd37640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8101d00 0x7f9ac81985d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400d950 tx=0x7f9ac400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9abf7fe640 1 -- 172.21.15.192:0/1701008085 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4017070 con 0x7f9ac8101d00 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9abf7fe640 1 -- 172.21.15.192:0/1701008085 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ac4009c30 con 0x7f9ac8101d00 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac819ffb0 con 0x7f9ac8101d00 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9abf7fe640 1 -- 172.21.15.192:0/1701008085 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400f740 con 0x7f9ac8101d00 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.131+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac81a0530 con 0x7f9ac8101d00 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.132+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac81a0760 con 0x7f9ac8101d00 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.134+0000 7f9abf7fe640 1 -- 172.21.15.192:0/1701008085 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9ac4010a80 con 0x7f9ac8101d00 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.134+0000 7f9abf7fe640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9ab40a2c30 0x7f9ab40a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:13.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.134+0000 7f9abf7fe640 1 -- 172.21.15.192:0/1701008085 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6727+0+0 (secure 0 0 0) 0x7f9ac40ce610 con 0x7f9ac8101d00 2024-09-11T23:56:13.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.135+0000 7f9ace538640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9ab40a2c30 0x7f9ab40a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:13.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.135+0000 7f9ace538640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9ab40a2c30 0x7f9ab40a50f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8005c20 tx=0x7f9ab8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:13.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.138+0000 7f9abf7fe640 1 -- 172.21.15.192:0/1701008085 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ac409bc20 con 0x7f9ac8101d00 2024-09-11T23:56:13.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:13.312+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9ac806aed0 con 0x7f9ab40a2c30 2024-09-11T23:56:13.723 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:56:13.723 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:56:13.723 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.723 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.723 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi105 2024-09-11T23:56:13.724 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.724 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.724 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.724 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.724 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.724 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.724 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi105 to 4272M 2024-09-11T23:56:13.724 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] boot 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:13.725 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:56:13.726 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:56:13.726 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi105 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi105 to 4272M 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] boot 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:13.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:56:13.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:56:13.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:13.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi105", "root=default"]}]': finished 2024-09-11T23:56:13.740 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: osdmap e66: 11 total, 10 up, 11 in 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi105 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi105 to 4272M 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.741 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: osd.10 [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] boot 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-11T23:56:13.742 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:15.025 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:14 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:56:15.025 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:14 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:56:15.025 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:14 smithi060 ceph-mon[30953]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:15.025 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:14 smithi060 ceph-mon[30953]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:56:15.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:14 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:56:15.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:14 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:56:15.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:14 smithi192 ceph-mon[35487]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:15.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:14 smithi192 ceph-mon[35487]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:56:15.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:14 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:56:15.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:14 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:56:15.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:14 smithi105 ceph-mon[34805]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-11T23:56:15.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:14 smithi105 ceph-mon[34805]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T23:56:16.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:15 smithi060 ceph-mon[30953]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:56:16.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:15 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/3096019294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]: dispatch 2024-09-11T23:56:16.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:15 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]: dispatch 2024-09-11T23:56:16.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:15 smithi060 ceph-mon[30953]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]': finished 2024-09-11T23:56:16.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:15 smithi060 ceph-mon[30953]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:56:16.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:15 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:16.115 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:15 smithi192 ceph-mon[35487]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:56:16.115 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:15 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/3096019294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]: dispatch 2024-09-11T23:56:16.115 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:15 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]: dispatch 2024-09-11T23:56:16.115 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:15 smithi192 ceph-mon[35487]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]': finished 2024-09-11T23:56:16.115 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:15 smithi192 ceph-mon[35487]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:56:16.115 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:15 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:16.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:15 smithi105 ceph-mon[34805]: osdmap e69: 11 total, 11 up, 11 in 2024-09-11T23:56:16.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:15 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/3096019294' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]: dispatch 2024-09-11T23:56:16.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:15 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]: dispatch 2024-09-11T23:56:16.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:15 smithi105 ceph-mon[34805]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5b7201d-7b7c-4897-a701-1ef840aa17dc"}]': finished 2024-09-11T23:56:16.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:15 smithi105 ceph-mon[34805]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T23:56:16.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:15 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:17.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:16 smithi060 ceph-mon[30953]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:17.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:16 smithi060 ceph-mon[30953]: from='client.? 172.21.15.192:0/1028214789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:56:17.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:16 smithi060 ceph-mon[30953]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:56:17.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:16 smithi105 ceph-mon[34805]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:16 smithi105 ceph-mon[34805]: from='client.? 172.21.15.192:0/1028214789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:56:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:16 smithi105 ceph-mon[34805]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:56:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:16 smithi192 ceph-mon[35487]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:16 smithi192 ceph-mon[35487]: from='client.? 172.21.15.192:0/1028214789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-11T23:56:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:16 smithi192 ceph-mon[35487]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T23:56:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:19.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:18 smithi060 ceph-mon[30953]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:19.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:18 smithi105 ceph-mon[34805]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:19.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:18 smithi192 ceph-mon[35487]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:21.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:20 smithi105 ceph-mon[34805]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-11T23:56:21.246 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:20 smithi192 ceph-mon[35487]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-11T23:56:21.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:20 smithi060 ceph-mon[30953]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-09-11T23:56:23.123 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:22 smithi192 ceph-mon[35487]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T23:56:23.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:22 smithi105 ceph-mon[34805]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T23:56:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:22 smithi060 ceph-mon[30953]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-11T23:56:25.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:24 smithi192 ceph-mon[35487]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:56:25.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:56:25.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:24 smithi105 ceph-mon[34805]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:56:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:56:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:25.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:24 smithi060 ceph-mon[30953]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T23:56:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-11T23:56:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:26.103 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:25 smithi060 ceph-mon[30953]: Deploying daemon osd.11 on smithi192 2024-09-11T23:56:26.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:25 smithi105 ceph-mon[34805]: Deploying daemon osd.11 on smithi192 2024-09-11T23:56:26.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:25 smithi192 ceph-mon[35487]: Deploying daemon osd.11 on smithi192 2024-09-11T23:56:27.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:26 smithi105 ceph-mon[34805]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-11T23:56:27.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:26 smithi192 ceph-mon[35487]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-11T23:56:27.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:26 smithi060 ceph-mon[30953]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-11T23:56:29.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:28 smithi105 ceph-mon[34805]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:56:29.279 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:28 smithi192 ceph-mon[35487]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:56:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:28 smithi060 ceph-mon[30953]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-11T23:56:31.178 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:30 smithi192 ceph-mon[35487]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:56:31.178 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:31.178 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:31.178 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:30 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:30 smithi105 ceph-mon[34805]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:56:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:30 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:31.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:30 smithi060 ceph-mon[30953]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T23:56:31.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:31.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:31.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:30 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:33.131 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:32 smithi192 ceph-mon[35487]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:33.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:32 smithi105 ceph-mon[34805]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:32 smithi060 ceph-mon[30953]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:34.410 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 11 on host 'smithi192' 2024-09-11T23:56:34.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.410+0000 7f9abf7fe640 1 -- 172.21.15.192:0/1701008085 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9ac806aed0 con 0x7f9ab40a2c30 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9ab40a2c30 msgr2=0x7f9ab40a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9ab40a2c30 0x7f9ab40a50f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8005c20 tx=0x7f9ab8000bc0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8101d00 msgr2=0x7f9ac81985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8101d00 0x7f9ac81985d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400d950 tx=0x7f9ac400de10 comp rx=0 tx=0).stop 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 shutdown_connections 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9ab40a2c30 0x7f9ab40a50f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac81026c0 0x7f9ac819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac8101d00 0x7f9ac81985d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 --2- 172.21.15.192:0/1701008085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac8100b00 0x7f9ac8198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 >> 172.21.15.192:0/1701008085 conn(0x7f9ac80fc290 msgr2=0x7f9ac806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 shutdown_connections 2024-09-11T23:56:34.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:34.413+0000 7f9ad079c640 1 -- 172.21.15.192:0/1701008085 wait complete. 2024-09-11T23:56:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:34 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:34 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:34.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:34.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:34.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:34.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:34.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:34 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:35.115 DEBUG:teuthology.orchestra.run.smithi192:osd.11> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T23:56:35.117 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T23:56:35.117 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:56:35.383 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 -- 172.21.15.60:0/73497201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860076220 msgr2=0x7f2860074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 --2- 172.21.15.60:0/73497201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860076220 0x7f2860074680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2854009900 tx=0x7f285402a410 comp rx=0 tx=0).stop 2024-09-11T23:56:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 -- 172.21.15.60:0/73497201 shutdown_connections 2024-09-11T23:56:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 --2- 172.21.15.60:0/73497201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2860109a80 0x7f286010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 --2- 172.21.15.60:0/73497201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2860074c50 0x7f28600750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 --2- 172.21.15.60:0/73497201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860076220 0x7f2860074680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 -- 172.21.15.60:0/73497201 >> 172.21.15.60:0/73497201 conn(0x7f28600fd390 msgr2=0x7f28600ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 -- 172.21.15.60:0/73497201 shutdown_connections 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.893+0000 7f2866c22640 1 -- 172.21.15.60:0/73497201 wait complete. 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f2866c22640 1 Processor -- start 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f2866c22640 1 -- start start 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f2866c22640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860074c50 0x7f286019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f2866c22640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2860076220 0x7f286019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f2866c22640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2860109a80 0x7f28601a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f2866c22640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f286010fbc0 con 0x7f2860074c50 2024-09-11T23:56:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f2866c22640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f286010fa40 con 0x7f2860076220 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f2866c22640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f286010fd40 con 0x7f2860109a80 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28649be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860074c50 0x7f286019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28649be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860074c50 0x7f286019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36656/0 (socket says 172.21.15.60:36656) 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28649be640 1 -- 172.21.15.60:0/3192090125 learned_addr learned my addr 172.21.15.60:0/3192090125 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28651bf640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2860109a80 0x7f28601a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f285ffff640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2860076220 0x7f286019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28649be640 1 -- 172.21.15.60:0/3192090125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2860109a80 msgr2=0x7f28601a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28649be640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2860109a80 0x7f28601a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28649be640 1 -- 172.21.15.60:0/3192090125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2860076220 msgr2=0x7f286019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28649be640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2860076220 0x7f286019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.894+0000 7f28649be640 1 -- 172.21.15.60:0/3192090125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28601a1dc0 con 0x7f2860074c50 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.895+0000 7f28649be640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860074c50 0x7f286019a190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2854005ab0 tx=0x7f28540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.895+0000 7f285dffb640 1 -- 172.21.15.60:0/3192090125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285403f030 con 0x7f2860074c50 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.895+0000 7f285dffb640 1 -- 172.21.15.60:0/3192090125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2854003d00 con 0x7f2860074c50 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.895+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28601a2050 con 0x7f2860074c50 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.895+0000 7f285dffb640 1 -- 172.21.15.60:0/3192090125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854035070 con 0x7f2860074c50 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.895+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28601a2580 con 0x7f2860074c50 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.896+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2860108800 con 0x7f2860074c50 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.898+0000 7f285dffb640 1 -- 172.21.15.60:0/3192090125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2854042030 con 0x7f2860074c50 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.898+0000 7f285dffb640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f28500a2c30 0x7f28500a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.898+0000 7f285ffff640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f28500a2c30 0x7f28500a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.898+0000 7f285dffb640 1 -- 172.21.15.60:0/3192090125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7f28540ef0a0 con 0x7f2860074c50 2024-09-11T23:56:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.899+0000 7f285ffff640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f28500a2c30 0x7f28500a50f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f284c005fd0 tx=0x7f284c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:35.904+0000 7f285dffb640 1 -- 172.21.15.60:0/3192090125 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f28540bc540 con 0x7f2860074c50 2024-09-11T23:56:36.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.078+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2860062df0 con 0x7f2860074c50 2024-09-11T23:56:36.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.079+0000 7f285dffb640 1 -- 172.21.15.60:0/3192090125 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f28540bbe40 con 0x7f2860074c50 2024-09-11T23:56:36.079 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f28500a2c30 msgr2=0x7f28500a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f28500a2c30 0x7f28500a50f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f284c005fd0 tx=0x7f284c005850 comp rx=0 tx=0).stop 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860074c50 msgr2=0x7f286019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860074c50 0x7f286019a190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2854005ab0 tx=0x7f28540042f0 comp rx=0 tx=0).stop 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 shutdown_connections 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2860109a80 0x7f28601a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2860076220 0x7f286019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f28500a2c30 0x7f28500a50f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 --2- 172.21.15.60:0/3192090125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2860074c50 0x7f286019a190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.082+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 >> 172.21.15.60:0/3192090125 conn(0x7f28600fd390 msgr2=0x7f28601059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.083+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 shutdown_connections 2024-09-11T23:56:36.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:36.083+0000 7f2866c22640 1 -- 172.21.15.60:0/3192090125 wait complete. 2024-09-11T23:56:36.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:36 smithi192 ceph-mon[35487]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:36.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:36 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3192090125' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:36.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:36 smithi192 ceph-mon[35487]: from='osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:36.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:36 smithi192 ceph-mon[35487]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:36.535 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 11 23:56:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-11T23:56:36.383+0000 7fb953ebe640 -1 osd.11 0 log_to_monitors true 2024-09-11T23:56:36.747 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:36 smithi060 ceph-mon[30953]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:36.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:36 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3192090125' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:36.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:36 smithi060 ceph-mon[30953]: from='osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:36.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:36 smithi060 ceph-mon[30953]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:36.777 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726098972,"num_in_osds":12,"osd_in_since":1726098975,"num_remapped_pgs":0} 2024-09-11T23:56:36.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:36 smithi105 ceph-mon[34805]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:36.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:36 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3192090125' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:36.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:36 smithi105 ceph-mon[34805]: from='osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:36.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:36 smithi105 ceph-mon[34805]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-11T23:56:37.677 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 11 23:56:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-11T23:56:37.508+0000 7fb94fe41640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T23:56:37.677 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 11 23:56:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-11T23:56:37.518+0000 7fb94bc69640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:56:37.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:37 smithi192 ceph-mon[35487]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:56:37.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:37 smithi192 ceph-mon[35487]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:56:37.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:37 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:37.678 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:37 smithi192 ceph-mon[35487]: from='osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:56:37.678 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:37 smithi192 ceph-mon[35487]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:56:37.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T23:56:37.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:37 smithi060 ceph-mon[30953]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:56:37.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:37 smithi060 ceph-mon[30953]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:56:37.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:37 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:37.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:37 smithi060 ceph-mon[30953]: from='osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:56:37.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:37 smithi060 ceph-mon[30953]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:56:37.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:37 smithi105 ceph-mon[34805]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T23:56:37.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:37 smithi105 ceph-mon[34805]: osdmap e72: 12 total, 11 up, 12 in 2024-09-11T23:56:37.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:37 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:37.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:37 smithi105 ceph-mon[34805]: from='osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:56:37.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:37 smithi105 ceph-mon[34805]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-11T23:56:38.051 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:38.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 -- 172.21.15.60:0/781906257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 msgr2=0x7fbea810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:38.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 --2- 172.21.15.60:0/781906257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 0x7fbea810a050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009ca0 tx=0x7fbea002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 -- 172.21.15.60:0/781906257 shutdown_connections 2024-09-11T23:56:38.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 --2- 172.21.15.60:0/781906257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 0x7fbea810a050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 --2- 172.21.15.60:0/781906257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea8102e00 0x7fbea8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 --2- 172.21.15.60:0/781906257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea8101c00 0x7fbea8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 -- 172.21.15.60:0/781906257 >> 172.21.15.60:0/781906257 conn(0x7fbea80fd390 msgr2=0x7fbea80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 -- 172.21.15.60:0/781906257 shutdown_connections 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.515+0000 7fbeb0288640 1 -- 172.21.15.60:0/781906257 wait complete. 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeb0288640 1 Processor -- start 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeb0288640 1 -- start start 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeb0288640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea8101c00 0x7fbea8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeb0288640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea8102e00 0x7fbea81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeb0288640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 0x7fbea819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeb0288640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbea810d9c0 con 0x7fbea81037c0 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeb0288640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbea810d840 con 0x7fbea8102e00 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeb0288640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbea810db40 con 0x7fbea8101c00 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeae825640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 0x7fbea819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeae825640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 0x7fbea819f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36670/0 (socket says 172.21.15.60:36670) 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeae024640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea8101c00 0x7fbea8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbeae825640 1 -- 172.21.15.60:0/3582696247 learned_addr learned my addr 172.21.15.60:0/3582696247 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.516+0000 7fbead823640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea8102e00 0x7fbea81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeae825640 1 -- 172.21.15.60:0/3582696247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea8101c00 msgr2=0x7fbea8197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeae825640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea8101c00 0x7fbea8197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeae825640 1 -- 172.21.15.60:0/3582696247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea8102e00 msgr2=0x7fbea81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeae825640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea8102e00 0x7fbea81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeae825640 1 -- 172.21.15.60:0/3582696247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea819fbb0 con 0x7fbea81037c0 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeae024640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea8101c00 0x7fbea8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeae825640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 0x7fbea819f540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbea0031ae0 tx=0x7fbea0031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbe9b7fe640 1 -- 172.21.15.60:0/3582696247 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea002fae0 con 0x7fbea81037c0 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbe9b7fe640 1 -- 172.21.15.60:0/3582696247 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbea002fc80 con 0x7fbea81037c0 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea819fe40 con 0x7fbea81037c0 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbe9b7fe640 1 -- 172.21.15.60:0/3582696247 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea00468a0 con 0x7fbea81037c0 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.517+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea81a0340 con 0x7fbea81037c0 2024-09-11T23:56:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.518+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea8108f30 con 0x7fbea81037c0 2024-09-11T23:56:38.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.519+0000 7fbe9b7fe640 1 -- 172.21.15.60:0/3582696247 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbea0030b50 con 0x7fbea81037c0 2024-09-11T23:56:38.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.520+0000 7fbe9b7fe640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe940a2c30 0x7fbe940a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:38.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.520+0000 7fbeae024640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe940a2c30 0x7fbe940a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:38.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.520+0000 7fbe9b7fe640 1 -- 172.21.15.60:0/3582696247 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fbea00effb0 con 0x7fbea81037c0 2024-09-11T23:56:38.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.521+0000 7fbeae024640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe940a2c30 0x7fbe940a50f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbea8102c60 tx=0x7fbea4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:38.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.524+0000 7fbe9b7fe640 1 -- 172.21.15.60:0/3582696247 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbea00bd310 con 0x7fbea81037c0 2024-09-11T23:56:38.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.698+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbea8062df0 con 0x7fbea81037c0 2024-09-11T23:56:38.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.698+0000 7fbe9b7fe640 1 -- 172.21.15.60:0/3582696247 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fbea00bcc10 con 0x7fbea81037c0 2024-09-11T23:56:38.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:38.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:56:38.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:56:38.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:38.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:38.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: Detected new or changed devices on smithi192 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:38.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:38 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.701 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:56:38.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe940a2c30 msgr2=0x7fbe940a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:38.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe940a2c30 0x7fbe940a50f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbea8102c60 tx=0x7fbea4005f90 comp rx=0 tx=0).stop 2024-09-11T23:56:38.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 msgr2=0x7fbea819f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:38.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 0x7fbea819f540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbea0031ae0 tx=0x7fbea0031ee0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 shutdown_connections 2024-09-11T23:56:38.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe940a2c30 0x7fbe940a50f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea81037c0 0x7fbea819f540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea8102e00 0x7fbea81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 --2- 172.21.15.60:0/3582696247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea8101c00 0x7fbea8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:38.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.700+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 >> 172.21.15.60:0/3582696247 conn(0x7fbea80fd390 msgr2=0x7fbea8106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:38.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.701+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 shutdown_connections 2024-09-11T23:56:38.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:38.701+0000 7fbeb0288640 1 -- 172.21.15.60:0/3582696247 wait complete. 2024-09-11T23:56:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:56:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:56:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: Detected new or changed devices on smithi192 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:38.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:38 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-11T23:56:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: osdmap e73: 12 total, 11 up, 12 in 2024-09-11T23:56:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: Detected new or changed devices on smithi192 2024-09-11T23:56:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:56:38.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-11T23:56:38.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:38.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:38.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:38.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:38 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:39.447 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726098998,"num_in_osds":12,"osd_in_since":1726098975,"num_remapped_pgs":0} 2024-09-11T23:56:39.447 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:56:39.745 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:39.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:39 smithi192 ceph-mon[35487]: purged_snaps scrub starts 2024-09-11T23:56:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:39 smithi192 ceph-mon[35487]: purged_snaps scrub ok 2024-09-11T23:56:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:39 smithi192 ceph-mon[35487]: osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] boot 2024-09-11T23:56:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:39 smithi192 ceph-mon[35487]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:56:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:39 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3582696247' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:39.793 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:39 smithi105 ceph-mon[34805]: purged_snaps scrub starts 2024-09-11T23:56:39.793 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:39 smithi105 ceph-mon[34805]: purged_snaps scrub ok 2024-09-11T23:56:39.793 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:39 smithi105 ceph-mon[34805]: osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] boot 2024-09-11T23:56:39.794 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:39 smithi105 ceph-mon[34805]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:56:39.794 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:39.794 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:39 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3582696247' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:39.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:39 smithi060 ceph-mon[30953]: purged_snaps scrub starts 2024-09-11T23:56:39.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:39 smithi060 ceph-mon[30953]: purged_snaps scrub ok 2024-09-11T23:56:39.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:39 smithi060 ceph-mon[30953]: osd.11 [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] boot 2024-09-11T23:56:39.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:39 smithi060 ceph-mon[30953]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T23:56:39.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:56:39.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:39 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3582696247' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-11T23:56:40.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 -- 172.21.15.60:0/1922370890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c1008d0 msgr2=0x7f414c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 --2- 172.21.15.60:0/1922370890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c1008d0 0x7f414c100cb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4148009900 tx=0x7f414802a410 comp rx=0 tx=0).stop 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 -- 172.21.15.60:0/1922370890 shutdown_connections 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 --2- 172.21.15.60:0/1922370890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f414c10e480 0x7f414c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 --2- 172.21.15.60:0/1922370890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f414c101280 0x7f414c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 --2- 172.21.15.60:0/1922370890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c1008d0 0x7f414c100cb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 -- 172.21.15.60:0/1922370890 >> 172.21.15.60:0/1922370890 conn(0x7f414c0fc7a0 msgr2=0x7f414c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 -- 172.21.15.60:0/1922370890 shutdown_connections 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.186+0000 7f4153a4d640 1 -- 172.21.15.60:0/1922370890 wait complete. 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4153a4d640 1 Processor -- start 2024-09-11T23:56:40.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4153a4d640 1 -- start start 2024-09-11T23:56:40.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4153a4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f414c1008d0 0x7f414c1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:40.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4153a4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c101280 0x7f414c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4153a4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f414c10e480 0x7f414c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4153a4d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1142e0 con 0x7f414c101280 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4153a4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f414c114160 con 0x7f414c10e480 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4153a4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f414c114460 con 0x7f414c1008d0 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4150fe8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c101280 0x7f414c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4150fe8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c101280 0x7f414c1a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36702/0 (socket says 172.21.15.60:36702) 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4150fe8640 1 -- 172.21.15.60:0/2540840044 learned_addr learned my addr 172.21.15.60:0/2540840044 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4151fea640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f414c10e480 0x7f414c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f41517e9640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f414c1008d0 0x7f414c1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4150fe8640 1 -- 172.21.15.60:0/2540840044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f414c1008d0 msgr2=0x7f414c1a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4150fe8640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f414c1008d0 0x7f414c1a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4150fe8640 1 -- 172.21.15.60:0/2540840044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f414c10e480 msgr2=0x7f414c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4150fe8640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f414c10e480 0x7f414c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f4150fe8640 1 -- 172.21.15.60:0/2540840044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c19acf0 con 0x7f414c101280 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.187+0000 7f41517e9640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f414c1008d0 0x7f414c1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.188+0000 7f4150fe8640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c101280 0x7f414c1a0940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f413c00d950 tx=0x7f413c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.188+0000 7f41427fc640 1 -- 172.21.15.60:0/2540840044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c017070 con 0x7f414c101280 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.188+0000 7f41427fc640 1 -- 172.21.15.60:0/2540840044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f413c009c30 con 0x7f414c101280 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.188+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414c19afe0 con 0x7f414c101280 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.188+0000 7f41427fc640 1 -- 172.21.15.60:0/2540840044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c00f740 con 0x7f414c101280 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.188+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414c1a72d0 con 0x7f414c101280 2024-09-11T23:56:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.189+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f414c100cb0 con 0x7f414c101280 2024-09-11T23:56:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.190+0000 7f41427fc640 1 -- 172.21.15.60:0/2540840044 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f413c010a80 con 0x7f414c101280 2024-09-11T23:56:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.190+0000 7f41427fc640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f41380a2b80 0x7f41380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.191+0000 7f41517e9640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f41380a2b80 0x7f41380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.191+0000 7f41427fc640 1 -- 172.21.15.60:0/2540840044 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f413c0ce7f0 con 0x7f414c101280 2024-09-11T23:56:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.191+0000 7f41517e9640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f41380a2b80 0x7f41380a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4148005ab0 tx=0x7f4148005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:40.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.195+0000 7f41427fc640 1 -- 172.21.15.60:0/2540840044 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f413c009de0 con 0x7f414c101280 2024-09-11T23:56:40.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.373+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f414c109640 con 0x7f414c101280 2024-09-11T23:56:40.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.374+0000 7f41427fc640 1 -- 172.21.15.60:0/2540840044 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18504 (secure 0 0 0) 0x7f413c09bbf0 con 0x7f414c101280 2024-09-11T23:56:40.375 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:56:40.375 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":75,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:56:39.512432+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:56:40.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f41380a2b80 msgr2=0x7f41380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:40.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f41380a2b80 0x7f41380a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4148005ab0 tx=0x7f4148005a20 comp rx=0 tx=0).stop 2024-09-11T23:56:40.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c101280 msgr2=0x7f414c1a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:40.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c101280 0x7f414c1a0940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f413c00d950 tx=0x7f413c00de10 comp rx=0 tx=0).stop 2024-09-11T23:56:40.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 shutdown_connections 2024-09-11T23:56:40.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f414c10e480 0x7f414c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f41380a2b80 0x7f41380a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f414c101280 0x7f414c1a0940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 --2- 172.21.15.60:0/2540840044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f414c1008d0 0x7f414c1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:40.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 >> 172.21.15.60:0/2540840044 conn(0x7f414c0fc7a0 msgr2=0x7f414c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:40.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 shutdown_connections 2024-09-11T23:56:40.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:40.377+0000 7f4153a4d640 1 -- 172.21.15.60:0/2540840044 wait complete. 2024-09-11T23:56:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:40 smithi105 ceph-mon[34805]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:40 smithi105 ceph-mon[34805]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:56:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:40 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2540840044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:56:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:40 smithi192 ceph-mon[35487]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:40 smithi192 ceph-mon[35487]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:56:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:40 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2540840044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:56:40.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:40 smithi060 ceph-mon[30953]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail 2024-09-11T23:56:40.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:40 smithi060 ceph-mon[30953]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T23:56:40.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:40 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2540840044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:56:41.086 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:52:53.812220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:56:41.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T23:56:41.341 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 -- 172.21.15.60:0/4172559067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94102790 msgr2=0x7f0a941067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/4172559067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94102790 0x7f0a941067e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009900 tx=0x7f0a8802a410 comp rx=0 tx=0).stop 2024-09-11T23:56:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 -- 172.21.15.60:0/4172559067 shutdown_connections 2024-09-11T23:56:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/4172559067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a94106f10 0x7f0a9410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/4172559067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94102790 0x7f0a941067e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/4172559067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a94101de0 0x7f0a941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 -- 172.21.15.60:0/4172559067 >> 172.21.15.60:0/4172559067 conn(0x7f0a940fd8c0 msgr2=0x7f0a940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 -- 172.21.15.60:0/4172559067 shutdown_connections 2024-09-11T23:56:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 -- 172.21.15.60:0/4172559067 wait complete. 2024-09-11T23:56:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 Processor -- start 2024-09-11T23:56:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.808+0000 7f0a9a36e640 1 -- start start 2024-09-11T23:56:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a9a36e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94101de0 0x7f0a940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a9a36e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a94102790 0x7f0a94074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a9a36e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a94106f10 0x7f0a94074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a9a36e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0a941120d0 con 0x7f0a94101de0 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a9a36e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a94111f50 con 0x7f0a94102790 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a9a36e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a94112250 con 0x7f0a94106f10 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94101de0 0x7f0a940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94101de0 0x7f0a940744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46480/0 (socket says 172.21.15.60:46480) 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 -- 172.21.15.60:0/2952261537 learned_addr learned my addr 172.21.15.60:0/2952261537 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a937fe640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a94102790 0x7f0a94074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:41.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a9890b640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a94106f10 0x7f0a94074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:41.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 -- 172.21.15.60:0/2952261537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a94106f10 msgr2=0x7f0a94074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a94106f10 0x7f0a94074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 -- 172.21.15.60:0/2952261537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a94102790 msgr2=0x7f0a94074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a94102790 0x7f0a94074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 -- 172.21.15.60:0/2952261537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a941a6a50 con 0x7f0a94101de0 2024-09-11T23:56:41.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a9890b640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a94106f10 0x7f0a94074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.809+0000 7f0a93fff640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94101de0 0x7f0a940744f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400b4a0 tx=0x7f0a8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.810+0000 7f0a917fa640 1 -- 172.21.15.60:0/2952261537 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84014070 con 0x7f0a94101de0 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.810+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a941a6d40 con 0x7f0a94101de0 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.810+0000 7f0a917fa640 1 -- 172.21.15.60:0/2952261537 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a84010b10 con 0x7f0a94101de0 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.810+0000 7f0a917fa640 1 -- 172.21.15.60:0/2952261537 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84017d60 con 0x7f0a94101de0 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.810+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a941a71f0 con 0x7f0a94101de0 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.811+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a941021c0 con 0x7f0a94101de0 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.812+0000 7f0a917fa640 1 -- 172.21.15.60:0/2952261537 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0a84017070 con 0x7f0a94101de0 2024-09-11T23:56:41.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.812+0000 7f0a917fa640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a7c0a2b80 0x7f0a7c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:41.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.813+0000 7f0a937fe640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a7c0a2b80 0x7f0a7c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:41.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.813+0000 7f0a917fa640 1 -- 172.21.15.60:0/2952261537 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0a840cdfc0 con 0x7f0a94101de0 2024-09-11T23:56:41.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.813+0000 7f0a937fe640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a7c0a2b80 0x7f0a7c0a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009230 tx=0x7f0a880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:41.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.817+0000 7f0a917fa640 1 -- 172.21.15.60:0/2952261537 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a8409b320 con 0x7f0a94101de0 2024-09-11T23:56:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.991+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0a9402d7c0 con 0x7f0a94101de0 2024-09-11T23:56:41.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.992+0000 7f0a917fa640 1 -- 172.21.15.60:0/2952261537 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f0a840850a0 con 0x7f0a94101de0 2024-09-11T23:56:41.992 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-11T23:56:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a7c0a2b80 msgr2=0x7f0a7c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a7c0a2b80 0x7f0a7c0a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009230 tx=0x7f0a880058d0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94101de0 msgr2=0x7f0a940744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94101de0 0x7f0a940744f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400b4a0 tx=0x7f0a8400b960 comp rx=0 tx=0).stop 2024-09-11T23:56:41.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 shutdown_connections 2024-09-11T23:56:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a94106f10 0x7f0a94074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a94102790 0x7f0a94074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a7c0a2b80 0x7f0a7c0a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 --2- 172.21.15.60:0/2952261537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a94101de0 0x7f0a940744f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 >> 172.21.15.60:0/2952261537 conn(0x7f0a940fd8c0 msgr2=0x7f0a940fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 shutdown_connections 2024-09-11T23:56:41.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:41.994+0000 7f0a9a36e640 1 -- 172.21.15.60:0/2952261537 wait complete. 2024-09-11T23:56:42.562 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:42 smithi060 ceph-mon[30953]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:42.562 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:42 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2952261537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:56:42.589 INFO:tasks.cephadm:Adding mds.a on smithi060 2024-09-11T23:56:42.589 INFO:tasks.cephadm:Adding mds.d on smithi060 2024-09-11T23:56:42.589 INFO:tasks.cephadm:Adding mds.g on smithi060 2024-09-11T23:56:42.589 INFO:tasks.cephadm:Adding mds.j on smithi060 2024-09-11T23:56:42.589 INFO:tasks.cephadm:Adding mds.b on smithi105 2024-09-11T23:56:42.590 INFO:tasks.cephadm:Adding mds.e on smithi105 2024-09-11T23:56:42.590 INFO:tasks.cephadm:Adding mds.h on smithi105 2024-09-11T23:56:42.590 INFO:tasks.cephadm:Adding mds.k on smithi105 2024-09-11T23:56:42.590 INFO:tasks.cephadm:Adding mds.c on smithi192 2024-09-11T23:56:42.590 INFO:tasks.cephadm:Adding mds.f on smithi192 2024-09-11T23:56:42.590 INFO:tasks.cephadm:Adding mds.i on smithi192 2024-09-11T23:56:42.590 INFO:tasks.cephadm:Adding mds.l on smithi192 2024-09-11T23:56:42.590 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l' 2024-09-11T23:56:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:42 smithi192 ceph-mon[35487]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:42 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2952261537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:56:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T23:56:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:42 smithi105 ceph-mon[34805]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:42 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2952261537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:56:43.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 -- 172.21.15.192:0/1880384417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84881078c0 msgr2=0x7f8488109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 --2- 172.21.15.192:0/1880384417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84881078c0 0x7f8488109d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8480009ca0 tx=0x7f848002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 -- 172.21.15.192:0/1880384417 shutdown_connections 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 --2- 172.21.15.192:0/1880384417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84881078c0 0x7f8488109d10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 --2- 172.21.15.192:0/1880384417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8488104f90 0x7f8488107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 --2- 172.21.15.192:0/1880384417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8488102660 0x7f8488104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 -- 172.21.15.192:0/1880384417 >> 172.21.15.192:0/1880384417 conn(0x7f84880fc280 msgr2=0x7f84880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 -- 172.21.15.192:0/1880384417 shutdown_connections 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 -- 172.21.15.192:0/1880384417 wait complete. 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 Processor -- start 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.334+0000 7f84906ce640 1 -- start start 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f84906ce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8488102660 0x7f8488197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:43.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f84906ce640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488104f90 0x7f84881984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f84906ce640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84881078c0 0x7f848819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f84906ce640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f848810d9b0 con 0x7f8488102660 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f84906ce640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f848810d830 con 0x7f84881078c0 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f84906ce640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f848810db30 con 0x7f8488104f90 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488104f90 0x7f84881984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488104f90 0x7f84881984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36192/0 (socket says 172.21.15.192:36192) 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 -- 172.21.15.192:0/2031833433 learned_addr learned my addr 172.21.15.192:0/2031833433 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848ec6b640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84881078c0 0x7f848819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848e46a640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8488102660 0x7f8488197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 -- 172.21.15.192:0/2031833433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84881078c0 msgr2=0x7f848819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84881078c0 0x7f848819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 -- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8488102660 msgr2=0x7f8488197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8488102660 0x7f8488197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 -- 172.21.15.192:0/2031833433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848819fbe0 con 0x7f8488104f90 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848e46a640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8488102660 0x7f8488197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f848dc69640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488104f90 0x7f84881984f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f847800d770 tx=0x7f847800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f847f7fe640 1 -- 172.21.15.192:0/2031833433 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478017070 con 0x7f8488104f90 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f847f7fe640 1 -- 172.21.15.192:0/2031833433 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8478009c30 con 0x7f8488104f90 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.335+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848819fed0 con 0x7f8488104f90 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.336+0000 7f847f7fe640 1 -- 172.21.15.192:0/2031833433 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847800f6b0 con 0x7f8488104f90 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.336+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84881a0380 con 0x7f8488104f90 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.337+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84880fdd70 con 0x7f8488104f90 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.338+0000 7f847f7fe640 1 -- 172.21.15.192:0/2031833433 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f847801a070 con 0x7f8488104f90 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.338+0000 7f847f7fe640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f84740a2bb0 0x7f84740a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:43.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.339+0000 7f847f7fe640 1 -- 172.21.15.192:0/2031833433 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f84780ce690 con 0x7f8488104f90 2024-09-11T23:56:43.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.339+0000 7f848e46a640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f84740a2bb0 0x7f84740a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:43.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.339+0000 7f848e46a640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f84740a2bb0 0x7f84740a5070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f84840058c0 tx=0x7f8484005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:43.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.343+0000 7f847f7fe640 1 -- 172.21.15.192:0/2031833433 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f847809ba90 con 0x7f8488104f90 2024-09-11T23:56:43.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.526+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}) -- 0x7f84880627f0 con 0x7f84740a2bb0 2024-09-11T23:56:43.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.533+0000 7f847f7fe640 1 -- 172.21.15.192:0/2031833433 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f84880627f0 con 0x7f84740a2bb0 2024-09-11T23:56:43.533 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mds.all update... 2024-09-11T23:56:43.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f84740a2bb0 msgr2=0x7f84740a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:43.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f84740a2bb0 0x7f84740a5070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f84840058c0 tx=0x7f8484005850 comp rx=0 tx=0).stop 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488104f90 msgr2=0x7f84881984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488104f90 0x7f84881984f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f847800d770 tx=0x7f847800dc30 comp rx=0 tx=0).stop 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 shutdown_connections 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84881078c0 0x7f848819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8488104f90 0x7f84881984f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f84740a2bb0 0x7f84740a5070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.535+0000 7f84906ce640 1 --2- 172.21.15.192:0/2031833433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8488102660 0x7f8488197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.536+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 >> 172.21.15.192:0/2031833433 conn(0x7f84880fc280 msgr2=0x7f8488102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.536+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 shutdown_connections 2024-09-11T23:56:43.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-11T23:56:43.536+0000 7f84906ce640 1 -- 172.21.15.192:0/2031833433 wait complete. 2024-09-11T23:56:44.201 DEBUG:teuthology.orchestra.run.smithi060:mds.a> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T23:56:44.204 DEBUG:teuthology.orchestra.run.smithi060:mds.d> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T23:56:44.250 DEBUG:teuthology.orchestra.run.smithi060:mds.g> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T23:56:44.293 DEBUG:teuthology.orchestra.run.smithi060:mds.j> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T23:56:44.336 DEBUG:teuthology.orchestra.run.smithi105:mds.b> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T23:56:44.339 DEBUG:teuthology.orchestra.run.smithi105:mds.e> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T23:56:44.382 DEBUG:teuthology.orchestra.run.smithi105:mds.h> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T23:56:44.426 DEBUG:teuthology.orchestra.run.smithi105:mds.k> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T23:56:44.469 DEBUG:teuthology.orchestra.run.smithi192:mds.c> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T23:56:44.471 DEBUG:teuthology.orchestra.run.smithi192:mds.f> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T23:56:44.516 DEBUG:teuthology.orchestra.run.smithi192:mds.i> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T23:56:44.559 DEBUG:teuthology.orchestra.run.smithi192:mds.l> sudo journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T23:56:44.603 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T23:56:44.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:44.622 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:44.623 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:44.623 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:44.623 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:44 smithi192 ceph-mon[35487]: Deploying daemon mds.l on smithi192 2024-09-11T23:56:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:44.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:44.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-11T23:56:44.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:44.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:44.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:44.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:44.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:44.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:44.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:44.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:44.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:44 smithi105 ceph-mon[34805]: Deploying daemon mds.l on smithi192 2024-09-11T23:56:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:56:44.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: Saving service mds.all spec with placement smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:44.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:44 smithi060 ceph-mon[30953]: Deploying daemon mds.l on smithi192 2024-09-11T23:56:44.861 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3834856600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88102d40 msgr2=0x7f6f88103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3834856600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88102d40 0x7f6f88103120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009900 tx=0x7f6f8402a480 comp rx=0 tx=0).stop 2024-09-11T23:56:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3834856600 shutdown_connections 2024-09-11T23:56:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3834856600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f8810c170 0x7f6f8810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3834856600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f88103660 0x7f6f8810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3834856600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88102d40 0x7f6f88103120 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3834856600 >> 172.21.15.60:0/3834856600 conn(0x7f6f880fc7a0 msgr2=0x7f6f880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3834856600 shutdown_connections 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.348+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3834856600 wait complete. 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8f54b640 1 Processor -- start 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8f54b640 1 -- start start 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8f54b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f88102d40 0x7f6f881985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8f54b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88103660 0x7f6f88198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8f54b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f8810c170 0x7f6f8819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8f54b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f88112090 con 0x7f6f88103660 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8f54b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f88111f10 con 0x7f6f8810c170 2024-09-11T23:56:45.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8f54b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6f88112210 con 0x7f6f88102d40 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8cae6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88103660 0x7f6f88198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8cae6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88103660 0x7f6f88198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46502/0 (socket says 172.21.15.60:46502) 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8cae6640 1 -- 172.21.15.60:0/3324162306 learned_addr learned my addr 172.21.15.60:0/3324162306 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8d2e7640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f88102d40 0x7f6f881985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8cae6640 1 -- 172.21.15.60:0/3324162306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f88102d40 msgr2=0x7f6f881985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8cae6640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f88102d40 0x7f6f881985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8cae6640 1 -- 172.21.15.60:0/3324162306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f8810c170 msgr2=0x7f6f8819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8cae6640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f8810c170 0x7f6f8819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.349+0000 7f6f8cae6640 1 -- 172.21.15.60:0/3324162306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8819d560 con 0x7f6f88103660 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.350+0000 7f6f8d2e7640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f88102d40 0x7f6f881985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:56:45.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.350+0000 7f6f8cae6640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88103660 0x7f6f88198af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800e9f0 tx=0x7f6f7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.350+0000 7f6f7e7fc640 1 -- 172.21.15.60:0/3324162306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800ccc0 con 0x7f6f88103660 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.350+0000 7f6f7e7fc640 1 -- 172.21.15.60:0/3324162306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f7800ce60 con 0x7f6f88103660 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.350+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8819d850 con 0x7f6f88103660 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.350+0000 7f6f7e7fc640 1 -- 172.21.15.60:0/3324162306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78010690 con 0x7f6f88103660 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.350+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f881a5130 con 0x7f6f88103660 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.351+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f88103120 con 0x7f6f88103660 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.352+0000 7f6f7e7fc640 1 -- 172.21.15.60:0/3324162306 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6f780046c0 con 0x7f6f88103660 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.353+0000 7f6f7e7fc640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6f740a2b80 0x7f6f740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.353+0000 7f6f8d2e7640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6f740a2b80 0x7f6f740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.353+0000 7f6f7e7fc640 1 -- 172.21.15.60:0/3324162306 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f6f780cf220 con 0x7f6f88103660 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.353+0000 7f6f8d2e7640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6f740a2b80 0x7f6f740a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f84005ab0 tx=0x7f6f84005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:45.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.356+0000 7f6f7e7fc640 1 -- 172.21.15.60:0/3324162306 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f780541b0 con 0x7f6f88103660 2024-09-11T23:56:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.571+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f88199910 con 0x7f6f88103660 2024-09-11T23:56:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.572+0000 7f6f7e7fc640 1 -- 172.21.15.60:0/3324162306 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f6f7809c620 con 0x7f6f88103660 2024-09-11T23:56:45.572 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:56:45.572 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":1,"btime":"2024-09-11T23:49:46:707418+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T23:56:45.573 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 1 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6f740a2b80 msgr2=0x7f6f740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6f740a2b80 0x7f6f740a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f84005ab0 tx=0x7f6f84005a20 comp rx=0 tx=0).stop 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88103660 msgr2=0x7f6f88198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88103660 0x7f6f88198af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800e9f0 tx=0x7f6f7800eeb0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 shutdown_connections 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f8810c170 0x7f6f8819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6f740a2b80 0x7f6f740a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f88103660 0x7f6f88198af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 --2- 172.21.15.60:0/3324162306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f88102d40 0x7f6f881985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.574+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 >> 172.21.15.60:0/3324162306 conn(0x7f6f880fc7a0 msgr2=0x7f6f880fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:45.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.575+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 shutdown_connections 2024-09-11T23:56:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:45.575+0000 7f6f8f54b640 1 -- 172.21.15.60:0/3324162306 wait complete. 2024-09-11T23:56:46.034 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:45 smithi192 systemd[1]: Starting Ceph mds.l for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:46.411 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:46 smithi192 podman[65034]: 2024-09-11 23:56:46.049154226 +0000 UTC m=+0.016854148 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:46.411 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:46 smithi192 podman[65034]: 2024-09-11 23:56:46.157695072 +0000 UTC m=+0.125394985 container create 514f0b36f1bb00a2b1001077a4ee0461786fb6c03f74e2277bafcb27876ceaff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:56:46.411 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:46 smithi192 podman[65034]: 2024-09-11 23:56:46.385608603 +0000 UTC m=+0.353308511 container init 514f0b36f1bb00a2b1001077a4ee0461786fb6c03f74e2277bafcb27876ceaff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:56:46.411 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:46 smithi192 podman[65034]: 2024-09-11 23:56:46.388508105 +0000 UTC m=+0.356208028 container start 514f0b36f1bb00a2b1001077a4ee0461786fb6c03f74e2277bafcb27876ceaff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-11T23:56:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:46 smithi060 ceph-mon[30953]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:46 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3324162306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:46 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6832/1968112880,v1:172.21.15.192:6833/1968112880] up:boot 2024-09-11T23:56:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:46 smithi060 ceph-mon[30953]: fsmap 1 up:standby 2024-09-11T23:56:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:46 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:56:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:46 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:46.784 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:46 smithi192 ceph-mds[65053]: -- 172.21.15.192:0/3543979278 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d39b33860 con 0x564d39b10800 2024-09-11T23:56:46.784 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:46 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l[65049]: starting mds.l at 2024-09-11T23:56:46.784 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:46 smithi192 bash[65034]: 514f0b36f1bb00a2b1001077a4ee0461786fb6c03f74e2277bafcb27876ceaff 2024-09-11T23:56:46.784 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 11 23:56:46 smithi192 systemd[1]: Started Ceph mds.l for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:46 smithi192 ceph-mon[35487]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:46 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3324162306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:46 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6832/1968112880,v1:172.21.15.192:6833/1968112880] up:boot 2024-09-11T23:56:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:46 smithi192 ceph-mon[35487]: fsmap 1 up:standby 2024-09-11T23:56:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:46 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:56:46.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:46 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:46.969 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:46 smithi105 ceph-mon[34805]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:46.969 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:46 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3324162306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:46.969 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:46 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6832/1968112880,v1:172.21.15.192:6833/1968112880] up:boot 2024-09-11T23:56:46.969 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:46 smithi105 ceph-mon[34805]: fsmap 1 up:standby 2024-09-11T23:56:46.969 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:46 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:56:46.970 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:46 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:47.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:47.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:47.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:47.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:47.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:47 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:47.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:47 smithi105 ceph-mon[34805]: Deploying daemon mds.k on smithi105 2024-09-11T23:56:47.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:47.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:47.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:47.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:47.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:47 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:47.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:47 smithi060 ceph-mon[30953]: Deploying daemon mds.k on smithi105 2024-09-11T23:56:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:47 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:48.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:47 smithi192 ceph-mon[35487]: Deploying daemon mds.k on smithi105 2024-09-11T23:56:48.310 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:48.700 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:48 smithi060 ceph-mon[30953]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:48.892 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:48 smithi105 ceph-mon[34805]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:48.892 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:48 smithi105 systemd[1]: Starting Ceph mds.k for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:49.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 -- 172.21.15.60:0/103927760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e14100480 msgr2=0x7f5e14100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/103927760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e14100480 0x7f5e14100860 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009900 tx=0x7f5e0402a410 comp rx=0 tx=0).stop 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 -- 172.21.15.60:0/103927760 shutdown_connections 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/103927760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e141055b0 0x7f5e1410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/103927760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e14100e30 0x7f5e14104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/103927760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e14100480 0x7f5e14100860 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 -- 172.21.15.60:0/103927760 >> 172.21.15.60:0/103927760 conn(0x7f5e14077210 msgr2=0x7f5e140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 -- 172.21.15.60:0/103927760 shutdown_connections 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.023+0000 7f5e1b66b640 1 -- 172.21.15.60:0/103927760 wait complete. 2024-09-11T23:56:49.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e1b66b640 1 Processor -- start 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e1b66b640 1 -- start start 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e1b66b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14100480 0x7f5e1419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e1b66b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e14100e30 0x7f5e1419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e1b66b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e141055b0 0x7f5e1419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e1b66b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1410feb0 con 0x7f5e141055b0 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e1b66b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1410fd30 con 0x7f5e14100e30 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e1b66b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14110030 con 0x7f5e14100480 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19c08640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e141055b0 0x7f5e1419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19407640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14100480 0x7f5e1419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19c08640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e141055b0 0x7f5e1419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46516/0 (socket says 172.21.15.60:46516) 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19c08640 1 -- 172.21.15.60:0/1769961969 learned_addr learned my addr 172.21.15.60:0/1769961969 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:56:49.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e18c06640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e14100e30 0x7f5e1419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19c08640 1 -- 172.21.15.60:0/1769961969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14100480 msgr2=0x7f5e1419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19c08640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14100480 0x7f5e1419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19c08640 1 -- 172.21.15.60:0/1769961969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e14100e30 msgr2=0x7f5e1419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19c08640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e14100e30 0x7f5e1419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e19c08640 1 -- 172.21.15.60:0/1769961969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1419f6c0 con 0x7f5e141055b0 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.024+0000 7f5e18c06640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e14100e30 0x7f5e1419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.025+0000 7f5e19c08640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e141055b0 0x7f5e1419efe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00dd70 tx=0x7f5e0c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.025+0000 7f5e127fc640 1 -- 172.21.15.60:0/1769961969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c004d20 con 0x7f5e141055b0 2024-09-11T23:56:49.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.025+0000 7f5e127fc640 1 -- 172.21.15.60:0/1769961969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e0c00be40 con 0x7f5e141055b0 2024-09-11T23:56:49.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.025+0000 7f5e127fc640 1 -- 172.21.15.60:0/1769961969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c005790 con 0x7f5e141055b0 2024-09-11T23:56:49.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.025+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1419f9b0 con 0x7f5e141055b0 2024-09-11T23:56:49.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.025+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e141a7290 con 0x7f5e141055b0 2024-09-11T23:56:49.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.026+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e14100860 con 0x7f5e141055b0 2024-09-11T23:56:49.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.028+0000 7f5e127fc640 1 -- 172.21.15.60:0/1769961969 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5e0c00e660 con 0x7f5e141055b0 2024-09-11T23:56:49.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.029+0000 7f5e127fc640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f5dfc0a2c00 0x7f5dfc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:49.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.029+0000 7f5e127fc640 1 -- 172.21.15.60:0/1769961969 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5e0c0cf270 con 0x7f5e141055b0 2024-09-11T23:56:49.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.029+0000 7f5e19407640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f5dfc0a2c00 0x7f5dfc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:49.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.030+0000 7f5e19407640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f5dfc0a2c00 0x7f5dfc0a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e04000c00 tx=0x7f5e04005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:49.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.032+0000 7f5e127fc640 1 -- 172.21.15.60:0/1769961969 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e0c09c670 con 0x7f5e141055b0 2024-09-11T23:56:49.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:48 smithi192 ceph-mon[35487]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:49.203 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:48 smithi105 podman[64329]: 2024-09-11 23:56:48.795500107 +0000 UTC m=+0.016025199 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:49.203 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:48 smithi105 podman[64329]: 2024-09-11 23:56:48.968099005 +0000 UTC m=+0.188624097 container create 6d0218333b605eb0ea2c331d08bfecd6975899d99032e3b5334d05eb327cf6af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-11T23:56:49.203 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:49 smithi105 podman[64329]: 2024-09-11 23:56:49.204326024 +0000 UTC m=+0.424851117 container init 6d0218333b605eb0ea2c331d08bfecd6975899d99032e3b5334d05eb327cf6af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T23:56:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.255+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e1419ba70 con 0x7f5e141055b0 2024-09-11T23:56:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.255+0000 7f5e127fc640 1 -- 172.21.15.60:0/1769961969 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f5e1419ba70 con 0x7f5e141055b0 2024-09-11T23:56:49.256 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:56:49.256 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":2,"btime":"2024-09-11T23:56:46:416968+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:56:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 2 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f5dfc0a2c00 msgr2=0x7f5dfc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f5dfc0a2c00 0x7f5dfc0a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e04000c00 tx=0x7f5e04005e80 comp rx=0 tx=0).stop 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e141055b0 msgr2=0x7f5e1419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e141055b0 0x7f5e1419efe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00dd70 tx=0x7f5e0c00b730 comp rx=0 tx=0).stop 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 shutdown_connections 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f5dfc0a2c00 0x7f5dfc0a50c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e141055b0 0x7f5e1419efe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e14100e30 0x7f5e1419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 --2- 172.21.15.60:0/1769961969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14100480 0x7f5e1419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.257+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 >> 172.21.15.60:0/1769961969 conn(0x7f5e14077210 msgr2=0x7f5e14103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.258+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 shutdown_connections 2024-09-11T23:56:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:49.258+0000 7f5e1b66b640 1 -- 172.21.15.60:0/1769961969 wait complete. 2024-09-11T23:56:49.479 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:49 smithi105 podman[64329]: 2024-09-11 23:56:49.207342547 +0000 UTC m=+0.427867643 container start 6d0218333b605eb0ea2c331d08bfecd6975899d99032e3b5334d05eb327cf6af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-11T23:56:49.479 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-mds[64349]: -- 172.21.15.105:0/178700722 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563af779b860 con 0x563af7779000 2024-09-11T23:56:49.480 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k[64345]: starting mds.k at 2024-09-11T23:56:49.480 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:49 smithi105 bash[64329]: 6d0218333b605eb0ea2c331d08bfecd6975899d99032e3b5334d05eb327cf6af 2024-09-11T23:56:49.480 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 11 23:56:49 smithi105 systemd[1]: Started Ceph mds.k for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:49.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:49 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1769961969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:49.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:49.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:49.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:49.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:49.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:49.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:49 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:49.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1769961969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:49.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:49.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:49.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:49.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:49.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:49.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:49 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:49 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1769961969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:50.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:50.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:50.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:50.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:49 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:50.607 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:50 smithi105 ceph-mon[34805]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:50.607 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:50 smithi105 ceph-mon[34805]: Deploying daemon mds.j on smithi060 2024-09-11T23:56:50.607 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:50 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6832/967941361,v1:172.21.15.105:6833/967941361] up:boot 2024-09-11T23:56:50.608 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:50 smithi105 ceph-mon[34805]: fsmap 2 up:standby 2024-09-11T23:56:50.608 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:50 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:56:50.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:50 smithi060 ceph-mon[30953]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:50.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:50 smithi060 ceph-mon[30953]: Deploying daemon mds.j on smithi060 2024-09-11T23:56:50.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:50 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6832/967941361,v1:172.21.15.105:6833/967941361] up:boot 2024-09-11T23:56:50.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:50 smithi060 ceph-mon[30953]: fsmap 2 up:standby 2024-09-11T23:56:50.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:50 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:56:50.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:50 smithi192 ceph-mon[35487]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:50.936 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:50 smithi192 ceph-mon[35487]: Deploying daemon mds.j on smithi060 2024-09-11T23:56:50.936 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:50 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6832/967941361,v1:172.21.15.105:6833/967941361] up:boot 2024-09-11T23:56:50.936 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:50 smithi192 ceph-mon[35487]: fsmap 2 up:standby 2024-09-11T23:56:50.936 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:50 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:56:52.073 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:51 smithi060 systemd[1]: Starting Ceph mds.j for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:52.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:52.325 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:52 smithi060 podman[70411]: 2024-09-11 23:56:51.977203436 +0000 UTC m=+0.015916813 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:52.325 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:52 smithi060 podman[70411]: 2024-09-11 23:56:52.077865985 +0000 UTC m=+0.116579346 container create 88d5c272bd1df3ff41982151af810328626034824c466b5b3078df3ea988d406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T23:56:52.325 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:52 smithi060 podman[70411]: 2024-09-11 23:56:52.297649853 +0000 UTC m=+0.336363241 container init 88d5c272bd1df3ff41982151af810328626034824c466b5b3078df3ea988d406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-11T23:56:52.325 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:52 smithi060 podman[70411]: 2024-09-11 23:56:52.300714475 +0000 UTC m=+0.339427845 container start 88d5c272bd1df3ff41982151af810328626034824c466b5b3078df3ea988d406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=) 2024-09-11T23:56:52.472 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:52.589 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-mds[70449]: -- 172.21.15.60:0/2098987425 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557332b27860 con 0x557332b05400 2024-09-11T23:56:52.589 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j[70445]: starting mds.j at 2024-09-11T23:56:52.589 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:52 smithi060 bash[70411]: 88d5c272bd1df3ff41982151af810328626034824c466b5b3078df3ea988d406 2024-09-11T23:56:52.589 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 11 23:56:52 smithi060 systemd[1]: Started Ceph mds.j for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-mon[30953]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:52.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:52.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:52 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:52.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:52 smithi105 ceph-mon[34805]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:52.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:52.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:52.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:52.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:52.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:52.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:52 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:52.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 -- 172.21.15.60:0/1035134429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102ef0 msgr2=0x7fbf3c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:52.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 --2- 172.21.15.60:0/1035134429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102ef0 0x7fbf3c10da40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009ca0 tx=0x7fbf3402a950 comp rx=0 tx=0).stop 2024-09-11T23:56:52.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 -- 172.21.15.60:0/1035134429 shutdown_connections 2024-09-11T23:56:52.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 --2- 172.21.15.60:0/1035134429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102ef0 0x7fbf3c10da40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 --2- 172.21.15.60:0/1035134429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf3c102570 0x7fbf3c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 --2- 172.21.15.60:0/1035134429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf3c100e20 0x7fbf3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 -- 172.21.15.60:0/1035134429 >> 172.21.15.60:0/1035134429 conn(0x7fbf3c0fc7d0 msgr2=0x7fbf3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:52.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 -- 172.21.15.60:0/1035134429 shutdown_connections 2024-09-11T23:56:52.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.968+0000 7fbf425c1640 1 -- 172.21.15.60:0/1035134429 wait complete. 2024-09-11T23:56:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf425c1640 1 Processor -- start 2024-09-11T23:56:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf425c1640 1 -- start start 2024-09-11T23:56:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf425c1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf3c100e20 0x7fbf3c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf425c1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102570 0x7fbf3c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf425c1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf3c102ef0 0x7fbf3c1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf425c1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c1110e0 con 0x7fbf3c102570 2024-09-11T23:56:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf425c1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c110f60 con 0x7fbf3c100e20 2024-09-11T23:56:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf425c1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c111260 con 0x7fbf3c102ef0 2024-09-11T23:56:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf33fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102570 0x7fbf3c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf33fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102570 0x7fbf3c1998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55074/0 (socket says 172.21.15.60:55074) 2024-09-11T23:56:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf33fff640 1 -- 172.21.15.60:0/2493748719 learned_addr learned my addr 172.21.15.60:0/2493748719 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:56:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf3bfff640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf3c100e20 0x7fbf3c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.969+0000 7fbf40b5e640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf3c102ef0 0x7fbf3c1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf33fff640 1 -- 172.21.15.60:0/2493748719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf3c102ef0 msgr2=0x7fbf3c1a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf33fff640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf3c102ef0 0x7fbf3c1a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf33fff640 1 -- 172.21.15.60:0/2493748719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf3c100e20 msgr2=0x7fbf3c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf33fff640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf3c100e20 0x7fbf3c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf33fff640 1 -- 172.21.15.60:0/2493748719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c1a4950 con 0x7fbf3c102570 2024-09-11T23:56:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf33fff640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102570 0x7fbf3c1998d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400c920 tx=0x7fbf2400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:52.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf39ffb640 1 -- 172.21.15.60:0/2493748719 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24007bb0 con 0x7fbf3c102570 2024-09-11T23:56:52.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf39ffb640 1 -- 172.21.15.60:0/2493748719 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf24007d50 con 0x7fbf3c102570 2024-09-11T23:56:52.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf39ffb640 1 -- 172.21.15.60:0/2493748719 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24018890 con 0x7fbf3c102570 2024-09-11T23:56:52.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3c1a4b20 con 0x7fbf3c102570 2024-09-11T23:56:52.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.970+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3c1a5010 con 0x7fbf3c102570 2024-09-11T23:56:52.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.971+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3c101200 con 0x7fbf3c102570 2024-09-11T23:56:52.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.972+0000 7fbf39ffb640 1 -- 172.21.15.60:0/2493748719 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fbf24018a50 con 0x7fbf3c102570 2024-09-11T23:56:52.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.973+0000 7fbf39ffb640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbf280a2c00 0x7fbf280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:52.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.973+0000 7fbf39ffb640 1 -- 172.21.15.60:0/2493748719 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fbf240cef00 con 0x7fbf3c102570 2024-09-11T23:56:52.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.973+0000 7fbf3bfff640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbf280a2c00 0x7fbf280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:52.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.974+0000 7fbf3bfff640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbf280a2c00 0x7fbf280a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009990 tx=0x7fbf2c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:52.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:52.976+0000 7fbf39ffb640 1 -- 172.21.15.60:0/2493748719 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf24014030 con 0x7fbf3c102570 2024-09-11T23:56:53.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:52 smithi192 ceph-mon[35487]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:53.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:53.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:53.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:53.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:53.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:53.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:52 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:53.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.194+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf3c06a5a0 con 0x7fbf3c102570 2024-09-11T23:56:53.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.194+0000 7fbf39ffb640 1 -- 172.21.15.60:0/2493748719 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7fbf2409c410 con 0x7fbf3c102570 2024-09-11T23:56:53.194 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:56:53.194 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":4,"btime":"2024-09-11T23:56:52:558441+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:56:53.194 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 4 2024-09-11T23:56:53.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbf280a2c00 msgr2=0x7fbf280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:53.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbf280a2c00 0x7fbf280a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009990 tx=0x7fbf2c009110 comp rx=0 tx=0).stop 2024-09-11T23:56:53.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102570 msgr2=0x7fbf3c1998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102570 0x7fbf3c1998d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400c920 tx=0x7fbf2400cd20 comp rx=0 tx=0).stop 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 shutdown_connections 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf3c102ef0 0x7fbf3c1a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbf280a2c00 0x7fbf280a50c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf3c102570 0x7fbf3c1998d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 --2- 172.21.15.60:0/2493748719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf3c100e20 0x7fbf3c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 >> 172.21.15.60:0/2493748719 conn(0x7fbf3c0fc7d0 msgr2=0x7fbf3c105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 shutdown_connections 2024-09-11T23:56:53.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:53.196+0000 7fbf425c1640 1 -- 172.21.15.60:0/2493748719 wait complete. 2024-09-11T23:56:53.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:53 smithi060 ceph-mon[30953]: Deploying daemon mds.d on smithi060 2024-09-11T23:56:53.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:53 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.60:6834/84261893,v1:172.21.15.60:6835/84261893] up:boot 2024-09-11T23:56:53.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:53 smithi060 ceph-mon[30953]: fsmap 3 up:standby 2024-09-11T23:56:53.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:53 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:56:53.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:53 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2493748719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:53.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:53 smithi105 ceph-mon[34805]: Deploying daemon mds.d on smithi060 2024-09-11T23:56:53.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:53 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.60:6834/84261893,v1:172.21.15.60:6835/84261893] up:boot 2024-09-11T23:56:53.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:53 smithi105 ceph-mon[34805]: fsmap 3 up:standby 2024-09-11T23:56:53.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:53 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:56:53.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:53 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2493748719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:54.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:53 smithi192 ceph-mon[35487]: Deploying daemon mds.d on smithi060 2024-09-11T23:56:54.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:53 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.60:6834/84261893,v1:172.21.15.60:6835/84261893] up:boot 2024-09-11T23:56:54.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:53 smithi192 ceph-mon[35487]: fsmap 3 up:standby 2024-09-11T23:56:54.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:53 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:56:54.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:53 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2493748719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:54.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:54 smithi060 ceph-mon[30953]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:54.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:54 smithi105 ceph-mon[34805]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:55.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:54 smithi192 ceph-mon[35487]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:55.076 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:54 smithi060 systemd[1]: Starting Ceph mds.d for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:55.339 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:55 smithi060 podman[70828]: 2024-09-11 23:56:55.191339658 +0000 UTC m=+0.016643542 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:55.339 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:55 smithi060 podman[70828]: 2024-09-11 23:56:55.294690709 +0000 UTC m=+0.119994582 container create 91df50013e27162d87dd01c22ad0db4166ecaf5dcaa599ec451d2be7a461f255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T23:56:55.839 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:55 smithi060 podman[70828]: 2024-09-11 23:56:55.539336428 +0000 UTC m=+0.364640306 container init 91df50013e27162d87dd01c22ad0db4166ecaf5dcaa599ec451d2be7a461f255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T23:56:55.839 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:55 smithi060 podman[70828]: 2024-09-11 23:56:55.542326904 +0000 UTC m=+0.367630786 container start 91df50013e27162d87dd01c22ad0db4166ecaf5dcaa599ec451d2be7a461f255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-11T23:56:55.839 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:55 smithi060 ceph-mds[70847]: -- 172.21.15.60:0/1039988501 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b114b2f860 con 0x55b114b0c800 2024-09-11T23:56:55.839 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:55 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d[70843]: starting mds.d at 2024-09-11T23:56:55.839 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:55 smithi060 bash[70828]: 91df50013e27162d87dd01c22ad0db4166ecaf5dcaa599ec451d2be7a461f255 2024-09-11T23:56:55.839 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 11 23:56:55 smithi060 systemd[1]: Started Ceph mds.d for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:56.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: Deploying daemon mds.e on smithi105 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.60:6836/2489903500,v1:172.21.15.60:6837/2489903500] up:boot 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: fsmap 4 up:standby 2024-09-11T23:56:56.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:56 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: Deploying daemon mds.e on smithi105 2024-09-11T23:56:57.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.60:6836/2489903500,v1:172.21.15.60:6837/2489903500] up:boot 2024-09-11T23:56:57.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: fsmap 4 up:standby 2024-09-11T23:56:57.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:56 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: Deploying daemon mds.e on smithi105 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.60:6836/2489903500,v1:172.21.15.60:6837/2489903500] up:boot 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: fsmap 4 up:standby 2024-09-11T23:56:57.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:56 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:56:57.106 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:56:57.380 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:56:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/2538542521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48100e20 msgr2=0x7f7e48101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/2538542521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48100e20 0x7f7e48101200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009900 tx=0x7f7e3802a480 comp rx=0 tx=0).stop 2024-09-11T23:56:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/2538542521 shutdown_connections 2024-09-11T23:56:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/2538542521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e48102ef0 0x7f7e4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/2538542521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e48102570 0x7f7e481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/2538542521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48100e20 0x7f7e48101200 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/2538542521 >> 172.21.15.60:0/2538542521 conn(0x7f7e480fc7d0 msgr2=0x7f7e480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/2538542521 shutdown_connections 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/2538542521 wait complete. 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.868+0000 7f7e4ebe5640 1 Processor -- start 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4ebe5640 1 -- start start 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4ebe5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e48100e20 0x7f7e48103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4ebe5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48102570 0x7f7e48103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4ebe5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e48102ef0 0x7f7e481041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4ebe5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7e481110a0 con 0x7f7e48102570 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4ebe5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48110f20 con 0x7f7e48100e20 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4ebe5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48111220 con 0x7f7e48102ef0 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48102570 0x7f7e48103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48102570 0x7f7e48103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55110/0 (socket says 172.21.15.60:55110) 2024-09-11T23:56:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 -- 172.21.15.60:0/4144522505 learned_addr learned my addr 172.21.15.60:0/4144522505 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:56:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4c981640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e48100e20 0x7f7e48103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e4d182640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e48102ef0 0x7f7e481041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 -- 172.21.15.60:0/4144522505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e48102ef0 msgr2=0x7f7e481041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e48102ef0 0x7f7e481041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 -- 172.21.15.60:0/4144522505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e48100e20 msgr2=0x7f7e48103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e48100e20 0x7f7e48103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 -- 172.21.15.60:0/4144522505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e481a6a60 con 0x7f7e48102570 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e47fff640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48102570 0x7f7e48103c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00e9f0 tx=0x7f7e3c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.869+0000 7f7e45ffb640 1 -- 172.21.15.60:0/4144522505 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00cd80 con 0x7f7e48102570 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.870+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e481a6d50 con 0x7f7e48102570 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.870+0000 7f7e45ffb640 1 -- 172.21.15.60:0/4144522505 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7e3c010930 con 0x7f7e48102570 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.870+0000 7f7e45ffb640 1 -- 172.21.15.60:0/4144522505 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c018b00 con 0x7f7e48102570 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.870+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e481a7230 con 0x7f7e48102570 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.871+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e48101200 con 0x7f7e48102570 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.872+0000 7f7e45ffb640 1 -- 172.21.15.60:0/4144522505 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7e3c018ca0 con 0x7f7e48102570 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.873+0000 7f7e45ffb640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7e300a2b80 0x7f7e300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.873+0000 7f7e4c981640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7e300a2b80 0x7f7e300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:56:57.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.873+0000 7f7e45ffb640 1 -- 172.21.15.60:0/4144522505 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f7e3c0cf360 con 0x7f7e48102570 2024-09-11T23:56:57.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.873+0000 7f7e4c981640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7e300a2b80 0x7f7e300a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009230 tx=0x7f7e380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:56:57.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:57.876+0000 7f7e45ffb640 1 -- 172.21.15.60:0/4144522505 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e3c09c6c0 con 0x7f7e48102570 2024-09-11T23:56:57.980 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:57 smithi105 systemd[1]: Starting Ceph mds.e for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:56:58.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.086+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e481a7490 con 0x7f7e48102570 2024-09-11T23:56:58.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.087+0000 7f7e45ffb640 1 -- 172.21.15.60:0/4144522505 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7f7e3c09bfc0 con 0x7f7e48102570 2024-09-11T23:56:58.086 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:56:58.086 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"btime":"2024-09-11T23:56:56:570729+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:56:58.087 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 5 2024-09-11T23:56:58.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7e300a2b80 msgr2=0x7f7e300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:58.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7e300a2b80 0x7f7e300a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009230 tx=0x7f7e380058d0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48102570 msgr2=0x7f7e48103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48102570 0x7f7e48103c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00e9f0 tx=0x7f7e3c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 shutdown_connections 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e48102ef0 0x7f7e481041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7e300a2b80 0x7f7e300a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e48102570 0x7f7e48103c90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 --2- 172.21.15.60:0/4144522505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e48100e20 0x7f7e48103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 >> 172.21.15.60:0/4144522505 conn(0x7f7e480fc7d0 msgr2=0x7f7e4806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 shutdown_connections 2024-09-11T23:56:58.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:56:58.089+0000 7f7e4ebe5640 1 -- 172.21.15.60:0/4144522505 wait complete. 2024-09-11T23:56:58.300 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:58 smithi105 podman[64645]: 2024-09-11 23:56:57.946007575 +0000 UTC m=+0.015970632 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:56:58.300 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:58 smithi105 podman[64645]: 2024-09-11 23:56:58.048967682 +0000 UTC m=+0.118930727 container create 15045d79e23bb1cfd61a4490f77b466e1b746019d8639d561f71f7b9671c1170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-11T23:56:58.300 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:58 smithi105 podman[64645]: 2024-09-11 23:56:58.301720762 +0000 UTC m=+0.371683807 container init 15045d79e23bb1cfd61a4490f77b466e1b746019d8639d561f71f7b9671c1170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:56:58.697 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:58 smithi105 podman[64645]: 2024-09-11 23:56:58.30459129 +0000 UTC m=+0.374554354 container start 15045d79e23bb1cfd61a4490f77b466e1b746019d8639d561f71f7b9671c1170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T23:56:58.697 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mds[64664]: -- 172.21.15.105:0/1375247537 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557320ef1860 con 0x557320ecf400 2024-09-11T23:56:58.697 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e[64660]: starting mds.e at 2024-09-11T23:56:58.697 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:58 smithi105 bash[64645]: 15045d79e23bb1cfd61a4490f77b466e1b746019d8639d561f71f7b9671c1170 2024-09-11T23:56:58.698 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 11 23:56:58 smithi105 systemd[1]: Started Ceph mds.e for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:56:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:58 smithi060 ceph-mon[30953]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:58.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:58 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4144522505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:58.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:58 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:58.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mon[34805]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:58.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4144522505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:58.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:58.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:58.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:58.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:58 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:58 smithi192 ceph-mon[35487]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:56:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:58 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4144522505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:56:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:56:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:56:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:56:59.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:58 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:56:59.954 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:59 smithi192 ceph-mon[35487]: Deploying daemon mds.f on smithi192 2024-09-11T23:56:59.954 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:59 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6834/3186850870,v1:172.21.15.105:6835/3186850870] up:boot 2024-09-11T23:56:59.954 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:59 smithi192 ceph-mon[35487]: fsmap 5 up:standby 2024-09-11T23:56:59.954 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:56:59 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:56:59.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:59 smithi105 ceph-mon[34805]: Deploying daemon mds.f on smithi192 2024-09-11T23:56:59.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:59 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6834/3186850870,v1:172.21.15.105:6835/3186850870] up:boot 2024-09-11T23:56:59.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:59 smithi105 ceph-mon[34805]: fsmap 5 up:standby 2024-09-11T23:56:59.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:56:59 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:57:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:59 smithi060 ceph-mon[30953]: Deploying daemon mds.f on smithi192 2024-09-11T23:57:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:59 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6834/3186850870,v1:172.21.15.105:6835/3186850870] up:boot 2024-09-11T23:57:00.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:59 smithi060 ceph-mon[30953]: fsmap 5 up:standby 2024-09-11T23:57:00.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:56:59 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:57:00.534 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:00 smithi192 systemd[1]: Starting Ceph mds.f for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:57:00.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:00.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:00 smithi192 ceph-mon[35487]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:00.926 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:00 smithi192 podman[65337]: 2024-09-11 23:57:00.561083724 +0000 UTC m=+0.015721364 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:57:00.926 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:00 smithi192 podman[65337]: 2024-09-11 23:57:00.691148314 +0000 UTC m=+0.145785951 container create 787b82838218805abc34957dc4ea8980267827548c26f1acaf7f9d909bbf0ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-11T23:57:00.926 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:00 smithi192 podman[65337]: 2024-09-11 23:57:00.927478263 +0000 UTC m=+0.382115890 container init 787b82838218805abc34957dc4ea8980267827548c26f1acaf7f9d909bbf0ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-11T23:57:00.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:00 smithi105 ceph-mon[34805]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:01.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:00 smithi060 ceph-mon[30953]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:01.158 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:01.284 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:00 smithi192 podman[65337]: 2024-09-11 23:57:00.930360733 +0000 UTC m=+0.384998360 container start 787b82838218805abc34957dc4ea8980267827548c26f1acaf7f9d909bbf0ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:57:01.284 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:00 smithi192 ceph-mds[65356]: -- 172.21.15.192:0/1644677612 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e794ebc20 con 0x562e794c8800 2024-09-11T23:57:01.284 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f[65352]: starting mds.f at 2024-09-11T23:57:01.284 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:01 smithi192 bash[65337]: 787b82838218805abc34957dc4ea8980267827548c26f1acaf7f9d909bbf0ba2 2024-09-11T23:57:01.285 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 11 23:57:01 smithi192 systemd[1]: Started Ceph mds.f for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.760+0000 7f3319f2e640 1 -- 172.21.15.60:0/3625521148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 msgr2=0x7f3314103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.760+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3625521148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 0x7f3314103120 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3304009900 tx=0x7f330402a480 comp rx=0 tx=0).stop 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.760+0000 7f3319f2e640 1 -- 172.21.15.60:0/3625521148 shutdown_connections 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.760+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3625521148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f331410c170 0x7f331410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.760+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3625521148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3314103660 0x7f331410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.760+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3625521148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 0x7f3314103120 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.760+0000 7f3319f2e640 1 -- 172.21.15.60:0/3625521148 >> 172.21.15.60:0/3625521148 conn(0x7f33140fc7a0 msgr2=0x7f33140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.760+0000 7f3319f2e640 1 -- 172.21.15.60:0/3625521148 shutdown_connections 2024-09-11T23:57:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 -- 172.21.15.60:0/3625521148 wait complete. 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 Processor -- start 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 -- start start 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 0x7f3314198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3314103660 0x7f3314198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f331410c170 0x7f331419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3314112090 con 0x7f3314102d40 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3314111f10 con 0x7f3314103660 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.761+0000 7f3319f2e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3314112210 con 0x7f331410c170 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 0x7f3314198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 0x7f3314198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34070/0 (socket says 172.21.15.60:34070) 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 -- 172.21.15.60:0/3858995248 learned_addr learned my addr 172.21.15.60:0/3858995248 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f3313fff640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f331410c170 0x7f331419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f3312ffd640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3314103660 0x7f3314198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 -- 172.21.15.60:0/3858995248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f331410c170 msgr2=0x7f331419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f331410c170 0x7f331419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 -- 172.21.15.60:0/3858995248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3314103660 msgr2=0x7f3314198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3314103660 0x7f3314198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 -- 172.21.15.60:0/3858995248 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331419d500 con 0x7f3314102d40 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f33137fe640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 0x7f3314198550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3304006010 tx=0x7f33040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f3310ff9640 1 -- 172.21.15.60:0/3858995248 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330403f030 con 0x7f3314102d40 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f3310ff9640 1 -- 172.21.15.60:0/3858995248 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3304003d00 con 0x7f3314102d40 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f3310ff9640 1 -- 172.21.15.60:0/3858995248 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304035070 con 0x7f3314102d40 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.762+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331419d790 con 0x7f3314102d40 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.763+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33141a50d0 con 0x7f3314102d40 2024-09-11T23:57:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.764+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331406b070 con 0x7f3314102d40 2024-09-11T23:57:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.765+0000 7f3310ff9640 1 -- 172.21.15.60:0/3858995248 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3304042030 con 0x7f3314102d40 2024-09-11T23:57:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.765+0000 7f3310ff9640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f32fc0a2b80 0x7f32fc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.766+0000 7f3312ffd640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f32fc0a2b80 0x7f32fc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.766+0000 7f3310ff9640 1 -- 172.21.15.60:0/3858995248 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f33040ef0c0 con 0x7f3314102d40 2024-09-11T23:57:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.766+0000 7f3312ffd640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f32fc0a2b80 0x7f32fc0a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f331410d4d0 tx=0x7f3308005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.770+0000 7f3310ff9640 1 -- 172.21.15.60:0/3858995248 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33040bbe70 con 0x7f3314102d40 2024-09-11T23:57:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.981+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3314107210 con 0x7f3314102d40 2024-09-11T23:57:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.982+0000 7f3310ff9640 1 -- 172.21.15.60:0/3858995248 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7f33040c0170 con 0x7f3314102d40 2024-09-11T23:57:01.982 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:01.982 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-11T23:57:01:705130+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-11T23:57:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-11T23:57:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f32fc0a2b80 msgr2=0x7f32fc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f32fc0a2b80 0x7f32fc0a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f331410d4d0 tx=0x7f3308005f70 comp rx=0 tx=0).stop 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 msgr2=0x7f3314198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 0x7f3314198550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3304006010 tx=0x7f33040042f0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 shutdown_connections 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f331410c170 0x7f331419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3314103660 0x7f3314198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f32fc0a2b80 0x7f32fc0a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 --2- 172.21.15.60:0/3858995248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3314102d40 0x7f3314198550 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 >> 172.21.15.60:0/3858995248 conn(0x7f33140fc7a0 msgr2=0x7f33140fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.984+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 shutdown_connections 2024-09-11T23:57:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:01.985+0000 7f3319f2e640 1 -- 172.21.15.60:0/3858995248 wait complete. 2024-09-11T23:57:02.289 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.289 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: Deploying daemon mds.c on smithi192 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] up:boot 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: fsmap 6 up:standby 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:57:02.290 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:02 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3858995248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:02.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:02.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:02.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:02.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: Deploying daemon mds.c on smithi192 2024-09-11T23:57:02.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] up:boot 2024-09-11T23:57:02.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: fsmap 6 up:standby 2024-09-11T23:57:02.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:57:02.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:02 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3858995248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:02.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:02.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: Deploying daemon mds.c on smithi192 2024-09-11T23:57:02.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] up:boot 2024-09-11T23:57:02.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: fsmap 6 up:standby 2024-09-11T23:57:02.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:57:02.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:02 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3858995248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:03.281 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:03 smithi192 ceph-mon[35487]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:03 smithi105 ceph-mon[34805]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:03.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:03 smithi060 ceph-mon[30953]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:03.784 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 11 23:57:03 smithi192 systemd[1]: Started Ceph mds.c for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:57:04.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:04.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:04.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:04.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:04.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:04.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:04.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:04.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:04.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: Deploying daemon mds.h on smithi105 2024-09-11T23:57:04.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] up:boot 2024-09-11T23:57:04.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: fsmap 7 up:standby 2024-09-11T23:57:04.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:04 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:57:04.985 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:05.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:05.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:05.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:05.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:05.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:05.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:05.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:05.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: Deploying daemon mds.h on smithi105 2024-09-11T23:57:05.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] up:boot 2024-09-11T23:57:05.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: fsmap 7 up:standby 2024-09-11T23:57:05.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:04 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:57:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: Deploying daemon mds.h on smithi105 2024-09-11T23:57:05.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] up:boot 2024-09-11T23:57:05.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: fsmap 7 up:standby 2024-09-11T23:57:05.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:04 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:57:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 -- 172.21.15.60:0/665649042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac1027a0 msgr2=0x7f25ac1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 --2- 172.21.15.60:0/665649042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac1027a0 0x7f25ac1067f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f259c009900 tx=0x7f259c02a410 comp rx=0 tx=0).stop 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 -- 172.21.15.60:0/665649042 shutdown_connections 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 --2- 172.21.15.60:0/665649042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac106f20 0x7f25ac10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 --2- 172.21.15.60:0/665649042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac1027a0 0x7f25ac1067f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 --2- 172.21.15.60:0/665649042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac101df0 0x7f25ac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 -- 172.21.15.60:0/665649042 >> 172.21.15.60:0/665649042 conn(0x7f25ac0fd8f0 msgr2=0x7f25ac0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 -- 172.21.15.60:0/665649042 shutdown_connections 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.700+0000 7f25b40a5640 1 -- 172.21.15.60:0/665649042 wait complete. 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b40a5640 1 Processor -- start 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b40a5640 1 -- start start 2024-09-11T23:57:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b40a5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac101df0 0x7f25ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b40a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac1027a0 0x7f25ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b40a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac106f20 0x7f25ac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b40a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac1120f0 con 0x7f25ac106f20 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b40a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac111f70 con 0x7f25ac1027a0 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b40a5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac112270 con 0x7f25ac101df0 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b2642640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac106f20 0x7f25ac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b1640640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac1027a0 0x7f25ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b2642640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac106f20 0x7f25ac074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34086/0 (socket says 172.21.15.60:34086) 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b2642640 1 -- 172.21.15.60:0/3253749911 learned_addr learned my addr 172.21.15.60:0/3253749911 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.701+0000 7f25b1e41640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac101df0 0x7f25ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b2642640 1 -- 172.21.15.60:0/3253749911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac101df0 msgr2=0x7f25ac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b2642640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac101df0 0x7f25ac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b2642640 1 -- 172.21.15.60:0/3253749911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac1027a0 msgr2=0x7f25ac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b2642640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac1027a0 0x7f25ac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b2642640 1 -- 172.21.15.60:0/3253749911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac1a6a10 con 0x7f25ac106f20 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b1640640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac1027a0 0x7f25ac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b2642640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac106f20 0x7f25ac074f70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25a400eb10 tx=0x7f25a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25a2ffd640 1 -- 172.21.15.60:0/3253749911 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a4004b20 con 0x7f25ac106f20 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25a2ffd640 1 -- 172.21.15.60:0/3253749911 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25a4004cc0 con 0x7f25ac106f20 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25a2ffd640 1 -- 172.21.15.60:0/3253749911 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a40107f0 con 0x7f25ac106f20 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac1a6d00 con 0x7f25ac106f20 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.702+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac1a7210 con 0x7f25ac106f20 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.703+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ac1021d0 con 0x7f25ac106f20 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.704+0000 7f25a2ffd640 1 -- 172.21.15.60:0/3253749911 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f25a4010990 con 0x7f25ac106f20 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.705+0000 7f25a2ffd640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f25980a2c00 0x7f25980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.705+0000 7f25b1e41640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f25980a2c00 0x7f25980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.705+0000 7f25a2ffd640 1 -- 172.21.15.60:0/3253749911 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f25a40cf220 con 0x7f25ac106f20 2024-09-11T23:57:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.706+0000 7f25b1e41640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f25980a2c00 0x7f25980a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25a8005fd0 tx=0x7f25a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.708+0000 7f25a2ffd640 1 -- 172.21.15.60:0/3253749911 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25a40541b0 con 0x7f25ac106f20 2024-09-11T23:57:05.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.923+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25ac02d7c0 con 0x7f25ac106f20 2024-09-11T23:57:05.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.924+0000 7f25a2ffd640 1 -- 172.21.15.60:0/3253749911 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f25a409c620 con 0x7f25ac106f20 2024-09-11T23:57:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:05.923 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":8,"btime":"2024-09-11T23:57:04:094907+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T23:57:05.924 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 8 2024-09-11T23:57:05.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.926+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f25980a2c00 msgr2=0x7f25980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.926+0000 7f25b40a5640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f25980a2c00 0x7f25980a50c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25a8005fd0 tx=0x7f25a800b390 comp rx=0 tx=0).stop 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.926+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac106f20 msgr2=0x7f25ac074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.926+0000 7f25b40a5640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac106f20 0x7f25ac074f70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25a400eb10 tx=0x7f25a400c2d0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.926+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 shutdown_connections 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.926+0000 7f25b40a5640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f25980a2c00 0x7f25980a50c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.926+0000 7f25b40a5640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25ac106f20 0x7f25ac074f70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.927+0000 7f25b40a5640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac1027a0 0x7f25ac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.927+0000 7f25b40a5640 1 --2- 172.21.15.60:0/3253749911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac101df0 0x7f25ac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.927+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 >> 172.21.15.60:0/3253749911 conn(0x7f25ac0fd8f0 msgr2=0x7f25ac0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.927+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 shutdown_connections 2024-09-11T23:57:05.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:05.927+0000 7f25b40a5640 1 -- 172.21.15.60:0/3253749911 wait complete. 2024-09-11T23:57:06.695 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 11 23:57:06 smithi105 systemd[1]: Started Ceph mds.h for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:57:06.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:06 smithi060 ceph-mon[30953]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:06.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:06 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3253749911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:06.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:06 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:06.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:06 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:06.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:06 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:06.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:06 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:06.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:06 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:06.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:06 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:06.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:06 smithi105 ceph-mon[34805]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:06.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:06 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3253749911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:06.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:06 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:06.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:06 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:06.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:06 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:06.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:06 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:06.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:06 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:06.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:06 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:07.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:06 smithi192 ceph-mon[35487]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:07.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:06 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3253749911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:07.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:06 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:07.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:06 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:07.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:06 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:07.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:06 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:07.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:06 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:07.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:06 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:07.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:07 smithi105 ceph-mon[34805]: Deploying daemon mds.i on smithi192 2024-09-11T23:57:07.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:07 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] up:boot 2024-09-11T23:57:07.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:07 smithi105 ceph-mon[34805]: fsmap 8 up:standby 2024-09-11T23:57:07.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:07 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:57:08.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:07 smithi192 ceph-mon[35487]: Deploying daemon mds.i on smithi192 2024-09-11T23:57:08.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:07 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] up:boot 2024-09-11T23:57:08.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:07 smithi192 ceph-mon[35487]: fsmap 8 up:standby 2024-09-11T23:57:08.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:07 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:57:08.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:07 smithi060 ceph-mon[30953]: Deploying daemon mds.i on smithi192 2024-09-11T23:57:08.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:07 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] up:boot 2024-09-11T23:57:08.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:07 smithi060 ceph-mon[30953]: fsmap 8 up:standby 2024-09-11T23:57:08.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:07 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:57:08.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:08.708 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:08 smithi192 podman[65940]: 2024-09-11 23:57:08.655168836 +0000 UTC m=+0.139449970 container create 309f4e53aaf6c88645c820ef8cb0f9e525cba7c925269b7795c20a51f2f0a10b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-11T23:57:08.845 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:08.966 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:08 smithi060 ceph-mon[30953]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:08.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:08 smithi105 ceph-mon[34805]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:09.024 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:08 smithi192 ceph-mon[35487]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:09.024 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:08 smithi192 podman[65940]: 2024-09-11 23:57:08.92481874 +0000 UTC m=+0.409099868 container init 309f4e53aaf6c88645c820ef8cb0f9e525cba7c925269b7795c20a51f2f0a10b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-11T23:57:09.024 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:08 smithi192 podman[65940]: 2024-09-11 23:57:08.927703488 +0000 UTC m=+0.411984619 container start 309f4e53aaf6c88645c820ef8cb0f9e525cba7c925269b7795c20a51f2f0a10b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-11T23:57:09.024 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:08 smithi192 ceph-mds[65959]: -- 172.21.15.192:0/2243812071 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562732d05860 con 0x562732ce3400 2024-09-11T23:57:09.025 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: starting mds.i at 2024-09-11T23:57:09.284 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:09 smithi192 bash[65940]: 309f4e53aaf6c88645c820ef8cb0f9e525cba7c925269b7795c20a51f2f0a10b 2024-09-11T23:57:09.284 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:09 smithi192 systemd[1]: Started Ceph mds.i for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3863563509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5810e4d0 msgr2=0x7f6b581108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3863563509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5810e4d0 0x7f6b581108e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009ca0 tx=0x7f6b5002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3863563509 shutdown_connections 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3863563509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5810e4d0 0x7f6b581108e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3863563509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b58101360 0x7f6b5810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3863563509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b581009b0 0x7f6b58100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3863563509 >> 172.21.15.60:0/3863563509 conn(0x7f6b580fc7d0 msgr2=0x7f6b580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3863563509 shutdown_connections 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3863563509 wait complete. 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.341+0000 7f6b5d55f640 1 Processor -- start 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b5d55f640 1 -- start start 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b5d55f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b581009b0 0x7f6b5819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b5d55f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b58101360 0x7f6b5819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b5d55f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5810e4d0 0x7f6b5819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b5d55f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58114360 con 0x7f6b58101360 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b5d55f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581141e0 con 0x7f6b581009b0 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b5d55f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581144e0 con 0x7f6b5810e4d0 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b58101360 0x7f6b5819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b58101360 0x7f6b5819ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34108/0 (socket says 172.21.15.60:34108) 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b567fc640 1 -- 172.21.15.60:0/3661112431 learned_addr learned my addr 172.21.15.60:0/3661112431 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b577fe640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5810e4d0 0x7f6b5819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b56ffd640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b581009b0 0x7f6b5819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b567fc640 1 -- 172.21.15.60:0/3661112431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5810e4d0 msgr2=0x7f6b5819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b567fc640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5810e4d0 0x7f6b5819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b567fc640 1 -- 172.21.15.60:0/3661112431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b581009b0 msgr2=0x7f6b5819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b567fc640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b581009b0 0x7f6b5819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.342+0000 7f6b567fc640 1 -- 172.21.15.60:0/3661112431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5819f6d0 con 0x7f6b58101360 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.343+0000 7f6b567fc640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b58101360 0x7f6b5819ac60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c920 tx=0x7f6b4c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.343+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3661112431 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c007c70 con 0x7f6b58101360 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.343+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3661112431 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b4c007e10 con 0x7f6b58101360 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.343+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5819f9c0 con 0x7f6b58101360 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.343+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3661112431 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c018940 con 0x7f6b58101360 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.343+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b581a72a0 con 0x7f6b58101360 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.344+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b58100d90 con 0x7f6b58101360 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.345+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3661112431 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6b4c018b20 con 0x7f6b58101360 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.346+0000 7f6b3ffff640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b400a2b80 0x7f6b400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:09.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.346+0000 7f6b56ffd640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b400a2b80 0x7f6b400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.346+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3661112431 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f6b4c0ceca0 con 0x7f6b58101360 2024-09-11T23:57:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.346+0000 7f6b56ffd640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b400a2b80 0x7f6b400a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b48005fd0 tx=0x7f6b48005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:09.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.350+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3661112431 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b4c014030 con 0x7f6b58101360 2024-09-11T23:57:09.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.569+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b581a74a0 con 0x7f6b58101360 2024-09-11T23:57:09.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.570+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3661112431 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f6b4c09c0a0 con 0x7f6b58101360 2024-09-11T23:57:09.569 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:09.570 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":9,"btime":"2024-09-11T23:57:06:695546+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-11T23:57:09.570 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 9 2024-09-11T23:57:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b400a2b80 msgr2=0x7f6b400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b400a2b80 0x7f6b400a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b48005fd0 tx=0x7f6b48005850 comp rx=0 tx=0).stop 2024-09-11T23:57:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b58101360 msgr2=0x7f6b5819ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b58101360 0x7f6b5819ac60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c920 tx=0x7f6b4c00cde0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 shutdown_connections 2024-09-11T23:57:09.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b5810e4d0 0x7f6b5819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b400a2b80 0x7f6b400a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b58101360 0x7f6b5819ac60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 --2- 172.21.15.60:0/3661112431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b581009b0 0x7f6b5819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:09.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 >> 172.21.15.60:0/3661112431 conn(0x7f6b580fc7d0 msgr2=0x7f6b580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:09.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 shutdown_connections 2024-09-11T23:57:09.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:09.572+0000 7f6b5d55f640 1 -- 172.21.15.60:0/3661112431 wait complete. 2024-09-11T23:57:10.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:10.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:10.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:10.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: Deploying daemon mds.g on smithi060 2024-09-11T23:57:10.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3661112431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:10.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] up:boot 2024-09-11T23:57:10.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: fsmap 9 up:standby 2024-09-11T23:57:10.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:10 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:57:10.304 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.305 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.305 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.305 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:10.305 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:10.305 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:10.305 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: Deploying daemon mds.g on smithi060 2024-09-11T23:57:10.306 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3661112431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:10.306 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] up:boot 2024-09-11T23:57:10.306 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: fsmap 9 up:standby 2024-09-11T23:57:10.306 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:10 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:57:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: Deploying daemon mds.g on smithi060 2024-09-11T23:57:10.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3661112431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:10.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] up:boot 2024-09-11T23:57:10.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: fsmap 9 up:standby 2024-09-11T23:57:10.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:10 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:57:11.227 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:11 smithi060 ceph-mon[30953]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:11 smithi105 ceph-mon[34805]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:11.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:11 smithi192 ceph-mon[35487]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:11.839 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:11 smithi060 systemd[1]: Starting Ceph mds.g for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:57:12.207 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:11 smithi060 podman[71598]: 2024-09-11 23:57:11.828899699 +0000 UTC m=+0.016330262 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:57:12.207 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:11 smithi060 podman[71598]: 2024-09-11 23:57:11.955762763 +0000 UTC m=+0.143193360 container create 7020f48b604159d92bb2c564f04aad885420d6a8fe3b7806a5124408e53638d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T23:57:12.207 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:12 smithi060 podman[71598]: 2024-09-11 23:57:12.208589519 +0000 UTC m=+0.396020074 container init 7020f48b604159d92bb2c564f04aad885420d6a8fe3b7806a5124408e53638d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-11T23:57:12.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:12.589 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:12 smithi060 podman[71598]: 2024-09-11 23:57:12.211510086 +0000 UTC m=+0.398940641 container start 7020f48b604159d92bb2c564f04aad885420d6a8fe3b7806a5124408e53638d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:57:12.589 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:12 smithi060 ceph-mds[71617]: -- 172.21.15.60:0/662240141 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578b6013860 con 0x5578b5ff0800 2024-09-11T23:57:12.589 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g[71613]: starting mds.g at 2024-09-11T23:57:12.589 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:12 smithi060 bash[71598]: 7020f48b604159d92bb2c564f04aad885420d6a8fe3b7806a5124408e53638d4 2024-09-11T23:57:12.589 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 11 23:57:12 smithi060 systemd[1]: Started Ceph mds.g for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:57:12.609 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.306+0000 7f7082cee640 1 -- 172.21.15.60:0/3824715397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 msgr2=0x7f707c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.306+0000 7f7082cee640 1 --2- 172.21.15.60:0/3824715397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 0x7f707c103120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7070009900 tx=0x7f707002a480 comp rx=0 tx=0).stop 2024-09-11T23:57:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 -- 172.21.15.60:0/3824715397 shutdown_connections 2024-09-11T23:57:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 --2- 172.21.15.60:0/3824715397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f707c10c170 0x7f707c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 --2- 172.21.15.60:0/3824715397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c103660 0x7f707c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 --2- 172.21.15.60:0/3824715397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 0x7f707c103120 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 -- 172.21.15.60:0/3824715397 >> 172.21.15.60:0/3824715397 conn(0x7f707c0fc7a0 msgr2=0x7f707c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 -- 172.21.15.60:0/3824715397 shutdown_connections 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 -- 172.21.15.60:0/3824715397 wait complete. 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 Processor -- start 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.307+0000 7f7082cee640 1 -- start start 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7082cee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 0x7f707c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7082cee640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f707c103660 0x7f707c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7082cee640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c10c170 0x7f707c19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7082cee640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f707c112170 con 0x7f707c102d40 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7082cee640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f707c111ff0 con 0x7f707c103660 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7082cee640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f707c1122f0 con 0x7f707c10c170 2024-09-11T23:57:13.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 0x7f707c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 0x7f707c198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37772/0 (socket says 172.21.15.60:37772) 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 -- 172.21.15.60:0/3619240432 learned_addr learned my addr 172.21.15.60:0/3619240432 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f707bfff640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f707c103660 0x7f707c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f708128b640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c10c170 0x7f707c19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 -- 172.21.15.60:0/3619240432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c10c170 msgr2=0x7f707c19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c10c170 0x7f707c19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 -- 172.21.15.60:0/3619240432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f707c103660 msgr2=0x7f707c198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f707c103660 0x7f707c198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 -- 172.21.15.60:0/3619240432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c19d600 con 0x7f707c102d40 2024-09-11T23:57:13.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f707bfff640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f707c103660 0x7f707c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:13.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f708128b640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c10c170 0x7f707c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:13.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.308+0000 7f7080a8a640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 0x7f707c198650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7070006010 tx=0x7f70700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:13.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.309+0000 7f7079ffb640 1 -- 172.21.15.60:0/3619240432 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707003f030 con 0x7f707c102d40 2024-09-11T23:57:13.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.309+0000 7f7079ffb640 1 -- 172.21.15.60:0/3619240432 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7070003d00 con 0x7f707c102d40 2024-09-11T23:57:13.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.309+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707c19d890 con 0x7f707c102d40 2024-09-11T23:57:13.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.309+0000 7f7079ffb640 1 -- 172.21.15.60:0/3619240432 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070035070 con 0x7f707c102d40 2024-09-11T23:57:13.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.309+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707c1a51d0 con 0x7f707c102d40 2024-09-11T23:57:13.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.310+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f707c1031a0 con 0x7f707c102d40 2024-09-11T23:57:13.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.312+0000 7f7079ffb640 1 -- 172.21.15.60:0/3619240432 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7070042030 con 0x7f707c102d40 2024-09-11T23:57:13.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.312+0000 7f7079ffb640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f706c0a2b80 0x7f706c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:13.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.313+0000 7f707bfff640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f706c0a2b80 0x7f706c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:13.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.313+0000 7f7079ffb640 1 -- 172.21.15.60:0/3619240432 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f70700ef810 con 0x7f707c102d40 2024-09-11T23:57:13.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.313+0000 7f707bfff640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f706c0a2b80 0x7f706c0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f707c0fed30 tx=0x7f7068008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:13.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.316+0000 7f7079ffb640 1 -- 172.21.15.60:0/3619240432 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70700bcc10 con 0x7f707c102d40 2024-09-11T23:57:13.398 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:13 smithi060 ceph-mon[30953]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:13.399 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.399 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.399 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.399 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:13.399 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:13.399 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:13 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:13 smithi105 ceph-mon[34805]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:13.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:13.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:13 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:13 smithi192 ceph-mon[35487]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:13 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:13.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.535+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f707c1071e0 con 0x7f707c102d40 2024-09-11T23:57:13.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.536+0000 7f7079ffb640 1 -- 172.21.15.60:0/3619240432 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8872 (secure 0 0 0) 0x7f70700bc510 con 0x7f707c102d40 2024-09-11T23:57:13.535 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:13.536 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"btime":"2024-09-11T23:57:13:091675+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:57:13.536 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2024-09-11T23:57:13.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f706c0a2b80 msgr2=0x7f706c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:13.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f706c0a2b80 0x7f706c0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f707c0fed30 tx=0x7f7068008040 comp rx=0 tx=0).stop 2024-09-11T23:57:13.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 msgr2=0x7f707c198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:13.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 0x7f707c198650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7070006010 tx=0x7f70700042f0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 shutdown_connections 2024-09-11T23:57:13.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f707c10c170 0x7f707c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f707c103660 0x7f707c198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f706c0a2b80 0x7f706c0a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.538+0000 7f7082cee640 1 --2- 172.21.15.60:0/3619240432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c102d40 0x7f707c198650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:13.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.539+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 >> 172.21.15.60:0/3619240432 conn(0x7f707c0fc7a0 msgr2=0x7f707c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:13.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.539+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 shutdown_connections 2024-09-11T23:57:13.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:13.539+0000 7f7082cee640 1 -- 172.21.15.60:0/3619240432 wait complete. 2024-09-11T23:57:14.280 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:14 smithi060 ceph-mon[30953]: Deploying daemon mds.a on smithi060 2024-09-11T23:57:14.280 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.60:6838/4061424559,v1:172.21.15.60:6839/4061424559] up:boot 2024-09-11T23:57:14.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:14 smithi060 ceph-mon[30953]: fsmap 10 up:standby 2024-09-11T23:57:14.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:14 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:57:14.281 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:14 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3619240432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:14.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:14 smithi105 ceph-mon[34805]: Deploying daemon mds.a on smithi060 2024-09-11T23:57:14.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.60:6838/4061424559,v1:172.21.15.60:6839/4061424559] up:boot 2024-09-11T23:57:14.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:14 smithi105 ceph-mon[34805]: fsmap 10 up:standby 2024-09-11T23:57:14.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:14 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:57:14.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:14 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3619240432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:14.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:14 smithi192 ceph-mon[35487]: Deploying daemon mds.a on smithi060 2024-09-11T23:57:14.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.60:6838/4061424559,v1:172.21.15.60:6839/4061424559] up:boot 2024-09-11T23:57:14.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:14 smithi192 ceph-mon[35487]: fsmap 10 up:standby 2024-09-11T23:57:14.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:14 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:57:14.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:14 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3619240432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:15.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:15 smithi060 ceph-mon[30953]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:15.339 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 systemd[1]: Starting Ceph mds.a for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:57:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:15 smithi105 ceph-mon[34805]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:15.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:15 smithi192 ceph-mon[35487]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:15.707 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 podman[72012]: 2024-09-11 23:57:15.358310106 +0000 UTC m=+0.016760506 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:57:15.708 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 podman[72012]: 2024-09-11 23:57:15.47960814 +0000 UTC m=+0.138058530 container create 1492d6ffa433f53fc09dc28c05b5ea2fef4ba82b4fda5859ada28810274a776e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T23:57:15.708 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 podman[72012]: 2024-09-11 23:57:15.682432301 +0000 UTC m=+0.340882694 container init 1492d6ffa433f53fc09dc28c05b5ea2fef4ba82b4fda5859ada28810274a776e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-11T23:57:15.708 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 podman[72012]: 2024-09-11 23:57:15.685259178 +0000 UTC m=+0.343709571 container start 1492d6ffa433f53fc09dc28c05b5ea2fef4ba82b4fda5859ada28810274a776e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-11T23:57:16.089 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 ceph-mds[72031]: -- 172.21.15.60:0/2662587933 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559416ee7860 con 0x559416ec5000 2024-09-11T23:57:16.089 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a[72027]: starting mds.a at 2024-09-11T23:57:16.089 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 bash[72012]: 1492d6ffa433f53fc09dc28c05b5ea2fef4ba82b4fda5859ada28810274a776e 2024-09-11T23:57:16.089 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 11 23:57:15 smithi060 systemd[1]: Started Ceph mds.a for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:57:16.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:16.580 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:16.945 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:16.945 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:16.945 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:16.945 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:16.945 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:16.945 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:16.945 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:16.946 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: Deploying daemon mds.b on smithi105 2024-09-11T23:57:16.946 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.60:6840/1402291177,v1:172.21.15.60:6841/1402291177] up:boot 2024-09-11T23:57:16.946 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: fsmap 11 up:standby 2024-09-11T23:57:16.946 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:16 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:57:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 -- 172.21.15.60:0/2891122413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108102790 msgr2=0x7f51081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 --2- 172.21.15.60:0/2891122413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108102790 0x7f51081067e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009900 tx=0x7f50f802a410 comp rx=0 tx=0).stop 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 -- 172.21.15.60:0/2891122413 shutdown_connections 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 --2- 172.21.15.60:0/2891122413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5108106f10 0x7f510810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 --2- 172.21.15.60:0/2891122413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108102790 0x7f51081067e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 --2- 172.21.15.60:0/2891122413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5108101de0 0x7f51081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 -- 172.21.15.60:0/2891122413 >> 172.21.15.60:0/2891122413 conn(0x7f51080fd8c0 msgr2=0x7f51080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 -- 172.21.15.60:0/2891122413 shutdown_connections 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 -- 172.21.15.60:0/2891122413 wait complete. 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 Processor -- start 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.029+0000 7f510f26f640 1 -- start start 2024-09-11T23:57:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510f26f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5108101de0 0x7f5108198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510f26f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5108102790 0x7f5108198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510f26f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108106f10 0x7f510819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510f26f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5108112090 con 0x7f5108106f10 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510f26f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5108111f10 con 0x7f5108102790 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510f26f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5108112210 con 0x7f5108101de0 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108106f10 0x7f510819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108106f10 0x7f510819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37818/0 (socket says 172.21.15.60:37818) 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 -- 172.21.15.60:0/623761893 learned_addr learned my addr 172.21.15.60:0/623761893 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510c80a640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5108102790 0x7f5108198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 -- 172.21.15.60:0/623761893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5108101de0 msgr2=0x7f5108198510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5108101de0 0x7f5108198510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 -- 172.21.15.60:0/623761893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5108102790 msgr2=0x7f5108198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5108102790 0x7f5108198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 -- 172.21.15.60:0/623761893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510819d4c0 con 0x7f5108106f10 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510d80c640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108106f10 0x7f510819cde0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5100009fd0 tx=0x7f510000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f50fe7fc640 1 -- 172.21.15.60:0/623761893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100017070 con 0x7f5108106f10 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510819d7b0 con 0x7f5108106f10 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f50fe7fc640 1 -- 172.21.15.60:0/623761893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5100004020 con 0x7f5108106f10 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f50fe7fc640 1 -- 172.21.15.60:0/623761893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51000106c0 con 0x7f5108106f10 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.030+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51081a5090 con 0x7f5108106f10 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.031+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51081021c0 con 0x7f5108106f10 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.033+0000 7f50fe7fc640 1 -- 172.21.15.60:0/623761893 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f51000041d0 con 0x7f5108106f10 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.033+0000 7f50fe7fc640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50f40a2b80 0x7f50f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.034+0000 7f510d00b640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50f40a2b80 0x7f50f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.034+0000 7f50fe7fc640 1 -- 172.21.15.60:0/623761893 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f51000ce8e0 con 0x7f5108106f10 2024-09-11T23:57:17.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.034+0000 7f510d00b640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50f40a2b80 0x7f50f40a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f510400b990 tx=0x7f510400b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:17.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.037+0000 7f50fe7fc640 1 -- 172.21.15.60:0/623761893 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f510009bce0 con 0x7f5108106f10 2024-09-11T23:57:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:17.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: Deploying daemon mds.b on smithi105 2024-09-11T23:57:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.60:6840/1402291177,v1:172.21.15.60:6841/1402291177] up:boot 2024-09-11T23:57:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: fsmap 11 up:standby 2024-09-11T23:57:17.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:16 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:57:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.247+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f510810a150 con 0x7f5108106f10 2024-09-11T23:57:17.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.247+0000 7f50fe7fc640 1 -- 172.21.15.60:0/623761893 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7f510009b5e0 con 0x7f5108106f10 2024-09-11T23:57:17.247 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:17.247 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":12,"btime":"2024-09-11T23:57:16:103661+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:57:17.247 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 12 2024-09-11T23:57:17.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.250+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50f40a2b80 msgr2=0x7f50f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.250+0000 7f510f26f640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50f40a2b80 0x7f50f40a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f510400b990 tx=0x7f510400b370 comp rx=0 tx=0).stop 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.250+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108106f10 msgr2=0x7f510819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.250+0000 7f510f26f640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108106f10 0x7f510819cde0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5100009fd0 tx=0x7f510000b260 comp rx=0 tx=0).stop 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.250+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 shutdown_connections 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.250+0000 7f510f26f640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50f40a2b80 0x7f50f40a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.251+0000 7f510f26f640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5108106f10 0x7f510819cde0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.251+0000 7f510f26f640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5108102790 0x7f5108198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.251+0000 7f510f26f640 1 --2- 172.21.15.60:0/623761893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5108101de0 0x7f5108198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.251+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 >> 172.21.15.60:0/623761893 conn(0x7f51080fd8c0 msgr2=0x7f51080febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.251+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 shutdown_connections 2024-09-11T23:57:17.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:17.251+0000 7f510f26f640 1 -- 172.21.15.60:0/623761893 wait complete. 2024-09-11T23:57:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-11T23:57:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T23:57:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: Deploying daemon mds.b on smithi105 2024-09-11T23:57:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.60:6840/1402291177,v1:172.21.15.60:6841/1402291177] up:boot 2024-09-11T23:57:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: fsmap 11 up:standby 2024-09-11T23:57:17.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:16 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:57:18.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:17 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/623761893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:18.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:17 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/623761893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:18.295 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:17 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/623761893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:18.295 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:17 smithi105 systemd[1]: Starting Ceph mds.b for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-11T23:57:18.478 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:18 smithi105 podman[65249]: 2024-09-11 23:57:18.081632556 +0000 UTC m=+0.016163287 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-11T23:57:18.478 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:18 smithi105 podman[65249]: 2024-09-11 23:57:18.224068701 +0000 UTC m=+0.158599428 container create d5501e64e6b737823c56496fe0048149a35b2025037b37ce353e19646bad080c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T23:57:18.478 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:18 smithi105 podman[65249]: 2024-09-11 23:57:18.479406884 +0000 UTC m=+0.413937610 container init d5501e64e6b737823c56496fe0048149a35b2025037b37ce353e19646bad080c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-11T23:57:18.729 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:18 smithi105 podman[65249]: 2024-09-11 23:57:18.482308403 +0000 UTC m=+0.416839138 container start d5501e64e6b737823c56496fe0048149a35b2025037b37ce353e19646bad080c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T23:57:18.729 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-mds[65268]: -- 172.21.15.105:0/1199290089 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56259484bc20 con 0x562594828800 2024-09-11T23:57:18.729 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b[65264]: starting mds.b at 2024-09-11T23:57:18.730 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:18 smithi105 bash[65249]: d5501e64e6b737823c56496fe0048149a35b2025037b37ce353e19646bad080c 2024-09-11T23:57:18.730 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 11 23:57:18 smithi105 systemd[1]: Started Ceph mds.b for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-11T23:57:19.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:18 smithi060 ceph-mon[30953]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:19.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:18 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:19.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-mon[34805]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:19.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:18 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:18 smithi192 ceph-mon[35487]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:18 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:19.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:19.884 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:19 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] up:boot 2024-09-11T23:57:19.884 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:19 smithi060 ceph-mon[30953]: fsmap 12 up:standby 2024-09-11T23:57:19.884 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:19 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:57:19.884 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:19 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:20.131 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:20.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:19 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] up:boot 2024-09-11T23:57:20.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:19 smithi105 ceph-mon[34805]: fsmap 12 up:standby 2024-09-11T23:57:20.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:19 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:57:20.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:19 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:19 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] up:boot 2024-09-11T23:57:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:19 smithi192 ceph-mon[35487]: fsmap 12 up:standby 2024-09-11T23:57:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:19 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:57:20.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:19 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:20.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.560+0000 7fb17b7f1640 1 -- 172.21.15.60:0/3678000517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1741008e0 msgr2=0x7fb174100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:20.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.560+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/3678000517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1741008e0 0x7fb174100cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb170009930 tx=0x7fb17002a420 comp rx=0 tx=0).stop 2024-09-11T23:57:20.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.560+0000 7fb17b7f1640 1 -- 172.21.15.60:0/3678000517 shutdown_connections 2024-09-11T23:57:20.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.560+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/3678000517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb174108160 0x7fb17410eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.560+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/3678000517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb174101290 0x7fb174107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.560+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/3678000517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1741008e0 0x7fb174100cc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.560+0000 7fb17b7f1640 1 -- 172.21.15.60:0/3678000517 >> 172.21.15.60:0/3678000517 conn(0x7fb174077210 msgr2=0x7fb174077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:20.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.561+0000 7fb17b7f1640 1 -- 172.21.15.60:0/3678000517 shutdown_connections 2024-09-11T23:57:20.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.561+0000 7fb17b7f1640 1 -- 172.21.15.60:0/3678000517 wait complete. 2024-09-11T23:57:20.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.561+0000 7fb17b7f1640 1 Processor -- start 2024-09-11T23:57:20.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.561+0000 7fb17b7f1640 1 -- start start 2024-09-11T23:57:20.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb17b7f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1741008e0 0x7fb1741985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:20.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb17b7f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb174101290 0x7fb174198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:20.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb17b7f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb174108160 0x7fb17419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:20.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb17b7f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb174112110 con 0x7fb174101290 2024-09-11T23:57:20.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb17b7f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb174111f90 con 0x7fb174108160 2024-09-11T23:57:20.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb17b7f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb174112290 con 0x7fb1741008e0 2024-09-11T23:57:20.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb174101290 0x7fb174198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:20.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb174101290 0x7fb174198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37830/0 (socket says 172.21.15.60:37830) 2024-09-11T23:57:20.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb179d8e640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb174108160 0x7fb17419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 -- 172.21.15.60:0/2893098469 learned_addr learned my addr 172.21.15.60:0/2893098469 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb17958d640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1741008e0 0x7fb1741985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 -- 172.21.15.60:0/2893098469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1741008e0 msgr2=0x7fb1741985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1741008e0 0x7fb1741985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 -- 172.21.15.60:0/2893098469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb174108160 msgr2=0x7fb17419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb174108160 0x7fb17419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 -- 172.21.15.60:0/2893098469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17419d570 con 0x7fb174101290 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb179d8e640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb174108160 0x7fb17419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:57:20.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.562+0000 7fb178d8c640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb174101290 0x7fb174198b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb16400e9c0 tx=0x7fb16400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:20.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.563+0000 7fb16a7fc640 1 -- 172.21.15.60:0/2893098469 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16400ccc0 con 0x7fb174101290 2024-09-11T23:57:20.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.563+0000 7fb16a7fc640 1 -- 172.21.15.60:0/2893098469 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb164005520 con 0x7fb174101290 2024-09-11T23:57:20.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.563+0000 7fb16a7fc640 1 -- 172.21.15.60:0/2893098469 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164010690 con 0x7fb174101290 2024-09-11T23:57:20.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.563+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17419d860 con 0x7fb174101290 2024-09-11T23:57:20.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.563+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1741a5140 con 0x7fb174101290 2024-09-11T23:57:20.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.564+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb174100cc0 con 0x7fb174101290 2024-09-11T23:57:20.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.565+0000 7fb16a7fc640 1 -- 172.21.15.60:0/2893098469 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb1640046c0 con 0x7fb174101290 2024-09-11T23:57:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.566+0000 7fb16a7fc640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb1600a2c00 0x7fb1600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.566+0000 7fb16a7fc640 1 -- 172.21.15.60:0/2893098469 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb1640cedd0 con 0x7fb174101290 2024-09-11T23:57:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.566+0000 7fb17958d640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb1600a2c00 0x7fb1600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.566+0000 7fb17958d640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb1600a2c00 0x7fb1600a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb170009900 tx=0x7fb1700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.570+0000 7fb16a7fc640 1 -- 172.21.15.60:0/2893098469 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb16409c1d0 con 0x7fb174101290 2024-09-11T23:57:20.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.785+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb17402d7c0 con 0x7fb174101290 2024-09-11T23:57:20.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.786+0000 7fb16a7fc640 1 -- 172.21.15.60:0/2893098469 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7fb16409bad0 con 0x7fb174101290 2024-09-11T23:57:20.785 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:20.785 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":13,"btime":"2024-09-11T23:57:18:837159+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-11T23:57:20.785 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 13 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb1600a2c00 msgr2=0x7fb1600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb1600a2c00 0x7fb1600a50c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb170009900 tx=0x7fb1700058d0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb174101290 msgr2=0x7fb174198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb174101290 0x7fb174198b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb16400e9c0 tx=0x7fb16400ee80 comp rx=0 tx=0).stop 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 shutdown_connections 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb174108160 0x7fb17419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb1600a2c00 0x7fb1600a50c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb174101290 0x7fb174198b00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 --2- 172.21.15.60:0/2893098469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1741008e0 0x7fb1741985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:20.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 >> 172.21.15.60:0/2893098469 conn(0x7fb174077210 msgr2=0x7fb1740ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:20.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 shutdown_connections 2024-09-11T23:57:20.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:20.788+0000 7fb17b7f1640 1 -- 172.21.15.60:0/2893098469 wait complete. 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:21.422 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:21.423 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.423 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:21.423 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:21 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2893098469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:21.450 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T23:57:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2893098469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:21.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:21.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.525 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:21.526 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:21.526 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:21.526 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:57:21.526 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:21 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2893098469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:22.395 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.979+0000 7f611a445640 1 -- 172.21.15.60:0/2781196600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114102790 msgr2=0x7f61141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.979+0000 7f611a445640 1 --2- 172.21.15.60:0/2781196600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114102790 0x7f61141067e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6108009900 tx=0x7f610802a410 comp rx=0 tx=0).stop 2024-09-11T23:57:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 -- 172.21.15.60:0/2781196600 shutdown_connections 2024-09-11T23:57:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 --2- 172.21.15.60:0/2781196600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6114106f10 0x7f611410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 --2- 172.21.15.60:0/2781196600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114102790 0x7f61141067e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 --2- 172.21.15.60:0/2781196600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114101de0 0x7f61141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 -- 172.21.15.60:0/2781196600 >> 172.21.15.60:0/2781196600 conn(0x7f61140fd8c0 msgr2=0x7f61140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 -- 172.21.15.60:0/2781196600 shutdown_connections 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 -- 172.21.15.60:0/2781196600 wait complete. 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 Processor -- start 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.980+0000 7f611a445640 1 -- start start 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f611a445640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114101de0 0x7f61141984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f611a445640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114102790 0x7f6114198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f611a445640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6114106f10 0x7f611419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f611a445640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61141120e0 con 0x7f6114101de0 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f611a445640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6114111f60 con 0x7f6114106f10 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f611a445640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6114112260 con 0x7f6114102790 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114101de0 0x7f61141984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114101de0 0x7f61141984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55752/0 (socket says 172.21.15.60:55752) 2024-09-11T23:57:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 -- 172.21.15.60:0/1496046887 learned_addr learned my addr 172.21.15.60:0/1496046887 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f61137fe640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114102790 0x7f6114198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f61189e2640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6114106f10 0x7f611419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 -- 172.21.15.60:0/1496046887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114102790 msgr2=0x7f6114198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114102790 0x7f6114198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 -- 172.21.15.60:0/1496046887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6114106f10 msgr2=0x7f611419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6114106f10 0x7f611419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 -- 172.21.15.60:0/1496046887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611419d470 con 0x7f6114101de0 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f6113fff640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114101de0 0x7f61141984c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f610400c890 tx=0x7f610400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f61117fa640 1 -- 172.21.15.60:0/1496046887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104004220 con 0x7f6114101de0 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f61117fa640 1 -- 172.21.15.60:0/1496046887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61040043c0 con 0x7f6114101de0 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611419d760 con 0x7f6114101de0 2024-09-11T23:57:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.981+0000 7f61117fa640 1 -- 172.21.15.60:0/1496046887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104004b10 con 0x7f6114101de0 2024-09-11T23:57:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.982+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61141a5040 con 0x7f6114101de0 2024-09-11T23:57:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.983+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61141021c0 con 0x7f6114101de0 2024-09-11T23:57:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.984+0000 7f61117fa640 1 -- 172.21.15.60:0/1496046887 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f61040051b0 con 0x7f6114101de0 2024-09-11T23:57:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.984+0000 7f61117fa640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f60fc0a2c00 0x7f60fc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.985+0000 7f61137fe640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f60fc0a2c00 0x7f60fc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.985+0000 7f61117fa640 1 -- 172.21.15.60:0/1496046887 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f61040ced20 con 0x7f6114101de0 2024-09-11T23:57:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.985+0000 7f61137fe640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f60fc0a2c00 0x7f60fc0a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6108000c00 tx=0x7f6108005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:22.988+0000 7f61117fa640 1 -- 172.21.15.60:0/1496046887 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6104014030 con 0x7f6114101de0 2024-09-11T23:57:23.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.172+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6114199820 con 0x7f6114101de0 2024-09-11T23:57:23.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.172+0000 7f61117fa640 1 -- 172.21.15.60:0/1496046887 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f6114199820 con 0x7f6114101de0 2024-09-11T23:57:23.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:23 smithi060 ceph-mon[30953]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:23.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.172 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:23 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.172 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:23.172 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-11T23:57:23.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-11T23:57:23.173 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-11T23:57:23.173 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-11T23:57:23.173 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-11T23:57:23.173 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-11T23:57:23.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f60fc0a2c00 msgr2=0x7f60fc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:23.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f60fc0a2c00 0x7f60fc0a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6108000c00 tx=0x7f6108005e80 comp rx=0 tx=0).stop 2024-09-11T23:57:23.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114101de0 msgr2=0x7f61141984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:23.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114101de0 0x7f61141984c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f610400c890 tx=0x7f610400cd50 comp rx=0 tx=0).stop 2024-09-11T23:57:23.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 shutdown_connections 2024-09-11T23:57:23.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6114106f10 0x7f611419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6114102790 0x7f6114198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f60fc0a2c00 0x7f60fc0a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 --2- 172.21.15.60:0/1496046887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6114101de0 0x7f61141984c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:23.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 >> 172.21.15.60:0/1496046887 conn(0x7f61140fd8c0 msgr2=0x7f61140fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:23.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 shutdown_connections 2024-09-11T23:57:23.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:23.176+0000 7f611a445640 1 -- 172.21.15.60:0/1496046887 wait complete. 2024-09-11T23:57:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:23 smithi105 ceph-mon[34805]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:23 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:23 smithi192 ceph-mon[35487]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:23 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:23.858 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:57:23.858 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:57:24.124 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:24.397 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:24 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1496046887' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:57:24.397 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.397 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.397 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:24.397 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:24.397 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:24 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1496046887' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:57:24.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:24.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:24.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:24 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1496046887' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-11T23:57:24.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:57:24.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:57:24.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:57:24.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 -- 172.21.15.60:0/4203990378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 msgr2=0x7ff4a010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:24.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/4203990378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 0x7ff4a010d950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff498009cd0 tx=0x7ff49802a8e0 comp rx=0 tx=0).stop 2024-09-11T23:57:24.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 -- 172.21.15.60:0/4203990378 shutdown_connections 2024-09-11T23:57:24.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/4203990378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 0x7ff4a010d950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:24.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/4203990378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a0100a80 0x7ff4a0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:24.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/4203990378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a0106a80 0x7ff4a0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:24.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 -- 172.21.15.60:0/4203990378 >> 172.21.15.60:0/4203990378 conn(0x7ff4a00fc7a0 msgr2=0x7ff4a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:24.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 -- 172.21.15.60:0/4203990378 shutdown_connections 2024-09-11T23:57:24.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.577+0000 7ff4a50b7640 1 -- 172.21.15.60:0/4203990378 wait complete. 2024-09-11T23:57:24.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff4a50b7640 1 Processor -- start 2024-09-11T23:57:24.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff4a50b7640 1 -- start start 2024-09-11T23:57:24.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff4a50b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a0100a80 0x7ff4a019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:24.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff4a50b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 0x7ff4a019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff4a50b7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a0106a80 0x7ff4a019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff4a50b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a0110fa0 con 0x7ff4a0101420 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff4a50b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a0110e20 con 0x7ff4a0100a80 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff4a50b7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a0111120 con 0x7ff4a0106a80 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff497fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 0x7ff4a019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff497fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 0x7ff4a019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55782/0 (socket says 172.21.15.60:55782) 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.578+0000 7ff497fff640 1 -- 172.21.15.60:0/3831695539 learned_addr learned my addr 172.21.15.60:0/3831695539 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff49f59e640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a0106a80 0x7ff4a019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff49ed9d640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a0100a80 0x7ff4a019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff497fff640 1 -- 172.21.15.60:0/3831695539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a0106a80 msgr2=0x7ff4a019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:24.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff497fff640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a0106a80 0x7ff4a019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff497fff640 1 -- 172.21.15.60:0/3831695539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a0100a80 msgr2=0x7ff4a019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff497fff640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a0100a80 0x7ff4a019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff497fff640 1 -- 172.21.15.60:0/3831695539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a019f610 con 0x7ff4a0101420 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff49ed9d640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a0100a80 0x7ff4a019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff497fff640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 0x7ff4a019aba0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff48800c920 tx=0x7ff48800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff49cd99640 1 -- 172.21.15.60:0/3831695539 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488007c70 con 0x7ff4a0101420 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a019f900 con 0x7ff4a0101420 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff49cd99640 1 -- 172.21.15.60:0/3831695539 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff488007e10 con 0x7ff4a0101420 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff49cd99640 1 -- 172.21.15.60:0/3831695539 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488018940 con 0x7ff4a0101420 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.579+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a01a71e0 con 0x7ff4a0101420 2024-09-11T23:57:24.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.580+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a0100ee0 con 0x7ff4a0101420 2024-09-11T23:57:24.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.581+0000 7ff49cd99640 1 -- 172.21.15.60:0/3831695539 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff488018be0 con 0x7ff4a0101420 2024-09-11T23:57:24.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.582+0000 7ff49cd99640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff48c0a2c00 0x7ff48c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:24.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.582+0000 7ff49ed9d640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff48c0a2c00 0x7ff48c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:24.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.582+0000 7ff49cd99640 1 -- 172.21.15.60:0/3831695539 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ff4880ced40 con 0x7ff4a0101420 2024-09-11T23:57:24.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.583+0000 7ff49ed9d640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff48c0a2c00 0x7ff48c0a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff490005fd0 tx=0x7ff490005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:24.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.586+0000 7ff49cd99640 1 -- 172.21.15.60:0/3831695539 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff488014030 con 0x7ff4a0101420 2024-09-11T23:57:24.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:24.762+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff4a01a7570 con 0x7ff4a0101420 2024-09-11T23:57:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.245+0000 7ff49cd99640 1 -- 172.21.15.60:0/3831695539 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7ff48809c140 con 0x7ff4a0101420 2024-09-11T23:57:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-11T23:57:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff48c0a2c00 msgr2=0x7ff48c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff48c0a2c00 0x7ff48c0a50c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff490005fd0 tx=0x7ff490005850 comp rx=0 tx=0).stop 2024-09-11T23:57:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 msgr2=0x7ff4a019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 0x7ff4a019aba0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff48800c920 tx=0x7ff48800cde0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 shutdown_connections 2024-09-11T23:57:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a0106a80 0x7ff4a019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff48c0a2c00 0x7ff48c0a50c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4a0101420 0x7ff4a019aba0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 --2- 172.21.15.60:0/3831695539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4a0100a80 0x7ff4a019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 >> 172.21.15.60:0/3831695539 conn(0x7ff4a00fc7a0 msgr2=0x7ff4a010c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 shutdown_connections 2024-09-11T23:57:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:25.248+0000 7ff4a50b7640 1 -- 172.21.15.60:0/3831695539 wait complete. 2024-09-11T23:57:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:25 smithi060 ceph-mon[30953]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:25 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3831695539' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:57:25.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:25 smithi105 ceph-mon[34805]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:25.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:25 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3831695539' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:57:25.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:25 smithi192 ceph-mon[35487]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:25.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:25 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3831695539' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-11T23:57:25.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:57:26.170 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:26.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:26 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3831695539' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:57:26.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:26 smithi192 ceph-mon[35487]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:57:26.549 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:26 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3831695539' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:57:26.549 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:26 smithi060 ceph-mon[30953]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:57:26.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:26 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3831695539' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T23:57:26.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:26 smithi105 ceph-mon[34805]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T23:57:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.779+0000 7f2a37fab640 1 -- 172.21.15.60:0/1876563740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 msgr2=0x7f2a30112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.779+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1876563740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 0x7f2a30112650 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009900 tx=0x7f2a2002a480 comp rx=0 tx=0).stop 2024-09-11T23:57:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 -- 172.21.15.60:0/1876563740 shutdown_connections 2024-09-11T23:57:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1876563740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a30112b90 0x7f2a30114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1876563740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 0x7f2a30112650 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1876563740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a30074590 0x7f2a30074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 -- 172.21.15.60:0/1876563740 >> 172.21.15.60:0/1876563740 conn(0x7f2a300fd8c0 msgr2=0x7f2a300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 -- 172.21.15.60:0/1876563740 shutdown_connections 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 -- 172.21.15.60:0/1876563740 wait complete. 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 Processor -- start 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 -- start start 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a30074590 0x7f2a301a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 0x7f2a301a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a30112b90 0x7f2a3019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a301186b0 con 0x7f2a30074eb0 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30118530 con 0x7f2a30112b90 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.780+0000 7f2a37fab640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a30118830 con 0x7f2a30074590 2024-09-11T23:57:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 0x7f2a301a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 0x7f2a301a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55806/0 (socket says 172.21.15.60:55806) 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 -- 172.21.15.60:0/1345637406 learned_addr learned my addr 172.21.15.60:0/1345637406 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a36548640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a30112b90 0x7f2a3019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35d47640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a30074590 0x7f2a301a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 -- 172.21.15.60:0/1345637406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a30074590 msgr2=0x7f2a301a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a30074590 0x7f2a301a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 -- 172.21.15.60:0/1345637406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a30112b90 msgr2=0x7f2a3019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a30112b90 0x7f2a3019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 -- 172.21.15.60:0/1345637406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3019f090 con 0x7f2a30074eb0 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a36548640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a30112b90 0x7f2a3019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:26.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35d47640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a30074590 0x7f2a301a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:26.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a35546640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 0x7f2a301a4ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a20006010 tx=0x7f2a200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:26.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a26ffd640 1 -- 172.21.15.60:0/1345637406 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2003f030 con 0x7f2a30074eb0 2024-09-11T23:57:26.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a26ffd640 1 -- 172.21.15.60:0/1345637406 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a20003d00 con 0x7f2a30074eb0 2024-09-11T23:57:26.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3019f320 con 0x7f2a30074eb0 2024-09-11T23:57:26.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a26ffd640 1 -- 172.21.15.60:0/1345637406 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a20035070 con 0x7f2a30074eb0 2024-09-11T23:57:26.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.781+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a301ab670 con 0x7f2a30074eb0 2024-09-11T23:57:26.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.782+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a30074970 con 0x7f2a30074eb0 2024-09-11T23:57:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.784+0000 7f2a26ffd640 1 -- 172.21.15.60:0/1345637406 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2a20042030 con 0x7f2a30074eb0 2024-09-11T23:57:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.784+0000 7f2a26ffd640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2a1c0a2b80 0x7f2a1c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.784+0000 7f2a26ffd640 1 -- 172.21.15.60:0/1345637406 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f2a200ef660 con 0x7f2a30074eb0 2024-09-11T23:57:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.784+0000 7f2a35d47640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2a1c0a2b80 0x7f2a1c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.785+0000 7f2a35d47640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2a1c0a2b80 0x7f2a1c0a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a3019faa0 tx=0x7f2a2c005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:26.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.788+0000 7f2a26ffd640 1 -- 172.21.15.60:0/1345637406 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a200bc9b0 con 0x7f2a30074eb0 2024-09-11T23:57:26.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:26.967+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2a301ab870 con 0x7f2a30074eb0 2024-09-11T23:57:27.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.403+0000 7f2a26ffd640 1 -- 172.21.15.60:0/1345637406 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7f2a200b6e20 con 0x7f2a30074eb0 2024-09-11T23:57:27.403 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-11T23:57:27.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2a1c0a2b80 msgr2=0x7f2a1c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2a1c0a2b80 0x7f2a1c0a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2a3019faa0 tx=0x7f2a2c005e70 comp rx=0 tx=0).stop 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 msgr2=0x7f2a301a4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 0x7f2a301a4ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a20006010 tx=0x7f2a200042f0 comp rx=0 tx=0).stop 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 shutdown_connections 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a30112b90 0x7f2a3019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2a1c0a2b80 0x7f2a1c0a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a30074eb0 0x7f2a301a4ce0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 --2- 172.21.15.60:0/1345637406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a30074590 0x7f2a301a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 >> 172.21.15.60:0/1345637406 conn(0x7f2a300fd8c0 msgr2=0x7f2a300fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:27.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 shutdown_connections 2024-09-11T23:57:27.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:27.406+0000 7f2a37fab640 1 -- 172.21.15.60:0/1345637406 wait complete. 2024-09-11T23:57:27.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:27 smithi060 ceph-mon[30953]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:27.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:27 smithi060 ceph-mon[30953]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:57:27.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:27 smithi060 ceph-mon[30953]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:57:27.728 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:27 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1345637406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:57:27.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:27 smithi105 ceph-mon[34805]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:27.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:27 smithi105 ceph-mon[34805]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:57:27.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:27 smithi105 ceph-mon[34805]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:57:27.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:27 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1345637406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:57:27.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:27 smithi192 ceph-mon[35487]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:27.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:27 smithi192 ceph-mon[35487]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T23:57:27.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:27 smithi192 ceph-mon[35487]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T23:57:27.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:27 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1345637406' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-11T23:57:28.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:57:28.333 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:28.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:28 smithi060 ceph-mon[30953]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:28.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:28 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1345637406' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:57:28.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:28 smithi060 ceph-mon[30953]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:57:28.685 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:28 smithi060 ceph-mon[30953]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:57:28.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:28 smithi105 ceph-mon[34805]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:28.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:28 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1345637406' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:57:28.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:28 smithi105 ceph-mon[34805]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:57:28.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:28 smithi105 ceph-mon[34805]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:57:28.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:28 smithi192 ceph-mon[35487]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:28.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:28 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1345637406' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T23:57:28.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:28 smithi192 ceph-mon[35487]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T23:57:28.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:28 smithi192 ceph-mon[35487]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T23:57:28.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 -- 172.21.15.60:0/2320635686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b010c180 msgr2=0x7fa3b010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:28.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 --2- 172.21.15.60:0/2320635686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b010c180 0x7fa3b010e610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009900 tx=0x7fa3a802a480 comp rx=0 tx=0).stop 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 -- 172.21.15.60:0/2320635686 shutdown_connections 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 --2- 172.21.15.60:0/2320635686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b010c180 0x7fa3b010e610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 --2- 172.21.15.60:0/2320635686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b0103700 0x7fa3b010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 --2- 172.21.15.60:0/2320635686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3b0102de0 0x7fa3b01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 -- 172.21.15.60:0/2320635686 >> 172.21.15.60:0/2320635686 conn(0x7fa3b00fc7a0 msgr2=0x7fa3b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 -- 172.21.15.60:0/2320635686 shutdown_connections 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 -- 172.21.15.60:0/2320635686 wait complete. 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.885+0000 7fa3b5348640 1 Processor -- start 2024-09-11T23:57:28.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3b5348640 1 -- start start 2024-09-11T23:57:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3b5348640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3b0102de0 0x7fa3b01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3b5348640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b0103700 0x7fa3b01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3b5348640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b010c180 0x7fa3b019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3b5348640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01120f0 con 0x7fa3b0103700 2024-09-11T23:57:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3b5348640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b0111f70 con 0x7fa3b0102de0 2024-09-11T23:57:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3b5348640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b0112270 con 0x7fa3b010c180 2024-09-11T23:57:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b0103700 0x7fa3b01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b0103700 0x7fa3b01989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55822/0 (socket says 172.21.15.60:55822) 2024-09-11T23:57:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 -- 172.21.15.60:0/4044231680 learned_addr learned my addr 172.21.15.60:0/4044231680 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3aeffd640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3b0102de0 0x7fa3b01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3af7fe640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b010c180 0x7fa3b019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 -- 172.21.15.60:0/4044231680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b010c180 msgr2=0x7fa3b019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b010c180 0x7fa3b019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:28.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 -- 172.21.15.60:0/4044231680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3b0102de0 msgr2=0x7fa3b01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3b0102de0 0x7fa3b01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 -- 172.21.15.60:0/4044231680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b019d460 con 0x7fa3b0103700 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.886+0000 7fa3ae7fc640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b0103700 0x7fa3b01989f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c920 tx=0x7fa3a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.887+0000 7fa397fff640 1 -- 172.21.15.60:0/4044231680 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4007c70 con 0x7fa3b0103700 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.887+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b019d750 con 0x7fa3b0103700 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.887+0000 7fa397fff640 1 -- 172.21.15.60:0/4044231680 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa3a4007e10 con 0x7fa3b0103700 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.887+0000 7fa397fff640 1 -- 172.21.15.60:0/4044231680 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4018940 con 0x7fa3b0103700 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.887+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01a5030 con 0x7fa3b0103700 2024-09-11T23:57:28.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.888+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b01031c0 con 0x7fa3b0103700 2024-09-11T23:57:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.890+0000 7fa397fff640 1 -- 172.21.15.60:0/4044231680 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa3a4018b00 con 0x7fa3b0103700 2024-09-11T23:57:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.890+0000 7fa397fff640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3980a2b80 0x7fa3980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.890+0000 7fa3aeffd640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3980a2b80 0x7fa3980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.890+0000 7fa397fff640 1 -- 172.21.15.60:0/4044231680 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7fa3a40cf330 con 0x7fa3b0103700 2024-09-11T23:57:28.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.891+0000 7fa3aeffd640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3980a2b80 0x7fa3980a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009f20 tx=0x7fa3a00094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:28.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:28.894+0000 7fa397fff640 1 -- 172.21.15.60:0/4044231680 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3a4014030 con 0x7fa3b0103700 2024-09-11T23:57:29.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.106+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa3b0199810 con 0x7fa3b0103700 2024-09-11T23:57:29.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.426+0000 7fa397fff640 1 -- 172.21.15.60:0/4044231680 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa3b0199810 con 0x7fa3b0103700 2024-09-11T23:57:29.425 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T23:57:29.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3980a2b80 msgr2=0x7fa3980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3980a2b80 0x7fa3980a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009f20 tx=0x7fa3a00094f0 comp rx=0 tx=0).stop 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b0103700 msgr2=0x7fa3b01989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b0103700 0x7fa3b01989f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c920 tx=0x7fa3a400cde0 comp rx=0 tx=0).stop 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 shutdown_connections 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b010c180 0x7fa3b019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3980a2b80 0x7fa3980a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3b0103700 0x7fa3b01989f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 --2- 172.21.15.60:0/4044231680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3b0102de0 0x7fa3b01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.428+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 >> 172.21.15.60:0/4044231680 conn(0x7fa3b00fc7a0 msgr2=0x7fa3b00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.429+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 shutdown_connections 2024-09-11T23:57:29.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:29.429+0000 7fa3b5348640 1 -- 172.21.15.60:0/4044231680 wait complete. 2024-09-11T23:57:29.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:29 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4044231680' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:57:29.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:29 smithi105 ceph-mon[34805]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T23:57:29.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:29 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4044231680' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:57:29.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:29 smithi192 ceph-mon[35487]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T23:57:29.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:29 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4044231680' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-11T23:57:29.796 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:29 smithi060 ceph-mon[30953]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-11T23:57:30.106 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:30.366 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:30 smithi105 ceph-mon[34805]: pgmap v274: 97 pgs: 21 creating+peering, 21 unknown, 55 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:30 smithi105 ceph-mon[34805]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:57:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:30 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4044231680' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:57:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:30 smithi105 ceph-mon[34805]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T23:57:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:30 smithi105 ceph-mon[34805]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T23:57:30.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:30 smithi060 ceph-mon[30953]: pgmap v274: 97 pgs: 21 creating+peering, 21 unknown, 55 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:30.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:30 smithi060 ceph-mon[30953]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:57:30.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:30 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4044231680' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:57:30.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:30 smithi060 ceph-mon[30953]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T23:57:30.776 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:30 smithi060 ceph-mon[30953]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T23:57:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:30 smithi192 ceph-mon[35487]: pgmap v274: 97 pgs: 21 creating+peering, 21 unknown, 55 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:57:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:30 smithi192 ceph-mon[35487]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T23:57:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:30 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4044231680' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T23:57:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:30 smithi192 ceph-mon[35487]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-11T23:57:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:30 smithi192 ceph-mon[35487]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-11T23:57:30.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 -- 172.21.15.60:0/384407278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 msgr2=0x7efedc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 --2- 172.21.15.60:0/384407278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 0x7efedc106e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efed8009930 tx=0x7efed802a420 comp rx=0 tx=0).stop 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 -- 172.21.15.60:0/384407278 shutdown_connections 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 --2- 172.21.15.60:0/384407278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc101420 0x7efedc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 --2- 172.21.15.60:0/384407278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efedc100a80 0x7efedc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 --2- 172.21.15.60:0/384407278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 0x7efedc106e60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 -- 172.21.15.60:0/384407278 >> 172.21.15.60:0/384407278 conn(0x7efedc0fc7a0 msgr2=0x7efedc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 -- 172.21.15.60:0/384407278 shutdown_connections 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.859+0000 7efee426c640 1 -- 172.21.15.60:0/384407278 wait complete. 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee426c640 1 Processor -- start 2024-09-11T23:57:30.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee426c640 1 -- start start 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee426c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efedc100a80 0x7efedc198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee426c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc101420 0x7efedc198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee426c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 0x7efedc19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee426c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1120e0 con 0x7efedc106a80 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee426c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efedc111f60 con 0x7efedc101420 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee426c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efedc112260 con 0x7efedc100a80 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee2809640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 0x7efedc19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee2809640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 0x7efedc19ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55846/0 (socket says 172.21.15.60:55846) 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee2809640 1 -- 172.21.15.60:0/1366003761 learned_addr learned my addr 172.21.15.60:0/1366003761 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee1807640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc101420 0x7efedc198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:30.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee2008640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efedc100a80 0x7efedc198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee2809640 1 -- 172.21.15.60:0/1366003761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efedc100a80 msgr2=0x7efedc198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee2809640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efedc100a80 0x7efedc198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee2809640 1 -- 172.21.15.60:0/1366003761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc101420 msgr2=0x7efedc198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.860+0000 7efee2809640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc101420 0x7efedc198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.861+0000 7efee2809640 1 -- 172.21.15.60:0/1366003761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc19d5b0 con 0x7efedc106a80 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.861+0000 7efee2008640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efedc100a80 0x7efedc198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.861+0000 7efee2809640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 0x7efedc19ced0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efed4009fd0 tx=0x7efed400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.861+0000 7efed37fe640 1 -- 172.21.15.60:0/1366003761 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4017070 con 0x7efedc106a80 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.861+0000 7efed37fe640 1 -- 172.21.15.60:0/1366003761 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efed400bdd0 con 0x7efedc106a80 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.861+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc19d8a0 con 0x7efedc106a80 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.861+0000 7efed37fe640 1 -- 172.21.15.60:0/1366003761 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed40106c0 con 0x7efedc106a80 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.861+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc1a5180 con 0x7efedc106a80 2024-09-11T23:57:30.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.862+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efedc100ee0 con 0x7efedc106a80 2024-09-11T23:57:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.863+0000 7efed37fe640 1 -- 172.21.15.60:0/1366003761 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efed4003970 con 0x7efedc106a80 2024-09-11T23:57:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.864+0000 7efed37fe640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efec80a2c00 0x7efec80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.864+0000 7efee2008640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efec80a2c00 0x7efec80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.864+0000 7efed37fe640 1 -- 172.21.15.60:0/1366003761 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7efed40cec40 con 0x7efedc106a80 2024-09-11T23:57:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.864+0000 7efee2008640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efec80a2c00 0x7efec80a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efed8000c00 tx=0x7efed8032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:30.868+0000 7efed37fe640 1 -- 172.21.15.60:0/1366003761 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efed409bc50 con 0x7efedc106a80 2024-09-11T23:57:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.044+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efedc108a60 con 0x7efedc106a80 2024-09-11T23:57:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.045+0000 7efed37fe640 1 -- 172.21.15.60:0/1366003761 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22315 (secure 0 0 0) 0x7efed409b550 con 0x7efedc106a80 2024-09-11T23:57:31.045 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:31.045 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:57:29.107272+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efec80a2c00 msgr2=0x7efec80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efec80a2c00 0x7efec80a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efed8000c00 tx=0x7efed8032c80 comp rx=0 tx=0).stop 2024-09-11T23:57:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 msgr2=0x7efedc19ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 0x7efedc19ced0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efed4009fd0 tx=0x7efed400def0 comp rx=0 tx=0).stop 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 shutdown_connections 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7efec80a2c00 0x7efec80a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efedc106a80 0x7efedc19ced0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efedc101420 0x7efedc198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 --2- 172.21.15.60:0/1366003761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efedc100a80 0x7efedc198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 >> 172.21.15.60:0/1366003761 conn(0x7efedc0fc7a0 msgr2=0x7efedc0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 shutdown_connections 2024-09-11T23:57:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:31.048+0000 7efee426c640 1 -- 172.21.15.60:0/1366003761 wait complete. 2024-09-11T23:57:31.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:31 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] up:active 2024-09-11T23:57:31.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:31 smithi060 ceph-mon[30953]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:31.672 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:31 smithi060 ceph-mon[30953]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:31.673 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:31 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1366003761' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:31.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:31.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:31 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] up:active 2024-09-11T23:57:31.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:31 smithi105 ceph-mon[34805]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:31.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:31 smithi105 ceph-mon[34805]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:31.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:31 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1366003761' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:31.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:31 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] up:active 2024-09-11T23:57:31.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:31 smithi192 ceph-mon[35487]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:31.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:31 smithi192 ceph-mon[35487]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:31.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:31 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1366003761' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:31.959 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:32.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 -- 172.21.15.60:0/1704107747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 msgr2=0x7f990c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 --2- 172.21.15.60:0/1704107747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 0x7f990c1067e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9900009900 tx=0x7f990002a410 comp rx=0 tx=0).stop 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 -- 172.21.15.60:0/1704107747 shutdown_connections 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 --2- 172.21.15.60:0/1704107747 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c106f10 0x7f990c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 --2- 172.21.15.60:0/1704107747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 0x7f990c1067e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 --2- 172.21.15.60:0/1704107747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f990c101de0 0x7f990c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 -- 172.21.15.60:0/1704107747 >> 172.21.15.60:0/1704107747 conn(0x7f990c0fd8c0 msgr2=0x7f990c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 -- 172.21.15.60:0/1704107747 shutdown_connections 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.470+0000 7f9913a55640 1 -- 172.21.15.60:0/1704107747 wait complete. 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9913a55640 1 Processor -- start 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9913a55640 1 -- start start 2024-09-11T23:57:32.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9913a55640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f990c101de0 0x7f990c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9913a55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 0x7f990c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9913a55640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c106f10 0x7f990c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9913a55640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f990c112050 con 0x7f990c102790 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9913a55640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f990c111ed0 con 0x7f990c106f10 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9913a55640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f990c1121d0 con 0x7f990c101de0 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9910ff0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 0x7f990c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9910ff0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 0x7f990c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51060/0 (socket says 172.21.15.60:51060) 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9910ff0640 1 -- 172.21.15.60:0/4113136908 learned_addr learned my addr 172.21.15.60:0/4113136908 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9911ff2640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c106f10 0x7f990c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f99117f1640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f990c101de0 0x7f990c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9910ff0640 1 -- 172.21.15.60:0/4113136908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f990c101de0 msgr2=0x7f990c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:32.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9910ff0640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f990c101de0 0x7f990c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9910ff0640 1 -- 172.21.15.60:0/4113136908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c106f10 msgr2=0x7f990c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9910ff0640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c106f10 0x7f990c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9910ff0640 1 -- 172.21.15.60:0/4113136908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c1a6950 con 0x7f990c102790 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.471+0000 7f9911ff2640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c106f10 0x7f990c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.472+0000 7f9910ff0640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 0x7f990c074a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9900006010 tx=0x7f99000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.472+0000 7f98fe7fc640 1 -- 172.21.15.60:0/4113136908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990003f030 con 0x7f990c102790 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.472+0000 7f98fe7fc640 1 -- 172.21.15.60:0/4113136908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9900003d00 con 0x7f990c102790 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.472+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c1a6be0 con 0x7f990c102790 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.472+0000 7f98fe7fc640 1 -- 172.21.15.60:0/4113136908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900035070 con 0x7f990c102790 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.472+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c1a70c0 con 0x7f990c102790 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.473+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990c1021c0 con 0x7f990c102790 2024-09-11T23:57:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.474+0000 7f98fe7fc640 1 -- 172.21.15.60:0/4113136908 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9900042030 con 0x7f990c102790 2024-09-11T23:57:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.475+0000 7f98fe7fc640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98f80a2b80 0x7f98f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.475+0000 7f99117f1640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98f80a2b80 0x7f98f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.475+0000 7f98fe7fc640 1 -- 172.21.15.60:0/4113136908 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f99000efb70 con 0x7f990c102790 2024-09-11T23:57:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.476+0000 7f99117f1640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98f80a2b80 0x7f98f80a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f990800ba40 tx=0x7f9908005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:32.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.478+0000 7f98fe7fc640 1 -- 172.21.15.60:0/4113136908 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99000bcbc0 con 0x7f990c102790 2024-09-11T23:57:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.654+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f990c075a20 con 0x7f990c102790 2024-09-11T23:57:32.653 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:32 smithi060 ceph-mon[30953]: pgmap v276: 97 pgs: 21 creating+peering, 76 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 200 B/s wr, 1 op/s 2024-09-11T23:57:32.654 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:32 smithi060 ceph-mon[30953]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:57:32.654 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:32 smithi060 ceph-mon[30953]: Cluster is now healthy 2024-09-11T23:57:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.655+0000 7f98fe7fc640 1 -- 172.21.15.60:0/4113136908 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22315 (secure 0 0 0) 0x7f990c075a20 con 0x7f990c102790 2024-09-11T23:57:32.655 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:32.655 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:57:29.107272+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.657+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98f80a2b80 msgr2=0x7f98f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.657+0000 7f9913a55640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98f80a2b80 0x7f98f80a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f990800ba40 tx=0x7f9908005cc0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.657+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 msgr2=0x7f990c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.657+0000 7f9913a55640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 0x7f990c074a30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9900006010 tx=0x7f99000042f0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.658+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 shutdown_connections 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.658+0000 7f9913a55640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f990c106f10 0x7f990c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.658+0000 7f9913a55640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f98f80a2b80 0x7f98f80a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.658+0000 7f9913a55640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f990c102790 0x7f990c074a30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.658+0000 7f9913a55640 1 --2- 172.21.15.60:0/4113136908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f990c101de0 0x7f990c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.658+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 >> 172.21.15.60:0/4113136908 conn(0x7f990c0fd8c0 msgr2=0x7f990c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.658+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 shutdown_connections 2024-09-11T23:57:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:32.658+0000 7f9913a55640 1 -- 172.21.15.60:0/4113136908 wait complete. 2024-09-11T23:57:32.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:32 smithi105 ceph-mon[34805]: pgmap v276: 97 pgs: 21 creating+peering, 76 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 200 B/s wr, 1 op/s 2024-09-11T23:57:32.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:32 smithi105 ceph-mon[34805]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:57:32.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:32 smithi105 ceph-mon[34805]: Cluster is now healthy 2024-09-11T23:57:32.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:32 smithi192 ceph-mon[35487]: pgmap v276: 97 pgs: 21 creating+peering, 76 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 200 B/s wr, 1 op/s 2024-09-11T23:57:32.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:32 smithi192 ceph-mon[35487]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T23:57:32.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:32 smithi192 ceph-mon[35487]: Cluster is now healthy 2024-09-11T23:57:33.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:57:33.562 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:33.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:33 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4113136908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:33 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4113136908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:33 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4113136908' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1905123766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0100e20 msgr2=0x7f39d0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1905123766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0100e20 0x7f39d0101200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009900 tx=0x7f39c002a480 comp rx=0 tx=0).stop 2024-09-11T23:57:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1905123766 shutdown_connections 2024-09-11T23:57:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1905123766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d0102ef0 0x7f39d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1905123766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d0102570 0x7f39d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1905123766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0100e20 0x7f39d0101200 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1905123766 >> 172.21.15.60:0/1905123766 conn(0x7f39d00fc7d0 msgr2=0x7f39d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1905123766 shutdown_connections 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1905123766 wait complete. 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.055+0000 7f39d5bf7640 1 Processor -- start 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39d5bf7640 1 -- start start 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39d5bf7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d0100e20 0x7f39d0199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39d5bf7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d0102570 0x7f39d0199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39d5bf7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0102ef0 0x7f39d01a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39d5bf7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0111160 con 0x7f39d0102ef0 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39d5bf7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0110fe0 con 0x7f39d0100e20 2024-09-11T23:57:34.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39d5bf7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01112e0 con 0x7f39d0102570 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0102ef0 0x7f39d01a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0102ef0 0x7f39d01a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51068/0 (socket says 172.21.15.60:51068) 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cffff640 1 -- 172.21.15.60:0/1542293865 learned_addr learned my addr 172.21.15.60:0/1542293865 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cf7fe640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d0100e20 0x7f39d0199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39ceffd640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d0102570 0x7f39d0199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cffff640 1 -- 172.21.15.60:0/1542293865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d0102570 msgr2=0x7f39d0199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cffff640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d0102570 0x7f39d0199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cffff640 1 -- 172.21.15.60:0/1542293865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d0100e20 msgr2=0x7f39d0199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cffff640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d0100e20 0x7f39d0199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.056+0000 7f39cffff640 1 -- 172.21.15.60:0/1542293865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d01a4b30 con 0x7f39d0102ef0 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.057+0000 7f39cffff640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0102ef0 0x7f39d01a45f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f39c800b970 tx=0x7f39c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:34.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.057+0000 7f39ccff9640 1 -- 172.21.15.60:0/1542293865 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8019070 con 0x7f39d0102ef0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.057+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d01a4d00 con 0x7f39d0102ef0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.057+0000 7f39ccff9640 1 -- 172.21.15.60:0/1542293865 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39c800cb40 con 0x7f39d0102ef0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.057+0000 7f39ccff9640 1 -- 172.21.15.60:0/1542293865 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8007700 con 0x7f39d0102ef0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.057+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d01a5210 con 0x7f39d0102ef0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.058+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d0101200 con 0x7f39d0102ef0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.059+0000 7f39ccff9640 1 -- 172.21.15.60:0/1542293865 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f39c801c070 con 0x7f39d0102ef0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.060+0000 7f39ccff9640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f39b80a2c00 0x7f39b80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.060+0000 7f39cf7fe640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f39b80a2c00 0x7f39b80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.060+0000 7f39ccff9640 1 -- 172.21.15.60:0/1542293865 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f39c80ce890 con 0x7f39d0102ef0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.060+0000 7f39cf7fe640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f39b80a2c00 0x7f39b80a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009230 tx=0x7f39c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:34.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.063+0000 7f39ccff9640 1 -- 172.21.15.60:0/1542293865 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39c809b2f0 con 0x7f39d0102ef0 2024-09-11T23:57:34.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.276+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f39d01a54a0 con 0x7f39d0102ef0 2024-09-11T23:57:34.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.442+0000 7f39ccff9640 1 -- 172.21.15.60:0/1542293865 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f39c809f5f0 con 0x7f39d0102ef0 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.444+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f39b80a2c00 msgr2=0x7f39b80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.444+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f39b80a2c00 0x7f39b80a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009230 tx=0x7f39c00058d0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.444+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0102ef0 msgr2=0x7f39d01a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.444+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0102ef0 0x7f39d01a45f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f39c800b970 tx=0x7f39c800be30 comp rx=0 tx=0).stop 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.444+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 shutdown_connections 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.445+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f39b80a2c00 0x7f39b80a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.445+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d0102ef0 0x7f39d01a45f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.445+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d0102570 0x7f39d0199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.445+0000 7f39d5bf7640 1 --2- 172.21.15.60:0/1542293865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d0100e20 0x7f39d0199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:34.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.445+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 >> 172.21.15.60:0/1542293865 conn(0x7f39d00fc7d0 msgr2=0x7f39d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:34.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.445+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 shutdown_connections 2024-09-11T23:57:34.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:34.445+0000 7f39d5bf7640 1 -- 172.21.15.60:0/1542293865 wait complete. 2024-09-11T23:57:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:34 smithi060 ceph-mon[30953]: pgmap v277: 97 pgs: 97 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T23:57:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:34 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1542293865' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:57:34.720 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:34 smithi192 ceph-mon[35487]: pgmap v277: 97 pgs: 97 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T23:57:34.720 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:34 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1542293865' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:57:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:34 smithi105 ceph-mon[34805]: pgmap v277: 97 pgs: 97 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T23:57:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:34 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1542293865' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-11T23:57:35.033 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: 2024-09-11T23:57:34.719+0000 7f3d95ffe640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:57:35.079 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T23:57:35.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-11T23:57:35.336 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:35.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:35 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1542293865' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:57:35.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:35 smithi105 ceph-mon[34805]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:35.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:35 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1542293865' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:57:35.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:35 smithi060 ceph-mon[30953]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:35.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:35 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1542293865' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T23:57:35.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:35 smithi192 ceph-mon[35487]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:35.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 -- 172.21.15.60:0/2538932763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4100e20 msgr2=0x7f15d4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:35.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/2538932763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4100e20 0x7f15d4101200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009900 tx=0x7f15c402a480 comp rx=0 tx=0).stop 2024-09-11T23:57:35.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 -- 172.21.15.60:0/2538932763 shutdown_connections 2024-09-11T23:57:35.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/2538932763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d4102ef0 0x7f15d410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/2538932763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15d4102570 0x7f15d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/2538932763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4100e20 0x7f15d4101200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 -- 172.21.15.60:0/2538932763 >> 172.21.15.60:0/2538932763 conn(0x7f15d40fc7d0 msgr2=0x7f15d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:35.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 -- 172.21.15.60:0/2538932763 shutdown_connections 2024-09-11T23:57:35.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.816+0000 7f15d8fd2640 1 -- 172.21.15.60:0/2538932763 wait complete. 2024-09-11T23:57:35.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d8fd2640 1 Processor -- start 2024-09-11T23:57:35.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d8fd2640 1 -- start start 2024-09-11T23:57:35.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d8fd2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15d4100e20 0x7f15d40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:35.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d8fd2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4102570 0x7f15d40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d8fd2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d4102ef0 0x7f15d40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d8fd2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41110e0 con 0x7f15d4102570 2024-09-11T23:57:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d8fd2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4110f60 con 0x7f15d4102ef0 2024-09-11T23:57:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d8fd2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4111260 con 0x7f15d4100e20 2024-09-11T23:57:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15cbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4102570 0x7f15d40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15cbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4102570 0x7f15d40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51098/0 (socket says 172.21.15.60:51098) 2024-09-11T23:57:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15cbfff640 1 -- 172.21.15.60:0/4095101625 learned_addr learned my addr 172.21.15.60:0/4095101625 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d2d9d640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d4102ef0 0x7f15d40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15d259c640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15d4100e20 0x7f15d40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15cbfff640 1 -- 172.21.15.60:0/4095101625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15d4100e20 msgr2=0x7f15d40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15cbfff640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15d4100e20 0x7f15d40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15cbfff640 1 -- 172.21.15.60:0/4095101625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d4102ef0 msgr2=0x7f15d40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15cbfff640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d4102ef0 0x7f15d40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.817+0000 7f15cbfff640 1 -- 172.21.15.60:0/4095101625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d41a6b00 con 0x7f15d4102570 2024-09-11T23:57:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.818+0000 7f15cbfff640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4102570 0x7f15d40fd1c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00b4a0 tx=0x7f15bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.818+0000 7f15cb7fe640 1 -- 172.21.15.60:0/4095101625 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc014070 con 0x7f15d4102570 2024-09-11T23:57:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.818+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d41a6df0 con 0x7f15d4102570 2024-09-11T23:57:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.818+0000 7f15cb7fe640 1 -- 172.21.15.60:0/4095101625 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15bc010b10 con 0x7f15d4102570 2024-09-11T23:57:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.818+0000 7f15cb7fe640 1 -- 172.21.15.60:0/4095101625 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc017d60 con 0x7f15d4102570 2024-09-11T23:57:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.818+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41a72f0 con 0x7f15d4102570 2024-09-11T23:57:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.819+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d4101200 con 0x7f15d4102570 2024-09-11T23:57:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.820+0000 7f15cb7fe640 1 -- 172.21.15.60:0/4095101625 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f15bc017070 con 0x7f15d4102570 2024-09-11T23:57:35.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.820+0000 7f15cb7fe640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f15c00a2b80 0x7f15c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:35.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.821+0000 7f15d259c640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f15c00a2b80 0x7f15c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:35.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.821+0000 7f15cb7fe640 1 -- 172.21.15.60:0/4095101625 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f15bc0ce260 con 0x7f15d4102570 2024-09-11T23:57:35.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.821+0000 7f15d259c640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f15c00a2b80 0x7f15c00a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15c4005ab0 tx=0x7f15c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:35.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:35.825+0000 7f15cb7fe640 1 -- 172.21.15.60:0/4095101625 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f15bc09b310 con 0x7f15d4102570 2024-09-11T23:57:36.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.041+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f15d41a7580 con 0x7f15d4102570 2024-09-11T23:57:36.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.454+0000 7f15cb7fe640 1 -- 172.21.15.60:0/4095101625 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f15bc09ac10 con 0x7f15d4102570 2024-09-11T23:57:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.457+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f15c00a2b80 msgr2=0x7f15c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.457+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f15c00a2b80 0x7f15c00a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15c4005ab0 tx=0x7f15c4005a20 comp rx=0 tx=0).stop 2024-09-11T23:57:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.457+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4102570 msgr2=0x7f15d40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.457+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4102570 0x7f15d40fd1c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00b4a0 tx=0x7f15bc00b960 comp rx=0 tx=0).stop 2024-09-11T23:57:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.458+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 shutdown_connections 2024-09-11T23:57:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.458+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d4102ef0 0x7f15d40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.458+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f15c00a2b80 0x7f15c00a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.458+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15d4102570 0x7f15d40fd1c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.458+0000 7f15d8fd2640 1 --2- 172.21.15.60:0/4095101625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15d4100e20 0x7f15d40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.458+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 >> 172.21.15.60:0/4095101625 conn(0x7f15d40fc7d0 msgr2=0x7f15d4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.458+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 shutdown_connections 2024-09-11T23:57:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:36.458+0000 7f15d8fd2640 1 -- 172.21.15.60:0/4095101625 wait complete. 2024-09-11T23:57:36.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:36 smithi105 ceph-mon[34805]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T23:57:36.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:36 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4095101625' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:57:36.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:36 smithi060 ceph-mon[30953]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T23:57:36.756 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:36 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4095101625' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:57:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:36 smithi192 ceph-mon[35487]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-11T23:57:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:36 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4095101625' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-11T23:57:37.289 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T23:57:37.557 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:37.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:37 smithi060 ceph-mon[30953]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:57:37.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:37 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4095101625' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:57:37.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:37 smithi060 ceph-mon[30953]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:57:37.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:37 smithi060 ceph-mon[30953]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:37.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:37 smithi060 ceph-mon[30953]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T23:57:37.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:37 smithi060 ceph-mon[30953]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T23:57:37.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:37 smithi105 ceph-mon[34805]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:57:37.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:37 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4095101625' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:57:37.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:37 smithi105 ceph-mon[34805]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:57:37.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:37 smithi105 ceph-mon[34805]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:37.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:37 smithi105 ceph-mon[34805]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T23:57:37.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:37 smithi105 ceph-mon[34805]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T23:57:37.789 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:37 smithi192 ceph-mon[35487]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T23:57:37.789 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:37 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4095101625' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-11T23:57:37.789 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:37 smithi192 ceph-mon[35487]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T23:57:37.790 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:37 smithi192 ceph-mon[35487]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-11T23:57:37.790 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:37 smithi192 ceph-mon[35487]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-11T23:57:37.790 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:37 smithi192 ceph-mon[35487]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 -- 172.21.15.60:0/3033451560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28102570 msgr2=0x7f1c281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 --2- 172.21.15.60:0/3033451560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28102570 0x7f1c281029b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009900 tx=0x7f1c1c02a480 comp rx=0 tx=0).stop 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 -- 172.21.15.60:0/3033451560 shutdown_connections 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 --2- 172.21.15.60:0/3033451560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c28102ef0 0x7f1c2810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 --2- 172.21.15.60:0/3033451560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28102570 0x7f1c281029b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 --2- 172.21.15.60:0/3033451560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c28100e20 0x7f1c28101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 -- 172.21.15.60:0/3033451560 >> 172.21.15.60:0/3033451560 conn(0x7f1c280fc7d0 msgr2=0x7f1c280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 -- 172.21.15.60:0/3033451560 shutdown_connections 2024-09-11T23:57:38.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 -- 172.21.15.60:0/3033451560 wait complete. 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 Processor -- start 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.086+0000 7f1c2d501640 1 -- start start 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c2d501640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28100e20 0x7f1c28199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c2d501640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c28102570 0x7f1c28199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c2d501640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c28102ef0 0x7f1c281a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c2d501640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28111070 con 0x7f1c28100e20 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c2d501640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28110ef0 con 0x7f1c28102ef0 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c2d501640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1c281111f0 con 0x7f1c28102570 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28100e20 0x7f1c28199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28100e20 0x7f1c28199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51104/0 (socket says 172.21.15.60:51104) 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 -- 172.21.15.60:0/145146088 learned_addr learned my addr 172.21.15.60:0/145146088 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c277fe640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c28102ef0 0x7f1c281a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c267fc640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c28102570 0x7f1c28199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 -- 172.21.15.60:0/145146088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c28102570 msgr2=0x7f1c28199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c28102570 0x7f1c28199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 -- 172.21.15.60:0/145146088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c28102ef0 msgr2=0x7f1c281a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c28102ef0 0x7f1c281a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 -- 172.21.15.60:0/145146088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c281a48f0 con 0x7f1c28100e20 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c267fc640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c28102570 0x7f1c28199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c26ffd640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28100e20 0x7f1c28199330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800cce0 tx=0x7f1c1800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c0ffff640 1 -- 172.21.15.60:0/145146088 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1800f650 con 0x7f1c28100e20 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c281a4ac0 con 0x7f1c28100e20 2024-09-11T23:57:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c0ffff640 1 -- 172.21.15.60:0/145146088 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c1800fcf0 con 0x7f1c28100e20 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.087+0000 7f1c0ffff640 1 -- 172.21.15.60:0/145146088 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18018d20 con 0x7f1c28100e20 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.088+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c281a5000 con 0x7f1c28100e20 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.089+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c28101200 con 0x7f1c28100e20 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.090+0000 7f1c0ffff640 1 -- 172.21.15.60:0/145146088 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1c1800f7f0 con 0x7f1c28100e20 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.090+0000 7f1c0ffff640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1c100a2b80 0x7f1c100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.091+0000 7f1c0ffff640 1 -- 172.21.15.60:0/145146088 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f1c180cf450 con 0x7f1c28100e20 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.091+0000 7f1c267fc640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1c100a2b80 0x7f1c100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.091+0000 7f1c267fc640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1c100a2b80 0x7f1c100a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c2806ab00 tx=0x7f1c1c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.095+0000 7f1c0ffff640 1 -- 172.21.15.60:0/145146088 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c18014030 con 0x7f1c28100e20 2024-09-11T23:57:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.306+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f1c281a5230 con 0x7f1c28100e20 2024-09-11T23:57:38.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.471+0000 7f1c0ffff640 1 -- 172.21.15.60:0/145146088 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f1c1809c500 con 0x7f1c28100e20 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.473+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1c100a2b80 msgr2=0x7f1c100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.473+0000 7f1c2d501640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1c100a2b80 0x7f1c100a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1c2806ab00 tx=0x7f1c1c005a20 comp rx=0 tx=0).stop 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.473+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28100e20 msgr2=0x7f1c28199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.473+0000 7f1c2d501640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28100e20 0x7f1c28199330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800cce0 tx=0x7f1c1800a620 comp rx=0 tx=0).stop 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.474+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 shutdown_connections 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.474+0000 7f1c2d501640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c28102ef0 0x7f1c281a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.474+0000 7f1c2d501640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c28102570 0x7f1c28199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.474+0000 7f1c2d501640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1c100a2b80 0x7f1c100a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.474+0000 7f1c2d501640 1 --2- 172.21.15.60:0/145146088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c28100e20 0x7f1c28199330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:38.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.474+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 >> 172.21.15.60:0/145146088 conn(0x7f1c280fc7d0 msgr2=0x7f1c28106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:38.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.474+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 shutdown_connections 2024-09-11T23:57:38.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:38.474+0000 7f1c2d501640 1 -- 172.21.15.60:0/145146088 wait complete. 2024-09-11T23:57:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:38 smithi060 ceph-mon[30953]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-11T23:57:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:38 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] up:active 2024-09-11T23:57:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:38 smithi060 ceph-mon[30953]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:57:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:38 smithi060 ceph-mon[30953]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T23:57:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:38 smithi060 ceph-mon[30953]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:57:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:38 smithi060 ceph-mon[30953]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:57:38.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:38 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/145146088' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:57:38.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:38 smithi105 ceph-mon[34805]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-11T23:57:38.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:38 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] up:active 2024-09-11T23:57:38.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:38 smithi105 ceph-mon[34805]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:57:38.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:38 smithi105 ceph-mon[34805]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T23:57:38.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:38 smithi105 ceph-mon[34805]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:57:38.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:38 smithi105 ceph-mon[34805]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:57:38.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:38 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/145146088' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:57:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:38 smithi192 ceph-mon[35487]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-11T23:57:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:38 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] up:active 2024-09-11T23:57:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:38 smithi192 ceph-mon[35487]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T23:57:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:38 smithi192 ceph-mon[35487]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-11T23:57:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:38 smithi192 ceph-mon[35487]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-11T23:57:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:38 smithi192 ceph-mon[35487]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-11T23:57:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:38 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/145146088' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-11T23:57:39.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T23:57:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:39.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/145146088' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:57:39.725 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] up:active 2024-09-11T23:57:39.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:57:39.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:57:39.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-11T23:57:39.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-11T23:57:39.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-11T23:57:39.726 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T23:57:39.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-11T23:57:39.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-11T23:57:39.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-11T23:57:39.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-11T23:57:39.727 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:39 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-11T23:57:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/145146088' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:57:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] up:active 2024-09-11T23:57:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:57:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:57:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-11T23:57:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-11T23:57:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-11T23:57:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T23:57:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-11T23:57:39.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-11T23:57:39.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-11T23:57:39.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-11T23:57:39.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:39 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-11T23:57:39.784 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: 2024-09-11T23:57:39.719+0000 7f3d95ffe640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-11T23:57:39.784 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: 2024-09-11T23:57:39.719+0000 7f3d95ffe640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-11T23:57:39.784 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: 2024-09-11T23:57:39.719+0000 7f3d95ffe640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-11T23:57:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/145146088' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] up:active 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-09-11T23:57:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:39 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-11T23:57:39.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 -- 172.21.15.60:0/1135124673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b01055b0 msgr2=0x7fb7b010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/1135124673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b01055b0 0x7fb7b010d130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009ca0 tx=0x7fb7a802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 -- 172.21.15.60:0/1135124673 shutdown_connections 2024-09-11T23:57:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/1135124673 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b01055b0 0x7fb7b010d130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/1135124673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b0100e30 0x7fb7b0104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/1135124673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7b0100480 0x7fb7b0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 -- 172.21.15.60:0/1135124673 >> 172.21.15.60:0/1135124673 conn(0x7fb7b0077210 msgr2=0x7fb7b00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 -- 172.21.15.60:0/1135124673 shutdown_connections 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.936+0000 7fb7b7be1640 1 -- 172.21.15.60:0/1135124673 wait complete. 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b7be1640 1 Processor -- start 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b7be1640 1 -- start start 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b7be1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b0100480 0x7fb7b01962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b7be1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b0100e30 0x7fb7b0196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b7be1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7b01055b0 0x7fb7b019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b7be1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b010fea0 con 0x7fb7b0100e30 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b7be1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b010fd20 con 0x7fb7b0100480 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b7be1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b0110020 con 0x7fb7b01055b0 2024-09-11T23:57:39.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b517c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b0100e30 0x7fb7b0196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b517c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b0100e30 0x7fb7b0196800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51124/0 (socket says 172.21.15.60:51124) 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b517c640 1 -- 172.21.15.60:0/2114110634 learned_addr learned my addr 172.21.15.60:0/2114110634 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b617e640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7b01055b0 0x7fb7b019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.937+0000 7fb7b597d640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b0100480 0x7fb7b01962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7b517c640 1 -- 172.21.15.60:0/2114110634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7b01055b0 msgr2=0x7fb7b019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7b517c640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7b01055b0 0x7fb7b019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7b517c640 1 -- 172.21.15.60:0/2114110634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b0100480 msgr2=0x7fb7b01962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7b517c640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b0100480 0x7fb7b01962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7b517c640 1 -- 172.21.15.60:0/2114110634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b019b270 con 0x7fb7b0100e30 2024-09-11T23:57:39.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7b517c640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b0100e30 0x7fb7b0196800 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000c920 tx=0x7fb7a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7a6ffd640 1 -- 172.21.15.60:0/2114110634 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0007c70 con 0x7fb7b0100e30 2024-09-11T23:57:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7a6ffd640 1 -- 172.21.15.60:0/2114110634 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb7a0007e10 con 0x7fb7b0100e30 2024-09-11T23:57:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b019b560 con 0x7fb7b0100e30 2024-09-11T23:57:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7a6ffd640 1 -- 172.21.15.60:0/2114110634 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0018940 con 0x7fb7b0100e30 2024-09-11T23:57:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.938+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b01a2e40 con 0x7fb7b0100e30 2024-09-11T23:57:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.939+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b0100860 con 0x7fb7b0100e30 2024-09-11T23:57:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.940+0000 7fb7a6ffd640 1 -- 172.21.15.60:0/2114110634 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb7a0018b20 con 0x7fb7b0100e30 2024-09-11T23:57:39.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.941+0000 7fb7a6ffd640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb79c0a2b80 0x7fb79c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:39.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.941+0000 7fb7b597d640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb79c0a2b80 0x7fb79c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:39.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.941+0000 7fb7a6ffd640 1 -- 172.21.15.60:0/2114110634 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8182+0+0 (secure 0 0 0) 0x7fb7a00cefc0 con 0x7fb7b0100e30 2024-09-11T23:57:39.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.941+0000 7fb7b597d640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb79c0a2b80 0x7fb79c0a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac005fd0 tx=0x7fb7ac010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:39.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:39.945+0000 7fb7a6ffd640 1 -- 172.21.15.60:0/2114110634 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7a0014030 con 0x7fb7b0100e30 2024-09-11T23:57:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.156+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fb7b0108200 con 0x7fb7b0100e30 2024-09-11T23:57:40.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.499+0000 7fb7a6ffd640 1 -- 172.21.15.60:0/2114110634 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fb7a009bff0 con 0x7fb7b0100e30 2024-09-11T23:57:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb79c0a2b80 msgr2=0x7fb79c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb79c0a2b80 0x7fb79c0a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac005fd0 tx=0x7fb7ac010040 comp rx=0 tx=0).stop 2024-09-11T23:57:40.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b0100e30 msgr2=0x7fb7b0196800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b0100e30 0x7fb7b0196800 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000c920 tx=0x7fb7a000cde0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 shutdown_connections 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7b01055b0 0x7fb7b019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb79c0a2b80 0x7fb79c0a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b0100e30 0x7fb7b0196800 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 --2- 172.21.15.60:0/2114110634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b0100480 0x7fb7b01962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 >> 172.21.15.60:0/2114110634 conn(0x7fb7b0077210 msgr2=0x7fb7b0103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 shutdown_connections 2024-09-11T23:57:40.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:40.502+0000 7fb7b7be1640 1 -- 172.21.15.60:0/2114110634 wait complete. 2024-09-11T23:57:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 11 op/s 2024-09-11T23:57:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-11T23:57:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T23:57:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] up:active 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: Cluster is now healthy 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:40 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2114110634' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 11 op/s 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-11T23:57:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:57:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] up:active 2024-09-11T23:57:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:57:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:57:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: Cluster is now healthy 2024-09-11T23:57:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-11T23:57:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:40.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:40 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2114110634' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s wr, 11 op/s 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-11T23:57:40.814 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T23:57:40.815 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] up:active 2024-09-11T23:57:40.815 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-11T23:57:40.815 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T23:57:40.815 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: Cluster is now healthy 2024-09-11T23:57:40.815 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-11T23:57:40.815 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:40.815 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:40 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2114110634' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-11T23:57:41.150 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-11T23:57:41.150 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T23:57:41.417 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:41 smithi192 ceph-mon[35487]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:57:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:41 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2114110634' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:57:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:41 smithi192 ceph-mon[35487]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:41.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:41 smithi192 ceph-mon[35487]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-11T23:57:41.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:41 smithi060 ceph-mon[30953]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:57:41.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:41 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2114110634' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:57:41.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:41 smithi060 ceph-mon[30953]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:41.802 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:41 smithi060 ceph-mon[30953]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 -- 172.21.15.60:0/1958615127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8108300 msgr2=0x7f27a810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 --2- 172.21.15.60:0/1958615127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8108300 0x7f27a810ec70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009930 tx=0x7f27a002a420 comp rx=0 tx=0).stop 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 -- 172.21.15.60:0/1958615127 shutdown_connections 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 --2- 172.21.15.60:0/1958615127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8108300 0x7f27a810ec70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 --2- 172.21.15.60:0/1958615127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a8103780 0x7f27a8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 --2- 172.21.15.60:0/1958615127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a8102dd0 0x7f27a81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 -- 172.21.15.60:0/1958615127 >> 172.21.15.60:0/1958615127 conn(0x7f27a80fc7d0 msgr2=0x7f27a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 -- 172.21.15.60:0/1958615127 shutdown_connections 2024-09-11T23:57:41.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 -- 172.21.15.60:0/1958615127 wait complete. 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 Processor -- start 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.887+0000 7f27adec8640 1 -- start start 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27adec8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8102dd0 0x7f27a81986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27adec8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a8103780 0x7f27a8198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27adec8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a8108300 0x7f27a819cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27adec8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8112250 con 0x7f27a8102dd0 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27adec8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81120d0 con 0x7f27a8108300 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27adec8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27a81123d0 con 0x7f27a8103780 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8102dd0 0x7f27a81986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8102dd0 0x7f27a81986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51452/0 (socket says 172.21.15.60:51452) 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 -- 172.21.15.60:0/1201021016 learned_addr learned my addr 172.21.15.60:0/1201021016 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:41.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a7fff640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a8108300 0x7f27a819cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a6ffd640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a8103780 0x7f27a8198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 -- 172.21.15.60:0/1201021016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a8103780 msgr2=0x7f27a8198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a8103780 0x7f27a8198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 -- 172.21.15.60:0/1201021016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a8108300 msgr2=0x7f27a819cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a8108300 0x7f27a819cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 -- 172.21.15.60:0/1201021016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a819d650 con 0x7f27a8102dd0 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a6ffd640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a8103780 0x7f27a8198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a77fe640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8102dd0 0x7f27a81986a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f279800ba50 tx=0x7f279800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.888+0000 7f27a4ff9640 1 -- 172.21.15.60:0/1201021016 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798019070 con 0x7f27a8102dd0 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.889+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a819d940 con 0x7f27a8102dd0 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.889+0000 7f27a4ff9640 1 -- 172.21.15.60:0/1201021016 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f279800cbe0 con 0x7f27a8102dd0 2024-09-11T23:57:41.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.889+0000 7f27a4ff9640 1 -- 172.21.15.60:0/1201021016 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798007770 con 0x7f27a8102dd0 2024-09-11T23:57:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.889+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a81a5220 con 0x7f27a8102dd0 2024-09-11T23:57:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.890+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a806a7b0 con 0x7f27a8102dd0 2024-09-11T23:57:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.891+0000 7f27a4ff9640 1 -- 172.21.15.60:0/1201021016 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f279801c070 con 0x7f27a8102dd0 2024-09-11T23:57:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.892+0000 7f27a4ff9640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f27900a2b80 0x7f27900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.892+0000 7f27a6ffd640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f27900a2b80 0x7f27900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.892+0000 7f27a4ff9640 1 -- 172.21.15.60:0/1201021016 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f27980ce600 con 0x7f27a8102dd0 2024-09-11T23:57:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.892+0000 7f27a6ffd640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f27900a2b80 0x7f27900a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27a80fed20 tx=0x7f279c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:41.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:41.896+0000 7f27a4ff9640 1 -- 172.21.15.60:0/1201021016 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f279809af40 con 0x7f27a8102dd0 2024-09-11T23:57:41.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:41 smithi105 ceph-mon[34805]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T23:57:41.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:41 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2114110634' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T23:57:41.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:41 smithi105 ceph-mon[34805]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-11T23:57:41.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:41 smithi105 ceph-mon[34805]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-11T23:57:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.097+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f27a8062630 con 0x7f27900a2b80 2024-09-11T23:57:42.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.126+0000 7f27a4ff9640 1 -- 172.21.15.60:0/1201021016 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f27a8062630 con 0x7f27900a2b80 2024-09-11T23:57:42.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f27900a2b80 msgr2=0x7f27900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:42.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f27900a2b80 0x7f27900a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27a80fed20 tx=0x7f279c005e50 comp rx=0 tx=0).stop 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8102dd0 msgr2=0x7f27a81986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8102dd0 0x7f27a81986a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f279800ba50 tx=0x7f279800bf10 comp rx=0 tx=0).stop 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 shutdown_connections 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a8108300 0x7f27a819cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a8103780 0x7f27a8198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f27900a2b80 0x7f27900a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 --2- 172.21.15.60:0/1201021016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a8102dd0 0x7f27a81986a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.128+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 >> 172.21.15.60:0/1201021016 conn(0x7f27a80fc7d0 msgr2=0x7f27a81063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.129+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 shutdown_connections 2024-09-11T23:57:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:42.129+0000 7f27adec8640 1 -- 172.21.15.60:0/1201021016 wait complete. 2024-09-11T23:57:42.422 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:57:42.101+0000 7f9a12a1c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:42.422 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:57:42.101+0000 7f9a12a1c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:42.422 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:57:42.101+0000 7f9a12a1c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:42.422 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:57:42.101+0000 7f9a12a1c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:42.422 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:57:42.101+0000 7f9a12a1c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:57:42.698 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-mon[30953]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 13 op/s 2024-09-11T23:57:42.698 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] up:active 2024-09-11T23:57:42.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-mon[30953]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:57:42.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:57:42.699 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:42 smithi060 ceph-mon[30953]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:42.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T23:57:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:42 smithi192 ceph-mon[35487]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 13 op/s 2024-09-11T23:57:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:42 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] up:active 2024-09-11T23:57:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:42 smithi192 ceph-mon[35487]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:57:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:42 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:57:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:42 smithi192 ceph-mon[35487]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:42 smithi105 ceph-mon[34805]: pgmap v283: 97 pgs: 4 peering, 93 active+clean; 582 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 13 op/s 2024-09-11T23:57:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:42 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] up:active 2024-09-11T23:57:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:42 smithi105 ceph-mon[34805]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-11T23:57:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:42 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:57:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:42 smithi105 ceph-mon[34805]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:42.991 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:43.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 -- 172.21.15.60:0/3946231224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 msgr2=0x7f727c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 --2- 172.21.15.60:0/3946231224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 0x7f727c1067e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f726c009900 tx=0x7f726c02a3f0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 -- 172.21.15.60:0/3946231224 shutdown_connections 2024-09-11T23:57:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 --2- 172.21.15.60:0/3946231224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c106f10 0x7f727c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 --2- 172.21.15.60:0/3946231224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 0x7f727c1067e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 --2- 172.21.15.60:0/3946231224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c101de0 0x7f727c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 -- 172.21.15.60:0/3946231224 >> 172.21.15.60:0/3946231224 conn(0x7f727c0fd8c0 msgr2=0x7f727c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 -- 172.21.15.60:0/3946231224 shutdown_connections 2024-09-11T23:57:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.464+0000 7f7284119640 1 -- 172.21.15.60:0/3946231224 wait complete. 2024-09-11T23:57:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f7284119640 1 Processor -- start 2024-09-11T23:57:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f7284119640 1 -- start start 2024-09-11T23:57:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f7284119640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c101de0 0x7f727c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f7284119640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 0x7f727c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f7284119640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c106f10 0x7f727c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:43.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f7284119640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f727c1120d0 con 0x7f727c102790 2024-09-11T23:57:43.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f7284119640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f727c111f50 con 0x7f727c101de0 2024-09-11T23:57:43.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f7284119640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f727c112250 con 0x7f727c106f10 2024-09-11T23:57:43.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f72816b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 0x7f727c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:43.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f72816b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 0x7f727c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51480/0 (socket says 172.21.15.60:51480) 2024-09-11T23:57:43.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f72816b4640 1 -- 172.21.15.60:0/2432112222 learned_addr learned my addr 172.21.15.60:0/2432112222 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:43.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.465+0000 7f72826b6640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c106f10 0x7f727c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:43.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f7281eb5640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c101de0 0x7f727c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f72816b4640 1 -- 172.21.15.60:0/2432112222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c106f10 msgr2=0x7f727c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f72816b4640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c106f10 0x7f727c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f72816b4640 1 -- 172.21.15.60:0/2432112222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c101de0 msgr2=0x7f727c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f72816b4640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c101de0 0x7f727c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f72816b4640 1 -- 172.21.15.60:0/2432112222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c19d4e0 con 0x7f727c102790 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f72816b4640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 0x7f727c198a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f726c006010 tx=0x7f726c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f7272ffd640 1 -- 172.21.15.60:0/2432112222 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c03f030 con 0x7f727c102790 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f7272ffd640 1 -- 172.21.15.60:0/2432112222 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f726c003d00 con 0x7f727c102790 2024-09-11T23:57:43.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f7272ffd640 1 -- 172.21.15.60:0/2432112222 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c035070 con 0x7f727c102790 2024-09-11T23:57:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c19d770 con 0x7f727c102790 2024-09-11T23:57:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.466+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c1a50b0 con 0x7f727c102790 2024-09-11T23:57:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.467+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727c1021c0 con 0x7f727c102790 2024-09-11T23:57:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.468+0000 7f7272ffd640 1 -- 172.21.15.60:0/2432112222 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f726c042030 con 0x7f727c102790 2024-09-11T23:57:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.469+0000 7f7272ffd640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f72680a2c00 0x7f72680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.469+0000 7f7281eb5640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f72680a2c00 0x7f72680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.469+0000 7f7272ffd640 1 -- 172.21.15.60:0/2432112222 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f726c0efb70 con 0x7f727c102790 2024-09-11T23:57:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.470+0000 7f7281eb5640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f72680a2c00 0x7f72680a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7278009890 tx=0x7f7278008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.472+0000 7f7272ffd640 1 -- 172.21.15.60:0/2432112222 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f726c0bcb00 con 0x7f727c102790 2024-09-11T23:57:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.525+0000 7f7272ffd640 1 -- 172.21.15.60:0/2432112222 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f726c0b8a70 con 0x7f727c102790 2024-09-11T23:57:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.681+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f727c10a120 con 0x7f72680a2c00 2024-09-11T23:57:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.706+0000 7f7272ffd640 1 -- 172.21.15.60:0/2432112222 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f727c10a120 con 0x7f72680a2c00 2024-09-11T23:57:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.708+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f72680a2c00 msgr2=0x7f72680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.708+0000 7f7284119640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f72680a2c00 0x7f72680a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7278009890 tx=0x7f7278008040 comp rx=0 tx=0).stop 2024-09-11T23:57:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.708+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 msgr2=0x7f727c198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.708+0000 7f7284119640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 0x7f727c198a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f726c006010 tx=0x7f726c0042f0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.708+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 shutdown_connections 2024-09-11T23:57:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.708+0000 7f7284119640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c106f10 0x7f727c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.708+0000 7f7284119640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f72680a2c00 0x7f72680a50c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.708+0000 7f7284119640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102790 0x7f727c198a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.709+0000 7f7284119640 1 --2- 172.21.15.60:0/2432112222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c101de0 0x7f727c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.709+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 >> 172.21.15.60:0/2432112222 conn(0x7f727c0fd8c0 msgr2=0x7f727c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.709+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 shutdown_connections 2024-09-11T23:57:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:43.709+0000 7f7284119640 1 -- 172.21.15.60:0/2432112222 wait complete. 2024-09-11T23:57:44.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T23:57:44.704 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:44.784 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 11 23:57:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: 2024-09-11T23:57:44.719+0000 7f3d95ffe640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-11T23:57:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:44 smithi192 ceph-mon[35487]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 20 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:44 smithi192 ceph-mon[35487]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:57:44.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:44 smithi192 ceph-mon[35487]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:44.826 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:44 smithi060 ceph-mon[30953]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 20 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:44.826 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:44 smithi060 ceph-mon[30953]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:57:44.826 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:44 smithi060 ceph-mon[30953]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:44.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:44 smithi105 ceph-mon[34805]: pgmap v284: 97 pgs: 4 peering, 93 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 20 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:44.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:44 smithi105 ceph-mon[34805]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-11T23:57:44.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:44 smithi105 ceph-mon[34805]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.175+0000 7f4794b9e640 1 -- 172.21.15.60:0/181403948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 msgr2=0x7f479010e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.175+0000 7f4794b9e640 1 --2- 172.21.15.60:0/181403948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 0x7f479010e460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4788009ca0 tx=0x7f478802a950 comp rx=0 tx=0).stop 2024-09-11T23:57:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.176+0000 7f4794b9e640 1 -- 172.21.15.60:0/181403948 shutdown_connections 2024-09-11T23:57:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.176+0000 7f4794b9e640 1 --2- 172.21.15.60:0/181403948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 0x7f479010e460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.176+0000 7f4794b9e640 1 --2- 172.21.15.60:0/181403948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47901034b0 0x7f479010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.176+0000 7f4794b9e640 1 --2- 172.21.15.60:0/181403948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790102b90 0x7f4790102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.176+0000 7f4794b9e640 1 -- 172.21.15.60:0/181403948 >> 172.21.15.60:0/181403948 conn(0x7f47900fc610 msgr2=0x7f47900fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.176+0000 7f4794b9e640 1 -- 172.21.15.60:0/181403948 shutdown_connections 2024-09-11T23:57:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.176+0000 7f4794b9e640 1 -- 172.21.15.60:0/181403948 wait complete. 2024-09-11T23:57:45.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.176+0000 7f4794b9e640 1 Processor -- start 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f4794b9e640 1 -- start start 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f4794b9e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790102b90 0x7f479019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f4794b9e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47901034b0 0x7f479019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f4794b9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 0x7f479019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f4794b9e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4790111ee0 con 0x7f479010bfc0 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f4794b9e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4790111d60 con 0x7f47901034b0 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f4794b9e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4790112060 con 0x7f4790102b90 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 0x7f479019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47901034b0 0x7f479019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 0x7f479019ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51502/0 (socket says 172.21.15.60:51502) 2024-09-11T23:57:45.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478ffff640 1 -- 172.21.15.60:0/2190299828 learned_addr learned my addr 172.21.15.60:0/2190299828 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478f7fe640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790102b90 0x7f479019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478ffff640 1 -- 172.21.15.60:0/2190299828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790102b90 msgr2=0x7f479019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478ffff640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790102b90 0x7f479019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478ffff640 1 -- 172.21.15.60:0/2190299828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47901034b0 msgr2=0x7f479019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478ffff640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47901034b0 0x7f479019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.177+0000 7f478ffff640 1 -- 172.21.15.60:0/2190299828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479019f430 con 0x7f479010bfc0 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.178+0000 7f478ffff640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 0x7f479019ed50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4788005cc0 tx=0x7f478802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.178+0000 7f478cff9640 1 -- 172.21.15.60:0/2190299828 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788034040 con 0x7f479010bfc0 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.178+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479019f6c0 con 0x7f479010bfc0 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.178+0000 7f478cff9640 1 -- 172.21.15.60:0/2190299828 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4788030940 con 0x7f479010bfc0 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.178+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47901a7000 con 0x7f479010bfc0 2024-09-11T23:57:45.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.178+0000 7f478cff9640 1 -- 172.21.15.60:0/2190299828 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788045680 con 0x7f479010bfc0 2024-09-11T23:57:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.179+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4790102f70 con 0x7f479010bfc0 2024-09-11T23:57:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.181+0000 7f478cff9640 1 -- 172.21.15.60:0/2190299828 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4788037020 con 0x7f479010bfc0 2024-09-11T23:57:45.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.181+0000 7f478cff9640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47780a2c10 0x7f47780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:45.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.181+0000 7f478f7fe640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47780a2c10 0x7f47780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:45.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.182+0000 7f478cff9640 1 -- 172.21.15.60:0/2190299828 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f47880f0250 con 0x7f479010bfc0 2024-09-11T23:57:45.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.182+0000 7f478f7fe640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47780a2c10 0x7f47780a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4780005fd0 tx=0x7f4780005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:45.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.185+0000 7f478cff9640 1 -- 172.21.15.60:0/2190299828 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47880811b0 con 0x7f479010bfc0 2024-09-11T23:57:45.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.388+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f4790101f50 con 0x7f47780a2c10 2024-09-11T23:57:45.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.393+0000 7f478cff9640 1 -- 172.21.15.60:0/2190299828 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4790101f50 con 0x7f47780a2c10 2024-09-11T23:57:45.392 INFO:teuthology.orchestra.run.smithi060.stdout:/volumes/qa/sv_0/5383339a-3219-4841-9abe-a8f248fd8a90 2024-09-11T23:57:45.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47780a2c10 msgr2=0x7f47780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47780a2c10 0x7f47780a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4780005fd0 tx=0x7f4780005850 comp rx=0 tx=0).stop 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 msgr2=0x7f479019ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 0x7f479019ed50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4788005cc0 tx=0x7f478802f790 comp rx=0 tx=0).stop 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 shutdown_connections 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47780a2c10 0x7f47780a50d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479010bfc0 0x7f479019ed50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47901034b0 0x7f479019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 --2- 172.21.15.60:0/2190299828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790102b90 0x7f479019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 >> 172.21.15.60:0/2190299828 conn(0x7f47900fc610 msgr2=0x7f47900fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 shutdown_connections 2024-09-11T23:57:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:45.395+0000 7f4794b9e640 1 -- 172.21.15.60:0/2190299828 wait complete. 2024-09-11T23:57:46.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T23:57:46.347 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:46.729 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:46 smithi060 ceph-mon[30953]: pgmap v285: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.6 KiB/s wr, 28 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:46.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:46 smithi060 ceph-mon[30953]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:46.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:46 smithi192 ceph-mon[35487]: pgmap v285: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.6 KiB/s wr, 28 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:46.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:46 smithi192 ceph-mon[35487]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:46.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 -- 172.21.15.60:0/2862718433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80481008d0 msgr2=0x7f8048100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:46.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 --2- 172.21.15.60:0/2862718433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80481008d0 0x7f8048100cb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8044009900 tx=0x7f804402a410 comp rx=0 tx=0).stop 2024-09-11T23:57:46.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 -- 172.21.15.60:0/2862718433 shutdown_connections 2024-09-11T23:57:46.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 --2- 172.21.15.60:0/2862718433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f804810e480 0x7f8048110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 --2- 172.21.15.60:0/2862718433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8048101280 0x7f804810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 --2- 172.21.15.60:0/2862718433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80481008d0 0x7f8048100cb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 -- 172.21.15.60:0/2862718433 >> 172.21.15.60:0/2862718433 conn(0x7f80480fc7a0 msgr2=0x7f80480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 -- 172.21.15.60:0/2862718433 shutdown_connections 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 -- 172.21.15.60:0/2862718433 wait complete. 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 Processor -- start 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.818+0000 7f8050261640 1 -- start start 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f8050261640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80481008d0 0x7f80481a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f8050261640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8048101280 0x7f80481a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f8050261640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804810e480 0x7f804819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f8050261640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f80481142e0 con 0x7f804810e480 2024-09-11T23:57:46.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f8050261640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8048114160 con 0x7f8048101280 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f8050261640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8048114460 con 0x7f80481008d0 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804810e480 0x7f804819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804810e480 0x7f804819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51526/0 (socket says 172.21.15.60:51526) 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 -- 172.21.15.60:0/1355896238 learned_addr learned my addr 172.21.15.60:0/1355896238 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804dffd640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80481008d0 0x7f80481a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804d7fc640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8048101280 0x7f80481a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 -- 172.21.15.60:0/1355896238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80481008d0 msgr2=0x7f80481a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80481008d0 0x7f80481a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 -- 172.21.15.60:0/1355896238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8048101280 msgr2=0x7f80481a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8048101280 0x7f80481a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 -- 172.21.15.60:0/1355896238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804819acf0 con 0x7f804810e480 2024-09-11T23:57:46.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f804e7fe640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804810e480 0x7f804819a5c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8040009fd0 tx=0x7f804000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f803effd640 1 -- 172.21.15.60:0/1355896238 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040004d20 con 0x7f804810e480 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f803effd640 1 -- 172.21.15.60:0/1355896238 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f804000cb20 con 0x7f804810e480 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804819afe0 con 0x7f804810e480 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f803effd640 1 -- 172.21.15.60:0/1355896238 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400117e0 con 0x7f804810e480 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.819+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80481a72d0 con 0x7f804810e480 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.820+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8048100cb0 con 0x7f804810e480 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.821+0000 7f803effd640 1 -- 172.21.15.60:0/1355896238 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f804000ccd0 con 0x7f804810e480 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.822+0000 7f803effd640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f80340a2c10 0x7f80340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:46.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.822+0000 7f804dffd640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f80340a2c10 0x7f80340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:46.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.822+0000 7f803effd640 1 -- 172.21.15.60:0/1355896238 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f80400cf7a0 con 0x7f804810e480 2024-09-11T23:57:46.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.823+0000 7f804dffd640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f80340a2c10 0x7f80340a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8044005ab0 tx=0x7f8044005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:46.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:46.826+0000 7f803effd640 1 -- 172.21.15.60:0/1355896238 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8040016030 con 0x7f804810e480 2024-09-11T23:57:46.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:46 smithi105 ceph-mon[34805]: pgmap v285: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.6 KiB/s wr, 28 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:46.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:46 smithi105 ceph-mon[34805]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:47.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.030+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8048062630 con 0x7f80340a2c10 2024-09-11T23:57:47.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.054+0000 7f803effd640 1 -- 172.21.15.60:0/1355896238 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8048062630 con 0x7f80340a2c10 2024-09-11T23:57:47.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f80340a2c10 msgr2=0x7f80340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:47.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f80340a2c10 0x7f80340a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8044005ab0 tx=0x7f8044005a20 comp rx=0 tx=0).stop 2024-09-11T23:57:47.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804810e480 msgr2=0x7f804819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:47.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804810e480 0x7f804819a5c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8040009fd0 tx=0x7f804000ee60 comp rx=0 tx=0).stop 2024-09-11T23:57:47.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 shutdown_connections 2024-09-11T23:57:47.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f80340a2c10 0x7f80340a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f804810e480 0x7f804819a5c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8048101280 0x7f80481a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 --2- 172.21.15.60:0/1355896238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80481008d0 0x7f80481a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:47.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 >> 172.21.15.60:0/1355896238 conn(0x7f80480fc7a0 msgr2=0x7f80480feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:47.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 shutdown_connections 2024-09-11T23:57:47.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:47.056+0000 7f8050261640 1 -- 172.21.15.60:0/1355896238 wait complete. 2024-09-11T23:57:47.677 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:47 smithi060 ceph-mon[30953]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:47.712 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T23:57:47.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:47 smithi192 ceph-mon[35487]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:47.979 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:47.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:47 smithi105 ceph-mon[34805]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 -- 172.21.15.60:0/1232722235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3398102da0 msgr2=0x7f3398103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 --2- 172.21.15.60:0/1232722235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3398102da0 0x7f3398103180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3394009900 tx=0x7f339402a480 comp rx=0 tx=0).stop 2024-09-11T23:57:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 -- 172.21.15.60:0/1232722235 shutdown_connections 2024-09-11T23:57:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 --2- 172.21.15.60:0/1232722235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f339810c180 0x7f339810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 --2- 172.21.15.60:0/1232722235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33981036c0 0x7f339810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 --2- 172.21.15.60:0/1232722235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3398102da0 0x7f3398103180 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 -- 172.21.15.60:0/1232722235 >> 172.21.15.60:0/1232722235 conn(0x7f33980fc7a0 msgr2=0x7f33980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 -- 172.21.15.60:0/1232722235 shutdown_connections 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.493+0000 7f33a06f0640 1 -- 172.21.15.60:0/1232722235 wait complete. 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f33a06f0640 1 Processor -- start 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f33a06f0640 1 -- start start 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f33a06f0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3398102da0 0x7f3398198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f33a06f0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33981036c0 0x7f3398198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f33a06f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339810c180 0x7f339819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f33a06f0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3398112080 con 0x7f339810c180 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f33a06f0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3398111f00 con 0x7f33981036c0 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f33a06f0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3398112200 con 0x7f3398102da0 2024-09-11T23:57:48.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f339ec8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339810c180 0x7f339819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f339ec8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339810c180 0x7f339819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51544/0 (socket says 172.21.15.60:51544) 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f339ec8d640 1 -- 172.21.15.60:0/2620094632 learned_addr learned my addr 172.21.15.60:0/2620094632 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.494+0000 7f339e48c640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3398102da0 0x7f3398198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f339dc8b640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33981036c0 0x7f3398198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f339ec8d640 1 -- 172.21.15.60:0/2620094632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3398102da0 msgr2=0x7f3398198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f339ec8d640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3398102da0 0x7f3398198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f339ec8d640 1 -- 172.21.15.60:0/2620094632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33981036c0 msgr2=0x7f3398198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f339ec8d640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33981036c0 0x7f3398198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f339ec8d640 1 -- 172.21.15.60:0/2620094632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339819d4b0 con 0x7f339810c180 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f339ec8d640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339810c180 0x7f339819cdd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f339000eb10 tx=0x7f339000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f338f7fe640 1 -- 172.21.15.60:0/2620094632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390004b20 con 0x7f339810c180 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f338f7fe640 1 -- 172.21.15.60:0/2620094632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3390004cc0 con 0x7f339810c180 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339819d7a0 con 0x7f339810c180 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f338f7fe640 1 -- 172.21.15.60:0/2620094632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33900107f0 con 0x7f339810c180 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.495+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33981a5080 con 0x7f339810c180 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.496+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3398103180 con 0x7f339810c180 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.497+0000 7f338f7fe640 1 -- 172.21.15.60:0/2620094632 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3390005020 con 0x7f339810c180 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.498+0000 7f338f7fe640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f33840a2c10 0x7f33840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.498+0000 7f339e48c640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f33840a2c10 0x7f33840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.499+0000 7f338f7fe640 1 -- 172.21.15.60:0/2620094632 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f33900cf6d0 con 0x7f339810c180 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.499+0000 7f339e48c640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f33840a2c10 0x7f33840a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3394009230 tx=0x7f33940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:48.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.503+0000 7f338f7fe640 1 -- 172.21.15.60:0/2620094632 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f339009c500 con 0x7f339810c180 2024-09-11T23:57:48.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.706+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f3398062630 con 0x7f33840a2c10 2024-09-11T23:57:48.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.710+0000 7f338f7fe640 1 -- 172.21.15.60:0/2620094632 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3398062630 con 0x7f33840a2c10 2024-09-11T23:57:48.710 INFO:teuthology.orchestra.run.smithi060.stdout:/volumes/qa/sv_1/4096197b-9b2b-412c-b613-d5ae5ff99b34 2024-09-11T23:57:48.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f33840a2c10 msgr2=0x7f33840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:48.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f33840a2c10 0x7f33840a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3394009230 tx=0x7f33940058d0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339810c180 msgr2=0x7f339819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:48.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339810c180 0x7f339819cdd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f339000eb10 tx=0x7f339000c2d0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 shutdown_connections 2024-09-11T23:57:48.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f33840a2c10 0x7f33840a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f339810c180 0x7f339819cdd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33981036c0 0x7f3398198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 --2- 172.21.15.60:0/2620094632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3398102da0 0x7f3398198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:48.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 >> 172.21.15.60:0/2620094632 conn(0x7f33980fc7a0 msgr2=0x7f33980fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:48.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 shutdown_connections 2024-09-11T23:57:48.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:48.713+0000 7f33a06f0640 1 -- 172.21.15.60:0/2620094632 wait complete. 2024-09-11T23:57:48.970 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:48 smithi060 ceph-mon[30953]: pgmap v286: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.6 KiB/s wr, 20 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:49.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:48 smithi105 ceph-mon[34805]: pgmap v286: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.6 KiB/s wr, 20 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:49.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:48 smithi192 ceph-mon[35487]: pgmap v286: 97 pgs: 97 active+clean; 592 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.6 KiB/s wr, 20 op/s; 77 B/s, 0 objects/s recovering 2024-09-11T23:57:49.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:57:49.711 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:50.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:49 smithi060 ceph-mon[30953]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:50.185 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:49 smithi192 ceph-mon[35487]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:50.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.216+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2619707078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0100a80 msgr2=0x7f2ce0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:50.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.216+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2619707078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0100a80 0x7f2ce0100ee0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009930 tx=0x7f2cd002a420 comp rx=0 tx=0).stop 2024-09-11T23:57:50.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.216+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2619707078 shutdown_connections 2024-09-11T23:57:50.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.216+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2619707078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce0101420 0x7f2ce010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.216+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2619707078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0100a80 0x7f2ce0100ee0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.216+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2619707078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce0106a80 0x7f2ce0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.216+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2619707078 >> 172.21.15.60:0/2619707078 conn(0x7f2ce00fc7a0 msgr2=0x7f2ce00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:50.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.217+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2619707078 shutdown_connections 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.217+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2619707078 wait complete. 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.217+0000 7f2ce7b46640 1 Processor -- start 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.217+0000 7f2ce7b46640 1 -- start start 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.217+0000 7f2ce7b46640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce0100a80 0x7f2ce0198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.217+0000 7f2ce7b46640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0101420 0x7f2ce0198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.217+0000 7f2ce7b46640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce0106a80 0x7f2ce019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.217+0000 7f2ce7b46640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce01110b0 con 0x7f2ce0101420 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce7b46640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce0110f30 con 0x7f2ce0100a80 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce7b46640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce0111230 con 0x7f2ce0106a80 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0101420 0x7f2ce0198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0101420 0x7f2ce0198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51560/0 (socket says 172.21.15.60:51560) 2024-09-11T23:57:50.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 -- 172.21.15.60:0/2995136699 learned_addr learned my addr 172.21.15.60:0/2995136699 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce60e3640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce0106a80 0x7f2ce019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce58e2640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce0100a80 0x7f2ce0198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 -- 172.21.15.60:0/2995136699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce0106a80 msgr2=0x7f2ce019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce0106a80 0x7f2ce019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 -- 172.21.15.60:0/2995136699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce0100a80 msgr2=0x7f2ce0198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce0100a80 0x7f2ce0198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 -- 172.21.15.60:0/2995136699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce019d610 con 0x7f2ce0101420 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce58e2640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce0100a80 0x7f2ce0198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce50e1640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0101420 0x7f2ce0198ba0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2cd002a940 tx=0x7f2cd0032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2cd6ffd640 1 -- 172.21.15.60:0/2995136699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd003f030 con 0x7f2ce0101420 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2cd6ffd640 1 -- 172.21.15.60:0/2995136699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2cd0003d00 con 0x7f2ce0101420 2024-09-11T23:57:50.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce019d8a0 con 0x7f2ce0101420 2024-09-11T23:57:50.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2cd6ffd640 1 -- 172.21.15.60:0/2995136699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0035070 con 0x7f2ce0101420 2024-09-11T23:57:50.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.218+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce01a51e0 con 0x7f2ce0101420 2024-09-11T23:57:50.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.219+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce0100f60 con 0x7f2ce0101420 2024-09-11T23:57:50.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.220+0000 7f2cd6ffd640 1 -- 172.21.15.60:0/2995136699 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2cd0042030 con 0x7f2ce0101420 2024-09-11T23:57:50.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.221+0000 7f2cd6ffd640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2ccc0a2c90 0x7f2ccc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:50.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.221+0000 7f2ce58e2640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2ccc0a2c90 0x7f2ccc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:50.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.221+0000 7f2cd6ffd640 1 -- 172.21.15.60:0/2995136699 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f2cd00efc20 con 0x7f2ce0101420 2024-09-11T23:57:50.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.222+0000 7f2ce58e2640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2ccc0a2c90 0x7f2ccc0a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc006fd0 tx=0x7f2cdc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:50.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.225+0000 7f2cd6ffd640 1 -- 172.21.15.60:0/2995136699 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2cd00bc9f0 con 0x7f2ce0101420 2024-09-11T23:57:50.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:49 smithi105 ceph-mon[34805]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:57:50.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.437+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ce01999c0 con 0x7f2ce0101420 2024-09-11T23:57:50.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.438+0000 7f2cd6ffd640 1 -- 172.21.15.60:0/2995136699 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7f2ce01999c0 con 0x7f2ce0101420 2024-09-11T23:57:50.437 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:50.438 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"btime":"2024-09-11T23:57:41:505965+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:57:41.505953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-11T23:57:50.438 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2ccc0a2c90 msgr2=0x7f2ccc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2ccc0a2c90 0x7f2ccc0a5150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc006fd0 tx=0x7f2cdc008040 comp rx=0 tx=0).stop 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0101420 msgr2=0x7f2ce0198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0101420 0x7f2ce0198ba0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2cd002a940 tx=0x7f2cd0032bf0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 shutdown_connections 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce0106a80 0x7f2ce019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2ccc0a2c90 0x7f2ccc0a5150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ce0101420 0x7f2ce0198ba0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 --2- 172.21.15.60:0/2995136699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce0100a80 0x7f2ce0198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:50.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.440+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 >> 172.21.15.60:0/2995136699 conn(0x7f2ce00fc7a0 msgr2=0x7f2ce006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:50.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.441+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 shutdown_connections 2024-09-11T23:57:50.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:50.441+0000 7f2ce7b46640 1 -- 172.21.15.60:0/2995136699 wait complete. 2024-09-11T23:57:51.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:50 smithi060 ceph-mon[30953]: pgmap v287: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 21 op/s; 62 B/s, 0 objects/s recovering 2024-09-11T23:57:51.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:50 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2995136699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:51.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:51.201 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:50 smithi192 ceph-mon[35487]: pgmap v287: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 21 op/s; 62 B/s, 0 objects/s recovering 2024-09-11T23:57:51.201 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:50 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2995136699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:51.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:50 smithi105 ceph-mon[34805]: pgmap v287: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 21 op/s; 62 B/s, 0 objects/s recovering 2024-09-11T23:57:51.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:50 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2995136699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:57:51.433 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:51.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 -- 172.21.15.60:0/3801964482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0106f10 msgr2=0x7f61c010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:51.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 --2- 172.21.15.60:0/3801964482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0106f10 0x7f61c010ea90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009ca0 tx=0x7f61b802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 -- 172.21.15.60:0/3801964482 shutdown_connections 2024-09-11T23:57:51.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 --2- 172.21.15.60:0/3801964482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0106f10 0x7f61c010ea90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 --2- 172.21.15.60:0/3801964482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c0102790 0x7f61c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 --2- 172.21.15.60:0/3801964482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c0101de0 0x7f61c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 -- 172.21.15.60:0/3801964482 >> 172.21.15.60:0/3801964482 conn(0x7f61c00fd8c0 msgr2=0x7f61c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:51.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 -- 172.21.15.60:0/3801964482 shutdown_connections 2024-09-11T23:57:51.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.896+0000 7f61c4c07640 1 -- 172.21.15.60:0/3801964482 wait complete. 2024-09-11T23:57:51.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61c4c07640 1 Processor -- start 2024-09-11T23:57:51.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61c4c07640 1 -- start start 2024-09-11T23:57:51.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61c4c07640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c0101de0 0x7f61c0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:51.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61c4c07640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0102790 0x7f61c01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:51.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61c4c07640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c0106f10 0x7f61c019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:51.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61c4c07640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0112090 con 0x7f61c0102790 2024-09-11T23:57:51.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61c4c07640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0111f10 con 0x7f61c0101de0 2024-09-11T23:57:51.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61c4c07640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0112210 con 0x7f61c0106f10 2024-09-11T23:57:51.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61bdd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0102790 0x7f61c01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:51.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61bdd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0102790 0x7f61c01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54800/0 (socket says 172.21.15.60:54800) 2024-09-11T23:57:51.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61bdd9b640 1 -- 172.21.15.60:0/228589653 learned_addr learned my addr 172.21.15.60:0/228589653 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:51.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.897+0000 7f61be59c640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c0101de0 0x7f61c0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:51.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61bed9d640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c0106f10 0x7f61c019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:51.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61bdd9b640 1 -- 172.21.15.60:0/228589653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c0106f10 msgr2=0x7f61c019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:51.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61bdd9b640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c0106f10 0x7f61c019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61bdd9b640 1 -- 172.21.15.60:0/228589653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c0101de0 msgr2=0x7f61c0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:51.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61bdd9b640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c0101de0 0x7f61c0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61bdd9b640 1 -- 172.21.15.60:0/228589653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c019d440 con 0x7f61c0102790 2024-09-11T23:57:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61bdd9b640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0102790 0x7f61c01989d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f61b400e9f0 tx=0x7f61b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61af7fe640 1 -- 172.21.15.60:0/228589653 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b400cd80 con 0x7f61c0102790 2024-09-11T23:57:51.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c019d730 con 0x7f61c0102790 2024-09-11T23:57:51.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61af7fe640 1 -- 172.21.15.60:0/228589653 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f61b4010930 con 0x7f61c0102790 2024-09-11T23:57:51.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61af7fe640 1 -- 172.21.15.60:0/228589653 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4018b00 con 0x7f61c0102790 2024-09-11T23:57:51.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.898+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c01a5010 con 0x7f61c0102790 2024-09-11T23:57:51.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.899+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c01021c0 con 0x7f61c0102790 2024-09-11T23:57:51.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.900+0000 7f61af7fe640 1 -- 172.21.15.60:0/228589653 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f61b4018ca0 con 0x7f61c0102790 2024-09-11T23:57:51.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.901+0000 7f61af7fe640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f61a80a2c10 0x7f61a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:51.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.901+0000 7f61be59c640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f61a80a2c10 0x7f61a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:51.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.901+0000 7f61af7fe640 1 -- 172.21.15.60:0/228589653 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f61b40cf4d0 con 0x7f61c0102790 2024-09-11T23:57:51.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.902+0000 7f61be59c640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f61a80a2c10 0x7f61a80a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f61b00058c0 tx=0x7f61b000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:51.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:51.905+0000 7f61af7fe640 1 -- 172.21.15.60:0/228589653 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61b409bcb0 con 0x7f61c0102790 2024-09-11T23:57:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.081+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61c0109b60 con 0x7f61c0102790 2024-09-11T23:57:52.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.082+0000 7f61af7fe640 1 -- 172.21.15.60:0/228589653 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22645 (secure 0 0 0) 0x7f61b409ffb0 con 0x7f61c0102790 2024-09-11T23:57:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:52.082 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":82,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:57:40.484442+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:57:52.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f61a80a2c10 msgr2=0x7f61a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:52.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f61a80a2c10 0x7f61a80a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f61b00058c0 tx=0x7f61b000a2d0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0102790 msgr2=0x7f61c01989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0102790 0x7f61c01989d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f61b400e9f0 tx=0x7f61b400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 shutdown_connections 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c0106f10 0x7f61c019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f61a80a2c10 0x7f61a80a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61c0102790 0x7f61c01989d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 --2- 172.21.15.60:0/228589653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61c0101de0 0x7f61c0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.084+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 >> 172.21.15.60:0/228589653 conn(0x7f61c00fd8c0 msgr2=0x7f61c00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.085+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 shutdown_connections 2024-09-11T23:57:52.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:52.085+0000 7f61c4c07640 1 -- 172.21.15.60:0/228589653 wait complete. 2024-09-11T23:57:52.776 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:57:52.776 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:57:53.034 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:53.149 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:52 smithi060 ceph-mon[30953]: pgmap v288: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 18 op/s; 57 B/s, 0 objects/s recovering 2024-09-11T23:57:53.149 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:52 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/228589653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:53.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:52 smithi105 ceph-mon[34805]: pgmap v288: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 18 op/s; 57 B/s, 0 objects/s recovering 2024-09-11T23:57:53.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:52 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/228589653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:53.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:52 smithi192 ceph-mon[35487]: pgmap v288: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 18 op/s; 57 B/s, 0 objects/s recovering 2024-09-11T23:57:53.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:52 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/228589653' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:57:53.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 -- 172.21.15.60:0/2918428957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102570 msgr2=0x7f11481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:53.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 --2- 172.21.15.60:0/2918428957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102570 0x7f11481029b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1130009900 tx=0x7f113002a480 comp rx=0 tx=0).stop 2024-09-11T23:57:53.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 -- 172.21.15.60:0/2918428957 shutdown_connections 2024-09-11T23:57:53.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 --2- 172.21.15.60:0/2918428957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148102ef0 0x7f114810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 --2- 172.21.15.60:0/2918428957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102570 0x7f11481029b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 --2- 172.21.15.60:0/2918428957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1148100e20 0x7f1148101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 -- 172.21.15.60:0/2918428957 >> 172.21.15.60:0/2918428957 conn(0x7f11480fc7d0 msgr2=0x7f11480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 -- 172.21.15.60:0/2918428957 shutdown_connections 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 -- 172.21.15.60:0/2918428957 wait complete. 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 Processor -- start 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.486+0000 7f114da7a640 1 -- start start 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f114da7a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148100e20 0x7f1148199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f114da7a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1148102570 0x7f11481999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f114da7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102ef0 0x7f11481a4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f114da7a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11481110e0 con 0x7f1148102ef0 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f114da7a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1148110f60 con 0x7f1148102570 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f114da7a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1148111260 con 0x7f1148100e20 2024-09-11T23:57:53.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f1147fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102ef0 0x7f11481a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f1147fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102ef0 0x7f11481a4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54822/0 (socket says 172.21.15.60:54822) 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f1147fff640 1 -- 172.21.15.60:0/2722181667 learned_addr learned my addr 172.21.15.60:0/2722181667 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f113effd640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1148102570 0x7f11481999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f11477fe640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148100e20 0x7f1148199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f1147fff640 1 -- 172.21.15.60:0/2722181667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148100e20 msgr2=0x7f1148199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f1147fff640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148100e20 0x7f1148199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f1147fff640 1 -- 172.21.15.60:0/2722181667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1148102570 msgr2=0x7f11481999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f1147fff640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1148102570 0x7f11481999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f1147fff640 1 -- 172.21.15.60:0/2722181667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11481a4a40 con 0x7f1148102ef0 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.487+0000 7f11477fe640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148100e20 0x7f1148199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.488+0000 7f1147fff640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102ef0 0x7f11481a4500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f114000b970 tx=0x7f114000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.488+0000 7f11457fa640 1 -- 172.21.15.60:0/2722181667 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140019070 con 0x7f1148102ef0 2024-09-11T23:57:53.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.488+0000 7f11457fa640 1 -- 172.21.15.60:0/2722181667 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f114000cb40 con 0x7f1148102ef0 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.488+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11481a4c10 con 0x7f1148102ef0 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.488+0000 7f11457fa640 1 -- 172.21.15.60:0/2722181667 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140007700 con 0x7f1148102ef0 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.488+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11481a50d0 con 0x7f1148102ef0 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.489+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1148101200 con 0x7f1148102ef0 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.490+0000 7f11457fa640 1 -- 172.21.15.60:0/2722181667 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f114001c070 con 0x7f1148102ef0 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.491+0000 7f11457fa640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f11340a2c10 0x7f11340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.491+0000 7f11457fa640 1 -- 172.21.15.60:0/2722181667 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f11400ce6d0 con 0x7f1148102ef0 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.491+0000 7f11477fe640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f11340a2c10 0x7f11340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:53.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.491+0000 7f11477fe640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f11340a2c10 0x7f11340a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1138009b40 tx=0x7f1138005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:53.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.495+0000 7f11457fa640 1 -- 172.21.15.60:0/2722181667 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f114009b610 con 0x7f1148102ef0 2024-09-11T23:57:53.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.666+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1148106f80 con 0x7f11340a2c10 2024-09-11T23:57:53.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.673+0000 7f11457fa640 1 -- 172.21.15.60:0/2722181667 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258930 (secure 0 0 0) 0x7f1148106f80 con 0x7f11340a2c10 2024-09-11T23:57:53.675 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:53.676 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:57:53.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f11340a2c10 msgr2=0x7f11340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f11340a2c10 0x7f11340a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1138009b40 tx=0x7f1138005e50 comp rx=0 tx=0).stop 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102ef0 msgr2=0x7f11481a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102ef0 0x7f11481a4500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f114000b970 tx=0x7f114000be30 comp rx=0 tx=0).stop 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 shutdown_connections 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f11340a2c10 0x7f11340a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1148102ef0 0x7f11481a4500 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1148102570 0x7f11481999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 --2- 172.21.15.60:0/2722181667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148100e20 0x7f1148199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.677+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 >> 172.21.15.60:0/2722181667 conn(0x7f11480fc7d0 msgr2=0x7f1148106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.678+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 shutdown_connections 2024-09-11T23:57:53.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:53.678+0000 7f114da7a640 1 -- 172.21.15.60:0/2722181667 wait complete. 2024-09-11T23:57:54.446 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-11T23:57:53.373434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639268,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":260,"num_read_kb":233,"num_write":413,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368624,"kb_used_data":11052,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573200,"statfs":{"total":1151940427776,"available":1151562956800,"internally_reserved":0,"allocated":11317248,"data_stored":7131730,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43544,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":-1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":124,"num_read_kb":114,"num_write":89,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003010"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488874+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:57:40.488874+0000","last_peered":"2024-09-11T23:57:40.488874+0000","last_clean":"2024-09-11T23:57:40.488874+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:57:40.488874+0000","last_undegraded":"2024-09-11T23:57:40.488874+0000","last_fullsized":"2024-09-11T23:57:40.488874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799409+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:57:40.799409+0000","last_peered":"2024-09-11T23:57:40.799409+0000","last_clean":"2024-09-11T23:57:40.799409+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:57:40.799409+0000","last_undegraded":"2024-09-11T23:57:40.799409+0000","last_fullsized":"2024-09-11T23:57:40.799409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799455+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:57:40.799455+0000","last_peered":"2024-09-11T23:57:40.799455+0000","last_clean":"2024-09-11T23:57:40.799455+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:57:40.799455+0000","last_undegraded":"2024-09-11T23:57:40.799455+0000","last_fullsized":"2024-09-11T23:57:40.799455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488696+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:57:40.488696+0000","last_peered":"2024-09-11T23:57:40.488696+0000","last_clean":"2024-09-11T23:57:40.488696+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:57:40.488696+0000","last_undegraded":"2024-09-11T23:57:40.488696+0000","last_fullsized":"2024-09-11T23:57:40.488696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491218+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:57:40.491218+0000","last_peered":"2024-09-11T23:57:40.491218+0000","last_clean":"2024-09-11T23:57:40.491218+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:57:40.491218+0000","last_undegraded":"2024-09-11T23:57:40.491218+0000","last_fullsized":"2024-09-11T23:57:40.491218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799682+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:57:40.799682+0000","last_peered":"2024-09-11T23:57:40.799682+0000","last_clean":"2024-09-11T23:57:40.799682+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:57:40.799682+0000","last_undegraded":"2024-09-11T23:57:40.799682+0000","last_fullsized":"2024-09-11T23:57:40.799682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489139+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:57:40.489139+0000","last_peered":"2024-09-11T23:57:40.489139+0000","last_clean":"2024-09-11T23:57:40.489139+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:57:40.489139+0000","last_undegraded":"2024-09-11T23:57:40.489139+0000","last_fullsized":"2024-09-11T23:57:40.489139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488986+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:57:40.488986+0000","last_peered":"2024-09-11T23:57:40.488986+0000","last_clean":"2024-09-11T23:57:40.488986+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:57:40.488986+0000","last_undegraded":"2024-09-11T23:57:40.488986+0000","last_fullsized":"2024-09-11T23:57:40.488986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800714+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:57:40.800714+0000","last_peered":"2024-09-11T23:57:40.800714+0000","last_clean":"2024-09-11T23:57:40.800714+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:57:40.800714+0000","last_undegraded":"2024-09-11T23:57:40.800714+0000","last_fullsized":"2024-09-11T23:57:40.800714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800173+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:57:40.800173+0000","last_peered":"2024-09-11T23:57:40.800173+0000","last_clean":"2024-09-11T23:57:40.800173+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:57:40.800173+0000","last_undegraded":"2024-09-11T23:57:40.800173+0000","last_fullsized":"2024-09-11T23:57:40.800173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488801+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:57:40.488801+0000","last_peered":"2024-09-11T23:57:40.488801+0000","last_clean":"2024-09-11T23:57:40.488801+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:57:40.488801+0000","last_undegraded":"2024-09-11T23:57:40.488801+0000","last_fullsized":"2024-09-11T23:57:40.488801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800804+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:57:40.800804+0000","last_peered":"2024-09-11T23:57:40.800804+0000","last_clean":"2024-09-11T23:57:40.800804+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:57:40.800804+0000","last_undegraded":"2024-09-11T23:57:40.800804+0000","last_fullsized":"2024-09-11T23:57:40.800804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487617+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:57:40.487617+0000","last_peered":"2024-09-11T23:57:40.487617+0000","last_clean":"2024-09-11T23:57:40.487617+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:57:40.487617+0000","last_undegraded":"2024-09-11T23:57:40.487617+0000","last_fullsized":"2024-09-11T23:57:40.487617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799293+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:57:40.799293+0000","last_peered":"2024-09-11T23:57:40.799293+0000","last_clean":"2024-09-11T23:57:40.799293+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:57:40.799293+0000","last_undegraded":"2024-09-11T23:57:40.799293+0000","last_fullsized":"2024-09-11T23:57:40.799293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799209+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:57:40.799209+0000","last_peered":"2024-09-11T23:57:40.799209+0000","last_clean":"2024-09-11T23:57:40.799209+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:57:40.799209+0000","last_undegraded":"2024-09-11T23:57:40.799209+0000","last_fullsized":"2024-09-11T23:57:40.799209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800297+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:57:40.800297+0000","last_peered":"2024-09-11T23:57:40.800297+0000","last_clean":"2024-09-11T23:57:40.800297+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:57:40.800297+0000","last_undegraded":"2024-09-11T23:57:40.800297+0000","last_fullsized":"2024-09-11T23:57:40.800297+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489035+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:57:40.489035+0000","last_peered":"2024-09-11T23:57:40.489035+0000","last_clean":"2024-09-11T23:57:40.489035+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:57:40.489035+0000","last_undegraded":"2024-09-11T23:57:40.489035+0000","last_fullsized":"2024-09-11T23:57:40.489035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491181+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:57:40.491181+0000","last_peered":"2024-09-11T23:57:40.491181+0000","last_clean":"2024-09-11T23:57:40.491181+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:57:40.491181+0000","last_undegraded":"2024-09-11T23:57:40.491181+0000","last_fullsized":"2024-09-11T23:57:40.491181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489817+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:57:40.489817+0000","last_peered":"2024-09-11T23:57:40.489817+0000","last_clean":"2024-09-11T23:57:40.489817+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:57:40.489817+0000","last_undegraded":"2024-09-11T23:57:40.489817+0000","last_fullsized":"2024-09-11T23:57:40.489817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488148+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:57:40.488148+0000","last_peered":"2024-09-11T23:57:40.488148+0000","last_clean":"2024-09-11T23:57:40.488148+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:57:40.488148+0000","last_undegraded":"2024-09-11T23:57:40.488148+0000","last_fullsized":"2024-09-11T23:57:40.488148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487703+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:57:40.487703+0000","last_peered":"2024-09-11T23:57:40.487703+0000","last_clean":"2024-09-11T23:57:40.487703+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:57:40.487703+0000","last_undegraded":"2024-09-11T23:57:40.487703+0000","last_fullsized":"2024-09-11T23:57:40.487703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800467+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:57:40.800467+0000","last_peered":"2024-09-11T23:57:40.800467+0000","last_clean":"2024-09-11T23:57:40.800467+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:57:40.800467+0000","last_undegraded":"2024-09-11T23:57:40.800467+0000","last_fullsized":"2024-09-11T23:57:40.800467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489186+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:57:40.489186+0000","last_peered":"2024-09-11T23:57:40.489186+0000","last_clean":"2024-09-11T23:57:40.489186+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:57:40.489186+0000","last_undegraded":"2024-09-11T23:57:40.489186+0000","last_fullsized":"2024-09-11T23:57:40.489186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491160+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:57:40.491160+0000","last_peered":"2024-09-11T23:57:40.491160+0000","last_clean":"2024-09-11T23:57:40.491160+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:57:40.491160+0000","last_undegraded":"2024-09-11T23:57:40.491160+0000","last_fullsized":"2024-09-11T23:57:40.491160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489537+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:57:40.489537+0000","last_peered":"2024-09-11T23:57:40.489537+0000","last_clean":"2024-09-11T23:57:40.489537+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:57:40.489537+0000","last_undegraded":"2024-09-11T23:57:40.489537+0000","last_fullsized":"2024-09-11T23:57:40.489537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490110+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:57:40.490110+0000","last_peered":"2024-09-11T23:57:40.490110+0000","last_clean":"2024-09-11T23:57:40.490110+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:57:40.490110+0000","last_undegraded":"2024-09-11T23:57:40.490110+0000","last_fullsized":"2024-09-11T23:57:40.490110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488877+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:57:40.488877+0000","last_peered":"2024-09-11T23:57:40.488877+0000","last_clean":"2024-09-11T23:57:40.488877+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:57:40.488877+0000","last_undegraded":"2024-09-11T23:57:40.488877+0000","last_fullsized":"2024-09-11T23:57:40.488877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487540+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:57:40.487540+0000","last_peered":"2024-09-11T23:57:40.487540+0000","last_clean":"2024-09-11T23:57:40.487540+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:57:40.487540+0000","last_undegraded":"2024-09-11T23:57:40.487540+0000","last_fullsized":"2024-09-11T23:57:40.487540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:57:40.799410+0000","last_peered":"2024-09-11T23:57:40.799410+0000","last_clean":"2024-09-11T23:57:40.799410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:57:40.799410+0000","last_undegraded":"2024-09-11T23:57:40.799410+0000","last_fullsized":"2024-09-11T23:57:40.799410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489720+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:57:40.489720+0000","last_peered":"2024-09-11T23:57:40.489720+0000","last_clean":"2024-09-11T23:57:40.489720+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:57:40.489720+0000","last_undegraded":"2024-09-11T23:57:40.489720+0000","last_fullsized":"2024-09-11T23:57:40.489720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.493188+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:57:40.493188+0000","last_peered":"2024-09-11T23:57:40.493188+0000","last_clean":"2024-09-11T23:57:40.493188+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:57:40.493188+0000","last_undegraded":"2024-09-11T23:57:40.493188+0000","last_fullsized":"2024-09-11T23:57:40.493188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488168+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:57:40.488168+0000","last_peered":"2024-09-11T23:57:40.488168+0000","last_clean":"2024-09-11T23:57:40.488168+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:57:40.488168+0000","last_undegraded":"2024-09-11T23:57:40.488168+0000","last_fullsized":"2024-09-11T23:57:40.488168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491663+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:57:40.491663+0000","last_peered":"2024-09-11T23:57:40.491663+0000","last_clean":"2024-09-11T23:57:40.491663+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:57:40.491663+0000","last_undegraded":"2024-09-11T23:57:40.491663+0000","last_fullsized":"2024-09-11T23:57:40.491663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:51.529504+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:57:51.529504+0000","last_peered":"2024-09-11T23:57:51.529504+0000","last_clean":"2024-09-11T23:57:51.529504+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:57:51.529504+0000","last_undegraded":"2024-09-11T23:57:51.529504+0000","last_fullsized":"2024-09-11T23:57:51.529504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491546+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:57:40.491546+0000","last_peered":"2024-09-11T23:57:40.491546+0000","last_clean":"2024-09-11T23:57:40.491546+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:57:40.491546+0000","last_undegraded":"2024-09-11T23:57:40.491546+0000","last_fullsized":"2024-09-11T23:57:40.491546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799644+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:57:40.799644+0000","last_peered":"2024-09-11T23:57:40.799644+0000","last_clean":"2024-09-11T23:57:40.799644+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:57:40.799644+0000","last_undegraded":"2024-09-11T23:57:40.799644+0000","last_fullsized":"2024-09-11T23:57:40.799644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487353+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:57:40.487353+0000","last_peered":"2024-09-11T23:57:40.487353+0000","last_clean":"2024-09-11T23:57:40.487353+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:57:40.487353+0000","last_undegraded":"2024-09-11T23:57:40.487353+0000","last_fullsized":"2024-09-11T23:57:40.487353+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489034+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:57:40.489034+0000","last_peered":"2024-09-11T23:57:40.489034+0000","last_clean":"2024-09-11T23:57:40.489034+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:57:40.489034+0000","last_undegraded":"2024-09-11T23:57:40.489034+0000","last_fullsized":"2024-09-11T23:57:40.489034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491451+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:57:40.491451+0000","last_peered":"2024-09-11T23:57:40.491451+0000","last_clean":"2024-09-11T23:57:40.491451+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:57:40.491451+0000","last_undegraded":"2024-09-11T23:57:40.491451+0000","last_fullsized":"2024-09-11T23:57:40.491451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490361+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:57:40.490361+0000","last_peered":"2024-09-11T23:57:40.490361+0000","last_clean":"2024-09-11T23:57:40.490361+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:57:40.490361+0000","last_undegraded":"2024-09-11T23:57:40.490361+0000","last_fullsized":"2024-09-11T23:57:40.490361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:47.523536+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:57:47.523536+0000","last_peered":"2024-09-11T23:57:47.523536+0000","last_clean":"2024-09-11T23:57:47.523536+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:57:47.523536+0000","last_undegraded":"2024-09-11T23:57:47.523536+0000","last_fullsized":"2024-09-11T23:57:47.523536+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800707+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:57:40.800707+0000","last_peered":"2024-09-11T23:57:40.800707+0000","last_clean":"2024-09-11T23:57:40.800707+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:57:40.800707+0000","last_undegraded":"2024-09-11T23:57:40.800707+0000","last_fullsized":"2024-09-11T23:57:40.800707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488921+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:57:40.488921+0000","last_peered":"2024-09-11T23:57:40.488921+0000","last_clean":"2024-09-11T23:57:40.488921+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:57:40.488921+0000","last_undegraded":"2024-09-11T23:57:40.488921+0000","last_fullsized":"2024-09-11T23:57:40.488921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799598+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:57:40.799598+0000","last_peered":"2024-09-11T23:57:40.799598+0000","last_clean":"2024-09-11T23:57:40.799598+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:57:40.799598+0000","last_undegraded":"2024-09-11T23:57:40.799598+0000","last_fullsized":"2024-09-11T23:57:40.799598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491653+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:57:40.491653+0000","last_peered":"2024-09-11T23:57:40.491653+0000","last_clean":"2024-09-11T23:57:40.491653+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:57:40.491653+0000","last_undegraded":"2024-09-11T23:57:40.491653+0000","last_fullsized":"2024-09-11T23:57:40.491653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800834+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:57:40.800834+0000","last_peered":"2024-09-11T23:57:40.800834+0000","last_clean":"2024-09-11T23:57:40.800834+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:57:40.800834+0000","last_undegraded":"2024-09-11T23:57:40.800834+0000","last_fullsized":"2024-09-11T23:57:40.800834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'23","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:47.525920+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:57:47.525920+0000","last_peered":"2024-09-11T23:57:47.525920+0000","last_clean":"2024-09-11T23:57:47.525920+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:57:47.525920+0000","last_undegraded":"2024-09-11T23:57:47.525920+0000","last_fullsized":"2024-09-11T23:57:47.525920+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":49,"num_write":25,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491931+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:57:40.491931+0000","last_peered":"2024-09-11T23:57:40.491931+0000","last_clean":"2024-09-11T23:57:40.491931+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:57:40.491931+0000","last_undegraded":"2024-09-11T23:57:40.491931+0000","last_fullsized":"2024-09-11T23:57:40.491931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.513007+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:57:41.513007+0000","last_peered":"2024-09-11T23:57:41.513007+0000","last_clean":"2024-09-11T23:57:41.513007+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:57:41.513007+0000","last_undegraded":"2024-09-11T23:57:41.513007+0000","last_fullsized":"2024-09-11T23:57:41.513007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487257+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:57:40.487257+0000","last_peered":"2024-09-11T23:57:40.487257+0000","last_clean":"2024-09-11T23:57:40.487257+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:57:40.487257+0000","last_undegraded":"2024-09-11T23:57:40.487257+0000","last_fullsized":"2024-09-11T23:57:40.487257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491147+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:57:40.491147+0000","last_peered":"2024-09-11T23:57:40.491147+0000","last_clean":"2024-09-11T23:57:40.491147+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:57:40.491147+0000","last_undegraded":"2024-09-11T23:57:40.491147+0000","last_fullsized":"2024-09-11T23:57:40.491147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491962+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:57:40.491962+0000","last_peered":"2024-09-11T23:57:40.491962+0000","last_clean":"2024-09-11T23:57:40.491962+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:57:40.491962+0000","last_undegraded":"2024-09-11T23:57:40.491962+0000","last_fullsized":"2024-09-11T23:57:40.491962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:47.524424+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:57:47.524424+0000","last_peered":"2024-09-11T23:57:47.524424+0000","last_clean":"2024-09-11T23:57:47.524424+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:57:47.524424+0000","last_undegraded":"2024-09-11T23:57:47.524424+0000","last_fullsized":"2024-09-11T23:57:47.524424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488670+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:57:40.488670+0000","last_peered":"2024-09-11T23:57:40.488670+0000","last_clean":"2024-09-11T23:57:40.488670+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:57:40.488670+0000","last_undegraded":"2024-09-11T23:57:40.488670+0000","last_fullsized":"2024-09-11T23:57:40.488670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491641+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:57:40.491641+0000","last_peered":"2024-09-11T23:57:40.491641+0000","last_clean":"2024-09-11T23:57:40.491641+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:57:40.491641+0000","last_undegraded":"2024-09-11T23:57:40.491641+0000","last_fullsized":"2024-09-11T23:57:40.491641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490860+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:57:40.490860+0000","last_peered":"2024-09-11T23:57:40.490860+0000","last_clean":"2024-09-11T23:57:40.490860+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:57:40.490860+0000","last_undegraded":"2024-09-11T23:57:40.490860+0000","last_fullsized":"2024-09-11T23:57:40.490860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491899+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:57:40.491899+0000","last_peered":"2024-09-11T23:57:40.491899+0000","last_clean":"2024-09-11T23:57:40.491899+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:57:40.491899+0000","last_undegraded":"2024-09-11T23:57:40.491899+0000","last_fullsized":"2024-09-11T23:57:40.491899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488299+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:57:40.488299+0000","last_peered":"2024-09-11T23:57:40.488299+0000","last_clean":"2024-09-11T23:57:40.488299+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:57:40.488299+0000","last_undegraded":"2024-09-11T23:57:40.488299+0000","last_fullsized":"2024-09-11T23:57:40.488299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.805290+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:57:40.805290+0000","last_peered":"2024-09-11T23:57:40.805290+0000","last_clean":"2024-09-11T23:57:40.805290+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:57:40.805290+0000","last_undegraded":"2024-09-11T23:57:40.805290+0000","last_fullsized":"2024-09-11T23:57:40.805290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488979+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:57:40.488979+0000","last_peered":"2024-09-11T23:57:40.488979+0000","last_clean":"2024-09-11T23:57:40.488979+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:57:40.488979+0000","last_undegraded":"2024-09-11T23:57:40.488979+0000","last_fullsized":"2024-09-11T23:57:40.488979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491752+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:57:40.491752+0000","last_peered":"2024-09-11T23:57:40.491752+0000","last_clean":"2024-09-11T23:57:40.491752+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:57:40.491752+0000","last_undegraded":"2024-09-11T23:57:40.491752+0000","last_fullsized":"2024-09-11T23:57:40.491752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489696+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:57:40.489696+0000","last_peered":"2024-09-11T23:57:40.489696+0000","last_clean":"2024-09-11T23:57:40.489696+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:57:40.489696+0000","last_undegraded":"2024-09-11T23:57:40.489696+0000","last_fullsized":"2024-09-11T23:57:40.489696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:51.529720+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:57:51.529720+0000","last_peered":"2024-09-11T23:57:51.529720+0000","last_clean":"2024-09-11T23:57:51.529720+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:57:51.529720+0000","last_undegraded":"2024-09-11T23:57:51.529720+0000","last_fullsized":"2024-09-11T23:57:51.529720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489088+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:57:40.489088+0000","last_peered":"2024-09-11T23:57:40.489088+0000","last_clean":"2024-09-11T23:57:40.489088+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:57:40.489088+0000","last_undegraded":"2024-09-11T23:57:40.489088+0000","last_fullsized":"2024-09-11T23:57:40.489088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":345,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489001+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:57:40.489001+0000","last_peered":"2024-09-11T23:57:40.489001+0000","last_clean":"2024-09-11T23:57:40.489001+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:57:40.489001+0000","last_undegraded":"2024-09-11T23:57:40.489001+0000","last_fullsized":"2024-09-11T23:57:40.489001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.513119+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:57:41.513119+0000","last_peered":"2024-09-11T23:57:41.513119+0000","last_clean":"2024-09-11T23:57:41.513119+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:57:41.513119+0000","last_undegraded":"2024-09-11T23:57:41.513119+0000","last_fullsized":"2024-09-11T23:57:41.513119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489307+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:57:40.489307+0000","last_peered":"2024-09-11T23:57:40.489307+0000","last_clean":"2024-09-11T23:57:40.489307+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:57:40.489307+0000","last_undegraded":"2024-09-11T23:57:40.489307+0000","last_fullsized":"2024-09-11T23:57:40.489307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.498988+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:57:40.498988+0000","last_peered":"2024-09-11T23:57:40.498988+0000","last_clean":"2024-09-11T23:57:40.498988+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:57:40.498988+0000","last_undegraded":"2024-09-11T23:57:40.498988+0000","last_fullsized":"2024-09-11T23:57:40.498988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487248+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:57:40.487248+0000","last_peered":"2024-09-11T23:57:40.487248+0000","last_clean":"2024-09-11T23:57:40.487248+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:57:40.487248+0000","last_undegraded":"2024-09-11T23:57:40.487248+0000","last_fullsized":"2024-09-11T23:57:40.487248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:48.524993+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:57:48.524993+0000","last_peered":"2024-09-11T23:57:48.524993+0000","last_clean":"2024-09-11T23:57:48.524993+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:57:48.524993+0000","last_undegraded":"2024-09-11T23:57:48.524993+0000","last_fullsized":"2024-09-11T23:57:48.524993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491275+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:57:40.491275+0000","last_peered":"2024-09-11T23:57:40.491275+0000","last_clean":"2024-09-11T23:57:40.491275+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:57:40.491275+0000","last_undegraded":"2024-09-11T23:57:40.491275+0000","last_fullsized":"2024-09-11T23:57:40.491275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:47.523458+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:57:47.523458+0000","last_peered":"2024-09-11T23:57:47.523458+0000","last_clean":"2024-09-11T23:57:47.523458+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:57:47.523458+0000","last_undegraded":"2024-09-11T23:57:47.523458+0000","last_fullsized":"2024-09-11T23:57:47.523458+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799994+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:57:40.799994+0000","last_peered":"2024-09-11T23:57:40.799994+0000","last_clean":"2024-09-11T23:57:40.799994+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:57:40.799994+0000","last_undegraded":"2024-09-11T23:57:40.799994+0000","last_fullsized":"2024-09-11T23:57:40.799994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491288+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:57:40.491288+0000","last_peered":"2024-09-11T23:57:40.491288+0000","last_clean":"2024-09-11T23:57:40.491288+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:57:40.491288+0000","last_undegraded":"2024-09-11T23:57:40.491288+0000","last_fullsized":"2024-09-11T23:57:40.491288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800126+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:57:40.800126+0000","last_peered":"2024-09-11T23:57:40.800126+0000","last_clean":"2024-09-11T23:57:40.800126+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:57:40.800126+0000","last_undegraded":"2024-09-11T23:57:40.800126+0000","last_fullsized":"2024-09-11T23:57:40.800126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.492087+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:57:40.492087+0000","last_peered":"2024-09-11T23:57:40.492087+0000","last_clean":"2024-09-11T23:57:40.492087+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:57:40.492087+0000","last_undegraded":"2024-09-11T23:57:40.492087+0000","last_fullsized":"2024-09-11T23:57:40.492087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487615+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:57:40.487615+0000","last_peered":"2024-09-11T23:57:40.487615+0000","last_clean":"2024-09-11T23:57:40.487615+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:57:40.487615+0000","last_undegraded":"2024-09-11T23:57:40.487615+0000","last_fullsized":"2024-09-11T23:57:40.487615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:47.437889+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:57:47.437889+0000","last_peered":"2024-09-11T23:57:47.437889+0000","last_clean":"2024-09-11T23:57:47.437889+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:57:47.437889+0000","last_undegraded":"2024-09-11T23:57:47.437889+0000","last_fullsized":"2024-09-11T23:57:47.437889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489719+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:57:40.489719+0000","last_peered":"2024-09-11T23:57:40.489719+0000","last_clean":"2024-09-11T23:57:40.489719+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:57:40.489719+0000","last_undegraded":"2024-09-11T23:57:40.489719+0000","last_fullsized":"2024-09-11T23:57:40.489719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488806+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:57:40.488806+0000","last_peered":"2024-09-11T23:57:40.488806+0000","last_clean":"2024-09-11T23:57:40.488806+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:57:40.488806+0000","last_undegraded":"2024-09-11T23:57:40.488806+0000","last_fullsized":"2024-09-11T23:57:40.488806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799613+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:57:40.799613+0000","last_peered":"2024-09-11T23:57:40.799613+0000","last_clean":"2024-09-11T23:57:40.799613+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:57:40.799613+0000","last_undegraded":"2024-09-11T23:57:40.799613+0000","last_fullsized":"2024-09-11T23:57:40.799613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800369+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:57:40.800369+0000","last_peered":"2024-09-11T23:57:40.800369+0000","last_clean":"2024-09-11T23:57:40.800369+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:57:40.800369+0000","last_undegraded":"2024-09-11T23:57:40.800369+0000","last_fullsized":"2024-09-11T23:57:40.800369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491088+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:57:40.491088+0000","last_peered":"2024-09-11T23:57:40.491088+0000","last_clean":"2024-09-11T23:57:40.491088+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:57:40.491088+0000","last_undegraded":"2024-09-11T23:57:40.491088+0000","last_fullsized":"2024-09-11T23:57:40.491088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489374+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:57:40.489374+0000","last_peered":"2024-09-11T23:57:40.489374+0000","last_clean":"2024-09-11T23:57:40.489374+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:57:40.489374+0000","last_undegraded":"2024-09-11T23:57:40.489374+0000","last_fullsized":"2024-09-11T23:57:40.489374+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488316+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:57:40.488316+0000","last_peered":"2024-09-11T23:57:40.488316+0000","last_clean":"2024-09-11T23:57:40.488316+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:57:40.488316+0000","last_undegraded":"2024-09-11T23:57:40.488316+0000","last_fullsized":"2024-09-11T23:57:40.488316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489841+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:57:40.489841+0000","last_peered":"2024-09-11T23:57:40.489841+0000","last_clean":"2024-09-11T23:57:40.489841+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:57:40.489841+0000","last_undegraded":"2024-09-11T23:57:40.489841+0000","last_fullsized":"2024-09-11T23:57:40.489841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489180+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:57:40.489180+0000","last_peered":"2024-09-11T23:57:40.489180+0000","last_clean":"2024-09-11T23:57:40.489180+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:57:40.489180+0000","last_undegraded":"2024-09-11T23:57:40.489180+0000","last_fullsized":"2024-09-11T23:57:40.489180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491384+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:57:40.491384+0000","last_peered":"2024-09-11T23:57:40.491384+0000","last_clean":"2024-09-11T23:57:40.491384+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:57:40.491384+0000","last_undegraded":"2024-09-11T23:57:40.491384+0000","last_fullsized":"2024-09-11T23:57:40.491384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489563+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:57:40.489563+0000","last_peered":"2024-09-11T23:57:40.489563+0000","last_clean":"2024-09-11T23:57:40.489563+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:57:40.489563+0000","last_undegraded":"2024-09-11T23:57:40.489563+0000","last_fullsized":"2024-09-11T23:57:40.489563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491508+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:57:40.491508+0000","last_peered":"2024-09-11T23:57:40.491508+0000","last_clean":"2024-09-11T23:57:40.491508+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:57:40.491508+0000","last_undegraded":"2024-09-11T23:57:40.491508+0000","last_fullsized":"2024-09-11T23:57:40.491508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491868+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:57:40.491868+0000","last_peered":"2024-09-11T23:57:40.491868+0000","last_clean":"2024-09-11T23:57:40.491868+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:57:40.491868+0000","last_undegraded":"2024-09-11T23:57:40.491868+0000","last_fullsized":"2024-09-11T23:57:40.491868+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800371+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:57:40.800371+0000","last_peered":"2024-09-11T23:57:40.800371+0000","last_clean":"2024-09-11T23:57:40.800371+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:57:40.800371+0000","last_undegraded":"2024-09-11T23:57:40.800371+0000","last_fullsized":"2024-09-11T23:57:40.800371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.512639+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:57:41.512639+0000","last_peered":"2024-09-11T23:57:41.512639+0000","last_clean":"2024-09-11T23:57:41.512639+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:57:41.512639+0000","last_undegraded":"2024-09-11T23:57:41.512639+0000","last_fullsized":"2024-09-11T23:57:41.512639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799601+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:57:40.799601+0000","last_peered":"2024-09-11T23:57:40.799601+0000","last_clean":"2024-09-11T23:57:40.799601+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:57:40.799601+0000","last_undegraded":"2024-09-11T23:57:40.799601+0000","last_fullsized":"2024-09-11T23:57:40.799601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489988+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:57:40.489988+0000","last_peered":"2024-09-11T23:57:40.489988+0000","last_clean":"2024-09-11T23:57:40.489988+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:57:40.489988+0000","last_undegraded":"2024-09-11T23:57:40.489988+0000","last_fullsized":"2024-09-11T23:57:40.489988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489745+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:57:40.489745+0000","last_peered":"2024-09-11T23:57:40.489745+0000","last_clean":"2024-09-11T23:57:40.489745+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:57:40.489745+0000","last_undegraded":"2024-09-11T23:57:40.489745+0000","last_fullsized":"2024-09-11T23:57:40.489745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:48.524072+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:57:48.524072+0000","last_peered":"2024-09-11T23:57:48.524072+0000","last_clean":"2024-09-11T23:57:48.524072+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:57:48.524072+0000","last_undegraded":"2024-09-11T23:57:48.524072+0000","last_fullsized":"2024-09-11T23:57:48.524072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48666,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":124,"num_read_kb":114,"num_write":230,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":164092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285260,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579920,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":434178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1066665,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972378,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":434108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201311,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":434486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430244,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1027792,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":434218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1026684,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":435094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":433650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":484448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":485243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":435164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":43194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:57:54.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:57:54.710 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:55.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:54 smithi060 ceph-mon[30953]: pgmap v289: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 17 op/s; 51 B/s, 0 objects/s recovering 2024-09-11T23:57:55.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:54 smithi060 ceph-mon[30953]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:55.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 -- 172.21.15.60:0/2520744230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 msgr2=0x7f3188103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 --2- 172.21.15.60:0/2520744230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 0x7f3188103180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3178009900 tx=0x7f317802a480 comp rx=0 tx=0).stop 2024-09-11T23:57:55.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 -- 172.21.15.60:0/2520744230 shutdown_connections 2024-09-11T23:57:55.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 --2- 172.21.15.60:0/2520744230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f318810c180 0x7f318810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 --2- 172.21.15.60:0/2520744230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31881036c0 0x7f318810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 --2- 172.21.15.60:0/2520744230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 0x7f3188103180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 -- 172.21.15.60:0/2520744230 >> 172.21.15.60:0/2520744230 conn(0x7f31880fc7a0 msgr2=0x7f31880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 -- 172.21.15.60:0/2520744230 shutdown_connections 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.194+0000 7f318d26f640 1 -- 172.21.15.60:0/2520744230 wait complete. 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f318d26f640 1 Processor -- start 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f318d26f640 1 -- start start 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f318d26f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 0x7f31881984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f318d26f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31881036c0 0x7f31881989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f318d26f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318810c180 0x7f318819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f318d26f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3188112080 con 0x7f3188102da0 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f318d26f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3188111f00 con 0x7f31881036c0 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f318d26f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3188112200 con 0x7f318810c180 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f3186ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 0x7f31881984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:55.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.195+0000 7f3186ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 0x7f31881984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54836/0 (socket says 172.21.15.60:54836) 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3186ffd640 1 -- 172.21.15.60:0/124553316 learned_addr learned my addr 172.21.15.60:0/124553316 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f317ffff640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31881036c0 0x7f31881989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3186ffd640 1 -- 172.21.15.60:0/124553316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318810c180 msgr2=0x7f318819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f31877fe640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318810c180 0x7f318819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3186ffd640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318810c180 0x7f318819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3186ffd640 1 -- 172.21.15.60:0/124553316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31881036c0 msgr2=0x7f31881989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3186ffd640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31881036c0 0x7f31881989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3186ffd640 1 -- 172.21.15.60:0/124553316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318819d460 con 0x7f3188102da0 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f317ffff640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31881036c0 0x7f31881989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f31877fe640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318810c180 0x7f318819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3186ffd640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 0x7f31881984b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3178006010 tx=0x7f31780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:55.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3184ff9640 1 -- 172.21.15.60:0/124553316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317803f030 con 0x7f3188102da0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3184ff9640 1 -- 172.21.15.60:0/124553316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3178003d00 con 0x7f3188102da0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318819d6f0 con 0x7f3188102da0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f3184ff9640 1 -- 172.21.15.60:0/124553316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178035070 con 0x7f3188102da0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.196+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31881a5030 con 0x7f3188102da0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.197+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3188103180 con 0x7f3188102da0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.198+0000 7f3184ff9640 1 -- 172.21.15.60:0/124553316 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3178042030 con 0x7f3188102da0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.199+0000 7f3184ff9640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f31740a2c90 0x7f31740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.199+0000 7f317ffff640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f31740a2c90 0x7f31740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.199+0000 7f3184ff9640 1 -- 172.21.15.60:0/124553316 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f31780ef800 con 0x7f3188102da0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.200+0000 7f317ffff640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f31740a2c90 0x7f31740a5150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f318810d5a0 tx=0x7f3170005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:55.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.204+0000 7f3184ff9640 1 -- 172.21.15.60:0/124553316 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31780bc6f0 con 0x7f3188102da0 2024-09-11T23:57:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:54 smithi105 ceph-mon[34805]: pgmap v289: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 17 op/s; 51 B/s, 0 objects/s recovering 2024-09-11T23:57:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:54 smithi105 ceph-mon[34805]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:54 smithi192 ceph-mon[35487]: pgmap v289: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 17 op/s; 51 B/s, 0 objects/s recovering 2024-09-11T23:57:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:54 smithi192 ceph-mon[35487]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:55.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.375+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3188062630 con 0x7f31740a2c90 2024-09-11T23:57:55.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.381+0000 7f3184ff9640 1 -- 172.21.15.60:0/124553316 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258928 (secure 0 0 0) 0x7f3188062630 con 0x7f31740a2c90 2024-09-11T23:57:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:55.384 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:57:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f31740a2c90 msgr2=0x7f31740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f31740a2c90 0x7f31740a5150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f318810d5a0 tx=0x7f3170005e50 comp rx=0 tx=0).stop 2024-09-11T23:57:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 msgr2=0x7f31881984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 0x7f31881984b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3178006010 tx=0x7f31780042f0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 shutdown_connections 2024-09-11T23:57:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318810c180 0x7f318819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31881036c0 0x7f31881989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f31740a2c90 0x7f31740a5150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 --2- 172.21.15.60:0/124553316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3188102da0 0x7f31881984b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 >> 172.21.15.60:0/124553316 conn(0x7f31880fc7a0 msgr2=0x7f31880fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 shutdown_connections 2024-09-11T23:57:55.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:55.385+0000 7f318d26f640 1 -- 172.21.15.60:0/124553316 wait complete. 2024-09-11T23:57:56.071 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-11T23:57:55.373853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648315,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":301,"num_read_kb":267,"num_write":423,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368640,"kb_used_data":11068,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573184,"statfs":{"total":1151940427776,"available":1151562940416,"internally_reserved":0,"allocated":11333632,"data_stored":7145034,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50232,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":-1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":141,"num_read_kb":128,"num_write":60,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003050"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488874+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:57:40.488874+0000","last_peered":"2024-09-11T23:57:40.488874+0000","last_clean":"2024-09-11T23:57:40.488874+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:57:40.488874+0000","last_undegraded":"2024-09-11T23:57:40.488874+0000","last_fullsized":"2024-09-11T23:57:40.488874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799409+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:57:40.799409+0000","last_peered":"2024-09-11T23:57:40.799409+0000","last_clean":"2024-09-11T23:57:40.799409+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:57:40.799409+0000","last_undegraded":"2024-09-11T23:57:40.799409+0000","last_fullsized":"2024-09-11T23:57:40.799409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799455+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:57:40.799455+0000","last_peered":"2024-09-11T23:57:40.799455+0000","last_clean":"2024-09-11T23:57:40.799455+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:57:40.799455+0000","last_undegraded":"2024-09-11T23:57:40.799455+0000","last_fullsized":"2024-09-11T23:57:40.799455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488696+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:57:40.488696+0000","last_peered":"2024-09-11T23:57:40.488696+0000","last_clean":"2024-09-11T23:57:40.488696+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:57:40.488696+0000","last_undegraded":"2024-09-11T23:57:40.488696+0000","last_fullsized":"2024-09-11T23:57:40.488696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491218+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:57:40.491218+0000","last_peered":"2024-09-11T23:57:40.491218+0000","last_clean":"2024-09-11T23:57:40.491218+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:57:40.491218+0000","last_undegraded":"2024-09-11T23:57:40.491218+0000","last_fullsized":"2024-09-11T23:57:40.491218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799682+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:57:40.799682+0000","last_peered":"2024-09-11T23:57:40.799682+0000","last_clean":"2024-09-11T23:57:40.799682+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:57:40.799682+0000","last_undegraded":"2024-09-11T23:57:40.799682+0000","last_fullsized":"2024-09-11T23:57:40.799682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489139+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:57:40.489139+0000","last_peered":"2024-09-11T23:57:40.489139+0000","last_clean":"2024-09-11T23:57:40.489139+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:57:40.489139+0000","last_undegraded":"2024-09-11T23:57:40.489139+0000","last_fullsized":"2024-09-11T23:57:40.489139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488986+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:57:40.488986+0000","last_peered":"2024-09-11T23:57:40.488986+0000","last_clean":"2024-09-11T23:57:40.488986+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:57:40.488986+0000","last_undegraded":"2024-09-11T23:57:40.488986+0000","last_fullsized":"2024-09-11T23:57:40.488986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800714+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:57:40.800714+0000","last_peered":"2024-09-11T23:57:40.800714+0000","last_clean":"2024-09-11T23:57:40.800714+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:57:40.800714+0000","last_undegraded":"2024-09-11T23:57:40.800714+0000","last_fullsized":"2024-09-11T23:57:40.800714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800173+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:57:40.800173+0000","last_peered":"2024-09-11T23:57:40.800173+0000","last_clean":"2024-09-11T23:57:40.800173+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:57:40.800173+0000","last_undegraded":"2024-09-11T23:57:40.800173+0000","last_fullsized":"2024-09-11T23:57:40.800173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488801+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:57:40.488801+0000","last_peered":"2024-09-11T23:57:40.488801+0000","last_clean":"2024-09-11T23:57:40.488801+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:57:40.488801+0000","last_undegraded":"2024-09-11T23:57:40.488801+0000","last_fullsized":"2024-09-11T23:57:40.488801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800804+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:57:40.800804+0000","last_peered":"2024-09-11T23:57:40.800804+0000","last_clean":"2024-09-11T23:57:40.800804+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:57:40.800804+0000","last_undegraded":"2024-09-11T23:57:40.800804+0000","last_fullsized":"2024-09-11T23:57:40.800804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487617+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:57:40.487617+0000","last_peered":"2024-09-11T23:57:40.487617+0000","last_clean":"2024-09-11T23:57:40.487617+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:57:40.487617+0000","last_undegraded":"2024-09-11T23:57:40.487617+0000","last_fullsized":"2024-09-11T23:57:40.487617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799293+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:57:40.799293+0000","last_peered":"2024-09-11T23:57:40.799293+0000","last_clean":"2024-09-11T23:57:40.799293+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:57:40.799293+0000","last_undegraded":"2024-09-11T23:57:40.799293+0000","last_fullsized":"2024-09-11T23:57:40.799293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799209+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:57:40.799209+0000","last_peered":"2024-09-11T23:57:40.799209+0000","last_clean":"2024-09-11T23:57:40.799209+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:57:40.799209+0000","last_undegraded":"2024-09-11T23:57:40.799209+0000","last_fullsized":"2024-09-11T23:57:40.799209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800297+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:57:40.800297+0000","last_peered":"2024-09-11T23:57:40.800297+0000","last_clean":"2024-09-11T23:57:40.800297+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:57:40.800297+0000","last_undegraded":"2024-09-11T23:57:40.800297+0000","last_fullsized":"2024-09-11T23:57:40.800297+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489035+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:57:40.489035+0000","last_peered":"2024-09-11T23:57:40.489035+0000","last_clean":"2024-09-11T23:57:40.489035+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:57:40.489035+0000","last_undegraded":"2024-09-11T23:57:40.489035+0000","last_fullsized":"2024-09-11T23:57:40.489035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491181+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:57:40.491181+0000","last_peered":"2024-09-11T23:57:40.491181+0000","last_clean":"2024-09-11T23:57:40.491181+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:57:40.491181+0000","last_undegraded":"2024-09-11T23:57:40.491181+0000","last_fullsized":"2024-09-11T23:57:40.491181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489817+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:57:40.489817+0000","last_peered":"2024-09-11T23:57:40.489817+0000","last_clean":"2024-09-11T23:57:40.489817+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:57:40.489817+0000","last_undegraded":"2024-09-11T23:57:40.489817+0000","last_fullsized":"2024-09-11T23:57:40.489817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488148+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:57:40.488148+0000","last_peered":"2024-09-11T23:57:40.488148+0000","last_clean":"2024-09-11T23:57:40.488148+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:57:40.488148+0000","last_undegraded":"2024-09-11T23:57:40.488148+0000","last_fullsized":"2024-09-11T23:57:40.488148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487703+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:57:40.487703+0000","last_peered":"2024-09-11T23:57:40.487703+0000","last_clean":"2024-09-11T23:57:40.487703+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:57:40.487703+0000","last_undegraded":"2024-09-11T23:57:40.487703+0000","last_fullsized":"2024-09-11T23:57:40.487703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800467+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:57:40.800467+0000","last_peered":"2024-09-11T23:57:40.800467+0000","last_clean":"2024-09-11T23:57:40.800467+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:57:40.800467+0000","last_undegraded":"2024-09-11T23:57:40.800467+0000","last_fullsized":"2024-09-11T23:57:40.800467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489186+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:57:40.489186+0000","last_peered":"2024-09-11T23:57:40.489186+0000","last_clean":"2024-09-11T23:57:40.489186+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:57:40.489186+0000","last_undegraded":"2024-09-11T23:57:40.489186+0000","last_fullsized":"2024-09-11T23:57:40.489186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491160+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:57:40.491160+0000","last_peered":"2024-09-11T23:57:40.491160+0000","last_clean":"2024-09-11T23:57:40.491160+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:57:40.491160+0000","last_undegraded":"2024-09-11T23:57:40.491160+0000","last_fullsized":"2024-09-11T23:57:40.491160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489537+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:57:40.489537+0000","last_peered":"2024-09-11T23:57:40.489537+0000","last_clean":"2024-09-11T23:57:40.489537+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:57:40.489537+0000","last_undegraded":"2024-09-11T23:57:40.489537+0000","last_fullsized":"2024-09-11T23:57:40.489537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490110+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:57:40.490110+0000","last_peered":"2024-09-11T23:57:40.490110+0000","last_clean":"2024-09-11T23:57:40.490110+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:57:40.490110+0000","last_undegraded":"2024-09-11T23:57:40.490110+0000","last_fullsized":"2024-09-11T23:57:40.490110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488877+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:57:40.488877+0000","last_peered":"2024-09-11T23:57:40.488877+0000","last_clean":"2024-09-11T23:57:40.488877+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:57:40.488877+0000","last_undegraded":"2024-09-11T23:57:40.488877+0000","last_fullsized":"2024-09-11T23:57:40.488877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487540+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:57:40.487540+0000","last_peered":"2024-09-11T23:57:40.487540+0000","last_clean":"2024-09-11T23:57:40.487540+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:57:40.487540+0000","last_undegraded":"2024-09-11T23:57:40.487540+0000","last_fullsized":"2024-09-11T23:57:40.487540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:57:40.799410+0000","last_peered":"2024-09-11T23:57:40.799410+0000","last_clean":"2024-09-11T23:57:40.799410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:57:40.799410+0000","last_undegraded":"2024-09-11T23:57:40.799410+0000","last_fullsized":"2024-09-11T23:57:40.799410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489720+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:57:40.489720+0000","last_peered":"2024-09-11T23:57:40.489720+0000","last_clean":"2024-09-11T23:57:40.489720+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:57:40.489720+0000","last_undegraded":"2024-09-11T23:57:40.489720+0000","last_fullsized":"2024-09-11T23:57:40.489720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.493188+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:57:40.493188+0000","last_peered":"2024-09-11T23:57:40.493188+0000","last_clean":"2024-09-11T23:57:40.493188+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:57:40.493188+0000","last_undegraded":"2024-09-11T23:57:40.493188+0000","last_fullsized":"2024-09-11T23:57:40.493188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488168+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:57:40.488168+0000","last_peered":"2024-09-11T23:57:40.488168+0000","last_clean":"2024-09-11T23:57:40.488168+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:57:40.488168+0000","last_undegraded":"2024-09-11T23:57:40.488168+0000","last_fullsized":"2024-09-11T23:57:40.488168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491663+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:57:40.491663+0000","last_peered":"2024-09-11T23:57:40.491663+0000","last_clean":"2024-09-11T23:57:40.491663+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:57:40.491663+0000","last_undegraded":"2024-09-11T23:57:40.491663+0000","last_fullsized":"2024-09-11T23:57:40.491663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:51.529504+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:57:51.529504+0000","last_peered":"2024-09-11T23:57:51.529504+0000","last_clean":"2024-09-11T23:57:51.529504+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:57:51.529504+0000","last_undegraded":"2024-09-11T23:57:51.529504+0000","last_fullsized":"2024-09-11T23:57:51.529504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491546+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:57:40.491546+0000","last_peered":"2024-09-11T23:57:40.491546+0000","last_clean":"2024-09-11T23:57:40.491546+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:57:40.491546+0000","last_undegraded":"2024-09-11T23:57:40.491546+0000","last_fullsized":"2024-09-11T23:57:40.491546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799644+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:57:40.799644+0000","last_peered":"2024-09-11T23:57:40.799644+0000","last_clean":"2024-09-11T23:57:40.799644+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:57:40.799644+0000","last_undegraded":"2024-09-11T23:57:40.799644+0000","last_fullsized":"2024-09-11T23:57:40.799644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487353+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:57:40.487353+0000","last_peered":"2024-09-11T23:57:40.487353+0000","last_clean":"2024-09-11T23:57:40.487353+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:57:40.487353+0000","last_undegraded":"2024-09-11T23:57:40.487353+0000","last_fullsized":"2024-09-11T23:57:40.487353+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489034+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:57:40.489034+0000","last_peered":"2024-09-11T23:57:40.489034+0000","last_clean":"2024-09-11T23:57:40.489034+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:57:40.489034+0000","last_undegraded":"2024-09-11T23:57:40.489034+0000","last_fullsized":"2024-09-11T23:57:40.489034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491451+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:57:40.491451+0000","last_peered":"2024-09-11T23:57:40.491451+0000","last_clean":"2024-09-11T23:57:40.491451+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:57:40.491451+0000","last_undegraded":"2024-09-11T23:57:40.491451+0000","last_fullsized":"2024-09-11T23:57:40.491451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490361+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:57:40.490361+0000","last_peered":"2024-09-11T23:57:40.490361+0000","last_clean":"2024-09-11T23:57:40.490361+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:57:40.490361+0000","last_undegraded":"2024-09-11T23:57:40.490361+0000","last_fullsized":"2024-09-11T23:57:40.490361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.530126+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:57:52.530126+0000","last_peered":"2024-09-11T23:57:52.530126+0000","last_clean":"2024-09-11T23:57:52.530126+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:57:52.530126+0000","last_undegraded":"2024-09-11T23:57:52.530126+0000","last_fullsized":"2024-09-11T23:57:52.530126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800707+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:57:40.800707+0000","last_peered":"2024-09-11T23:57:40.800707+0000","last_clean":"2024-09-11T23:57:40.800707+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:57:40.800707+0000","last_undegraded":"2024-09-11T23:57:40.800707+0000","last_fullsized":"2024-09-11T23:57:40.800707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488921+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:57:40.488921+0000","last_peered":"2024-09-11T23:57:40.488921+0000","last_clean":"2024-09-11T23:57:40.488921+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:57:40.488921+0000","last_undegraded":"2024-09-11T23:57:40.488921+0000","last_fullsized":"2024-09-11T23:57:40.488921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799598+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:57:40.799598+0000","last_peered":"2024-09-11T23:57:40.799598+0000","last_clean":"2024-09-11T23:57:40.799598+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:57:40.799598+0000","last_undegraded":"2024-09-11T23:57:40.799598+0000","last_fullsized":"2024-09-11T23:57:40.799598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491653+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:57:40.491653+0000","last_peered":"2024-09-11T23:57:40.491653+0000","last_clean":"2024-09-11T23:57:40.491653+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:57:40.491653+0000","last_undegraded":"2024-09-11T23:57:40.491653+0000","last_fullsized":"2024-09-11T23:57:40.491653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800834+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:57:40.800834+0000","last_peered":"2024-09-11T23:57:40.800834+0000","last_clean":"2024-09-11T23:57:40.800834+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:57:40.800834+0000","last_undegraded":"2024-09-11T23:57:40.800834+0000","last_fullsized":"2024-09-11T23:57:40.800834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'27","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.533445+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:57:52.533445+0000","last_peered":"2024-09-11T23:57:52.533445+0000","last_clean":"2024-09-11T23:57:52.533445+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:57:52.533445+0000","last_undegraded":"2024-09-11T23:57:52.533445+0000","last_fullsized":"2024-09-11T23:57:52.533445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491931+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:57:40.491931+0000","last_peered":"2024-09-11T23:57:40.491931+0000","last_clean":"2024-09-11T23:57:40.491931+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:57:40.491931+0000","last_undegraded":"2024-09-11T23:57:40.491931+0000","last_fullsized":"2024-09-11T23:57:40.491931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.513007+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:57:41.513007+0000","last_peered":"2024-09-11T23:57:41.513007+0000","last_clean":"2024-09-11T23:57:41.513007+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:57:41.513007+0000","last_undegraded":"2024-09-11T23:57:41.513007+0000","last_fullsized":"2024-09-11T23:57:41.513007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487257+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:57:40.487257+0000","last_peered":"2024-09-11T23:57:40.487257+0000","last_clean":"2024-09-11T23:57:40.487257+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:57:40.487257+0000","last_undegraded":"2024-09-11T23:57:40.487257+0000","last_fullsized":"2024-09-11T23:57:40.487257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491147+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:57:40.491147+0000","last_peered":"2024-09-11T23:57:40.491147+0000","last_clean":"2024-09-11T23:57:40.491147+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:57:40.491147+0000","last_undegraded":"2024-09-11T23:57:40.491147+0000","last_fullsized":"2024-09-11T23:57:40.491147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491962+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:57:40.491962+0000","last_peered":"2024-09-11T23:57:40.491962+0000","last_clean":"2024-09-11T23:57:40.491962+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:57:40.491962+0000","last_undegraded":"2024-09-11T23:57:40.491962+0000","last_fullsized":"2024-09-11T23:57:40.491962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.530229+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:57:52.530229+0000","last_peered":"2024-09-11T23:57:52.530229+0000","last_clean":"2024-09-11T23:57:52.530229+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:57:52.530229+0000","last_undegraded":"2024-09-11T23:57:52.530229+0000","last_fullsized":"2024-09-11T23:57:52.530229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488670+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:57:40.488670+0000","last_peered":"2024-09-11T23:57:40.488670+0000","last_clean":"2024-09-11T23:57:40.488670+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:57:40.488670+0000","last_undegraded":"2024-09-11T23:57:40.488670+0000","last_fullsized":"2024-09-11T23:57:40.488670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491641+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:57:40.491641+0000","last_peered":"2024-09-11T23:57:40.491641+0000","last_clean":"2024-09-11T23:57:40.491641+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:57:40.491641+0000","last_undegraded":"2024-09-11T23:57:40.491641+0000","last_fullsized":"2024-09-11T23:57:40.491641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490860+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:57:40.490860+0000","last_peered":"2024-09-11T23:57:40.490860+0000","last_clean":"2024-09-11T23:57:40.490860+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:57:40.490860+0000","last_undegraded":"2024-09-11T23:57:40.490860+0000","last_fullsized":"2024-09-11T23:57:40.490860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491899+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:57:40.491899+0000","last_peered":"2024-09-11T23:57:40.491899+0000","last_clean":"2024-09-11T23:57:40.491899+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:57:40.491899+0000","last_undegraded":"2024-09-11T23:57:40.491899+0000","last_fullsized":"2024-09-11T23:57:40.491899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488299+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:57:40.488299+0000","last_peered":"2024-09-11T23:57:40.488299+0000","last_clean":"2024-09-11T23:57:40.488299+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:57:40.488299+0000","last_undegraded":"2024-09-11T23:57:40.488299+0000","last_fullsized":"2024-09-11T23:57:40.488299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.805290+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:57:40.805290+0000","last_peered":"2024-09-11T23:57:40.805290+0000","last_clean":"2024-09-11T23:57:40.805290+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:57:40.805290+0000","last_undegraded":"2024-09-11T23:57:40.805290+0000","last_fullsized":"2024-09-11T23:57:40.805290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488979+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:57:40.488979+0000","last_peered":"2024-09-11T23:57:40.488979+0000","last_clean":"2024-09-11T23:57:40.488979+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:57:40.488979+0000","last_undegraded":"2024-09-11T23:57:40.488979+0000","last_fullsized":"2024-09-11T23:57:40.488979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491752+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:57:40.491752+0000","last_peered":"2024-09-11T23:57:40.491752+0000","last_clean":"2024-09-11T23:57:40.491752+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:57:40.491752+0000","last_undegraded":"2024-09-11T23:57:40.491752+0000","last_fullsized":"2024-09-11T23:57:40.491752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489696+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:57:40.489696+0000","last_peered":"2024-09-11T23:57:40.489696+0000","last_clean":"2024-09-11T23:57:40.489696+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:57:40.489696+0000","last_undegraded":"2024-09-11T23:57:40.489696+0000","last_fullsized":"2024-09-11T23:57:40.489696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:51.529720+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:57:51.529720+0000","last_peered":"2024-09-11T23:57:51.529720+0000","last_clean":"2024-09-11T23:57:51.529720+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:57:51.529720+0000","last_undegraded":"2024-09-11T23:57:51.529720+0000","last_fullsized":"2024-09-11T23:57:51.529720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489088+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:57:40.489088+0000","last_peered":"2024-09-11T23:57:40.489088+0000","last_clean":"2024-09-11T23:57:40.489088+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:57:40.489088+0000","last_undegraded":"2024-09-11T23:57:40.489088+0000","last_fullsized":"2024-09-11T23:57:40.489088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":345,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489001+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:57:40.489001+0000","last_peered":"2024-09-11T23:57:40.489001+0000","last_clean":"2024-09-11T23:57:40.489001+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:57:40.489001+0000","last_undegraded":"2024-09-11T23:57:40.489001+0000","last_fullsized":"2024-09-11T23:57:40.489001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.513119+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:57:41.513119+0000","last_peered":"2024-09-11T23:57:41.513119+0000","last_clean":"2024-09-11T23:57:41.513119+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:57:41.513119+0000","last_undegraded":"2024-09-11T23:57:41.513119+0000","last_fullsized":"2024-09-11T23:57:41.513119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489307+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:57:40.489307+0000","last_peered":"2024-09-11T23:57:40.489307+0000","last_clean":"2024-09-11T23:57:40.489307+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:57:40.489307+0000","last_undegraded":"2024-09-11T23:57:40.489307+0000","last_fullsized":"2024-09-11T23:57:40.489307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.498988+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:57:40.498988+0000","last_peered":"2024-09-11T23:57:40.498988+0000","last_clean":"2024-09-11T23:57:40.498988+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:57:40.498988+0000","last_undegraded":"2024-09-11T23:57:40.498988+0000","last_fullsized":"2024-09-11T23:57:40.498988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487248+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:57:40.487248+0000","last_peered":"2024-09-11T23:57:40.487248+0000","last_clean":"2024-09-11T23:57:40.487248+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:57:40.487248+0000","last_undegraded":"2024-09-11T23:57:40.487248+0000","last_fullsized":"2024-09-11T23:57:40.487248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:53.530914+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:57:53.530914+0000","last_peered":"2024-09-11T23:57:53.530914+0000","last_clean":"2024-09-11T23:57:53.530914+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:57:53.530914+0000","last_undegraded":"2024-09-11T23:57:53.530914+0000","last_fullsized":"2024-09-11T23:57:53.530914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491275+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:57:40.491275+0000","last_peered":"2024-09-11T23:57:40.491275+0000","last_clean":"2024-09-11T23:57:40.491275+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:57:40.491275+0000","last_undegraded":"2024-09-11T23:57:40.491275+0000","last_fullsized":"2024-09-11T23:57:40.491275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.529729+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:57:52.529729+0000","last_peered":"2024-09-11T23:57:52.529729+0000","last_clean":"2024-09-11T23:57:52.529729+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:57:52.529729+0000","last_undegraded":"2024-09-11T23:57:52.529729+0000","last_fullsized":"2024-09-11T23:57:52.529729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799994+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:57:40.799994+0000","last_peered":"2024-09-11T23:57:40.799994+0000","last_clean":"2024-09-11T23:57:40.799994+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:57:40.799994+0000","last_undegraded":"2024-09-11T23:57:40.799994+0000","last_fullsized":"2024-09-11T23:57:40.799994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491288+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:57:40.491288+0000","last_peered":"2024-09-11T23:57:40.491288+0000","last_clean":"2024-09-11T23:57:40.491288+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:57:40.491288+0000","last_undegraded":"2024-09-11T23:57:40.491288+0000","last_fullsized":"2024-09-11T23:57:40.491288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800126+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:57:40.800126+0000","last_peered":"2024-09-11T23:57:40.800126+0000","last_clean":"2024-09-11T23:57:40.800126+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:57:40.800126+0000","last_undegraded":"2024-09-11T23:57:40.800126+0000","last_fullsized":"2024-09-11T23:57:40.800126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.492087+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:57:40.492087+0000","last_peered":"2024-09-11T23:57:40.492087+0000","last_clean":"2024-09-11T23:57:40.492087+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:57:40.492087+0000","last_undegraded":"2024-09-11T23:57:40.492087+0000","last_fullsized":"2024-09-11T23:57:40.492087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487615+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:57:40.487615+0000","last_peered":"2024-09-11T23:57:40.487615+0000","last_clean":"2024-09-11T23:57:40.487615+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:57:40.487615+0000","last_undegraded":"2024-09-11T23:57:40.487615+0000","last_fullsized":"2024-09-11T23:57:40.487615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.438068+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:57:52.438068+0000","last_peered":"2024-09-11T23:57:52.438068+0000","last_clean":"2024-09-11T23:57:52.438068+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:57:52.438068+0000","last_undegraded":"2024-09-11T23:57:52.438068+0000","last_fullsized":"2024-09-11T23:57:52.438068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489719+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:57:40.489719+0000","last_peered":"2024-09-11T23:57:40.489719+0000","last_clean":"2024-09-11T23:57:40.489719+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:57:40.489719+0000","last_undegraded":"2024-09-11T23:57:40.489719+0000","last_fullsized":"2024-09-11T23:57:40.489719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488806+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:57:40.488806+0000","last_peered":"2024-09-11T23:57:40.488806+0000","last_clean":"2024-09-11T23:57:40.488806+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:57:40.488806+0000","last_undegraded":"2024-09-11T23:57:40.488806+0000","last_fullsized":"2024-09-11T23:57:40.488806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799613+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:57:40.799613+0000","last_peered":"2024-09-11T23:57:40.799613+0000","last_clean":"2024-09-11T23:57:40.799613+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:57:40.799613+0000","last_undegraded":"2024-09-11T23:57:40.799613+0000","last_fullsized":"2024-09-11T23:57:40.799613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800369+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:57:40.800369+0000","last_peered":"2024-09-11T23:57:40.800369+0000","last_clean":"2024-09-11T23:57:40.800369+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:57:40.800369+0000","last_undegraded":"2024-09-11T23:57:40.800369+0000","last_fullsized":"2024-09-11T23:57:40.800369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491088+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:57:40.491088+0000","last_peered":"2024-09-11T23:57:40.491088+0000","last_clean":"2024-09-11T23:57:40.491088+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:57:40.491088+0000","last_undegraded":"2024-09-11T23:57:40.491088+0000","last_fullsized":"2024-09-11T23:57:40.491088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489374+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:57:40.489374+0000","last_peered":"2024-09-11T23:57:40.489374+0000","last_clean":"2024-09-11T23:57:40.489374+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:57:40.489374+0000","last_undegraded":"2024-09-11T23:57:40.489374+0000","last_fullsized":"2024-09-11T23:57:40.489374+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488316+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:57:40.488316+0000","last_peered":"2024-09-11T23:57:40.488316+0000","last_clean":"2024-09-11T23:57:40.488316+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:57:40.488316+0000","last_undegraded":"2024-09-11T23:57:40.488316+0000","last_fullsized":"2024-09-11T23:57:40.488316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489841+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:57:40.489841+0000","last_peered":"2024-09-11T23:57:40.489841+0000","last_clean":"2024-09-11T23:57:40.489841+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:57:40.489841+0000","last_undegraded":"2024-09-11T23:57:40.489841+0000","last_fullsized":"2024-09-11T23:57:40.489841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489180+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:57:40.489180+0000","last_peered":"2024-09-11T23:57:40.489180+0000","last_clean":"2024-09-11T23:57:40.489180+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:57:40.489180+0000","last_undegraded":"2024-09-11T23:57:40.489180+0000","last_fullsized":"2024-09-11T23:57:40.489180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491384+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:57:40.491384+0000","last_peered":"2024-09-11T23:57:40.491384+0000","last_clean":"2024-09-11T23:57:40.491384+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:57:40.491384+0000","last_undegraded":"2024-09-11T23:57:40.491384+0000","last_fullsized":"2024-09-11T23:57:40.491384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489563+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:57:40.489563+0000","last_peered":"2024-09-11T23:57:40.489563+0000","last_clean":"2024-09-11T23:57:40.489563+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:57:40.489563+0000","last_undegraded":"2024-09-11T23:57:40.489563+0000","last_fullsized":"2024-09-11T23:57:40.489563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491508+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:57:40.491508+0000","last_peered":"2024-09-11T23:57:40.491508+0000","last_clean":"2024-09-11T23:57:40.491508+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:57:40.491508+0000","last_undegraded":"2024-09-11T23:57:40.491508+0000","last_fullsized":"2024-09-11T23:57:40.491508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491868+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:57:40.491868+0000","last_peered":"2024-09-11T23:57:40.491868+0000","last_clean":"2024-09-11T23:57:40.491868+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:57:40.491868+0000","last_undegraded":"2024-09-11T23:57:40.491868+0000","last_fullsized":"2024-09-11T23:57:40.491868+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800371+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:57:40.800371+0000","last_peered":"2024-09-11T23:57:40.800371+0000","last_clean":"2024-09-11T23:57:40.800371+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:57:40.800371+0000","last_undegraded":"2024-09-11T23:57:40.800371+0000","last_fullsized":"2024-09-11T23:57:40.800371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.512639+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:57:41.512639+0000","last_peered":"2024-09-11T23:57:41.512639+0000","last_clean":"2024-09-11T23:57:41.512639+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:57:41.512639+0000","last_undegraded":"2024-09-11T23:57:41.512639+0000","last_fullsized":"2024-09-11T23:57:41.512639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799601+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:57:40.799601+0000","last_peered":"2024-09-11T23:57:40.799601+0000","last_clean":"2024-09-11T23:57:40.799601+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:57:40.799601+0000","last_undegraded":"2024-09-11T23:57:40.799601+0000","last_fullsized":"2024-09-11T23:57:40.799601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489988+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:57:40.489988+0000","last_peered":"2024-09-11T23:57:40.489988+0000","last_clean":"2024-09-11T23:57:40.489988+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:57:40.489988+0000","last_undegraded":"2024-09-11T23:57:40.489988+0000","last_fullsized":"2024-09-11T23:57:40.489988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489745+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:57:40.489745+0000","last_peered":"2024-09-11T23:57:40.489745+0000","last_clean":"2024-09-11T23:57:40.489745+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:57:40.489745+0000","last_undegraded":"2024-09-11T23:57:40.489745+0000","last_fullsized":"2024-09-11T23:57:40.489745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:53.530266+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:57:53.530266+0000","last_peered":"2024-09-11T23:57:53.530266+0000","last_clean":"2024-09-11T23:57:53.530266+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:57:53.530266+0000","last_undegraded":"2024-09-11T23:57:53.530266+0000","last_fullsized":"2024-09-11T23:57:53.530266+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57713,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":165,"num_read_kb":148,"num_write":240,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":177396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285260,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":434178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":1075712,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972379,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":434108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201311,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":434486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1027792,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":434218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1026684,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":435094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":433650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":484448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":489500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":435164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":51462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":52241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:57:56.075 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:57:56.075 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T23:57:56.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T23:57:56.331 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:56.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.787+0000 7f0def4cf640 1 -- 172.21.15.60:0/95463724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8101cd0 msgr2=0x7f0de8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.787+0000 7f0def4cf640 1 --2- 172.21.15.60:0/95463724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8101cd0 0x7f0de8102150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009900 tx=0x7f0ddc02a410 comp rx=0 tx=0).stop 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.787+0000 7f0def4cf640 1 -- 172.21.15.60:0/95463724 shutdown_connections 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.787+0000 7f0def4cf640 1 --2- 172.21.15.60:0/95463724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de8102690 0x7f0de8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.787+0000 7f0def4cf640 1 --2- 172.21.15.60:0/95463724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8101cd0 0x7f0de8102150 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.787+0000 7f0def4cf640 1 --2- 172.21.15.60:0/95463724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de8100ad0 0x7f0de8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.787+0000 7f0def4cf640 1 -- 172.21.15.60:0/95463724 >> 172.21.15.60:0/95463724 conn(0x7f0de80fc280 msgr2=0x7f0de80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 -- 172.21.15.60:0/95463724 shutdown_connections 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 -- 172.21.15.60:0/95463724 wait complete. 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 Processor -- start 2024-09-11T23:57:56.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 -- start start 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de8100ad0 0x7f0de8198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de8101cd0 0x7f0de81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8102690 0x7f0de819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0de810c990 con 0x7f0de8102690 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0de810c810 con 0x7f0de8101cd0 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.788+0000 7f0def4cf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0de810cb10 con 0x7f0de8100ad0 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8102690 0x7f0de819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8102690 0x7f0de819f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54856/0 (socket says 172.21.15.60:54856) 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 -- 172.21.15.60:0/2427751376 learned_addr learned my addr 172.21.15.60:0/2427751376 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0ded26b640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de8100ad0 0x7f0de8198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deca6a640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de8101cd0 0x7f0de81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 -- 172.21.15.60:0/2427751376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de8100ad0 msgr2=0x7f0de8198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:56.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de8100ad0 0x7f0de8198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 -- 172.21.15.60:0/2427751376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de8101cd0 msgr2=0x7f0de81986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de8101cd0 0x7f0de81986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 -- 172.21.15.60:0/2427751376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de819fda0 con 0x7f0de8102690 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0deda6c640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8102690 0x7f0de819f730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009fd0 tx=0x7f0de000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0de67fc640 1 -- 172.21.15.60:0/2427751376 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0011830 con 0x7f0de8102690 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0de67fc640 1 -- 172.21.15.60:0/2427751376 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0de0016070 con 0x7f0de8102690 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de81a0090 con 0x7f0de8102690 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.789+0000 7f0de67fc640 1 -- 172.21.15.60:0/2427751376 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de000f2e0 con 0x7f0de8102690 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.790+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de81a0620 con 0x7f0de8102690 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.790+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de81a08e0 con 0x7f0de8102690 2024-09-11T23:57:56.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.792+0000 7f0de67fc640 1 -- 172.21.15.60:0/2427751376 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0de001b460 con 0x7f0de8102690 2024-09-11T23:57:56.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.793+0000 7f0de67fc640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0dd00a2c40 0x7f0dd00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:56.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.793+0000 7f0de67fc640 1 -- 172.21.15.60:0/2427751376 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f0de00ced10 con 0x7f0de8102690 2024-09-11T23:57:56.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.793+0000 7f0ded26b640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0dd00a2c40 0x7f0dd00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:56.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.793+0000 7f0ded26b640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0dd00a2c40 0x7f0dd00a5100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0de8101b30 tx=0x7f0dd800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:56.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:56.796+0000 7f0de67fc640 1 -- 172.21.15.60:0/2427751376 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0de009bbf0 con 0x7f0de8102690 2024-09-11T23:57:57.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.038+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f0de81a0c70 con 0x7f0de8102690 2024-09-11T23:57:57.037 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:56 smithi060 ceph-mon[30953]: pgmap v290: 97 pgs: 97 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:57:57.037 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:56 smithi060 ceph-mon[30953]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:57.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.040+0000 7f0de67fc640 1 -- 172.21.15.60:0/2427751376 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f0de009b4f0 con 0x7f0de8102690 2024-09-11T23:57:57.039 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-11T23:57:57.039 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQCFLuJm6ARaAhAAnoOSm29TbllaCozSMxysNA== 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.042+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0dd00a2c40 msgr2=0x7f0dd00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.042+0000 7f0def4cf640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0dd00a2c40 0x7f0dd00a5100 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0de8101b30 tx=0x7f0dd800d040 comp rx=0 tx=0).stop 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.042+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8102690 msgr2=0x7f0de819f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.042+0000 7f0def4cf640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8102690 0x7f0de819f730 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009fd0 tx=0x7f0de000b8e0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.043+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 shutdown_connections 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.043+0000 7f0def4cf640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0dd00a2c40 0x7f0dd00a5100 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.043+0000 7f0def4cf640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0de8102690 0x7f0de819f730 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.043+0000 7f0def4cf640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de8101cd0 0x7f0de81986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.043+0000 7f0def4cf640 1 --2- 172.21.15.60:0/2427751376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de8100ad0 0x7f0de8198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:57.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.043+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 >> 172.21.15.60:0/2427751376 conn(0x7f0de80fc280 msgr2=0x7f0de8069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:57.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.043+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 shutdown_connections 2024-09-11T23:57:57.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:57.043+0000 7f0def4cf640 1 -- 172.21.15.60:0/2427751376 wait complete. 2024-09-11T23:57:57.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:56 smithi105 ceph-mon[34805]: pgmap v290: 97 pgs: 97 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:57:57.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:56 smithi105 ceph-mon[34805]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:57.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:56 smithi192 ceph-mon[35487]: pgmap v290: 97 pgs: 97 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-11T23:57:57.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:56 smithi192 ceph-mon[35487]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:57:57.674 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:57:57.674 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T23:57:57.674 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T23:57:57.713 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T23:57:57.713 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T23:57:57.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T23:57:58.008 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:57:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:57 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2427751376' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:57:58.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:57 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2427751376' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:57:58.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:57 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2427751376' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:57:58.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:57 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2427751376' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:57:58.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:57 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2427751376' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-11T23:57:58.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:57 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2427751376' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.456+0000 7f1968815640 1 -- 172.21.15.60:0/1606305844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964106f10 msgr2=0x7f196410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.456+0000 7f1968815640 1 --2- 172.21.15.60:0/1606305844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964106f10 0x7f196410ea90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f195c009ca0 tx=0x7f195c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.457+0000 7f1968815640 1 -- 172.21.15.60:0/1606305844 shutdown_connections 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.457+0000 7f1968815640 1 --2- 172.21.15.60:0/1606305844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964106f10 0x7f196410ea90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.457+0000 7f1968815640 1 --2- 172.21.15.60:0/1606305844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1964102790 0x7f19641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.457+0000 7f1968815640 1 --2- 172.21.15.60:0/1606305844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1964101de0 0x7f19641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.457+0000 7f1968815640 1 -- 172.21.15.60:0/1606305844 >> 172.21.15.60:0/1606305844 conn(0x7f19640fd8c0 msgr2=0x7f19640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.457+0000 7f1968815640 1 -- 172.21.15.60:0/1606305844 shutdown_connections 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.457+0000 7f1968815640 1 -- 172.21.15.60:0/1606305844 wait complete. 2024-09-11T23:57:58.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1968815640 1 Processor -- start 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1968815640 1 -- start start 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1968815640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1964101de0 0x7f19640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1968815640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964102790 0x7f1964074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1968815640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1964106f10 0x7f1964074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1968815640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1964112090 con 0x7f1964102790 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1968815640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1964111f10 con 0x7f1964101de0 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1968815640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1964112210 con 0x7f1964106f10 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1961d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964102790 0x7f1964074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1961d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964102790 0x7f1964074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54878/0 (socket says 172.21.15.60:54878) 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1961d9b640 1 -- 172.21.15.60:0/3291166477 learned_addr learned my addr 172.21.15.60:0/3291166477 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:57:58.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f1962d9d640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1964106f10 0x7f1964074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.458+0000 7f196259c640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1964101de0 0x7f19640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f1961d9b640 1 -- 172.21.15.60:0/3291166477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1964106f10 msgr2=0x7f1964074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f1961d9b640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1964106f10 0x7f1964074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f1961d9b640 1 -- 172.21.15.60:0/3291166477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1964101de0 msgr2=0x7f19640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f1961d9b640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1964101de0 0x7f19640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f1961d9b640 1 -- 172.21.15.60:0/3291166477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19641a6910 con 0x7f1964102790 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f196259c640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1964101de0 0x7f19640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f1961d9b640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964102790 0x7f1964074a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f195800d950 tx=0x7f195800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f19537fe640 1 -- 172.21.15.60:0/3291166477 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958017070 con 0x7f1964102790 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19641a6c00 con 0x7f1964102790 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f19537fe640 1 -- 172.21.15.60:0/3291166477 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1958009c30 con 0x7f1964102790 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f19537fe640 1 -- 172.21.15.60:0/3291166477 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195800f740 con 0x7f1964102790 2024-09-11T23:57:58.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.459+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19641a7190 con 0x7f1964102790 2024-09-11T23:57:58.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.461+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19641021c0 con 0x7f1964102790 2024-09-11T23:57:58.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.461+0000 7f19537fe640 1 -- 172.21.15.60:0/3291166477 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1958010a80 con 0x7f1964102790 2024-09-11T23:57:58.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.462+0000 7f19537fe640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f194c0a2c10 0x7f194c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:57:58.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.462+0000 7f196259c640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f194c0a2c10 0x7f194c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:57:58.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.462+0000 7f19537fe640 1 -- 172.21.15.60:0/3291166477 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f19580cecf0 con 0x7f1964102790 2024-09-11T23:57:58.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.463+0000 7f196259c640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f194c0a2c10 0x7f194c0a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1954009c20 tx=0x7f1954005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:57:58.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.466+0000 7f19537fe640 1 -- 172.21.15.60:0/3291166477 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1958009de0 con 0x7f1964102790 2024-09-11T23:57:58.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.690+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f196410a120 con 0x7f1964102790 2024-09-11T23:57:58.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.695+0000 7f19537fe640 1 -- 172.21.15.60:0/3291166477 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263199 (secure 0 0 0) 0x7f195809bb20 con 0x7f1964102790 2024-09-11T23:57:58.697 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:57:58.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f194c0a2c10 msgr2=0x7f194c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f194c0a2c10 0x7f194c0a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1954009c20 tx=0x7f1954005f90 comp rx=0 tx=0).stop 2024-09-11T23:57:58.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964102790 msgr2=0x7f1964074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964102790 0x7f1964074a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f195800d950 tx=0x7f195800de10 comp rx=0 tx=0).stop 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 shutdown_connections 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1964106f10 0x7f1964074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f194c0a2c10 0x7f194c0a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964102790 0x7f1964074a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 --2- 172.21.15.60:0/3291166477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1964101de0 0x7f19640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 >> 172.21.15.60:0/3291166477 conn(0x7f19640fd8c0 msgr2=0x7f19640fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 shutdown_connections 2024-09-11T23:57:58.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:57:58.698+0000 7f1968815640 1 -- 172.21.15.60:0/3291166477 wait complete. 2024-09-11T23:57:59.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:59 smithi060 ceph-mon[30953]: pgmap v291: 97 pgs: 97 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-11T23:57:59.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:57:59 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3291166477' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:57:59.401 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:59 smithi105 ceph-mon[34805]: pgmap v291: 97 pgs: 97 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-11T23:57:59.401 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:57:59 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3291166477' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:57:59.511 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1180183286},{"type":"v1","addr":"172.21.15.60:6801","nonce":1180183286}]},"active_addr":"172.21.15.60:6801/1180183286","active_change":"2024-09-11T23:50:39.288890+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.60:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2524722535}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3141588653}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3663020999}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":75586277}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2816413872}]}]} 2024-09-11T23:57:59.516 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T23:57:59.516 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T23:57:59.516 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:57:59.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:59 smithi192 ceph-mon[35487]: pgmap v291: 97 pgs: 97 active+clean; 633 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-11T23:57:59.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:57:59 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3291166477' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-11T23:57:59.775 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:00.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 -- 172.21.15.60:0/841440013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 msgr2=0x7fac381021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 --2- 172.21.15.60:0/841440013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 0x7fac381021c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fac30009ca0 tx=0x7fac3002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 -- 172.21.15.60:0/841440013 shutdown_connections 2024-09-11T23:58:00.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 --2- 172.21.15.60:0/841440013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac38106f10 0x7fac3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 --2- 172.21.15.60:0/841440013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac38102790 0x7fac381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 --2- 172.21.15.60:0/841440013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 0x7fac381021c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 -- 172.21.15.60:0/841440013 >> 172.21.15.60:0/841440013 conn(0x7fac380fd8c0 msgr2=0x7fac380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 -- 172.21.15.60:0/841440013 shutdown_connections 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 -- 172.21.15.60:0/841440013 wait complete. 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.242+0000 7fac3d414640 1 Processor -- start 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac3d414640 1 -- start start 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac3d414640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 0x7fac38198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac3d414640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac38102790 0x7fac381989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac3d414640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac38106f10 0x7fac3819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac3d414640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fac38112050 con 0x7fac38101de0 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac3d414640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac38111ed0 con 0x7fac38102790 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac3d414640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fac381121d0 con 0x7fac38106f10 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac36ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 0x7fac38198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac36ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 0x7fac38198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54896/0 (socket says 172.21.15.60:54896) 2024-09-11T23:58:00.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac36ffd640 1 -- 172.21.15.60:0/2680265049 learned_addr learned my addr 172.21.15.60:0/2680265049 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac367fc640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac38102790 0x7fac381989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac377fe640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac38106f10 0x7fac3819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac36ffd640 1 -- 172.21.15.60:0/2680265049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac38106f10 msgr2=0x7fac3819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac36ffd640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac38106f10 0x7fac3819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac36ffd640 1 -- 172.21.15.60:0/2680265049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac38102790 msgr2=0x7fac381989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac36ffd640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac38102790 0x7fac381989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac36ffd640 1 -- 172.21.15.60:0/2680265049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3819d410 con 0x7fac38101de0 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.243+0000 7fac377fe640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac38106f10 0x7fac3819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.244+0000 7fac36ffd640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 0x7fac38198460 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac3002ade0 tx=0x7fac300319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.244+0000 7fac2ffff640 1 -- 172.21.15.60:0/2680265049 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30003b70 con 0x7fac38101de0 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.244+0000 7fac2ffff640 1 -- 172.21.15.60:0/2680265049 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac30003d10 con 0x7fac38101de0 2024-09-11T23:58:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.244+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3819d6a0 con 0x7fac38101de0 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.244+0000 7fac2ffff640 1 -- 172.21.15.60:0/2680265049 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3002fd10 con 0x7fac38101de0 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.244+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac381a4fe0 con 0x7fac38101de0 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.245+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac381021c0 con 0x7fac38101de0 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.246+0000 7fac2ffff640 1 -- 172.21.15.60:0/2680265049 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fac30004050 con 0x7fac38101de0 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.247+0000 7fac2ffff640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fac240a2c10 0x7fac240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.247+0000 7fac367fc640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fac240a2c10 0x7fac240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.247+0000 7fac2ffff640 1 -- 172.21.15.60:0/2680265049 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fac300f0240 con 0x7fac38101de0 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.247+0000 7fac367fc640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fac240a2c10 0x7fac240a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac38108880 tx=0x7fac2000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:00.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.251+0000 7fac2ffff640 1 -- 172.21.15.60:0/2680265049 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac300bd1b0 con 0x7fac38101de0 2024-09-11T23:58:00.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.430+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac3810a0f0 con 0x7fac38101de0 2024-09-11T23:58:00.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.431+0000 7fac2ffff640 1 -- 172.21.15.60:0/2680265049 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22645 (secure 0 0 0) 0x7fac300bcab0 con 0x7fac38101de0 2024-09-11T23:58:00.432 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:00.432 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":82,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:57:40.484442+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:58:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fac240a2c10 msgr2=0x7fac240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fac240a2c10 0x7fac240a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fac38108880 tx=0x7fac2000a2d0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 msgr2=0x7fac38198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 0x7fac38198460 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac3002ade0 tx=0x7fac300319f0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 shutdown_connections 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac38106f10 0x7fac3819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac38102790 0x7fac381989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fac240a2c10 0x7fac240a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 --2- 172.21.15.60:0/2680265049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38101de0 0x7fac38198460 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.433+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 >> 172.21.15.60:0/2680265049 conn(0x7fac380fd8c0 msgr2=0x7fac380fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.434+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 shutdown_connections 2024-09-11T23:58:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:00.434+0000 7fac3d414640 1 -- 172.21.15.60:0/2680265049 wait complete. 2024-09-11T23:58:01.185 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T23:58:01.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:58:01.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:01 smithi060 ceph-mon[30953]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.5 KiB/s wr, 14 op/s 2024-09-11T23:58:01.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:01 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2680265049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:01 smithi105 ceph-mon[34805]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.5 KiB/s wr, 14 op/s 2024-09-11T23:58:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:01 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2680265049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:01.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:01 smithi192 ceph-mon[35487]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.5 KiB/s wr, 14 op/s 2024-09-11T23:58:01.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:01 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2680265049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.909+0000 7fb15784d640 1 -- 172.21.15.60:0/2971627839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 msgr2=0x7fb150100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.909+0000 7fb15784d640 1 --2- 172.21.15.60:0/2971627839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 0x7fb150100cb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009900 tx=0x7fb14c02a410 comp rx=0 tx=0).stop 2024-09-11T23:58:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 -- 172.21.15.60:0/2971627839 shutdown_connections 2024-09-11T23:58:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 --2- 172.21.15.60:0/2971627839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15010e480 0x7fb150110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:01.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 --2- 172.21.15.60:0/2971627839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb150101280 0x7fb15010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 --2- 172.21.15.60:0/2971627839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 0x7fb150100cb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 -- 172.21.15.60:0/2971627839 >> 172.21.15.60:0/2971627839 conn(0x7fb1500fc7a0 msgr2=0x7fb1500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 -- 172.21.15.60:0/2971627839 shutdown_connections 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 -- 172.21.15.60:0/2971627839 wait complete. 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 Processor -- start 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 -- start start 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 0x7fb1501a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb150101280 0x7fb1501a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.910+0000 7fb15784d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb15010e480 0x7fb15019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb15784d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1501142e0 con 0x7fb1501008d0 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb15784d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb150114160 con 0x7fb150101280 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb15784d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb150114460 con 0x7fb15010e480 2024-09-11T23:58:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 0x7fb1501a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 0x7fb1501a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60916/0 (socket says 172.21.15.60:60916) 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 -- 172.21.15.60:0/3048711203 learned_addr learned my addr 172.21.15.60:0/3048711203 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb155dea640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb15010e480 0x7fb15019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb154de8640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb150101280 0x7fb1501a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 -- 172.21.15.60:0/3048711203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb15010e480 msgr2=0x7fb15019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb15010e480 0x7fb15019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 -- 172.21.15.60:0/3048711203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb150101280 msgr2=0x7fb1501a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb150101280 0x7fb1501a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 -- 172.21.15.60:0/3048711203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15019aec0 con 0x7fb1501008d0 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb154de8640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb150101280 0x7fb1501a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1555e9640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 0x7fb1501a0580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb14c006010 tx=0x7fb14c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1467fc640 1 -- 172.21.15.60:0/3048711203 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c03f030 con 0x7fb1501008d0 2024-09-11T23:58:01.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1467fc640 1 -- 172.21.15.60:0/3048711203 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb14c003d00 con 0x7fb1501008d0 2024-09-11T23:58:01.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15019b150 con 0x7fb1501008d0 2024-09-11T23:58:01.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb1467fc640 1 -- 172.21.15.60:0/3048711203 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c035070 con 0x7fb1501008d0 2024-09-11T23:58:01.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.911+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1501a7330 con 0x7fb1501008d0 2024-09-11T23:58:01.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.913+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb15006b070 con 0x7fb1501008d0 2024-09-11T23:58:01.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.914+0000 7fb1467fc640 1 -- 172.21.15.60:0/3048711203 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb14c042030 con 0x7fb1501008d0 2024-09-11T23:58:01.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.914+0000 7fb1467fc640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb13c0a2c90 0x7fb13c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:01.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.914+0000 7fb154de8640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb13c0a2c90 0x7fb13c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:01.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.915+0000 7fb1467fc640 1 -- 172.21.15.60:0/3048711203 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fb14c0ef750 con 0x7fb1501008d0 2024-09-11T23:58:01.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.915+0000 7fb154de8640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb13c0a2c90 0x7fb13c0a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb140005fd0 tx=0x7fb140005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:01.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:01.918+0000 7fb1467fc640 1 -- 172.21.15.60:0/3048711203 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb14c0bc640 con 0x7fb1501008d0 2024-09-11T23:58:02.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.094+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb150109610 con 0x7fb1501008d0 2024-09-11T23:58:02.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.095+0000 7fb1467fc640 1 -- 172.21.15.60:0/3048711203 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22645 (secure 0 0 0) 0x7fb14c0bbf40 con 0x7fb1501008d0 2024-09-11T23:58:02.096 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:02.096 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":82,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:57:40.484442+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:58:02.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb13c0a2c90 msgr2=0x7fb13c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:02.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb13c0a2c90 0x7fb13c0a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb140005fd0 tx=0x7fb140005ea0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 msgr2=0x7fb1501a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:02.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 0x7fb1501a0580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb14c006010 tx=0x7fb14c0042f0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 shutdown_connections 2024-09-11T23:58:02.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb15010e480 0x7fb15019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb150101280 0x7fb1501a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb13c0a2c90 0x7fb13c0a5150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 --2- 172.21.15.60:0/3048711203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1501008d0 0x7fb1501a0580 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:02.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 >> 172.21.15.60:0/3048711203 conn(0x7fb1500fc7a0 msgr2=0x7fb1500feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:02.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 shutdown_connections 2024-09-11T23:58:02.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:02.098+0000 7fb15784d640 1 -- 172.21.15.60:0/3048711203 wait complete. 2024-09-11T23:58:02.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T23:58:02.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T23:58:02.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T23:58:02.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T23:58:02.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T23:58:02.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T23:58:02.934 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T23:58:02.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T23:58:02.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T23:58:02.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T23:58:02.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T23:58:02.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T23:58:03.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:03 smithi060 ceph-mon[30953]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-11T23:58:03.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:03 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3048711203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:03 smithi105 ceph-mon[34805]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-11T23:58:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:03 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3048711203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:03 smithi192 ceph-mon[35487]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-11T23:58:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:03 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3048711203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:03.586 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 -- 172.21.15.60:0/165187913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c101de0 msgr2=0x7f410c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:04.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 --2- 172.21.15.60:0/165187913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c101de0 0x7f410c1021c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009900 tx=0x7f40fc02a410 comp rx=0 tx=0).stop 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 -- 172.21.15.60:0/165187913 shutdown_connections 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 --2- 172.21.15.60:0/165187913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c106f10 0x7f410c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 --2- 172.21.15.60:0/165187913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f410c102790 0x7f410c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 --2- 172.21.15.60:0/165187913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c101de0 0x7f410c1021c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 -- 172.21.15.60:0/165187913 >> 172.21.15.60:0/165187913 conn(0x7f410c0fd8c0 msgr2=0x7f410c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 -- 172.21.15.60:0/165187913 shutdown_connections 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 -- 172.21.15.60:0/165187913 wait complete. 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 Processor -- start 2024-09-11T23:58:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.224+0000 7f41125f6640 1 -- start start 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f41125f6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c101de0 0x7f410c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f41125f6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f410c102790 0x7f410c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f41125f6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c106f10 0x7f410c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f41125f6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f410c112050 con 0x7f410c106f10 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f41125f6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f410c111ed0 con 0x7f410c102790 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f41125f6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f410c1121d0 con 0x7f410c101de0 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4110b93640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c106f10 0x7f410c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4110b93640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c106f10 0x7f410c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60934/0 (socket says 172.21.15.60:60934) 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4110b93640 1 -- 172.21.15.60:0/3059395882 learned_addr learned my addr 172.21.15.60:0/3059395882 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f410bfff640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c101de0 0x7f410c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4103fff640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f410c102790 0x7f410c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4110b93640 1 -- 172.21.15.60:0/3059395882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c101de0 msgr2=0x7f410c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4110b93640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c101de0 0x7f410c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4110b93640 1 -- 172.21.15.60:0/3059395882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f410c102790 msgr2=0x7f410c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4110b93640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f410c102790 0x7f410c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.225+0000 7f4110b93640 1 -- 172.21.15.60:0/3059395882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c19d420 con 0x7f410c106f10 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.226+0000 7f4110b93640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c106f10 0x7f410c19cd40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f410400eaa0 tx=0x7f410400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.226+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104004d20 con 0x7f410c106f10 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.226+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4104005020 con 0x7f410c106f10 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.226+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410c19d710 con 0x7f410c106f10 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.226+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41040116b0 con 0x7f410c106f10 2024-09-11T23:58:04.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.226+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f410c1a4ff0 con 0x7f410c106f10 2024-09-11T23:58:04.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.227+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f410c0fefa0 con 0x7f410c106f10 2024-09-11T23:58:04.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.228+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f41040051d0 con 0x7f410c106f10 2024-09-11T23:58:04.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.229+0000 7f4109ffb640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f40f80a2c10 0x7f40f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:04.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.230+0000 7f410bfff640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f40f80a2c10 0x7f40f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:04.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.230+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f41040cf3b0 con 0x7f410c106f10 2024-09-11T23:58:04.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.230+0000 7f4109ffb640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] conn(0x7f40f80ac740 0x7f40f80aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:04.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.230+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 --> [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4104018ec0 con 0x7f40f80ac740 2024-09-11T23:58:04.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.230+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f41040d6050 con 0x7f410c106f10 2024-09-11T23:58:04.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.231+0000 7f410bfff640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f40f80a2c10 0x7f40f80a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009230 tx=0x7f40fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:04.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.231+0000 7f4103fff640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] conn(0x7f40f80ac740 0x7f40f80aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:04.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.231+0000 7f4103fff640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] conn(0x7f40f80ac740 0x7f40f80aebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:04.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.232+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 <== osd.11 v2:172.21.15.192:6824/885041669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4104018ec0 con 0x7f40f80ac740 2024-09-11T23:58:04.243 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.243 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.244 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.248 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.248 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.253 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.254 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.262+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 --> [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f410c1032c0 con 0x7f40f80ac740 2024-09-11T23:58:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.266+0000 7f4109ffb640 1 -- 172.21.15.60:0/3059395882 <== osd.11 v2:172.21.15.192:6824/885041669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f410c1032c0 con 0x7f40f80ac740 2024-09-11T23:58:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.267+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 >> [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] conn(0x7f40f80ac740 msgr2=0x7f40f80aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.267+0000 7f41125f6640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] conn(0x7f40f80ac740 0x7f40f80aebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.268+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f40f80a2c10 msgr2=0x7f40f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.268+0000 7f41125f6640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f40f80a2c10 0x7f40f80a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009230 tx=0x7f40fc0058d0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.268+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c106f10 msgr2=0x7f410c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.268+0000 7f41125f6640 1 --2- 172.21.15.60:0/3059395882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f410c106f10 0x7f410c19cd40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f410400eaa0 tx=0x7f410400eea0 comp rx=0 tx=0).stop 2024-09-11T23:58:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.268+0000 7f4110b93640 1 -- 172.21.15.60:0/3059395882 reap_dead start 2024-09-11T23:58:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.270+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 shutdown_connections 2024-09-11T23:58:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.270+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 >> 172.21.15.60:0/3059395882 conn(0x7f410c0fd8c0 msgr2=0x7f410c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:04.274 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.276+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 shutdown_connections 2024-09-11T23:58:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:04.276+0000 7f41125f6640 1 -- 172.21.15.60:0/3059395882 wait complete. 2024-09-11T23:58:05.068 INFO:teuthology.orchestra.run.smithi060.stdout:317827579923 2024-09-11T23:58:05.068 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T23:58:05.288 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:05 smithi060 ceph-mon[30953]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-11T23:58:05.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:05 smithi105 ceph-mon[34805]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-11T23:58:05.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:05 smithi192 ceph-mon[35487]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 -- 172.21.15.60:0/1100470271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84106a70 msgr2=0x7fbd84106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 --2- 172.21.15.60:0/1100470271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84106a70 0x7fbd84106e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009930 tx=0x7fbd7402a420 comp rx=0 tx=0).stop 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 -- 172.21.15.60:0/1100470271 shutdown_connections 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 --2- 172.21.15.60:0/1100470271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd84101410 0x7fbd8410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 --2- 172.21.15.60:0/1100470271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd84100a70 0x7fbd84100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 --2- 172.21.15.60:0/1100470271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84106a70 0x7fbd84106e50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 -- 172.21.15.60:0/1100470271 >> 172.21.15.60:0/1100470271 conn(0x7fbd840fc790 msgr2=0x7fbd840febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 -- 172.21.15.60:0/1100470271 shutdown_connections 2024-09-11T23:58:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.546+0000 7fbd89fb9640 1 -- 172.21.15.60:0/1100470271 wait complete. 2024-09-11T23:58:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.547+0000 7fbd89fb9640 1 Processor -- start 2024-09-11T23:58:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.547+0000 7fbd89fb9640 1 -- start start 2024-09-11T23:58:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.547+0000 7fbd89fb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84100a70 0x7fbd840fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.547+0000 7fbd89fb9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd84101410 0x7fbd840fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.547+0000 7fbd89fb9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd84106a70 0x7fbd840fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.547+0000 7fbd89fb9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84110f50 con 0x7fbd84100a70 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.547+0000 7fbd89fb9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84110dd0 con 0x7fbd84106a70 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.547+0000 7fbd89fb9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841110d0 con 0x7fbd84101410 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84100a70 0x7fbd840fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84100a70 0x7fbd840fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60966/0 (socket says 172.21.15.60:60966) 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 -- 172.21.15.60:0/373232419 learned_addr learned my addr 172.21.15.60:0/373232419 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:05.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd83fff640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd84106a70 0x7fbd840fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd82ffd640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd84101410 0x7fbd840fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 -- 172.21.15.60:0/373232419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd84101410 msgr2=0x7fbd840fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd84101410 0x7fbd840fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 -- 172.21.15.60:0/373232419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd84106a70 msgr2=0x7fbd840fd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd84106a70 0x7fbd840fd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 -- 172.21.15.60:0/373232419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd841a69e0 con 0x7fbd84100a70 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd82ffd640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd84101410 0x7fbd840fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd83fff640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd84106a70 0x7fbd840fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd837fe640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84100a70 0x7fbd840fce50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009230 tx=0x7fbd74004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7403f030 con 0x7fbd84100a70 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd841a6c70 con 0x7fbd84100a70 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.548+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbd74003af0 con 0x7fbd84100a70 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.549+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74035070 con 0x7fbd84100a70 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.549+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd841a7150 con 0x7fbd84100a70 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.550+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd840628c0 con 0x7fbd84100a70 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.551+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbd74042030 con 0x7fbd84100a70 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.552+0000 7fbd80ff9640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd6c0a2c10 0x7fbd6c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.552+0000 7fbd82ffd640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd6c0a2c10 0x7fbd6c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.552+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fbd740efe10 con 0x7fbd84100a70 2024-09-11T23:58:05.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.552+0000 7fbd80ff9640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] conn(0x7fbd6c0ac610 0x7fbd6c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:05.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.552+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 --> [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd6c0af180 con 0x7fbd6c0ac610 2024-09-11T23:58:05.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.552+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fbd740f0260 con 0x7fbd84100a70 2024-09-11T23:58:05.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.552+0000 7fbd83fff640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] conn(0x7fbd6c0ac610 0x7fbd6c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:05.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.552+0000 7fbd82ffd640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd6c0a2c10 0x7fbd6c0a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbd780058c0 tx=0x7fbd78005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:05.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.553+0000 7fbd83fff640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] conn(0x7fbd6c0ac610 0x7fbd6c0aeab0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:05.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.553+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 <== osd.0 v2:172.21.15.60:6802/2876211481 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd6c0af180 con 0x7fbd6c0ac610 2024-09-11T23:58:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.567+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 --> [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd84062d40 con 0x7fbd6c0ac610 2024-09-11T23:58:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.567+0000 7fbd80ff9640 1 -- 172.21.15.60:0/373232419 <== osd.0 v2:172.21.15.60:6802/2876211481 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbd84062d40 con 0x7fbd6c0ac610 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] conn(0x7fbd6c0ac610 msgr2=0x7fbd6c0aeab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] conn(0x7fbd6c0ac610 0x7fbd6c0aeab0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd6c0a2c10 msgr2=0x7fbd6c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd6c0a2c10 0x7fbd6c0a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbd780058c0 tx=0x7fbd78005850 comp rx=0 tx=0).stop 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84100a70 msgr2=0x7fbd840fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 --2- 172.21.15.60:0/373232419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd84100a70 0x7fbd840fce50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009230 tx=0x7fbd74004270 comp rx=0 tx=0).stop 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd83fff640 1 -- 172.21.15.60:0/373232419 reap_dead start 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 shutdown_connections 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 >> 172.21.15.60:0/373232419 conn(0x7fbd840fc790 msgr2=0x7fbd8406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 shutdown_connections 2024-09-11T23:58:05.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:05.568+0000 7fbd89fb9640 1 -- 172.21.15.60:0/373232419 wait complete. 2024-09-11T23:58:06.770 INFO:teuthology.orchestra.run.smithi060.stdout:34359738443 2024-09-11T23:58:06.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T23:58:07.237 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:07 smithi060 ceph-mon[30953]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-11T23:58:07.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 -- 172.21.15.60:0/1987117986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 msgr2=0x7fdaf8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 --2- 172.21.15.60:0/1987117986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 0x7fdaf8101200 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009900 tx=0x7fdaec02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 -- 172.21.15.60:0/1987117986 shutdown_connections 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 --2- 172.21.15.60:0/1987117986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf8102ef0 0x7fdaf810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 --2- 172.21.15.60:0/1987117986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdaf8102570 0x7fdaf81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 --2- 172.21.15.60:0/1987117986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 0x7fdaf8101200 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 -- 172.21.15.60:0/1987117986 >> 172.21.15.60:0/1987117986 conn(0x7fdaf80fc7d0 msgr2=0x7fdaf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 -- 172.21.15.60:0/1987117986 shutdown_connections 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.237+0000 7fdafed57640 1 -- 172.21.15.60:0/1987117986 wait complete. 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafed57640 1 Processor -- start 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafed57640 1 -- start start 2024-09-11T23:58:07.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafed57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 0x7fdaf8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:07.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafed57640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdaf8102570 0x7fdaf8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:07.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafed57640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf8102ef0 0x7fdaf819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:07.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafed57640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf81110a0 con 0x7fdaf8100e20 2024-09-11T23:58:07.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafed57640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf8110f20 con 0x7fdaf8102570 2024-09-11T23:58:07.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafed57640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf8111220 con 0x7fdaf8102ef0 2024-09-11T23:58:07.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafcaf3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 0x7fdaf8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:07.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafcaf3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 0x7fdaf8198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32770/0 (socket says 172.21.15.60:32770) 2024-09-11T23:58:07.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafcaf3640 1 -- 172.21.15.60:0/3783518877 learned_addr learned my addr 172.21.15.60:0/3783518877 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:07.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafcaf3640 1 -- 172.21.15.60:0/3783518877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf8102ef0 msgr2=0x7fdaf819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:07.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafd2f4640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf8102ef0 0x7fdaf819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:07.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafcaf3640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf8102ef0 0x7fdaf819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:07.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafcaf3640 1 -- 172.21.15.60:0/3783518877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdaf8102570 msgr2=0x7fdaf8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:07.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafcaf3640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdaf8102570 0x7fdaf8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:07.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.238+0000 7fdafcaf3640 1 -- 172.21.15.60:0/3783518877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf819d4c0 con 0x7fdaf8100e20 2024-09-11T23:58:07.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.239+0000 7fdafcaf3640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 0x7fdaf8198510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaec006010 tx=0x7fdaec004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:07.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.239+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec03f030 con 0x7fdaf8100e20 2024-09-11T23:58:07.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.239+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdaec005500 con 0x7fdaf8100e20 2024-09-11T23:58:07.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.239+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec035070 con 0x7fdaf8100e20 2024-09-11T23:58:07.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.239+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf819d750 con 0x7fdaf8100e20 2024-09-11T23:58:07.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.239+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf81a5090 con 0x7fdaf8100e20 2024-09-11T23:58:07.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.240+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdaf806ab10 con 0x7fdaf8100e20 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.241+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdaec042030 con 0x7fdaf8100e20 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.242+0000 7fdaf5ffb640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdae80a2c90 0x7fdae80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.242+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fdaec0efeb0 con 0x7fdaf8100e20 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.242+0000 7fdaf7fff640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdae80a2c90 0x7fdae80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.242+0000 7fdaf5ffb640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] conn(0x7fdae80ac7c0 0x7fdae80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.242+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 --> [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdaec03ce50 con 0x7fdae80ac7c0 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.242+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fdaec0f0300 con 0x7fdaf8100e20 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.243+0000 7fdaf7fff640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdae80a2c90 0x7fdae80a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80fed10 tx=0x7fdae4005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.243+0000 7fdafd2f4640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] conn(0x7fdae80ac7c0 0x7fdae80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:07.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.243+0000 7fdafd2f4640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] conn(0x7fdae80ac7c0 0x7fdae80aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.244+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 <== osd.1 v2:172.21.15.105:6800/2839535181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdaec03ce50 con 0x7fdae80ac7c0 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.258+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 --> [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdaf81021b0 con 0x7fdae80ac7c0 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.258+0000 7fdaf5ffb640 1 -- 172.21.15.60:0/3783518877 <== osd.1 v2:172.21.15.105:6800/2839535181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdaf81021b0 con 0x7fdae80ac7c0 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 >> [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] conn(0x7fdae80ac7c0 msgr2=0x7fdae80aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] conn(0x7fdae80ac7c0 0x7fdae80aec60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdae80a2c90 msgr2=0x7fdae80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdae80a2c90 0x7fdae80a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80fed10 tx=0x7fdae4005bf0 comp rx=0 tx=0).stop 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 msgr2=0x7fdaf8198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 --2- 172.21.15.60:0/3783518877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdaf8100e20 0x7fdaf8198510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaec006010 tx=0x7fdaec004c00 comp rx=0 tx=0).stop 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafd2f4640 1 -- 172.21.15.60:0/3783518877 reap_dead start 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 shutdown_connections 2024-09-11T23:58:07.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 >> 172.21.15.60:0/3783518877 conn(0x7fdaf80fc7d0 msgr2=0x7fdaf806a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:07.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 shutdown_connections 2024-09-11T23:58:07.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.259+0000 7fdafed57640 1 -- 172.21.15.60:0/3783518877 wait complete. 2024-09-11T23:58:07.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:07 smithi105 ceph-mon[34805]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-11T23:58:07.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:07 smithi192 ceph-mon[35487]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-11T23:58:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.168+0000 7fbe6cfec640 1 -- 172.21.15.60:0/3377669957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102ef0 msgr2=0x7fbe6810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.168+0000 7fbe6cfec640 1 --2- 172.21.15.60:0/3377669957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102ef0 0x7fbe6810da40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009ca0 tx=0x7fbe6002a950 comp rx=0 tx=0).stop 2024-09-11T23:58:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.168+0000 7fbe6cfec640 1 -- 172.21.15.60:0/3377669957 shutdown_connections 2024-09-11T23:58:08.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.168+0000 7fbe6cfec640 1 --2- 172.21.15.60:0/3377669957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102ef0 0x7fbe6810da40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.168+0000 7fbe6cfec640 1 --2- 172.21.15.60:0/3377669957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe68102570 0x7fbe681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.168+0000 7fbe6cfec640 1 --2- 172.21.15.60:0/3377669957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe68100e20 0x7fbe68101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.168+0000 7fbe6cfec640 1 -- 172.21.15.60:0/3377669957 >> 172.21.15.60:0/3377669957 conn(0x7fbe680fc7d0 msgr2=0x7fbe680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.169+0000 7fbe6cfec640 1 -- 172.21.15.60:0/3377669957 shutdown_connections 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.169+0000 7fbe6cfec640 1 -- 172.21.15.60:0/3377669957 wait complete. 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.169+0000 7fbe6cfec640 1 Processor -- start 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.169+0000 7fbe6cfec640 1 -- start start 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.169+0000 7fbe6cfec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe68100e20 0x7fbe681986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.169+0000 7fbe6cfec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102570 0x7fbe68198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe6cfec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe68102ef0 0x7fbe6819cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe6cfec640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe68111160 con 0x7fbe68102570 2024-09-11T23:58:08.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe6cfec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe68110fe0 con 0x7fbe68100e20 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe6cfec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681112e0 con 0x7fbe68102ef0 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102570 0x7fbe68198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102570 0x7fbe68198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32812/0 (socket says 172.21.15.60:32812) 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 -- 172.21.15.60:0/1703790325 learned_addr learned my addr 172.21.15.60:0/1703790325 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe6659c640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe68100e20 0x7fbe681986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 -- 172.21.15.60:0/1703790325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe68102ef0 msgr2=0x7fbe6819cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe68102ef0 0x7fbe6819cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 -- 172.21.15.60:0/1703790325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe68100e20 msgr2=0x7fbe681986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe68100e20 0x7fbe681986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 -- 172.21.15.60:0/1703790325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6819d6a0 con 0x7fbe68102570 2024-09-11T23:58:08.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe6659c640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe68100e20 0x7fbe681986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe65d9b640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102570 0x7fbe68198c30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800b4a0 tx=0x7fbe5800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58014070 con 0x7fbe68102570 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe58010b10 con 0x7fbe68102570 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6819d990 con 0x7fbe68102570 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58017d60 con 0x7fbe68102570 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.170+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe681a5270 con 0x7fbe68102570 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.171+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe68062980 con 0x7fbe68102570 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.173+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbe58017070 con 0x7fbe68102570 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.173+0000 7fbe5f7fe640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe540a2c10 0x7fbe540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.174+0000 7fbe6659c640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe540a2c10 0x7fbe540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.174+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fbe580ce8d0 con 0x7fbe68102570 2024-09-11T23:58:08.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.174+0000 7fbe5f7fe640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] conn(0x7fbe540ac740 0x7fbe540aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.174+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 --> [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe5801ae50 con 0x7fbe540ac740 2024-09-11T23:58:08.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.174+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fbe580ced20 con 0x7fbe68102570 2024-09-11T23:58:08.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.174+0000 7fbe6659c640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe540a2c10 0x7fbe540a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009930 tx=0x7fbe50008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.174+0000 7fbe66d9d640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] conn(0x7fbe540ac740 0x7fbe540aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.175+0000 7fbe66d9d640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] conn(0x7fbe540ac740 0x7fbe540aebe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.175+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 <== osd.5 v2:172.21.15.192:6808/3136840060 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe5801ae50 con 0x7fbe540ac740 2024-09-11T23:58:08.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.189+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 --> [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe68062e00 con 0x7fbe540ac740 2024-09-11T23:58:08.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe5f7fe640 1 -- 172.21.15.60:0/1703790325 <== osd.5 v2:172.21.15.192:6808/3136840060 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbe68062e00 con 0x7fbe540ac740 2024-09-11T23:58:08.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 >> [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] conn(0x7fbe540ac740 msgr2=0x7fbe540aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] conn(0x7fbe540ac740 0x7fbe540aebe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe540a2c10 msgr2=0x7fbe540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbe540a2c10 0x7fbe540a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009930 tx=0x7fbe50008040 comp rx=0 tx=0).stop 2024-09-11T23:58:08.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102570 msgr2=0x7fbe68198c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 --2- 172.21.15.60:0/1703790325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe68102570 0x7fbe68198c30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800b4a0 tx=0x7fbe5800b960 comp rx=0 tx=0).stop 2024-09-11T23:58:08.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe66d9d640 1 -- 172.21.15.60:0/1703790325 reap_dead start 2024-09-11T23:58:08.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 shutdown_connections 2024-09-11T23:58:08.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 >> 172.21.15.60:0/1703790325 conn(0x7fbe680fc7d0 msgr2=0x7fbe6806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:08.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 shutdown_connections 2024-09-11T23:58:08.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.190+0000 7fbe6cfec640 1 -- 172.21.15.60:0/1703790325 wait complete. 2024-09-11T23:58:08.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 -- 172.21.15.60:0/2701894730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 msgr2=0x7fa8c4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 --2- 172.21.15.60:0/2701894730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 0x7fa8c4100ed0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009930 tx=0x7fa8b802a420 comp rx=0 tx=0).stop 2024-09-11T23:58:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 -- 172.21.15.60:0/2701894730 shutdown_connections 2024-09-11T23:58:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 --2- 172.21.15.60:0/2701894730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8c4101410 0x7fa8c410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 --2- 172.21.15.60:0/2701894730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 0x7fa8c4100ed0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 --2- 172.21.15.60:0/2701894730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c4106a70 0x7fa8c4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 -- 172.21.15.60:0/2701894730 >> 172.21.15.60:0/2701894730 conn(0x7fa8c40fc7d0 msgr2=0x7fa8c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 -- 172.21.15.60:0/2701894730 shutdown_connections 2024-09-11T23:58:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.093+0000 7fa8c957f640 1 -- 172.21.15.60:0/2701894730 wait complete. 2024-09-11T23:58:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c957f640 1 Processor -- start 2024-09-11T23:58:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c957f640 1 -- start start 2024-09-11T23:58:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c957f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 0x7fa8c41a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c957f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c4101410 0x7fa8c41a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c957f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8c4106a70 0x7fa8c419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c957f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c4110fd0 con 0x7fa8c4100a70 2024-09-11T23:58:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c957f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c4110e50 con 0x7fa8c4101410 2024-09-11T23:58:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c957f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c4111150 con 0x7fa8c4106a70 2024-09-11T23:58:08.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 0x7fa8c41a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 0x7fa8c41a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32784/0 (socket says 172.21.15.60:32784) 2024-09-11T23:58:08.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c2ffd640 1 -- 172.21.15.60:0/1427287379 learned_addr learned my addr 172.21.15.60:0/1427287379 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:08.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c27fc640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c4101410 0x7fa8c41a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c2ffd640 1 -- 172.21.15.60:0/1427287379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8c4106a70 msgr2=0x7fa8c419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c2ffd640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8c4106a70 0x7fa8c419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c2ffd640 1 -- 172.21.15.60:0/1427287379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c4101410 msgr2=0x7fa8c41a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c2ffd640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c4101410 0x7fa8c41a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c2ffd640 1 -- 172.21.15.60:0/1427287379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c419aef0 con 0x7fa8c4100a70 2024-09-11T23:58:08.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.094+0000 7fa8c27fc640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c4101410 0x7fa8c41a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:08.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.095+0000 7fa8c2ffd640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 0x7fa8c41a05b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400d950 tx=0x7fa8b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.095+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4017070 con 0x7fa8c4100a70 2024-09-11T23:58:08.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.095+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8b4009c30 con 0x7fa8c4100a70 2024-09-11T23:58:08.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.095+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c419b1e0 con 0x7fa8c4100a70 2024-09-11T23:58:08.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.095+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400f740 con 0x7fa8c4100a70 2024-09-11T23:58:08.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.095+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c41a7530 con 0x7fa8c4100a70 2024-09-11T23:58:08.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.096+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8c410cfa0 con 0x7fa8c4100a70 2024-09-11T23:58:08.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.097+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa8b4010a80 con 0x7fa8c4100a70 2024-09-11T23:58:08.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.098+0000 7fa8abfff640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa8ac0a2c10 0x7fa8ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.098+0000 7fa8c27fc640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa8ac0a2c10 0x7fa8ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.098+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fa8b40cf280 con 0x7fa8c4100a70 2024-09-11T23:58:08.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.098+0000 7fa8abfff640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] conn(0x7fa8ac0ac730 0x7fa8ac0aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:08.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.098+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 --> [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8ac0af2a0 con 0x7fa8ac0ac730 2024-09-11T23:58:08.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.098+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa8b40cf6d0 con 0x7fa8c4100a70 2024-09-11T23:58:08.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.098+0000 7fa8c37fe640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] conn(0x7fa8ac0ac730 0x7fa8ac0aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:08.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.098+0000 7fa8c27fc640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa8ac0a2c10 0x7fa8ac0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8000c00 tx=0x7fa8b8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.099+0000 7fa8c37fe640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] conn(0x7fa8ac0ac730 0x7fa8ac0aebd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:08.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.099+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 <== osd.3 v2:172.21.15.60:6810/1798770509 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa8ac0af2a0 con 0x7fa8ac0ac730 2024-09-11T23:58:08.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.113+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 --> [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa8c419b520 con 0x7fa8ac0ac730 2024-09-11T23:58:08.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8abfff640 1 -- 172.21.15.60:0/1427287379 <== osd.3 v2:172.21.15.60:6810/1798770509 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa8bc00a720 con 0x7fa8ac0ac730 2024-09-11T23:58:08.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] conn(0x7fa8ac0ac730 msgr2=0x7fa8ac0aebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] conn(0x7fa8ac0ac730 0x7fa8ac0aebd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:08.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa8ac0a2c10 msgr2=0x7fa8ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa8ac0a2c10 0x7fa8ac0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8000c00 tx=0x7fa8b8005a20 comp rx=0 tx=0).stop 2024-09-11T23:58:08.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 msgr2=0x7fa8c41a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:08.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 --2- 172.21.15.60:0/1427287379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8c4100a70 0x7fa8c41a05b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400d950 tx=0x7fa8b400de10 comp rx=0 tx=0).stop 2024-09-11T23:58:08.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c37fe640 1 -- 172.21.15.60:0/1427287379 reap_dead start 2024-09-11T23:58:08.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 shutdown_connections 2024-09-11T23:58:08.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 >> 172.21.15.60:0/1427287379 conn(0x7fa8c40fc7d0 msgr2=0x7fa8c406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:08.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 shutdown_connections 2024-09-11T23:58:08.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:08.114+0000 7fa8c957f640 1 -- 172.21.15.60:0/1427287379 wait complete. 2024-09-11T23:58:09.305 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:09 smithi060 ceph-mon[30953]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-11T23:58:09.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 -- 172.21.15.60:0/3298160904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4100e20 msgr2=0x7fa3a4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 --2- 172.21.15.60:0/3298160904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4100e20 0x7fa3a4101200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009900 tx=0x7fa3a002a480 comp rx=0 tx=0).stop 2024-09-11T23:58:09.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 -- 172.21.15.60:0/3298160904 shutdown_connections 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 --2- 172.21.15.60:0/3298160904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a4102ef0 0x7fa3a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 --2- 172.21.15.60:0/3298160904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3a4102570 0x7fa3a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 --2- 172.21.15.60:0/3298160904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4100e20 0x7fa3a4101200 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 -- 172.21.15.60:0/3298160904 >> 172.21.15.60:0/3298160904 conn(0x7fa3a40fc7d0 msgr2=0x7fa3a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 -- 172.21.15.60:0/3298160904 shutdown_connections 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 -- 172.21.15.60:0/3298160904 wait complete. 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 Processor -- start 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.305+0000 7fa3abd21640 1 -- start start 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3abd21640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a4100e20 0x7fa3a41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3abd21640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4102570 0x7fa3a4198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3abd21640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3a4102ef0 0x7fa3a419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3abd21640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a41110e0 con 0x7fa3a4102570 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3abd21640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a4110f60 con 0x7fa3a4100e20 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3abd21640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a4111260 con 0x7fa3a4102ef0 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4102570 0x7fa3a4198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4102570 0x7fa3a4198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32842/0 (socket says 172.21.15.60:32842) 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 -- 172.21.15.60:0/2508903511 learned_addr learned my addr 172.21.15.60:0/2508903511 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a9abd640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a4100e20 0x7fa3a41986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3aa2be640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3a4102ef0 0x7fa3a419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 -- 172.21.15.60:0/2508903511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3a4102ef0 msgr2=0x7fa3a419cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3a4102ef0 0x7fa3a419cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 -- 172.21.15.60:0/2508903511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a4100e20 msgr2=0x7fa3a41986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a4100e20 0x7fa3a41986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 -- 172.21.15.60:0/2508903511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a419d680 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa3a92bc640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4102570 0x7fa3a4198c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa39400b4a0 tx=0x7fa39400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.306+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa394014070 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.307+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a419d970 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.307+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa394010b10 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.307+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa394017d60 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.307+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a41a5250 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.308+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3a4062980 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.309+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa394017070 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.309+0000 7fa39affd640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3900a2c10 0x7fa3900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.310+0000 7fa3a9abd640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3900a2c10 0x7fa3900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.310+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fa3940ce9a0 con 0x7fa3a4102570 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.310+0000 7fa39affd640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] conn(0x7fa3900ac740 0x7fa3900aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.310+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 --> [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa39400dec0 con 0x7fa3900ac740 2024-09-11T23:58:09.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.310+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa3940ced50 con 0x7fa3a4102570 2024-09-11T23:58:09.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.310+0000 7fa3a9abd640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3900a2c10 0x7fa3900a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0000c00 tx=0x7fa3a00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.310+0000 7fa3aa2be640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] conn(0x7fa3900ac740 0x7fa3900aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.311+0000 7fa3aa2be640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] conn(0x7fa3900ac740 0x7fa3900aebe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.311+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 <== osd.7 v2:172.21.15.105:6816/1526057205 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa39400dec0 con 0x7fa3900ac740 2024-09-11T23:58:09.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.326+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 --> [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa3a4062e00 con 0x7fa3900ac740 2024-09-11T23:58:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa39affd640 1 -- 172.21.15.60:0/2508903511 <== osd.7 v2:172.21.15.105:6816/1526057205 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa3a4062e00 con 0x7fa3900ac740 2024-09-11T23:58:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 >> [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] conn(0x7fa3900ac740 msgr2=0x7fa3900aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] conn(0x7fa3900ac740 0x7fa3900aebe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3900a2c10 msgr2=0x7fa3900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa3900a2c10 0x7fa3900a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0000c00 tx=0x7fa3a00095f0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4102570 msgr2=0x7fa3a4198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 --2- 172.21.15.60:0/2508903511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3a4102570 0x7fa3a4198c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa39400b4a0 tx=0x7fa39400b960 comp rx=0 tx=0).stop 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3aa2be640 1 -- 172.21.15.60:0/2508903511 reap_dead start 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 shutdown_connections 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 >> 172.21.15.60:0/2508903511 conn(0x7fa3a40fc7d0 msgr2=0x7fa3a406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 shutdown_connections 2024-09-11T23:58:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.327+0000 7fa3abd21640 1 -- 172.21.15.60:0/2508903511 wait complete. 2024-09-11T23:58:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:09 smithi105 ceph-mon[34805]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-11T23:58:09.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:09 smithi192 ceph-mon[35487]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-11T23:58:09.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 -- 172.21.15.60:0/3330121237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc106f10 msgr2=0x7f47bc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 --2- 172.21.15.60:0/3330121237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc106f10 0x7f47bc10ea90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009ca0 tx=0x7f47b402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 -- 172.21.15.60:0/3330121237 shutdown_connections 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 --2- 172.21.15.60:0/3330121237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc106f10 0x7f47bc10ea90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 --2- 172.21.15.60:0/3330121237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47bc102790 0x7f47bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 --2- 172.21.15.60:0/3330121237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47bc101de0 0x7f47bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 -- 172.21.15.60:0/3330121237 >> 172.21.15.60:0/3330121237 conn(0x7f47bc0fd8e0 msgr2=0x7f47bc0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 -- 172.21.15.60:0/3330121237 shutdown_connections 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.194+0000 7f47c2ede640 1 -- 172.21.15.60:0/3330121237 wait complete. 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c2ede640 1 Processor -- start 2024-09-11T23:58:09.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c2ede640 1 -- start start 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c2ede640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc101de0 0x7f47bc1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c2ede640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47bc102790 0x7f47bc1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c2ede640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47bc106f10 0x7f47bc19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c2ede640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc112090 con 0x7f47bc101de0 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c2ede640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc111f10 con 0x7f47bc106f10 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c2ede640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc112210 con 0x7f47bc102790 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc101de0 0x7f47bc1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc101de0 0x7f47bc1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32824/0 (socket says 172.21.15.60:32824) 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 -- 172.21.15.60:0/765391674 learned_addr learned my addr 172.21.15.60:0/765391674 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c147b640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47bc106f10 0x7f47bc19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47b3fff640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47bc102790 0x7f47bc1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 -- 172.21.15.60:0/765391674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47bc102790 msgr2=0x7f47bc1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47bc102790 0x7f47bc1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 -- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47bc106f10 msgr2=0x7f47bc19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47bc106f10 0x7f47bc19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 -- 172.21.15.60:0/765391674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc19d460 con 0x7f47bc101de0 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c147b640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47bc106f10 0x7f47bc19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47b3fff640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47bc102790 0x7f47bc1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.195+0000 7f47c0c7a640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc101de0 0x7f47bc1984b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f47b800d950 tx=0x7f47b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.196+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8017030 con 0x7f47bc101de0 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.196+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc19d750 con 0x7f47bc101de0 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.196+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47b8004020 con 0x7f47bc101de0 2024-09-11T23:58:09.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.196+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8004a00 con 0x7f47bc101de0 2024-09-11T23:58:09.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.196+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc1a5030 con 0x7f47bc101de0 2024-09-11T23:58:09.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.197+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47bc062980 con 0x7f47bc101de0 2024-09-11T23:58:09.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.198+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f47b80041d0 con 0x7f47bc101de0 2024-09-11T23:58:09.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.198+0000 7f47b1ffb640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47a40a2c10 0x7f47a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.198+0000 7f47b3fff640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47a40a2c10 0x7f47a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.198+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f47b80cec70 con 0x7f47bc101de0 2024-09-11T23:58:09.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.199+0000 7f47b1ffb640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] conn(0x7f47a40ac740 0x7f47a40aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.199+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 --> [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47a40af2b0 con 0x7f47a40ac740 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.199+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f47b80d1330 con 0x7f47bc101de0 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.199+0000 7f47b3fff640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47a40a2c10 0x7f47a40a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f47ac005fd0 tx=0x7f47ac0094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.199+0000 7f47c147b640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] conn(0x7f47a40ac740 0x7f47a40aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.200+0000 7f47c147b640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] conn(0x7f47a40ac740 0x7f47a40aebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.200+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 <== osd.10 v2:172.21.15.105:6824/3699246515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47a40af2b0 con 0x7f47a40ac740 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.214+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 --> [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47bc062db0 con 0x7f47a40ac740 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.215+0000 7f47b1ffb640 1 -- 172.21.15.60:0/765391674 <== osd.10 v2:172.21.15.105:6824/3699246515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f47bc062db0 con 0x7f47a40ac740 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.215+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] conn(0x7f47a40ac740 msgr2=0x7f47a40aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] conn(0x7f47a40ac740 0x7f47a40aebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47a40a2c10 msgr2=0x7f47a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f47a40a2c10 0x7f47a40a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f47ac005fd0 tx=0x7f47ac0094d0 comp rx=0 tx=0).stop 2024-09-11T23:58:09.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc101de0 msgr2=0x7f47bc1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:09.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 --2- 172.21.15.60:0/765391674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc101de0 0x7f47bc1984b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f47b800d950 tx=0x7f47b800de10 comp rx=0 tx=0).stop 2024-09-11T23:58:09.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c147b640 1 -- 172.21.15.60:0/765391674 reap_dead start 2024-09-11T23:58:09.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 shutdown_connections 2024-09-11T23:58:09.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 >> 172.21.15.60:0/765391674 conn(0x7f47bc0fd8e0 msgr2=0x7f47bc0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:09.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 shutdown_connections 2024-09-11T23:58:09.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:09.216+0000 7f47c2ede640 1 -- 172.21.15.60:0/765391674 wait complete. 2024-09-11T23:58:10.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 -- 172.21.15.60:0/473574737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102570 msgr2=0x7f7dec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 --2- 172.21.15.60:0/473574737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102570 0x7f7dec1029b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009900 tx=0x7f7dd402a480 comp rx=0 tx=0).stop 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 -- 172.21.15.60:0/473574737 shutdown_connections 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 --2- 172.21.15.60:0/473574737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dec102ef0 0x7f7dec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 --2- 172.21.15.60:0/473574737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102570 0x7f7dec1029b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 --2- 172.21.15.60:0/473574737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dec100e20 0x7f7dec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 -- 172.21.15.60:0/473574737 >> 172.21.15.60:0/473574737 conn(0x7f7dec0fc7d0 msgr2=0x7f7dec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 -- 172.21.15.60:0/473574737 shutdown_connections 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 -- 172.21.15.60:0/473574737 wait complete. 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.169+0000 7f7df223b640 1 Processor -- start 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7df223b640 1 -- start start 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7df223b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dec100e20 0x7f7dec0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7df223b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dec102570 0x7f7dec0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7df223b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102ef0 0x7f7dec0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7df223b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec111160 con 0x7f7dec102ef0 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7df223b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec110fe0 con 0x7f7dec102570 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7df223b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7dec1112e0 con 0x7f7dec100e20 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7debfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102ef0 0x7f7dec0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7debfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102ef0 0x7f7dec0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32862/0 (socket says 172.21.15.60:32862) 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7debfff640 1 -- 172.21.15.60:0/2530293873 learned_addr learned my addr 172.21.15.60:0/2530293873 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7deb7fe640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dec100e20 0x7f7dec0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7deaffd640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dec102570 0x7f7dec0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7debfff640 1 -- 172.21.15.60:0/2530293873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dec100e20 msgr2=0x7f7dec0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7debfff640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7dec100e20 0x7f7dec0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7debfff640 1 -- 172.21.15.60:0/2530293873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dec102570 msgr2=0x7f7dec0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7debfff640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dec102570 0x7f7dec0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.170+0000 7f7debfff640 1 -- 172.21.15.60:0/2530293873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dec1a6be0 con 0x7f7dec102ef0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.171+0000 7f7debfff640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102ef0 0x7f7dec0fd700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009fd0 tx=0x7f7de400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.171+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4011830 con 0x7f7dec102ef0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.171+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7de4016070 con 0x7f7dec102ef0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.171+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dec1a6ed0 con 0x7f7dec102ef0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.171+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de400f2e0 con 0x7f7dec102ef0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.171+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dec1a7430 con 0x7f7dec102ef0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.172+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7dec062880 con 0x7f7dec102ef0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.173+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7de401b460 con 0x7f7dec102ef0 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.174+0000 7f7de8ff9640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7dd80a2c90 0x7f7dd80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.174+0000 7f7deb7fe640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7dd80a2c90 0x7f7dd80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.174+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f7de40cf130 con 0x7f7dec102ef0 2024-09-11T23:58:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.174+0000 7f7de8ff9640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] conn(0x7f7dd80ac7c0 0x7f7dd80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.174+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 --> [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7de4022e50 con 0x7f7dd80ac7c0 2024-09-11T23:58:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.174+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7de40cf4e0 con 0x7f7dec102ef0 2024-09-11T23:58:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.174+0000 7f7deb7fe640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7dd80a2c90 0x7f7dd80a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00a400 tx=0x7f7ddc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.175+0000 7f7deaffd640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] conn(0x7f7dd80ac7c0 0x7f7dd80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.175+0000 7f7deaffd640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] conn(0x7f7dd80ac7c0 0x7f7dd80aec60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.176+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 <== osd.8 v2:172.21.15.192:6816/4104765194 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7de4022e50 con 0x7f7dd80ac7c0 2024-09-11T23:58:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.191+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 --> [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7dec062d30 con 0x7f7dd80ac7c0 2024-09-11T23:58:10.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.191+0000 7f7de8ff9640 1 -- 172.21.15.60:0/2530293873 <== osd.8 v2:172.21.15.192:6816/4104765194 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7dec062d30 con 0x7f7dd80ac7c0 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 >> [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] conn(0x7f7dd80ac7c0 msgr2=0x7f7dd80aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] conn(0x7f7dd80ac7c0 0x7f7dd80aec60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7dd80a2c90 msgr2=0x7f7dd80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7dd80a2c90 0x7f7dd80a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00a400 tx=0x7f7ddc00d040 comp rx=0 tx=0).stop 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102ef0 msgr2=0x7f7dec0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 --2- 172.21.15.60:0/2530293873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dec102ef0 0x7f7dec0fd700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009fd0 tx=0x7f7de400b8e0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7debfff640 1 -- 172.21.15.60:0/2530293873 reap_dead start 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 shutdown_connections 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 >> 172.21.15.60:0/2530293873 conn(0x7f7dec0fc7d0 msgr2=0x7f7dec06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 shutdown_connections 2024-09-11T23:58:10.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:10.192+0000 7f7df223b640 1 -- 172.21.15.60:0/2530293873 wait complete. 2024-09-11T23:58:10.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.143+0000 7fb235092640 1 -- 172.21.15.60:0/1774541507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb230102d30 msgr2=0x7fb230103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.143+0000 7fb235092640 1 --2- 172.21.15.60:0/1774541507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb230102d30 0x7fb230103110 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb228009930 tx=0x7fb22802a420 comp rx=0 tx=0).stop 2024-09-11T23:58:10.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.143+0000 7fb235092640 1 -- 172.21.15.60:0/1774541507 shutdown_connections 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.143+0000 7fb235092640 1 --2- 172.21.15.60:0/1774541507 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2301082a0 0x7fb23010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.143+0000 7fb235092640 1 --2- 172.21.15.60:0/1774541507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2301036e0 0x7fb230107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.143+0000 7fb235092640 1 --2- 172.21.15.60:0/1774541507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb230102d30 0x7fb230103110 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.144+0000 7fb235092640 1 -- 172.21.15.60:0/1774541507 >> 172.21.15.60:0/1774541507 conn(0x7fb2300fc7d0 msgr2=0x7fb2300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.144+0000 7fb235092640 1 -- 172.21.15.60:0/1774541507 shutdown_connections 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.144+0000 7fb235092640 1 -- 172.21.15.60:0/1774541507 wait complete. 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.144+0000 7fb235092640 1 Processor -- start 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb235092640 1 -- start start 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb235092640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb230102d30 0x7fb230198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb235092640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2301036e0 0x7fb230198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb235092640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2301082a0 0x7fb23019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb235092640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb230112260 con 0x7fb2301036e0 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb235092640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301120e0 con 0x7fb230102d30 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb235092640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301123e0 con 0x7fb2301082a0 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2301036e0 0x7fb230198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2301036e0 0x7fb230198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60982/0 (socket says 172.21.15.60:60982) 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 -- 172.21.15.60:0/3985638512 learned_addr learned my addr 172.21.15.60:0/3985638512 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22ed9d640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb230102d30 0x7fb230198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22f59e640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2301082a0 0x7fb23019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 -- 172.21.15.60:0/3985638512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2301082a0 msgr2=0x7fb23019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2301082a0 0x7fb23019d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 -- 172.21.15.60:0/3985638512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb230102d30 msgr2=0x7fb230198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb230102d30 0x7fb230198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 -- 172.21.15.60:0/3985638512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23019d6f0 con 0x7fb2301036e0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.145+0000 7fb22e59c640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2301036e0 0x7fb230198c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb21800d750 tx=0x7fb21800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.146+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218017070 con 0x7fb2301036e0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.146+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23019d9e0 con 0x7fb2301036e0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.146+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb218005520 con 0x7fb2301036e0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.146+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218004e00 con 0x7fb2301036e0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.146+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2301a52c0 con 0x7fb2301036e0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.147+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb230062980 con 0x7fb2301036e0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.148+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb218004fa0 con 0x7fb2301036e0 2024-09-11T23:58:10.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.149+0000 7fb227fff640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb21c0a2c10 0x7fb21c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.149+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fb2180ceef0 con 0x7fb2301036e0 2024-09-11T23:58:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.149+0000 7fb22ed9d640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb21c0a2c10 0x7fb21c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.149+0000 7fb227fff640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] conn(0x7fb21c0ac740 0x7fb21c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.149+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 --> [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb21c0af2b0 con 0x7fb21c0ac740 2024-09-11T23:58:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.149+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fb2180cf340 con 0x7fb2301036e0 2024-09-11T23:58:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.150+0000 7fb22f59e640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] conn(0x7fb21c0ac740 0x7fb21c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.150+0000 7fb22ed9d640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb21c0a2c10 0x7fb21c0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb228009900 tx=0x7fb2280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.150+0000 7fb22f59e640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] conn(0x7fb21c0ac740 0x7fb21c0aebe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.151+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 <== osd.2 v2:172.21.15.192:6800/4171786693 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb21c0af2b0 con 0x7fb21c0ac740 2024-09-11T23:58:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.167+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 --> [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb230062e00 con 0x7fb21c0ac740 2024-09-11T23:58:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.167+0000 7fb227fff640 1 -- 172.21.15.60:0/3985638512 <== osd.2 v2:172.21.15.192:6800/4171786693 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb230062e00 con 0x7fb21c0ac740 2024-09-11T23:58:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.168+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 >> [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] conn(0x7fb21c0ac740 msgr2=0x7fb21c0aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.168+0000 7fb235092640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] conn(0x7fb21c0ac740 0x7fb21c0aebe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.168+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb21c0a2c10 msgr2=0x7fb21c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.168+0000 7fb235092640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb21c0a2c10 0x7fb21c0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb228009900 tx=0x7fb2280058d0 comp rx=0 tx=0).stop 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.168+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2301036e0 msgr2=0x7fb230198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.168+0000 7fb235092640 1 --2- 172.21.15.60:0/3985638512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2301036e0 0x7fb230198c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb21800d750 tx=0x7fb21800dc10 comp rx=0 tx=0).stop 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.168+0000 7fb22f59e640 1 -- 172.21.15.60:0/3985638512 reap_dead start 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.168+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 shutdown_connections 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.169+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 >> 172.21.15.60:0/3985638512 conn(0x7fb2300fc7d0 msgr2=0x7fb230106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.169+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 shutdown_connections 2024-09-11T23:58:10.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:07.169+0000 7fb235092640 1 -- 172.21.15.60:0/3985638512 wait complete. 2024-09-11T23:58:11.045 INFO:teuthology.orchestra.run.smithi060.stdout:77309411394 2024-09-11T23:58:11.046 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T23:58:11.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:11 smithi060 ceph-mon[30953]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-11T23:58:11.415 INFO:teuthology.orchestra.run.smithi060.stdout:103079215166 2024-09-11T23:58:11.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T23:58:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:11 smithi105 ceph-mon[34805]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-11T23:58:11.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:11 smithi192 ceph-mon[35487]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-11T23:58:12.674 INFO:teuthology.orchestra.run.smithi060.stdout:154618822706 2024-09-11T23:58:12.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T23:58:12.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 -- 172.21.15.60:0/1779641980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde2010c170 msgr2=0x7fde2010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 --2- 172.21.15.60:0/1779641980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde2010c170 0x7fde2010e610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde18009ca0 tx=0x7fde1802a950 comp rx=0 tx=0).stop 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 -- 172.21.15.60:0/1779641980 shutdown_connections 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 --2- 172.21.15.60:0/1779641980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde2010c170 0x7fde2010e610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 --2- 172.21.15.60:0/1779641980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde20103660 0x7fde2010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 --2- 172.21.15.60:0/1779641980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde20102d40 0x7fde20103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 -- 172.21.15.60:0/1779641980 >> 172.21.15.60:0/1779641980 conn(0x7fde200fc7a0 msgr2=0x7fde200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 -- 172.21.15.60:0/1779641980 shutdown_connections 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.011+0000 7fde27694640 1 -- 172.21.15.60:0/1779641980 wait complete. 2024-09-11T23:58:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde27694640 1 Processor -- start 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde27694640 1 -- start start 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde27694640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde20102d40 0x7fde20198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde27694640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde20103660 0x7fde20198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde27694640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2010c170 0x7fde2019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde27694640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fde201120f0 con 0x7fde20103660 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde27694640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde20111f70 con 0x7fde20102d40 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde27694640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fde20112270 con 0x7fde2010c170 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde24c2f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde20103660 0x7fde20198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde24c2f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde20103660 0x7fde20198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42752/0 (socket says 172.21.15.60:42752) 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.012+0000 7fde24c2f640 1 -- 172.21.15.60:0/383317754 learned_addr learned my addr 172.21.15.60:0/383317754 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde25c31640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2010c170 0x7fde2019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde25430640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde20102d40 0x7fde20198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde24c2f640 1 -- 172.21.15.60:0/383317754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2010c170 msgr2=0x7fde2019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde24c2f640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde2010c170 0x7fde2019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde24c2f640 1 -- 172.21.15.60:0/383317754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde20102d40 msgr2=0x7fde20198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde24c2f640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde20102d40 0x7fde20198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde24c2f640 1 -- 172.21.15.60:0/383317754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2019d4c0 con 0x7fde20103660 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde25430640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde20102d40 0x7fde20198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde24c2f640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde20103660 0x7fde20198a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fde1000c970 tx=0x7fde1000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10007bb0 con 0x7fde20103660 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde10007d50 con 0x7fde20103660 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2019d7b0 con 0x7fde20103660 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde100188d0 con 0x7fde20103660 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.013+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde201a5090 con 0x7fde20103660 2024-09-11T23:58:12.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.014+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde200fed90 con 0x7fde20103660 2024-09-11T23:58:12.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.015+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fde10018a70 con 0x7fde20103660 2024-09-11T23:58:12.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.016+0000 7fde167fc640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fde0c0a2c10 0x7fde0c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:12.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.016+0000 7fde25430640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fde0c0a2c10 0x7fde0c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:12.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.016+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fde100cf9d0 con 0x7fde20103660 2024-09-11T23:58:12.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.016+0000 7fde167fc640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] conn(0x7fde0c0ac740 0x7fde0c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:12.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.016+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 --> [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde0c0af2b0 con 0x7fde0c0ac740 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.016+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fde100cfd80 con 0x7fde20103660 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.017+0000 7fde25c31640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] conn(0x7fde0c0ac740 0x7fde0c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.017+0000 7fde25430640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fde0c0a2c10 0x7fde0c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde1c006fd0 tx=0x7fde1c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.017+0000 7fde25c31640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] conn(0x7fde0c0ac740 0x7fde0c0aebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.018+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 <== osd.9 v2:172.21.15.60:6826/3531170684 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde0c0af2b0 con 0x7fde0c0ac740 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 --> [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde2006b070 con 0x7fde0c0ac740 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde167fc640 1 -- 172.21.15.60:0/383317754 <== osd.9 v2:172.21.15.60:6826/3531170684 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fde2006b070 con 0x7fde0c0ac740 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] conn(0x7fde0c0ac740 msgr2=0x7fde0c0aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] conn(0x7fde0c0ac740 0x7fde0c0aebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fde0c0a2c10 msgr2=0x7fde0c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fde0c0a2c10 0x7fde0c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde1c006fd0 tx=0x7fde1c008040 comp rx=0 tx=0).stop 2024-09-11T23:58:12.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde20103660 msgr2=0x7fde20198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:12.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 --2- 172.21.15.60:0/383317754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde20103660 0x7fde20198a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fde1000c970 tx=0x7fde1000ce30 comp rx=0 tx=0).stop 2024-09-11T23:58:12.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde25c31640 1 -- 172.21.15.60:0/383317754 reap_dead start 2024-09-11T23:58:12.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 shutdown_connections 2024-09-11T23:58:12.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 >> 172.21.15.60:0/383317754 conn(0x7fde200fc7a0 msgr2=0x7fde200fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:12.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 shutdown_connections 2024-09-11T23:58:12.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:12.032+0000 7fde27694640 1 -- 172.21.15.60:0/383317754 wait complete. 2024-09-11T23:58:13.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:13 smithi060 ceph-mon[30953]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-11T23:58:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:13 smithi105 ceph-mon[34805]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-11T23:58:13.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3791647724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48106a90 msgr2=0x7fdd48106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:13.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 --2- 172.21.15.60:0/3791647724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48106a90 0x7fdd48106e70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009930 tx=0x7fdd3c02a420 comp rx=0 tx=0).stop 2024-09-11T23:58:13.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3791647724 shutdown_connections 2024-09-11T23:58:13.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 --2- 172.21.15.60:0/3791647724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd48101430 0x7fdd4810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:13.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 --2- 172.21.15.60:0/3791647724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd48100a90 0x7fdd48100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:13.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 --2- 172.21.15.60:0/3791647724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48106a90 0x7fdd48106e70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:13.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3791647724 >> 172.21.15.60:0/3791647724 conn(0x7fdd480fc7d0 msgr2=0x7fdd480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:13.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3791647724 shutdown_connections 2024-09-11T23:58:13.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.482+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3791647724 wait complete. 2024-09-11T23:58:13.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4ed90640 1 Processor -- start 2024-09-11T23:58:13.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4ed90640 1 -- start start 2024-09-11T23:58:13.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4ed90640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd48100a90 0x7fdd480fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:13.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4ed90640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48101430 0x7fdd480fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4ed90640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd48106a90 0x7fdd480fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4ed90640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48110fb0 con 0x7fdd48101430 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4ed90640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48110e30 con 0x7fdd48100a90 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4ed90640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdd48111130 con 0x7fdd48106a90 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd47fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48101430 0x7fdd480fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd47fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48101430 0x7fdd480fd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42778/0 (socket says 172.21.15.60:42778) 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd47fff640 1 -- 172.21.15.60:0/3062845147 learned_addr learned my addr 172.21.15.60:0/3062845147 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4d32d640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd48106a90 0x7fdd480fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.483+0000 7fdd4cb2c640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd48100a90 0x7fdd480fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd47fff640 1 -- 172.21.15.60:0/3062845147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd48106a90 msgr2=0x7fdd480fd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:13.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd47fff640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd48106a90 0x7fdd480fd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd47fff640 1 -- 172.21.15.60:0/3062845147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd48100a90 msgr2=0x7fdd480fcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd47fff640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd48100a90 0x7fdd480fcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd47fff640 1 -- 172.21.15.60:0/3062845147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd481a6960 con 0x7fdd48101430 2024-09-11T23:58:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd47fff640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48101430 0x7fdd480fd2b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400e9f0 tx=0x7fdd3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400cd80 con 0x7fdd48101430 2024-09-11T23:58:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd481a6c50 con 0x7fdd48101430 2024-09-11T23:58:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd481a7190 con 0x7fdd48101430 2024-09-11T23:58:13.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd34010930 con 0x7fdd48101430 2024-09-11T23:58:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.484+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34018a10 con 0x7fdd48101430 2024-09-11T23:58:13.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.485+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd2c001030 con 0x7fdd48101430 2024-09-11T23:58:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.486+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdd34018bb0 con 0x7fdd48101430 2024-09-11T23:58:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.487+0000 7fdd45ffb640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdd380a2c10 0x7fdd380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.487+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fdd340cfa10 con 0x7fdd48101430 2024-09-11T23:58:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.487+0000 7fdd4cb2c640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdd380a2c10 0x7fdd380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.487+0000 7fdd45ffb640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] conn(0x7fdd380ac740 0x7fdd380aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.487+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 --> [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd380af2b0 con 0x7fdd380ac740 2024-09-11T23:58:13.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.487+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fdd340cfdc0 con 0x7fdd48101430 2024-09-11T23:58:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.488+0000 7fdd4d32d640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] conn(0x7fdd380ac740 0x7fdd380aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.488+0000 7fdd4cb2c640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdd380a2c10 0x7fdd380a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009900 tx=0x7fdd3c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.488+0000 7fdd4d32d640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] conn(0x7fdd380ac740 0x7fdd380aebe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.489+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 <== osd.6 v2:172.21.15.60:6818/2796525273 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd380af2b0 con 0x7fdd380ac740 2024-09-11T23:58:13.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.502+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 --> [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd2c002dd0 con 0x7fdd380ac740 2024-09-11T23:58:13.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.502+0000 7fdd45ffb640 1 -- 172.21.15.60:0/3062845147 <== osd.6 v2:172.21.15.60:6818/2796525273 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdd2c002dd0 con 0x7fdd380ac740 2024-09-11T23:58:13.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] conn(0x7fdd380ac740 msgr2=0x7fdd380aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:13.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] conn(0x7fdd380ac740 0x7fdd380aebe0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdd380a2c10 msgr2=0x7fdd380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdd380a2c10 0x7fdd380a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009900 tx=0x7fdd3c0058d0 comp rx=0 tx=0).stop 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48101430 msgr2=0x7fdd480fd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 --2- 172.21.15.60:0/3062845147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd48101430 0x7fdd480fd2b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400e9f0 tx=0x7fdd3400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4d32d640 1 -- 172.21.15.60:0/3062845147 reap_dead start 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 shutdown_connections 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 >> 172.21.15.60:0/3062845147 conn(0x7fdd480fc7d0 msgr2=0x7fdd4806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 shutdown_connections 2024-09-11T23:58:13.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:13.503+0000 7fdd4ed90640 1 -- 172.21.15.60:0/3062845147 wait complete. 2024-09-11T23:58:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:13 smithi192 ceph-mon[35487]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-11T23:58:14.188 INFO:teuthology.orchestra.run.smithi060.stdout:184683593775 2024-09-11T23:58:14.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T23:58:14.721 INFO:teuthology.orchestra.run.smithi060.stdout:206158430249 2024-09-11T23:58:14.721 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T23:58:15.142 INFO:teuthology.orchestra.run.smithi060.stdout:287762808858 2024-09-11T23:58:15.142 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T23:58:15.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:15 smithi060 ceph-mon[30953]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-11T23:58:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:15 smithi105 ceph-mon[34805]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-11T23:58:15.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:15 smithi192 ceph-mon[35487]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-11T23:58:15.617 INFO:teuthology.orchestra.run.smithi060.stdout:236223201315 2024-09-11T23:58:15.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T23:58:15.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 -- 172.21.15.60:0/3529415787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 msgr2=0x7fb63810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 --2- 172.21.15.60:0/3529415787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 0x7fb63810de80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb624009900 tx=0x7fb62402a480 comp rx=0 tx=0).stop 2024-09-11T23:58:15.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 -- 172.21.15.60:0/3529415787 shutdown_connections 2024-09-11T23:58:15.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 --2- 172.21.15.60:0/3529415787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb63810e3c0 0x7fb638110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 --2- 172.21.15.60:0/3529415787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 0x7fb63810de80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 --2- 172.21.15.60:0/3529415787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb638074620 0x7fb638074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 -- 172.21.15.60:0/3529415787 >> 172.21.15.60:0/3529415787 conn(0x7fb6380fd8c0 msgr2=0x7fb6380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 -- 172.21.15.60:0/3529415787 shutdown_connections 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.928+0000 7fb63edaf640 1 -- 172.21.15.60:0/3529415787 wait complete. 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63edaf640 1 Processor -- start 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63edaf640 1 -- start start 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63edaf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb638074620 0x7fb63819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63edaf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 0x7fb63819ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63edaf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb63810e3c0 0x7fb63819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63edaf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381142f0 con 0x7fb638074f40 2024-09-11T23:58:15.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63edaf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb638114170 con 0x7fb63810e3c0 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63edaf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb638114470 con 0x7fb638074620 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb637fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 0x7fb63819ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb637fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 0x7fb63819ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42800/0 (socket says 172.21.15.60:42800) 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb637fff640 1 -- 172.21.15.60:0/1828645011 learned_addr learned my addr 172.21.15.60:0/1828645011 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63cb4b640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb638074620 0x7fb63819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.929+0000 7fb63d34c640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb63810e3c0 0x7fb63819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb637fff640 1 -- 172.21.15.60:0/1828645011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb638074620 msgr2=0x7fb63819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb637fff640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb638074620 0x7fb63819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb637fff640 1 -- 172.21.15.60:0/1828645011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb63810e3c0 msgr2=0x7fb63819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb637fff640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb63810e3c0 0x7fb63819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb637fff640 1 -- 172.21.15.60:0/1828645011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63819e740 con 0x7fb638074f40 2024-09-11T23:58:15.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb637fff640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 0x7fb63819ad30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb624006010 tx=0x7fb6240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62403f030 con 0x7fb638074f40 2024-09-11T23:58:15.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb624003d00 con 0x7fb638074f40 2024-09-11T23:58:15.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63819e9d0 con 0x7fb638074f40 2024-09-11T23:58:15.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624035070 con 0x7fb638074f40 2024-09-11T23:58:15.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.930+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381a73a0 con 0x7fb638074f40 2024-09-11T23:58:15.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.931+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6380ffe70 con 0x7fb638074f40 2024-09-11T23:58:15.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.932+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb624042030 con 0x7fb638074f40 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.933+0000 7fb635ffb640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb6280a2c90 0x7fb6280a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.933+0000 7fb63cb4b640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb6280a2c90 0x7fb6280a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.933+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fb6240efec0 con 0x7fb638074f40 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.933+0000 7fb635ffb640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] conn(0x7fb6280ac7c0 0x7fb6280aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.933+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 --> [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6280af330 con 0x7fb6280ac7c0 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.933+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fb6240f0270 con 0x7fb638074f40 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.934+0000 7fb63cb4b640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb6280a2c90 0x7fb6280a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00bbe0 tx=0x7fb62c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.934+0000 7fb63d34c640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] conn(0x7fb6280ac7c0 0x7fb6280aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.934+0000 7fb63d34c640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] conn(0x7fb6280ac7c0 0x7fb6280aec60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.935+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 <== osd.4 v2:172.21.15.105:6808/1760564347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6280af330 con 0x7fb6280ac7c0 2024-09-11T23:58:15.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.948+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 --> [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb638075cd0 con 0x7fb6280ac7c0 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb635ffb640 1 -- 172.21.15.60:0/1828645011 <== osd.4 v2:172.21.15.105:6808/1760564347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb638075cd0 con 0x7fb6280ac7c0 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 >> [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] conn(0x7fb6280ac7c0 msgr2=0x7fb6280aec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63edaf640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] conn(0x7fb6280ac7c0 0x7fb6280aec60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb6280a2c90 msgr2=0x7fb6280a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63edaf640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb6280a2c90 0x7fb6280a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00bbe0 tx=0x7fb62c00b390 comp rx=0 tx=0).stop 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 msgr2=0x7fb63819ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63edaf640 1 --2- 172.21.15.60:0/1828645011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb638074f40 0x7fb63819ad30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb624006010 tx=0x7fb6240042f0 comp rx=0 tx=0).stop 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63d34c640 1 -- 172.21.15.60:0/1828645011 reap_dead start 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 shutdown_connections 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.949+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 >> 172.21.15.60:0/1828645011 conn(0x7fb6380fd8c0 msgr2=0x7fb6380fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.950+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 shutdown_connections 2024-09-11T23:58:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:15.950+0000 7fb63edaf640 1 -- 172.21.15.60:0/1828645011 wait complete. 2024-09-11T23:58:16.828 INFO:teuthology.orchestra.run.smithi060.stdout:133143986234 2024-09-11T23:58:16.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T23:58:17.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:17 smithi060 ceph-mon[30953]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-11T23:58:17.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:17 smithi105 ceph-mon[34805]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-11T23:58:17.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:17 smithi192 ceph-mon[35487]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-11T23:58:17.687 INFO:teuthology.orchestra.run.smithi060.stdout:55834574918 2024-09-11T23:58:17.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T23:58:17.802 INFO:teuthology.orchestra.run.smithi060.stdout:266287972383 2024-09-11T23:58:17.802 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T23:58:17.852 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:17.873 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.609+0000 7f7c53441640 1 -- 172.21.15.60:0/1313675208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c4c101dd0 msgr2=0x7f7c4c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.609+0000 7f7c53441640 1 --2- 172.21.15.60:0/1313675208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c4c101dd0 0x7f7c4c1021b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009860 tx=0x7f7c4802a340 comp rx=0 tx=0).stop 2024-09-11T23:58:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.609+0000 7f7c53441640 1 -- 172.21.15.60:0/1313675208 shutdown_connections 2024-09-11T23:58:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.609+0000 7f7c53441640 1 --2- 172.21.15.60:0/1313675208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c106f00 0x7f7c4c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.609+0000 7f7c53441640 1 --2- 172.21.15.60:0/1313675208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c4c102780 0x7f7c4c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.609+0000 7f7c53441640 1 --2- 172.21.15.60:0/1313675208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c4c101dd0 0x7f7c4c1021b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.609+0000 7f7c53441640 1 -- 172.21.15.60:0/1313675208 >> 172.21.15.60:0/1313675208 conn(0x7f7c4c0fd8b0 msgr2=0x7f7c4c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:18.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.611+0000 7f7c53441640 1 -- 172.21.15.60:0/1313675208 shutdown_connections 2024-09-11T23:58:18.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.612+0000 7f7c53441640 1 -- 172.21.15.60:0/1313675208 wait complete. 2024-09-11T23:58:18.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.613+0000 7f7c53441640 1 Processor -- start 2024-09-11T23:58:18.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.613+0000 7f7c53441640 1 -- start start 2024-09-11T23:58:18.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.613+0000 7f7c53441640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c4c101dd0 0x7f7c4c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c53441640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c102780 0x7f7c4c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c53441640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c4c106f00 0x7f7c4c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c53441640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c112080 con 0x7f7c4c106f00 2024-09-11T23:58:18.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c53441640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c111f00 con 0x7f7c4c102780 2024-09-11T23:58:18.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c53441640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c112200 con 0x7f7c4c101dd0 2024-09-11T23:58:18.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c519de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c4c106f00 0x7f7c4c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c511dd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c4c101dd0 0x7f7c4c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c519de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c4c106f00 0x7f7c4c19ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42824/0 (socket says 172.21.15.60:42824) 2024-09-11T23:58:18.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c519de640 1 -- 172.21.15.60:0/524875223 learned_addr learned my addr 172.21.15.60:0/524875223 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:18.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c509dc640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c102780 0x7f7c4c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c509dc640 1 -- 172.21.15.60:0/524875223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c4c101dd0 msgr2=0x7f7c4c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c509dc640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c4c101dd0 0x7f7c4c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c509dc640 1 -- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c4c106f00 msgr2=0x7f7c4c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.614+0000 7f7c509dc640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c4c106f00 0x7f7c4c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.615+0000 7f7c509dc640 1 -- 172.21.15.60:0/524875223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c19d550 con 0x7f7c4c102780 2024-09-11T23:58:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.615+0000 7f7c509dc640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c102780 0x7f7c4c198ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00e790 tx=0x7f7c3c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.615+0000 7f7c427fc640 1 -- 172.21.15.60:0/524875223 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c00eea0 con 0x7f7c4c102780 2024-09-11T23:58:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.615+0000 7f7c427fc640 1 -- 172.21.15.60:0/524875223 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c3c00ccc0 con 0x7f7c4c102780 2024-09-11T23:58:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.615+0000 7f7c427fc640 1 -- 172.21.15.60:0/524875223 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c018860 con 0x7f7c4c102780 2024-09-11T23:58:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.615+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c19d840 con 0x7f7c4c102780 2024-09-11T23:58:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.616+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1a5120 con 0x7f7c4c102780 2024-09-11T23:58:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.618+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c1021b0 con 0x7f7c4c102780 2024-09-11T23:58:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.619+0000 7f7c427fc640 1 -- 172.21.15.60:0/524875223 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7c3c018a00 con 0x7f7c4c102780 2024-09-11T23:58:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.620+0000 7f7c427fc640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c380a2c10 0x7f7c380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.621+0000 7f7c427fc640 1 -- 172.21.15.60:0/524875223 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f7c3c0cf3e0 con 0x7f7c4c102780 2024-09-11T23:58:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.621+0000 7f7c511dd640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c380a2c10 0x7f7c380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:18.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.622+0000 7f7c511dd640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c380a2c10 0x7f7c380a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009780 tx=0x7f7c48000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.625+0000 7f7c427fc640 1 -- 172.21.15.60:0/524875223 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c3c09c210 con 0x7f7c4c102780 2024-09-11T23:58:18.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.810+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f7c4c10a0e0 con 0x7f7c4c102780 2024-09-11T23:58:18.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.811+0000 7f7c427fc640 1 -- 172.21.15.60:0/524875223 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7c3c09bb10 con 0x7f7c4c102780 2024-09-11T23:58:18.812 INFO:teuthology.orchestra.run.smithi060.stdout:317827579926 2024-09-11T23:58:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c380a2c10 msgr2=0x7f7c380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c380a2c10 0x7f7c380a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009780 tx=0x7f7c48000bc0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c102780 msgr2=0x7f7c4c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:18.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c102780 0x7f7c4c198ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00e790 tx=0x7f7c3c00ec50 comp rx=0 tx=0).stop 2024-09-11T23:58:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 shutdown_connections 2024-09-11T23:58:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c380a2c10 0x7f7c380a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c4c106f00 0x7f7c4c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c4c102780 0x7f7c4c198ae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 --2- 172.21.15.60:0/524875223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c4c101dd0 0x7f7c4c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 >> 172.21.15.60:0/524875223 conn(0x7f7c4c0fd8b0 msgr2=0x7f7c4c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 shutdown_connections 2024-09-11T23:58:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:18.813+0000 7f7c53441640 1 -- 172.21.15.60:0/524875223 wait complete. 2024-09-11T23:58:19.196 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:19 smithi060 ceph-mon[30953]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:19.196 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:19 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/524875223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:58:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 -- 172.21.15.60:0/2202903485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708101420 msgr2=0x7f570810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 --2- 172.21.15.60:0/2202903485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708101420 0x7f570810d950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5700009cd0 tx=0x7f570002a8e0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 -- 172.21.15.60:0/2202903485 shutdown_connections 2024-09-11T23:58:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 --2- 172.21.15.60:0/2202903485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708101420 0x7f570810d950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 --2- 172.21.15.60:0/2202903485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708100a80 0x7f5708100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 --2- 172.21.15.60:0/2202903485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5708106a80 0x7f5708106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 -- 172.21.15.60:0/2202903485 >> 172.21.15.60:0/2202903485 conn(0x7f57080fc7a0 msgr2=0x7f57080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 -- 172.21.15.60:0/2202903485 shutdown_connections 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.279+0000 7f570fac5640 1 -- 172.21.15.60:0/2202903485 wait complete. 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.280+0000 7f570fac5640 1 Processor -- start 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.280+0000 7f570fac5640 1 -- start start 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.280+0000 7f570fac5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708100a80 0x7f57081986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.280+0000 7f570fac5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708101420 0x7f5708198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.280+0000 7f570fac5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5708106a80 0x7f570819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.280+0000 7f570fac5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5708112160 con 0x7f5708100a80 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.280+0000 7f570fac5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5708111fe0 con 0x7f5708106a80 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.280+0000 7f570fac5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f57081122e0 con 0x7f5708101420 2024-09-11T23:58:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708100a80 0x7f57081986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708100a80 0x7f57081986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42836/0 (socket says 172.21.15.60:42836) 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 -- 172.21.15.60:0/4229494891 learned_addr learned my addr 172.21.15.60:0/4229494891 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d060640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708101420 0x7f5708198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 -- 172.21.15.60:0/4229494891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708101420 msgr2=0x7f5708198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708101420 0x7f5708198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 -- 172.21.15.60:0/4229494891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5708106a80 msgr2=0x7f570819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5708106a80 0x7f570819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 -- 172.21.15.60:0/4229494891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570819d670 con 0x7f5708100a80 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d060640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708101420 0x7f5708198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570d861640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708100a80 0x7f57081986c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f570400b4a0 tx=0x7f570400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:19.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f56feffd640 1 -- 172.21.15.60:0/4229494891 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704014070 con 0x7f5708100a80 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f56feffd640 1 -- 172.21.15.60:0/4229494891 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5704010b10 con 0x7f5708100a80 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570819d960 con 0x7f5708100a80 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f56feffd640 1 -- 172.21.15.60:0/4229494891 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704017d60 con 0x7f5708100a80 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.281+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57081a5240 con 0x7f5708100a80 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.282+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5708100f60 con 0x7f5708100a80 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.283+0000 7f56feffd640 1 -- 172.21.15.60:0/4229494891 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5704017070 con 0x7f5708100a80 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.284+0000 7f56feffd640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f56f40a2c10 0x7f56f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.284+0000 7f570d060640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f56f40a2c10 0x7f56f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.284+0000 7f56feffd640 1 -- 172.21.15.60:0/4229494891 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f57040ce880 con 0x7f5708100a80 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.285+0000 7f570d060640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f56f40a2c10 0x7f56f40a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f56f8006fd0 tx=0x7f56f8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.288+0000 7f56feffd640 1 -- 172.21.15.60:0/4229494891 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f570409b7c0 con 0x7f5708100a80 2024-09-11T23:58:19.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.466+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5708199a20 con 0x7f5708100a80 2024-09-11T23:58:19.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.467+0000 7f56feffd640 1 -- 172.21.15.60:0/4229494891 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f570409b0c0 con 0x7f5708100a80 2024-09-11T23:58:19.467 INFO:teuthology.orchestra.run.smithi060.stdout:34359738445 2024-09-11T23:58:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.469+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f56f40a2c10 msgr2=0x7f56f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.469+0000 7f570fac5640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f56f40a2c10 0x7f56f40a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f56f8006fd0 tx=0x7f56f8008040 comp rx=0 tx=0).stop 2024-09-11T23:58:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.469+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708100a80 msgr2=0x7f57081986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.469+0000 7f570fac5640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708100a80 0x7f57081986c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f570400b4a0 tx=0x7f570400b960 comp rx=0 tx=0).stop 2024-09-11T23:58:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.470+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 shutdown_connections 2024-09-11T23:58:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.470+0000 7f570fac5640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5708106a80 0x7f570819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.470+0000 7f570fac5640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5708101420 0x7f5708198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.470+0000 7f570fac5640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f56f40a2c10 0x7f56f40a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.470+0000 7f570fac5640 1 --2- 172.21.15.60:0/4229494891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5708100a80 0x7f57081986c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.470+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 >> 172.21.15.60:0/4229494891 conn(0x7f57080fc7a0 msgr2=0x7f57080fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:19.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.470+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 shutdown_connections 2024-09-11T23:58:19.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.470+0000 7f570fac5640 1 -- 172.21.15.60:0/4229494891 wait complete. 2024-09-11T23:58:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:19 smithi105 ceph-mon[34805]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:19 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/524875223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:58:19.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:19 smithi192 ceph-mon[35487]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:19 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/524875223' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.515+0000 7fce70320640 1 -- 172.21.15.60:0/2489006918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce68102df0 msgr2=0x7fce681031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.515+0000 7fce70320640 1 --2- 172.21.15.60:0/2489006918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce68102df0 0x7fce681031d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fce64009900 tx=0x7fce6402a480 comp rx=0 tx=0).stop 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 -- 172.21.15.60:0/2489006918 shutdown_connections 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 --2- 172.21.15.60:0/2489006918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce6810c190 0x7fce6810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 --2- 172.21.15.60:0/2489006918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce68103710 0x7fce6810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 --2- 172.21.15.60:0/2489006918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce68102df0 0x7fce681031d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 -- 172.21.15.60:0/2489006918 >> 172.21.15.60:0/2489006918 conn(0x7fce680fc790 msgr2=0x7fce680febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 -- 172.21.15.60:0/2489006918 shutdown_connections 2024-09-11T23:58:19.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 -- 172.21.15.60:0/2489006918 wait complete. 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 Processor -- start 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.516+0000 7fce70320640 1 -- start start 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce70320640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce68102df0 0x7fce68198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce70320640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce68103710 0x7fce68198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce70320640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6810c190 0x7fce6819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce70320640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fce68112080 con 0x7fce6810c190 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce70320640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce68111f00 con 0x7fce68103710 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce70320640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce68112200 con 0x7fce68102df0 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6810c190 0x7fce6819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e0bc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce68102df0 0x7fce68198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6810c190 0x7fce6819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42848/0 (socket says 172.21.15.60:42848) 2024-09-11T23:58:19.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e0bc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce68102df0 0x7fce68198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:37022/0 (socket says 172.21.15.60:37022) 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 -- 172.21.15.60:0/590483344 learned_addr learned my addr 172.21.15.60:0/590483344 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6d8bb640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce68103710 0x7fce68198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 -- 172.21.15.60:0/590483344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce68102df0 msgr2=0x7fce68198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce68102df0 0x7fce68198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 -- 172.21.15.60:0/590483344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce68103710 msgr2=0x7fce68198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce68103710 0x7fce68198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 -- 172.21.15.60:0/590483344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6819d4b0 con 0x7fce6810c190 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e0bc640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce68102df0 0x7fce68198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.517+0000 7fce6e8bd640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6810c190 0x7fce6819cdd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce6000eaa0 tx=0x7fce6000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.518+0000 7fce5f7fe640 1 -- 172.21.15.60:0/590483344 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6000cdb0 con 0x7fce6810c190 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.518+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6819d7a0 con 0x7fce6810c190 2024-09-11T23:58:19.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.518+0000 7fce5f7fe640 1 -- 172.21.15.60:0/590483344 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce60004b20 con 0x7fce6810c190 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.518+0000 7fce5f7fe640 1 -- 172.21.15.60:0/590483344 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60011760 con 0x7fce6810c190 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.518+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce681a5080 con 0x7fce6810c190 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.519+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce681031d0 con 0x7fce6810c190 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.520+0000 7fce5f7fe640 1 -- 172.21.15.60:0/590483344 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fce60011900 con 0x7fce6810c190 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.521+0000 7fce5f7fe640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.521+0000 7fce6e0bc640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.521+0000 7fce5f7fe640 1 -- 172.21.15.60:0/590483344 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fce600cf310 con 0x7fce6810c190 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.521+0000 7fce6e0bc640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce64009230 tx=0x7fce640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:19.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.525+0000 7fce5f7fe640 1 -- 172.21.15.60:0/590483344 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce60016030 con 0x7fce6810c190 2024-09-11T23:58:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.703+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fce68106ce0 con 0x7fce6810c190 2024-09-11T23:58:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.704+0000 7fce5f7fe640 1 -- 172.21.15.60:0/590483344 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fce6009ba90 con 0x7fce6810c190 2024-09-11T23:58:19.704 INFO:teuthology.orchestra.run.smithi060.stdout:154618822708 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 msgr2=0x7fce540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce64009230 tx=0x7fce640058d0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6810c190 msgr2=0x7fce6819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6810c190 0x7fce6819cdd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce6000eaa0 tx=0x7fce6000ef60 comp rx=0 tx=0).stop 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 shutdown_connections 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6810c190 0x7fce6819cdd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce68103710 0x7fce68198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 --2- 172.21.15.60:0/590483344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce68102df0 0x7fce68198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 >> 172.21.15.60:0/590483344 conn(0x7fce680fc790 msgr2=0x7fce680fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 shutdown_connections 2024-09-11T23:58:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.706+0000 7fce70320640 1 -- 172.21.15.60:0/590483344 wait complete. 2024-09-11T23:58:19.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.951+0000 7f7498bf6640 1 -- 172.21.15.60:0/561694983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494101de0 msgr2=0x7f74941021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.951+0000 7f7498bf6640 1 --2- 172.21.15.60:0/561694983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494101de0 0x7f74941021c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7484009900 tx=0x7f748402a410 comp rx=0 tx=0).stop 2024-09-11T23:58:19.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.952+0000 7f7498bf6640 1 -- 172.21.15.60:0/561694983 shutdown_connections 2024-09-11T23:58:19.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.952+0000 7f7498bf6640 1 --2- 172.21.15.60:0/561694983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7494106f10 0x7f749410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.952+0000 7f7498bf6640 1 --2- 172.21.15.60:0/561694983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7494102790 0x7f74941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.952+0000 7f7498bf6640 1 --2- 172.21.15.60:0/561694983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494101de0 0x7f74941021c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.952+0000 7f7498bf6640 1 -- 172.21.15.60:0/561694983 >> 172.21.15.60:0/561694983 conn(0x7f74940fd8c0 msgr2=0x7f74940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.952+0000 7f7498bf6640 1 -- 172.21.15.60:0/561694983 shutdown_connections 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.952+0000 7f7498bf6640 1 -- 172.21.15.60:0/561694983 wait complete. 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7498bf6640 1 Processor -- start 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7498bf6640 1 -- start start 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7498bf6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7494101de0 0x7f749419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7498bf6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7494102790 0x7f749419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7498bf6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494106f10 0x7f749419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7498bf6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7494112090 con 0x7f7494106f10 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7498bf6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7494111f10 con 0x7f7494102790 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7498bf6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7494112210 con 0x7f7494101de0 2024-09-11T23:58:19.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7492d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494106f10 0x7f749419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7492d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494106f10 0x7f749419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42876/0 (socket says 172.21.15.60:42876) 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7492d9d640 1 -- 172.21.15.60:0/201515716 learned_addr learned my addr 172.21.15.60:0/201515716 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7491d9b640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7494102790 0x7f749419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f749259c640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7494101de0 0x7f749419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7492d9d640 1 -- 172.21.15.60:0/201515716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7494101de0 msgr2=0x7f749419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7492d9d640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7494101de0 0x7f749419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7492d9d640 1 -- 172.21.15.60:0/201515716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7494102790 msgr2=0x7f749419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7492d9d640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7494102790 0x7f749419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.953+0000 7f7492d9d640 1 -- 172.21.15.60:0/201515716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749419f6c0 con 0x7f7494106f10 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.954+0000 7f7492d9d640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494106f10 0x7f749419efe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f748c00cce0 tx=0x7f748c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:19.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.954+0000 7f74837fe640 1 -- 172.21.15.60:0/201515716 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c00f450 con 0x7f7494106f10 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.954+0000 7f74837fe640 1 -- 172.21.15.60:0/201515716 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f748c00faf0 con 0x7f7494106f10 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.954+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749419f9b0 con 0x7f7494106f10 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.954+0000 7f74837fe640 1 -- 172.21.15.60:0/201515716 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c018cc0 con 0x7f7494106f10 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.954+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74941a7290 con 0x7f7494106f10 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.955+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74941021c0 con 0x7f7494106f10 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.956+0000 7f74837fe640 1 -- 172.21.15.60:0/201515716 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f748c00f5f0 con 0x7f7494106f10 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.957+0000 7f74837fe640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f747c0a2c10 0x7f747c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.957+0000 7f749259c640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f747c0a2c10 0x7f747c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.957+0000 7f74837fe640 1 -- 172.21.15.60:0/201515716 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f748c0cf790 con 0x7f7494106f10 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.957+0000 7f749259c640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f747c0a2c10 0x7f747c0a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7484005ab0 tx=0x7f7484005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:19.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:19.960+0000 7f74837fe640 1 -- 172.21.15.60:0/201515716 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f748c014030 con 0x7f7494106f10 2024-09-11T23:58:20.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.138+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f749419ba70 con 0x7f7494106f10 2024-09-11T23:58:20.138 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:20 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4229494891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:58:20.139 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:20 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/590483344' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:58:20.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.138+0000 7f74837fe640 1 -- 172.21.15.60:0/201515716 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f749419ba70 con 0x7f7494106f10 2024-09-11T23:58:20.139 INFO:teuthology.orchestra.run.smithi060.stdout:184683593776 2024-09-11T23:58:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f747c0a2c10 msgr2=0x7f747c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f747c0a2c10 0x7f747c0a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7484005ab0 tx=0x7f7484005a20 comp rx=0 tx=0).stop 2024-09-11T23:58:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494106f10 msgr2=0x7f749419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494106f10 0x7f749419efe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f748c00cce0 tx=0x7f748c00a620 comp rx=0 tx=0).stop 2024-09-11T23:58:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 shutdown_connections 2024-09-11T23:58:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f747c0a2c10 0x7f747c0a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7494106f10 0x7f749419efe0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7494102790 0x7f749419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 --2- 172.21.15.60:0/201515716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7494101de0 0x7f749419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 >> 172.21.15.60:0/201515716 conn(0x7f74940fd8c0 msgr2=0x7f74940fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 shutdown_connections 2024-09-11T23:58:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:20.140+0000 7f7498bf6640 1 -- 172.21.15.60:0/201515716 wait complete. 2024-09-11T23:58:20.435 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:20 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4229494891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:58:20.435 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:20 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/590483344' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:58:20.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:20 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4229494891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-11T23:58:20.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:20 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/590483344' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-11T23:58:20.849 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822706 got 154618822708 for osd.5 2024-09-11T23:58:20.850 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:21 smithi105 ceph-mon[34805]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/201515716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:58:21.506 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:21 smithi060 ceph-mon[30953]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:21.506 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:21 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/201515716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:58:21.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:21 smithi192 ceph-mon[35487]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:21.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:21 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/201515716' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-11T23:58:21.540 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579923 got 317827579926 for osd.11 2024-09-11T23:58:21.540 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:22.300 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738445 for osd.0 2024-09-11T23:58:22.300 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:22.473 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:22.473 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:22.474 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:22.957 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593775 got 184683593776 for osd.6 2024-09-11T23:58:22.958 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:23.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 -- 172.21.15.60:0/3961015687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc100e20 msgr2=0x7f29dc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 --2- 172.21.15.60:0/3961015687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc100e20 0x7f29dc101200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009900 tx=0x7f29cc02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 -- 172.21.15.60:0/3961015687 shutdown_connections 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 --2- 172.21.15.60:0/3961015687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29dc102ef0 0x7f29dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 --2- 172.21.15.60:0/3961015687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc102570 0x7f29dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 --2- 172.21.15.60:0/3961015687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc100e20 0x7f29dc101200 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 -- 172.21.15.60:0/3961015687 >> 172.21.15.60:0/3961015687 conn(0x7f29dc0fc7d0 msgr2=0x7f29dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 -- 172.21.15.60:0/3961015687 shutdown_connections 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.134+0000 7f29e1b89640 1 -- 172.21.15.60:0/3961015687 wait complete. 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29e1b89640 1 Processor -- start 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29e1b89640 1 -- start start 2024-09-11T23:58:23.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29e1b89640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc100e20 0x7f29dc198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29e1b89640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29dc102570 0x7f29dc198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29e1b89640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc102ef0 0x7f29dc19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29e1b89640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc1110a0 con 0x7f29dc102ef0 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29e1b89640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc110f20 con 0x7f29dc102570 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29e1b89640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc111220 con 0x7f29dc100e20 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc102ef0 0x7f29dc19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29dbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc102ef0 0x7f29dc19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44160/0 (socket says 172.21.15.60:44160) 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29dbfff640 1 -- 172.21.15.60:0/667768325 learned_addr learned my addr 172.21.15.60:0/667768325 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.135+0000 7f29db7fe640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc100e20 0x7f29dc198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29daffd640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29dc102570 0x7f29dc198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29dbfff640 1 -- 172.21.15.60:0/667768325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc100e20 msgr2=0x7f29dc198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29dbfff640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc100e20 0x7f29dc198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29dbfff640 1 -- 172.21.15.60:0/667768325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29dc102570 msgr2=0x7f29dc198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29dbfff640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29dc102570 0x7f29dc198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29dbfff640 1 -- 172.21.15.60:0/667768325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc19d5f0 con 0x7f29dc102ef0 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29dbfff640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc102ef0 0x7f29dc19cf10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f29d400eb10 tx=0x7f29d400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29d8ff9640 1 -- 172.21.15.60:0/667768325 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4004b20 con 0x7f29dc102ef0 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29d8ff9640 1 -- 172.21.15.60:0/667768325 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29d4004cc0 con 0x7f29dc102ef0 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc19d8e0 con 0x7f29dc102ef0 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29d8ff9640 1 -- 172.21.15.60:0/667768325 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40107f0 con 0x7f29dc102ef0 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.136+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc1a51c0 con 0x7f29dc102ef0 2024-09-11T23:58:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.137+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc101200 con 0x7f29dc102ef0 2024-09-11T23:58:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.139+0000 7f29d8ff9640 1 -- 172.21.15.60:0/667768325 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f29d4005020 con 0x7f29dc102ef0 2024-09-11T23:58:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.140+0000 7f29d8ff9640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f29c40a2c10 0x7f29c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.140+0000 7f29db7fe640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f29c40a2c10 0x7f29c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.140+0000 7f29d8ff9640 1 -- 172.21.15.60:0/667768325 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f29d40cf780 con 0x7f29dc102ef0 2024-09-11T23:58:23.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.140+0000 7f29db7fe640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f29c40a2c10 0x7f29c40a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009230 tx=0x7f29cc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:23.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.144+0000 7f29d8ff9640 1 -- 172.21.15.60:0/667768325 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29d409c5b0 con 0x7f29dc102ef0 2024-09-11T23:58:23.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.320+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f29dc1a5420 con 0x7f29dc102ef0 2024-09-11T23:58:23.320 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:23 smithi060 ceph-mon[30953]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-11T23:58:23.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.320+0000 7f29d8ff9640 1 -- 172.21.15.60:0/667768325 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f29d409beb0 con 0x7f29dc102ef0 2024-09-11T23:58:23.321 INFO:teuthology.orchestra.run.smithi060.stdout:103079215168 2024-09-11T23:58:23.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f29c40a2c10 msgr2=0x7f29c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f29c40a2c10 0x7f29c40a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009230 tx=0x7f29cc0058d0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc102ef0 msgr2=0x7f29dc19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc102ef0 0x7f29dc19cf10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f29d400eb10 tx=0x7f29d400c2d0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 shutdown_connections 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f29c40a2c10 0x7f29c40a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc102ef0 0x7f29dc19cf10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29dc102570 0x7f29dc198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 --2- 172.21.15.60:0/667768325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29dc100e20 0x7f29dc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.322+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 >> 172.21.15.60:0/667768325 conn(0x7f29dc0fc7d0 msgr2=0x7f29dc105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.323+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 shutdown_connections 2024-09-11T23:58:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.323+0000 7f29e1b89640 1 -- 172.21.15.60:0/667768325 wait complete. 2024-09-11T23:58:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:23 smithi105 ceph-mon[34805]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-11T23:58:23.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:23 smithi192 ceph-mon[35487]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-11T23:58:23.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 -- 172.21.15.60:0/2838101177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0100e20 msgr2=0x7f7be0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 --2- 172.21.15.60:0/2838101177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0100e20 0x7f7be0101200 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009900 tx=0x7f7bdc02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:23.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 -- 172.21.15.60:0/2838101177 shutdown_connections 2024-09-11T23:58:23.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 --2- 172.21.15.60:0/2838101177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0102ef0 0x7f7be010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 --2- 172.21.15.60:0/2838101177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be0102570 0x7f7be01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 --2- 172.21.15.60:0/2838101177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0100e20 0x7f7be0101200 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 -- 172.21.15.60:0/2838101177 >> 172.21.15.60:0/2838101177 conn(0x7f7be00fc7d0 msgr2=0x7f7be00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:23.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 -- 172.21.15.60:0/2838101177 shutdown_connections 2024-09-11T23:58:23.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.935+0000 7f7be72d1640 1 -- 172.21.15.60:0/2838101177 wait complete. 2024-09-11T23:58:23.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be72d1640 1 Processor -- start 2024-09-11T23:58:23.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be72d1640 1 -- start start 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be72d1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0100e20 0x7f7be01a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be72d1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0102570 0x7f7be01a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be72d1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be0102ef0 0x7f7be019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be72d1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0110020 con 0x7f7be0102570 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be72d1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7be010fea0 con 0x7f7be0102ef0 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be72d1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7be01101a0 con 0x7f7be0100e20 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be486c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0102570 0x7f7be01a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be486c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0102570 0x7f7be01a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44178/0 (socket says 172.21.15.60:44178) 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.936+0000 7f7be486c640 1 -- 172.21.15.60:0/5093959 learned_addr learned my addr 172.21.15.60:0/5093959 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be506d640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0100e20 0x7f7be01a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be586e640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be0102ef0 0x7f7be019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be486c640 1 -- 172.21.15.60:0/5093959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0100e20 msgr2=0x7f7be01a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be486c640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0100e20 0x7f7be01a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be486c640 1 -- 172.21.15.60:0/5093959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be0102ef0 msgr2=0x7f7be019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be486c640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be0102ef0 0x7f7be019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be486c640 1 -- 172.21.15.60:0/5093959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be019ad50 con 0x7f7be0102570 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be586e640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be0102ef0 0x7f7be019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be486c640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0102570 0x7f7be01a09a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000b4a0 tx=0x7f7bd000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7bd67fc640 1 -- 172.21.15.60:0/5093959 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0014070 con 0x7f7be0102570 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7bd67fc640 1 -- 172.21.15.60:0/5093959 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7bd0010b10 con 0x7f7be0102570 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be019b040 con 0x7f7be0102570 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7bd67fc640 1 -- 172.21.15.60:0/5093959 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0017d60 con 0x7f7be0102570 2024-09-11T23:58:23.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.937+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be01a7330 con 0x7f7be0102570 2024-09-11T23:58:23.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.938+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be0101200 con 0x7f7be0102570 2024-09-11T23:58:23.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.939+0000 7f7bd67fc640 1 -- 172.21.15.60:0/5093959 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7bd0017070 con 0x7f7be0102570 2024-09-11T23:58:23.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.940+0000 7f7bd67fc640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7bcc0a2c00 0x7f7bcc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:23.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.940+0000 7f7be506d640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7bcc0a2c00 0x7f7bcc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:23.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.940+0000 7f7bd67fc640 1 -- 172.21.15.60:0/5093959 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f7bd00ce430 con 0x7f7be0102570 2024-09-11T23:58:23.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.940+0000 7f7be506d640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7bcc0a2c00 0x7f7bcc0a50c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc000c00 tx=0x7f7bdc005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:23.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:23.944+0000 7f7bd67fc640 1 -- 172.21.15.60:0/5093959 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bd009b370 con 0x7f7be0102570 2024-09-11T23:58:24.134 INFO:teuthology.orchestra.run.smithi060.stdout:77309411398 2024-09-11T23:58:24.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.133+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7be019bb50 con 0x7f7be0102570 2024-09-11T23:58:24.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.133+0000 7f7bd67fc640 1 -- 172.21.15.60:0/5093959 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7be019bb50 con 0x7f7be0102570 2024-09-11T23:58:24.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7bcc0a2c00 msgr2=0x7f7bcc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7bcc0a2c00 0x7f7bcc0a50c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc000c00 tx=0x7f7bdc005e80 comp rx=0 tx=0).stop 2024-09-11T23:58:24.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0102570 msgr2=0x7f7be01a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0102570 0x7f7be01a09a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000b4a0 tx=0x7f7bd000b960 comp rx=0 tx=0).stop 2024-09-11T23:58:24.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 shutdown_connections 2024-09-11T23:58:24.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7be0102ef0 0x7f7be019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7bcc0a2c00 0x7f7bcc0a50c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7be0102570 0x7f7be01a09a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 --2- 172.21.15.60:0/5093959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0100e20 0x7f7be01a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 >> 172.21.15.60:0/5093959 conn(0x7f7be00fc7d0 msgr2=0x7f7be01067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:24.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 shutdown_connections 2024-09-11T23:58:24.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.136+0000 7f7be72d1640 1 -- 172.21.15.60:0/5093959 wait complete. 2024-09-11T23:58:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.146+0000 7f20b0a41640 1 -- 172.21.15.60:0/476582014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 msgr2=0x7f20ac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.146+0000 7f20b0a41640 1 --2- 172.21.15.60:0/476582014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 0x7f20ac1067e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009900 tx=0x7f20a002a410 comp rx=0 tx=0).stop 2024-09-11T23:58:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.146+0000 7f20b0a41640 1 -- 172.21.15.60:0/476582014 shutdown_connections 2024-09-11T23:58:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.147+0000 7f20b0a41640 1 --2- 172.21.15.60:0/476582014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20ac106f10 0x7f20ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.147+0000 7f20b0a41640 1 --2- 172.21.15.60:0/476582014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 0x7f20ac1067e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.147+0000 7f20b0a41640 1 --2- 172.21.15.60:0/476582014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac101de0 0x7f20ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.147+0000 7f20b0a41640 1 -- 172.21.15.60:0/476582014 >> 172.21.15.60:0/476582014 conn(0x7f20ac0fd880 msgr2=0x7f20ac0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.147+0000 7f20b0a41640 1 -- 172.21.15.60:0/476582014 shutdown_connections 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.147+0000 7f20b0a41640 1 -- 172.21.15.60:0/476582014 wait complete. 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.147+0000 7f20b0a41640 1 Processor -- start 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20b0a41640 1 -- start start 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20b0a41640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20ac101de0 0x7f20ac19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20b0a41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 0x7f20ac19acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20b0a41640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac106f10 0x7f20ac19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20b0a41640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac1120e0 con 0x7f20ac102790 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20b0a41640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac111f60 con 0x7f20ac106f10 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20b0a41640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac112260 con 0x7f20ac101de0 2024-09-11T23:58:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20a9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 0x7f20ac19acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20aa59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20ac101de0 0x7f20ac19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20a9d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 0x7f20ac19acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44190/0 (socket says 172.21.15.60:44190) 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20aad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac106f10 0x7f20ac19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.148+0000 7f20a9d9b640 1 -- 172.21.15.60:0/3093192371 learned_addr learned my addr 172.21.15.60:0/3093192371 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f20aa59c640 1 -- 172.21.15.60:0/3093192371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac106f10 msgr2=0x7f20ac19df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f20aa59c640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac106f10 0x7f20ac19df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f20aa59c640 1 -- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 msgr2=0x7f20ac19acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f20aa59c640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 0x7f20ac19acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f20aa59c640 1 -- 172.21.15.60:0/3093192371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac19e6c0 con 0x7f20ac101de0 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f20aa59c640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20ac101de0 0x7f20ac19a770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f209c00e9f0 tx=0x7f209c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f209b7fe640 1 -- 172.21.15.60:0/3093192371 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c00cd80 con 0x7f20ac101de0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac19e9b0 con 0x7f20ac101de0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f209b7fe640 1 -- 172.21.15.60:0/3093192371 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f209c0035f0 con 0x7f20ac101de0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.149+0000 7f209b7fe640 1 -- 172.21.15.60:0/3093192371 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c010650 con 0x7f20ac101de0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.150+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac1a7320 con 0x7f20ac101de0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.151+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ac1021c0 con 0x7f20ac101de0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.153+0000 7f209b7fe640 1 -- 172.21.15.60:0/3093192371 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f209c0037a0 con 0x7f20ac101de0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.153+0000 7f209b7fe640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f20940a2c10 0x7f20940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.153+0000 7f20a9d9b640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f20940a2c10 0x7f20940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.153+0000 7f209b7fe640 1 -- 172.21.15.60:0/3093192371 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f209c0cf470 con 0x7f20ac101de0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.154+0000 7f20a9d9b640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f20940a2c10 0x7f20940a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20a0005ec0 tx=0x7f20a00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.156+0000 7f209b7fe640 1 -- 172.21.15.60:0/3093192371 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f209c09c2a0 con 0x7f20ac101de0 2024-09-11T23:58:24.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.337+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f20ac1a7550 con 0x7f20ac101de0 2024-09-11T23:58:24.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.338+0000 7f209b7fe640 1 -- 172.21.15.60:0/3093192371 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f209c09bba0 con 0x7f20ac101de0 2024-09-11T23:58:24.338 INFO:teuthology.orchestra.run.smithi060.stdout:55834574921 2024-09-11T23:58:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f20940a2c10 msgr2=0x7f20940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f20940a2c10 0x7f20940a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20a0005ec0 tx=0x7f20a00046c0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20ac101de0 msgr2=0x7f20ac19a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20ac101de0 0x7f20ac19a770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f209c00e9f0 tx=0x7f209c00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 shutdown_connections 2024-09-11T23:58:24.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac106f10 0x7f20ac19df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f20940a2c10 0x7f20940a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac102790 0x7f20ac19acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 --2- 172.21.15.60:0/3093192371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20ac101de0 0x7f20ac19a770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 >> 172.21.15.60:0/3093192371 conn(0x7f20ac0fd880 msgr2=0x7f20ac0ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 shutdown_connections 2024-09-11T23:58:24.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:24.340+0000 7f20b0a41640 1 -- 172.21.15.60:0/3093192371 wait complete. 2024-09-11T23:58:24.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:24 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/667768325' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:58:24.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:24 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:58:24.529 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:24 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/667768325' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:58:24.529 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:24 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:58:24.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:24 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/667768325' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-11T23:58:24.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:24 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:58:24.850 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411398 for osd.2 2024-09-11T23:58:24.850 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:25 smithi105 ceph-mon[34805]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-09-11T23:58:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:25 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/5093959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:58:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:25 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3093192371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:58:25.462 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:25 smithi060 ceph-mon[30953]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-09-11T23:58:25.462 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:25 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/5093959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:58:25.462 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:25 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3093192371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:58:25.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:25 smithi192 ceph-mon[35487]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-09-11T23:58:25.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:25 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/5093959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-11T23:58:25.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:25 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3093192371' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-11T23:58:25.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.842+0000 7feb3616b640 1 -- 172.21.15.60:0/686551274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30101420 msgr2=0x7feb3010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:25.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.842+0000 7feb3616b640 1 --2- 172.21.15.60:0/686551274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30101420 0x7feb3010d950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feb28009cd0 tx=0x7feb2802a8e0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.842+0000 7feb3616b640 1 -- 172.21.15.60:0/686551274 shutdown_connections 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.842+0000 7feb3616b640 1 --2- 172.21.15.60:0/686551274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30101420 0x7feb3010d950 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.842+0000 7feb3616b640 1 --2- 172.21.15.60:0/686551274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb30100a80 0x7feb30100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.842+0000 7feb3616b640 1 --2- 172.21.15.60:0/686551274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb30106a80 0x7feb30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.842+0000 7feb3616b640 1 -- 172.21.15.60:0/686551274 >> 172.21.15.60:0/686551274 conn(0x7feb300fc7a0 msgr2=0x7feb300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.843+0000 7feb3616b640 1 -- 172.21.15.60:0/686551274 shutdown_connections 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.843+0000 7feb3616b640 1 -- 172.21.15.60:0/686551274 wait complete. 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.843+0000 7feb3616b640 1 Processor -- start 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.843+0000 7feb3616b640 1 -- start start 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.843+0000 7feb3616b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb30100a80 0x7feb300fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb3616b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb30101420 0x7feb300fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb3616b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30106a80 0x7feb300fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb3616b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb30110fa0 con 0x7feb30106a80 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb3616b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb30110e20 con 0x7feb30101420 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb3616b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb30111120 con 0x7feb30100a80 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30106a80 0x7feb300fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30106a80 0x7feb300fd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44228/0 (socket says 172.21.15.60:44228) 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 -- 172.21.15.60:0/1582866115 learned_addr learned my addr 172.21.15.60:0/1582866115 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2f7fe640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb30100a80 0x7feb300fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2effd640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb30101420 0x7feb300fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 -- 172.21.15.60:0/1582866115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb30100a80 msgr2=0x7feb300fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb30100a80 0x7feb300fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 -- 172.21.15.60:0/1582866115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb30101420 msgr2=0x7feb300fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb30101420 0x7feb300fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 -- 172.21.15.60:0/1582866115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb301a6940 con 0x7feb30106a80 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2ffff640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30106a80 0x7feb300fd860 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb28009ca0 tx=0x7feb28003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2cff9640 1 -- 172.21.15.60:0/1582866115 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28032e60 con 0x7feb30106a80 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2cff9640 1 -- 172.21.15.60:0/1582866115 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb28004540 con 0x7feb30106a80 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb301a6bd0 con 0x7feb30106a80 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb2cff9640 1 -- 172.21.15.60:0/1582866115 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28046480 con 0x7feb30106a80 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.844+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb301a7160 con 0x7feb30106a80 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.846+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb30100ee0 con 0x7feb30106a80 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.847+0000 7feb2cff9640 1 -- 172.21.15.60:0/1582866115 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7feb280046f0 con 0x7feb30106a80 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.847+0000 7feb2cff9640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7feb180a2c90 0x7feb180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.847+0000 7feb2f7fe640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7feb180a2c90 0x7feb180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.847+0000 7feb2cff9640 1 -- 172.21.15.60:0/1582866115 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7feb2802e030 con 0x7feb30106a80 2024-09-11T23:58:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.848+0000 7feb2f7fe640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7feb180a2c90 0x7feb180a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feb2000bb60 tx=0x7feb2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.851+0000 7feb2cff9640 1 -- 172.21.15.60:0/1582866115 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb2804b060 con 0x7feb30106a80 2024-09-11T23:58:26.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.030+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7feb3010a000 con 0x7feb30106a80 2024-09-11T23:58:26.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.030+0000 7feb2cff9640 1 -- 172.21.15.60:0/1582866115 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feb280bd630 con 0x7feb30106a80 2024-09-11T23:58:26.031 INFO:teuthology.orchestra.run.smithi060.stdout:206158430251 2024-09-11T23:58:26.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7feb180a2c90 msgr2=0x7feb180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7feb180a2c90 0x7feb180a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feb2000bb60 tx=0x7feb2000b390 comp rx=0 tx=0).stop 2024-09-11T23:58:26.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30106a80 msgr2=0x7feb300fd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30106a80 0x7feb300fd860 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb28009ca0 tx=0x7feb28003f10 comp rx=0 tx=0).stop 2024-09-11T23:58:26.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 shutdown_connections 2024-09-11T23:58:26.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7feb180a2c90 0x7feb180a5150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb30106a80 0x7feb300fd860 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb30101420 0x7feb300fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 --2- 172.21.15.60:0/1582866115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb30100a80 0x7feb300fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 >> 172.21.15.60:0/1582866115 conn(0x7feb300fc7a0 msgr2=0x7feb3006a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:26.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 shutdown_connections 2024-09-11T23:58:26.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.033+0000 7feb3616b640 1 -- 172.21.15.60:0/1582866115 wait complete. 2024-09-11T23:58:26.541 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574918 got 55834574921 for osd.1 2024-09-11T23:58:26.541 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:26 smithi060 ceph-mon[30953]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-11T23:58:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:26 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:26 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2634119959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:58:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:26 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1582866115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:58:26.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:26 smithi105 ceph-mon[34805]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-11T23:58:26.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:26 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:26.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:26 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:26 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:26 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:26 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2634119959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:58:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:26 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1582866115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:58:26.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 -- 172.21.15.60:0/2538507407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 msgr2=0x7ff2041006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 --2- 172.21.15.60:0/2538507407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 0x7ff2041006d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff200009930 tx=0x7ff20002a420 comp rx=0 tx=0).stop 2024-09-11T23:58:26.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 -- 172.21.15.60:0/2538507407 shutdown_connections 2024-09-11T23:58:26.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 --2- 172.21.15.60:0/2538507407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff204106f50 0x7ff20410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 --2- 172.21.15.60:0/2538507407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff204100ca0 0x7ff204106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 --2- 172.21.15.60:0/2538507407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 0x7ff2041006d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 -- 172.21.15.60:0/2538507407 >> 172.21.15.60:0/2538507407 conn(0x7ff204077210 msgr2=0x7ff2040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 -- 172.21.15.60:0/2538507407 shutdown_connections 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.976+0000 7ff20b096640 1 -- 172.21.15.60:0/2538507407 wait complete. 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff20b096640 1 Processor -- start 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff20b096640 1 -- start start 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff20b096640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 0x7ff204198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff20b096640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff204100ca0 0x7ff204198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff20b096640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff204106f50 0x7ff20419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff20b096640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2041120e0 con 0x7ff2041002f0 2024-09-11T23:58:26.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff20b096640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff204111f60 con 0x7ff204100ca0 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff20b096640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff204112260 con 0x7ff204106f50 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff208e32640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 0x7ff204198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff208e32640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 0x7ff204198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44238/0 (socket says 172.21.15.60:44238) 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff208e32640 1 -- 172.21.15.60:0/1823331304 learned_addr learned my addr 172.21.15.60:0/1823331304 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff209633640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff204106f50 0x7ff20419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.977+0000 7ff1fbfff640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff204100ca0 0x7ff204198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff208e32640 1 -- 172.21.15.60:0/1823331304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff204106f50 msgr2=0x7ff20419ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff208e32640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff204106f50 0x7ff20419ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff208e32640 1 -- 172.21.15.60:0/1823331304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff204100ca0 msgr2=0x7ff204198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff208e32640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff204100ca0 0x7ff204198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:26.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff208e32640 1 -- 172.21.15.60:0/1823331304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20419d520 con 0x7ff2041002f0 2024-09-11T23:58:26.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff208e32640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 0x7ff204198570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff200009230 tx=0x7ff200004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:26.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff1f9ffb640 1 -- 172.21.15.60:0/1823331304 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20003f030 con 0x7ff2041002f0 2024-09-11T23:58:26.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff20419d7b0 con 0x7ff2041002f0 2024-09-11T23:58:26.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff1f9ffb640 1 -- 172.21.15.60:0/1823331304 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff200003af0 con 0x7ff2041002f0 2024-09-11T23:58:26.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff1f9ffb640 1 -- 172.21.15.60:0/1823331304 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200035070 con 0x7ff2041002f0 2024-09-11T23:58:26.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.978+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2041a50f0 con 0x7ff2041002f0 2024-09-11T23:58:26.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.980+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2041033b0 con 0x7ff2041002f0 2024-09-11T23:58:26.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.981+0000 7ff1f9ffb640 1 -- 172.21.15.60:0/1823331304 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff200042030 con 0x7ff2041002f0 2024-09-11T23:58:26.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.982+0000 7ff1f9ffb640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff1ec0a2c10 0x7ff1ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:26.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.982+0000 7ff1fbfff640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff1ec0a2c10 0x7ff1ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:26.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.982+0000 7ff1f9ffb640 1 -- 172.21.15.60:0/1823331304 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7ff2000efcd0 con 0x7ff2041002f0 2024-09-11T23:58:26.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.983+0000 7ff1fbfff640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff1ec0a2c10 0x7ff1ec0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ff7f0 tx=0x7ff1f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:26.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:26.985+0000 7ff1f9ffb640 1 -- 172.21.15.60:0/1823331304 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2000bc570 con 0x7ff2041002f0 2024-09-11T23:58:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:26 smithi192 ceph-mon[35487]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-11T23:58:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:26 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:26 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2634119959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-11T23:58:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:26 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1582866115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-11T23:58:27.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/3425416564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102ef0 msgr2=0x7f7cac10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/3425416564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102ef0 0x7f7cac10da40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009ca0 tx=0x7f7ca402a950 comp rx=0 tx=0).stop 2024-09-11T23:58:27.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/3425416564 shutdown_connections 2024-09-11T23:58:27.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/3425416564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102ef0 0x7f7cac10da40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/3425416564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac102570 0x7f7cac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/3425416564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cac100e20 0x7f7cac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/3425416564 >> 172.21.15.60:0/3425416564 conn(0x7f7cac0fc7d0 msgr2=0x7f7cac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/3425416564 shutdown_connections 2024-09-11T23:58:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/3425416564 wait complete. 2024-09-11T23:58:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 Processor -- start 2024-09-11T23:58:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.547+0000 7f7cb2fd4640 1 -- start start 2024-09-11T23:58:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb2fd4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac100e20 0x7f7cac198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb2fd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102570 0x7f7cac198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb2fd4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cac102ef0 0x7f7cac19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb2fd4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac1110f0 con 0x7f7cac102570 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb2fd4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac110f70 con 0x7f7cac102ef0 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb2fd4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac111270 con 0x7f7cac100e20 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cabfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102570 0x7f7cac198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb1571640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cac102ef0 0x7f7cac19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cabfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102570 0x7f7cac198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44212/0 (socket says 172.21.15.60:44212) 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb0d70640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac100e20 0x7f7cac198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cabfff640 1 -- 172.21.15.60:0/2634119959 learned_addr learned my addr 172.21.15.60:0/2634119959 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb1571640 1 -- 172.21.15.60:0/2634119959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac100e20 msgr2=0x7f7cac198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb1571640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac100e20 0x7f7cac198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb1571640 1 -- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102570 msgr2=0x7f7cac198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb1571640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102570 0x7f7cac198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb1571640 1 -- 172.21.15.60:0/2634119959 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac19d510 con 0x7f7cac102ef0 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb0d70640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac100e20 0x7f7cac198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cabfff640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102570 0x7f7cac198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.548+0000 7f7cb1571640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cac102ef0 0x7f7cac19ce30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ca402af40 tx=0x7f7ca402fc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.549+0000 7f7ca9ffb640 1 -- 172.21.15.60:0/2634119959 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4034040 con 0x7f7cac102ef0 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.549+0000 7f7ca9ffb640 1 -- 172.21.15.60:0/2634119959 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ca4030940 con 0x7f7cac102ef0 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.549+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cac19d7a0 con 0x7f7cac102ef0 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.549+0000 7f7ca9ffb640 1 -- 172.21.15.60:0/2634119959 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4004770 con 0x7f7cac102ef0 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.549+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cac1a50e0 con 0x7f7cac102ef0 2024-09-11T23:58:27.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.550+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cac1021b0 con 0x7f7cac102ef0 2024-09-11T23:58:27.103 INFO:teuthology.orchestra.run.smithi060.stdout:287762808860 2024-09-11T23:58:27.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.551+0000 7f7ca9ffb640 1 -- 172.21.15.60:0/2634119959 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7ca4037020 con 0x7f7cac102ef0 2024-09-11T23:58:27.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.551+0000 7f7ca9ffb640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c9c0a2c10 0x7f7c9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:27.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.552+0000 7f7cb0d70640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c9c0a2c10 0x7f7c9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:27.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.552+0000 7f7ca9ffb640 1 -- 172.21.15.60:0/2634119959 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f7ca40efd60 con 0x7f7cac102ef0 2024-09-11T23:58:27.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.552+0000 7f7cb0d70640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c9c0a2c10 0x7f7c9c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009fc0 tx=0x7f7ca0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:27.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.556+0000 7f7ca9ffb640 1 -- 172.21.15.60:0/2634119959 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ca40bcca0 con 0x7f7cac102ef0 2024-09-11T23:58:27.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.735+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f7cac10a0a0 con 0x7f7cac102ef0 2024-09-11T23:58:27.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.736+0000 7f7ca9ffb640 1 -- 172.21.15.60:0/2634119959 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7ca4030b10 con 0x7f7cac102ef0 2024-09-11T23:58:27.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.738+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c9c0a2c10 msgr2=0x7f7c9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.738+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c9c0a2c10 0x7f7c9c0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009fc0 tx=0x7f7ca0005f90 comp rx=0 tx=0).stop 2024-09-11T23:58:27.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.738+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cac102ef0 msgr2=0x7f7cac19ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.738+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cac102ef0 0x7f7cac19ce30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ca402af40 tx=0x7f7ca402fc20 comp rx=0 tx=0).stop 2024-09-11T23:58:27.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.739+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 shutdown_connections 2024-09-11T23:58:27.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.739+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cac102ef0 0x7f7cac19ce30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.739+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7c9c0a2c10 0x7f7c9c0a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.739+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7cac102570 0x7f7cac198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.739+0000 7f7cb2fd4640 1 --2- 172.21.15.60:0/2634119959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac100e20 0x7f7cac198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.739+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 >> 172.21.15.60:0/2634119959 conn(0x7f7cac0fc7d0 msgr2=0x7f7cac06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:27.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.739+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 shutdown_connections 2024-09-11T23:58:27.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:25.739+0000 7f7cb2fd4640 1 -- 172.21.15.60:0/2634119959 wait complete. 2024-09-11T23:58:27.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.162+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7ff20410a120 con 0x7ff2041002f0 2024-09-11T23:58:27.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.163+0000 7ff1f9ffb640 1 -- 172.21.15.60:0/1823331304 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff2000c0870 con 0x7ff2041002f0 2024-09-11T23:58:27.163 INFO:teuthology.orchestra.run.smithi060.stdout:236223201318 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff1ec0a2c10 msgr2=0x7ff1ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff1ec0a2c10 0x7ff1ec0a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ff7f0 tx=0x7ff1f400b410 comp rx=0 tx=0).stop 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 msgr2=0x7ff204198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 0x7ff204198570 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff200009230 tx=0x7ff200004270 comp rx=0 tx=0).stop 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 shutdown_connections 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff204106f50 0x7ff20419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff204100ca0 0x7ff204198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff1ec0a2c10 0x7ff1ec0a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 --2- 172.21.15.60:0/1823331304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2041002f0 0x7ff204198570 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 >> 172.21.15.60:0/1823331304 conn(0x7ff204077210 msgr2=0x7ff2041051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 shutdown_connections 2024-09-11T23:58:27.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:27.165+0000 7ff20b096640 1 -- 172.21.15.60:0/1823331304 wait complete. 2024-09-11T23:58:27.704 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:27 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1823331304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:58:27.732 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808858 got 287762808860 for osd.10 2024-09-11T23:58:27.733 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:27.931 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:27.932 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:27.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:27 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1823331304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:58:28.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:27 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1823331304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-11T23:58:28.353 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215166 got 103079215168 for osd.3 2024-09-11T23:58:28.353 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:28.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:28 smithi060 ceph-mon[30953]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:28.784 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430249 got 206158430251 for osd.7 2024-09-11T23:58:28.785 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:28.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:28 smithi105 ceph-mon[34805]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:29.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:28 smithi192 ceph-mon[35487]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:29.255 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201315 got 236223201318 for osd.8 2024-09-11T23:58:29.256 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:29.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 -- 172.21.15.60:0/2669518894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc102790 msgr2=0x7f1dfc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 --2- 172.21.15.60:0/2669518894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc102790 0x7f1dfc1067e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009900 tx=0x7f1dec02a410 comp rx=0 tx=0).stop 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 -- 172.21.15.60:0/2669518894 shutdown_connections 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 --2- 172.21.15.60:0/2669518894 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dfc106f10 0x7f1dfc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 --2- 172.21.15.60:0/2669518894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc102790 0x7f1dfc1067e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 --2- 172.21.15.60:0/2669518894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc101de0 0x7f1dfc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 -- 172.21.15.60:0/2669518894 >> 172.21.15.60:0/2669518894 conn(0x7f1dfc0fd8c0 msgr2=0x7f1dfc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 -- 172.21.15.60:0/2669518894 shutdown_connections 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 -- 172.21.15.60:0/2669518894 wait complete. 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.960+0000 7f1e03912640 1 Processor -- start 2024-09-11T23:58:29.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e03912640 1 -- start start 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e03912640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc101de0 0x7f1dfc1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e03912640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dfc102790 0x7f1dfc198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e03912640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc106f10 0x7f1dfc19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e03912640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc112120 con 0x7f1dfc101de0 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e03912640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc111fa0 con 0x7f1dfc102790 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e03912640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc1122a0 con 0x7f1dfc106f10 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc101de0 0x7f1dfc1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc101de0 0x7f1dfc1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44256/0 (socket says 172.21.15.60:44256) 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 -- 172.21.15.60:0/1015688517 learned_addr learned my addr 172.21.15.60:0/1015688517 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e00ead640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dfc102790 0x7f1dfc198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e01eaf640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc106f10 0x7f1dfc19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 -- 172.21.15.60:0/1015688517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc106f10 msgr2=0x7f1dfc19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc106f10 0x7f1dfc19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 -- 172.21.15.60:0/1015688517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dfc102790 msgr2=0x7f1dfc198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dfc102790 0x7f1dfc198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 -- 172.21.15.60:0/1015688517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc19d550 con 0x7f1dfc101de0 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e01eaf640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc106f10 0x7f1dfc19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e00ead640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dfc102790 0x7f1dfc198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.961+0000 7f1e016ae640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc101de0 0x7f1dfc1985a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b4a0 tx=0x7f1df800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.962+0000 7f1df27fc640 1 -- 172.21.15.60:0/1015688517 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8014070 con 0x7f1dfc101de0 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.962+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc19d840 con 0x7f1dfc101de0 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.962+0000 7f1df27fc640 1 -- 172.21.15.60:0/1015688517 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1df8010b10 con 0x7f1dfc101de0 2024-09-11T23:58:29.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.962+0000 7f1df27fc640 1 -- 172.21.15.60:0/1015688517 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8017d60 con 0x7f1dfc101de0 2024-09-11T23:58:29.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.962+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1a5120 con 0x7f1dfc101de0 2024-09-11T23:58:29.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.963+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc1021c0 con 0x7f1dfc101de0 2024-09-11T23:58:29.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.964+0000 7f1df27fc640 1 -- 172.21.15.60:0/1015688517 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1df8017070 con 0x7f1dfc101de0 2024-09-11T23:58:29.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.965+0000 7f1df27fc640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1de80a2c10 0x7f1de80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:29.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.965+0000 7f1e00ead640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1de80a2c10 0x7f1de80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:29.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.965+0000 7f1df27fc640 1 -- 172.21.15.60:0/1015688517 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f1df80ce4e0 con 0x7f1dfc101de0 2024-09-11T23:58:29.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.965+0000 7f1e00ead640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1de80a2c10 0x7f1de80a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dec000c00 tx=0x7f1dec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:29.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:29.969+0000 7f1df27fc640 1 -- 172.21.15.60:0/1015688517 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1df809b420 con 0x7f1dfc101de0 2024-09-11T23:58:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.146+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1dfc10a0f0 con 0x7f1dfc101de0 2024-09-11T23:58:30.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.147+0000 7f1df27fc640 1 -- 172.21.15.60:0/1015688517 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1df809ad20 con 0x7f1dfc101de0 2024-09-11T23:58:30.147 INFO:teuthology.orchestra.run.smithi060.stdout:133143986237 2024-09-11T23:58:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1de80a2c10 msgr2=0x7f1de80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1de80a2c10 0x7f1de80a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dec000c00 tx=0x7f1dec005a20 comp rx=0 tx=0).stop 2024-09-11T23:58:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc101de0 msgr2=0x7f1dfc1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc101de0 0x7f1dfc1985a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1df800b4a0 tx=0x7f1df800b960 comp rx=0 tx=0).stop 2024-09-11T23:58:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 shutdown_connections 2024-09-11T23:58:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dfc106f10 0x7f1dfc19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dfc102790 0x7f1dfc198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1de80a2c10 0x7f1de80a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 --2- 172.21.15.60:0/1015688517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1dfc101de0 0x7f1dfc1985a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 >> 172.21.15.60:0/1015688517 conn(0x7f1dfc0fd8c0 msgr2=0x7f1dfc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 shutdown_connections 2024-09-11T23:58:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.149+0000 7f1e03912640 1 -- 172.21.15.60:0/1015688517 wait complete. 2024-09-11T23:58:30.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.276+0000 7f347e1c7640 1 -- 172.21.15.60:0/2645593494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478103760 msgr2=0x7f3478107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:30.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.276+0000 7f347e1c7640 1 --2- 172.21.15.60:0/2645593494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478103760 0x7f3478107ba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f346c009930 tx=0x7f346c02a420 comp rx=0 tx=0).stop 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.277+0000 7f347e1c7640 1 -- 172.21.15.60:0/2645593494 shutdown_connections 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.277+0000 7f347e1c7640 1 --2- 172.21.15.60:0/2645593494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34781082e0 0x7f347810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.277+0000 7f347e1c7640 1 --2- 172.21.15.60:0/2645593494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478103760 0x7f3478107ba0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.277+0000 7f347e1c7640 1 --2- 172.21.15.60:0/2645593494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3478102db0 0x7f3478103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.277+0000 7f347e1c7640 1 -- 172.21.15.60:0/2645593494 >> 172.21.15.60:0/2645593494 conn(0x7f34780fc7d0 msgr2=0x7f34780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.277+0000 7f347e1c7640 1 -- 172.21.15.60:0/2645593494 shutdown_connections 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.277+0000 7f347e1c7640 1 -- 172.21.15.60:0/2645593494 wait complete. 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.277+0000 7f347e1c7640 1 Processor -- start 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f347e1c7640 1 -- start start 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f347e1c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478102db0 0x7f34781985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f347e1c7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3478103760 0x7f3478198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:30.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f347e1c7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34781082e0 0x7f347819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f347e1c7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f34781121d0 con 0x7f3478102db0 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f347e1c7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3478112050 con 0x7f34781082e0 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f347e1c7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3478112350 con 0x7f3478103760 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f34777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478102db0 0x7f34781985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f34777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478102db0 0x7f34781985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44272/0 (socket says 172.21.15.60:44272) 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f34777fe640 1 -- 172.21.15.60:0/1141663467 learned_addr learned my addr 172.21.15.60:0/1141663467 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f3476ffd640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3478103760 0x7f3478198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f34777fe640 1 -- 172.21.15.60:0/1141663467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3478103760 msgr2=0x7f3478198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f34777fe640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3478103760 0x7f3478198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f34777fe640 1 -- 172.21.15.60:0/1141663467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34781082e0 msgr2=0x7f347819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:30.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.278+0000 7f34777fe640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34781082e0 0x7f347819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.279+0000 7f34777fe640 1 -- 172.21.15.60:0/1141663467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347819d550 con 0x7f3478102db0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.279+0000 7f34777fe640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478102db0 0x7f34781985a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f346800c920 tx=0x7f346800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.279+0000 7f3474ff9640 1 -- 172.21.15.60:0/1141663467 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468007c70 con 0x7f3478102db0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.279+0000 7f3474ff9640 1 -- 172.21.15.60:0/1141663467 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3468007e10 con 0x7f3478102db0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.279+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347819d840 con 0x7f3478102db0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.279+0000 7f3474ff9640 1 -- 172.21.15.60:0/1141663467 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468018940 con 0x7f3478102db0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.279+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3478100940 con 0x7f3478102db0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.280+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347806a7d0 con 0x7f3478102db0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.281+0000 7f3474ff9640 1 -- 172.21.15.60:0/1141663467 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3468018b20 con 0x7f3478102db0 2024-09-11T23:58:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.282+0000 7f3474ff9640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f34600a2c10 0x7f34600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:30.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.282+0000 7f3476ffd640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f34600a2c10 0x7f34600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:30.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.282+0000 7f3474ff9640 1 -- 172.21.15.60:0/1141663467 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f34680cf320 con 0x7f3478102db0 2024-09-11T23:58:30.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.282+0000 7f3476ffd640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f34600a2c10 0x7f34600a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f346c005940 tx=0x7f346c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:30.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.286+0000 7f3474ff9640 1 -- 172.21.15.60:0/1141663467 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3468014030 con 0x7f3478102db0 2024-09-11T23:58:30.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.466+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f3478103190 con 0x7f3478102db0 2024-09-11T23:58:30.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.466+0000 7f3474ff9640 1 -- 172.21.15.60:0/1141663467 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f346809c150 con 0x7f3478102db0 2024-09-11T23:58:30.467 INFO:teuthology.orchestra.run.smithi060.stdout:266287972386 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f34600a2c10 msgr2=0x7f34600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f34600a2c10 0x7f34600a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f346c005940 tx=0x7f346c0058d0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478102db0 msgr2=0x7f34781985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478102db0 0x7f34781985a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f346800c920 tx=0x7f346800cde0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 shutdown_connections 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34781082e0 0x7f347819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3478103760 0x7f3478198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f34600a2c10 0x7f34600a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 --2- 172.21.15.60:0/1141663467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3478102db0 0x7f34781985a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:30.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 >> 172.21.15.60:0/1141663467 conn(0x7f34780fc7d0 msgr2=0x7f34780fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:30.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 shutdown_connections 2024-09-11T23:58:30.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:30.469+0000 7f347e1c7640 1 -- 172.21.15.60:0/1141663467 wait complete. 2024-09-11T23:58:30.808 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:30 smithi060 ceph-mon[30953]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:30.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:30 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1015688517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:58:30.809 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:30 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1141663467' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:58:30.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:30 smithi105 ceph-mon[34805]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:30.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:30 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1015688517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:58:30.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:30 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1141663467' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:58:31.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:30 smithi192 ceph-mon[35487]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:31.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:30 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1015688517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-11T23:58:31.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:30 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1141663467' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-11T23:58:31.509 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972383 got 266287972386 for osd.9 2024-09-11T23:58:31.509 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:31.684 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986234 got 133143986237 for osd.4 2024-09-11T23:58:31.684 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:31.684 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:58:31.685 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:58:32.505 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:32.840 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:32 smithi060 ceph-mon[30953]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:32 smithi105 ceph-mon[34805]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:33.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:32 smithi192 ceph-mon[35487]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:33.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 -- 172.21.15.60:0/1881114778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964106f10 msgr2=0x7fa96410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 --2- 172.21.15.60:0/1881114778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964106f10 0x7fa96410ea90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009ca0 tx=0x7fa95c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 -- 172.21.15.60:0/1881114778 shutdown_connections 2024-09-11T23:58:33.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 --2- 172.21.15.60:0/1881114778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964106f10 0x7fa96410ea90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 --2- 172.21.15.60:0/1881114778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa964102790 0x7fa9641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 --2- 172.21.15.60:0/1881114778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa964101de0 0x7fa9641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 -- 172.21.15.60:0/1881114778 >> 172.21.15.60:0/1881114778 conn(0x7fa9640fd8c0 msgr2=0x7fa9640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 -- 172.21.15.60:0/1881114778 shutdown_connections 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.015+0000 7fa9696a2640 1 -- 172.21.15.60:0/1881114778 wait complete. 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.016+0000 7fa9696a2640 1 Processor -- start 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.016+0000 7fa9696a2640 1 -- start start 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9696a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964101de0 0x7fa964198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9696a2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa964102790 0x7fa964198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9696a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa964106f10 0x7fa96419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9696a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa964112090 con 0x7fa964101de0 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9696a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa964111f10 con 0x7fa964106f10 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9696a2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa964112210 con 0x7fa964102790 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964101de0 0x7fa964198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964101de0 0x7fa964198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44338/0 (socket says 172.21.15.60:44338) 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 -- 172.21.15.60:0/2472584616 learned_addr learned my addr 172.21.15.60:0/2472584616 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa95a7fc640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa964102790 0x7fa964198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9637fe640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa964106f10 0x7fa96419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 -- 172.21.15.60:0/2472584616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa964102790 msgr2=0x7fa964198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa964102790 0x7fa964198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 -- 172.21.15.60:0/2472584616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa964106f10 msgr2=0x7fa96419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa964106f10 0x7fa96419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 -- 172.21.15.60:0/2472584616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96419d500 con 0x7fa964101de0 2024-09-11T23:58:33.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa95a7fc640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa964102790 0x7fa964198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9637fe640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa964106f10 0x7fa96419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa962ffd640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964101de0 0x7fa964198550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa95400d950 tx=0x7fa95400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa960ff9640 1 -- 172.21.15.60:0/2472584616 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954017030 con 0x7fa964101de0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa960ff9640 1 -- 172.21.15.60:0/2472584616 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa954004020 con 0x7fa964101de0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.017+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96419d7f0 con 0x7fa964101de0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.018+0000 7fa960ff9640 1 -- 172.21.15.60:0/2472584616 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954004a00 con 0x7fa964101de0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.018+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9641a50d0 con 0x7fa964101de0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.018+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9641021c0 con 0x7fa964101de0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.020+0000 7fa960ff9640 1 -- 172.21.15.60:0/2472584616 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa9540041d0 con 0x7fa964101de0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.020+0000 7fa960ff9640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa9500a2c10 0x7fa9500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.021+0000 7fa95a7fc640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa9500a2c10 0x7fa9500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.021+0000 7fa960ff9640 1 -- 172.21.15.60:0/2472584616 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fa9540cf2d0 con 0x7fa964101de0 2024-09-11T23:58:33.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.021+0000 7fa95a7fc640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa9500a2c10 0x7fa9500a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa9641087b0 tx=0x7fa94c005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:33.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.024+0000 7fa960ff9640 1 -- 172.21.15.60:0/2472584616 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa95409c100 con 0x7fa964101de0 2024-09-11T23:58:33.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.201+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa96410a160 con 0x7fa9500a2c10 2024-09-11T23:58:33.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.212+0000 7fa960ff9640 1 -- 172.21.15.60:0/2472584616 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258921 (secure 0 0 0) 0x7fa94c00d990 con 0x7fa9500a2c10 2024-09-11T23:58:33.216 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:33.217 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa9500a2c10 msgr2=0x7fa9500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa9500a2c10 0x7fa9500a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa9641087b0 tx=0x7fa94c005cb0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964101de0 msgr2=0x7fa964198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964101de0 0x7fa964198550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa95400d950 tx=0x7fa95400de10 comp rx=0 tx=0).stop 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 shutdown_connections 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa964106f10 0x7fa96419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa964102790 0x7fa964198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa9500a2c10 0x7fa9500a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 --2- 172.21.15.60:0/2472584616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa964101de0 0x7fa964198550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 >> 172.21.15.60:0/2472584616 conn(0x7fa9640fd8c0 msgr2=0x7fa9640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:33.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 shutdown_connections 2024-09-11T23:58:33.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:33.215+0000 7fa9696a2640 1 -- 172.21.15.60:0/2472584616 wait complete. 2024-09-11T23:58:33.841 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:33 smithi060 ceph-mon[30953]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:33.883 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-11T23:58:31.382922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657967,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":652,"num_read_kb":453,"num_write":426,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368660,"kb_used_data":11088,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573164,"statfs":{"total":1151940427776,"available":1151562919936,"internally_reserved":0,"allocated":11354112,"data_stored":7169733,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":60,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003241"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488874+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:57:40.488874+0000","last_peered":"2024-09-11T23:57:40.488874+0000","last_clean":"2024-09-11T23:57:40.488874+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:57:40.488874+0000","last_undegraded":"2024-09-11T23:57:40.488874+0000","last_fullsized":"2024-09-11T23:57:40.488874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799409+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:57:40.799409+0000","last_peered":"2024-09-11T23:57:40.799409+0000","last_clean":"2024-09-11T23:57:40.799409+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:57:40.799409+0000","last_undegraded":"2024-09-11T23:57:40.799409+0000","last_fullsized":"2024-09-11T23:57:40.799409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799455+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:57:40.799455+0000","last_peered":"2024-09-11T23:57:40.799455+0000","last_clean":"2024-09-11T23:57:40.799455+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:57:40.799455+0000","last_undegraded":"2024-09-11T23:57:40.799455+0000","last_fullsized":"2024-09-11T23:57:40.799455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488696+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:57:40.488696+0000","last_peered":"2024-09-11T23:57:40.488696+0000","last_clean":"2024-09-11T23:57:40.488696+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:57:40.488696+0000","last_undegraded":"2024-09-11T23:57:40.488696+0000","last_fullsized":"2024-09-11T23:57:40.488696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491218+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:57:40.491218+0000","last_peered":"2024-09-11T23:57:40.491218+0000","last_clean":"2024-09-11T23:57:40.491218+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:57:40.491218+0000","last_undegraded":"2024-09-11T23:57:40.491218+0000","last_fullsized":"2024-09-11T23:57:40.491218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799682+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:57:40.799682+0000","last_peered":"2024-09-11T23:57:40.799682+0000","last_clean":"2024-09-11T23:57:40.799682+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:57:40.799682+0000","last_undegraded":"2024-09-11T23:57:40.799682+0000","last_fullsized":"2024-09-11T23:57:40.799682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489139+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:57:40.489139+0000","last_peered":"2024-09-11T23:57:40.489139+0000","last_clean":"2024-09-11T23:57:40.489139+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:57:40.489139+0000","last_undegraded":"2024-09-11T23:57:40.489139+0000","last_fullsized":"2024-09-11T23:57:40.489139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488986+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:57:40.488986+0000","last_peered":"2024-09-11T23:57:40.488986+0000","last_clean":"2024-09-11T23:57:40.488986+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:57:40.488986+0000","last_undegraded":"2024-09-11T23:57:40.488986+0000","last_fullsized":"2024-09-11T23:57:40.488986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800714+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:57:40.800714+0000","last_peered":"2024-09-11T23:57:40.800714+0000","last_clean":"2024-09-11T23:57:40.800714+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:57:40.800714+0000","last_undegraded":"2024-09-11T23:57:40.800714+0000","last_fullsized":"2024-09-11T23:57:40.800714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800173+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:57:40.800173+0000","last_peered":"2024-09-11T23:57:40.800173+0000","last_clean":"2024-09-11T23:57:40.800173+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:57:40.800173+0000","last_undegraded":"2024-09-11T23:57:40.800173+0000","last_fullsized":"2024-09-11T23:57:40.800173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488801+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:57:40.488801+0000","last_peered":"2024-09-11T23:57:40.488801+0000","last_clean":"2024-09-11T23:57:40.488801+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:57:40.488801+0000","last_undegraded":"2024-09-11T23:57:40.488801+0000","last_fullsized":"2024-09-11T23:57:40.488801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800804+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:57:40.800804+0000","last_peered":"2024-09-11T23:57:40.800804+0000","last_clean":"2024-09-11T23:57:40.800804+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:57:40.800804+0000","last_undegraded":"2024-09-11T23:57:40.800804+0000","last_fullsized":"2024-09-11T23:57:40.800804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487617+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:57:40.487617+0000","last_peered":"2024-09-11T23:57:40.487617+0000","last_clean":"2024-09-11T23:57:40.487617+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:57:40.487617+0000","last_undegraded":"2024-09-11T23:57:40.487617+0000","last_fullsized":"2024-09-11T23:57:40.487617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799293+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:57:40.799293+0000","last_peered":"2024-09-11T23:57:40.799293+0000","last_clean":"2024-09-11T23:57:40.799293+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:57:40.799293+0000","last_undegraded":"2024-09-11T23:57:40.799293+0000","last_fullsized":"2024-09-11T23:57:40.799293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799209+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:57:40.799209+0000","last_peered":"2024-09-11T23:57:40.799209+0000","last_clean":"2024-09-11T23:57:40.799209+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:57:40.799209+0000","last_undegraded":"2024-09-11T23:57:40.799209+0000","last_fullsized":"2024-09-11T23:57:40.799209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800297+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:57:40.800297+0000","last_peered":"2024-09-11T23:57:40.800297+0000","last_clean":"2024-09-11T23:57:40.800297+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:57:40.800297+0000","last_undegraded":"2024-09-11T23:57:40.800297+0000","last_fullsized":"2024-09-11T23:57:40.800297+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489035+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:57:40.489035+0000","last_peered":"2024-09-11T23:57:40.489035+0000","last_clean":"2024-09-11T23:57:40.489035+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:57:40.489035+0000","last_undegraded":"2024-09-11T23:57:40.489035+0000","last_fullsized":"2024-09-11T23:57:40.489035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491181+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:57:40.491181+0000","last_peered":"2024-09-11T23:57:40.491181+0000","last_clean":"2024-09-11T23:57:40.491181+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:57:40.491181+0000","last_undegraded":"2024-09-11T23:57:40.491181+0000","last_fullsized":"2024-09-11T23:57:40.491181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489817+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:57:40.489817+0000","last_peered":"2024-09-11T23:57:40.489817+0000","last_clean":"2024-09-11T23:57:40.489817+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:57:40.489817+0000","last_undegraded":"2024-09-11T23:57:40.489817+0000","last_fullsized":"2024-09-11T23:57:40.489817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488148+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:57:40.488148+0000","last_peered":"2024-09-11T23:57:40.488148+0000","last_clean":"2024-09-11T23:57:40.488148+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:57:40.488148+0000","last_undegraded":"2024-09-11T23:57:40.488148+0000","last_fullsized":"2024-09-11T23:57:40.488148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487703+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:57:40.487703+0000","last_peered":"2024-09-11T23:57:40.487703+0000","last_clean":"2024-09-11T23:57:40.487703+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:57:40.487703+0000","last_undegraded":"2024-09-11T23:57:40.487703+0000","last_fullsized":"2024-09-11T23:57:40.487703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800467+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:57:40.800467+0000","last_peered":"2024-09-11T23:57:40.800467+0000","last_clean":"2024-09-11T23:57:40.800467+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:57:40.800467+0000","last_undegraded":"2024-09-11T23:57:40.800467+0000","last_fullsized":"2024-09-11T23:57:40.800467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489186+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:57:40.489186+0000","last_peered":"2024-09-11T23:57:40.489186+0000","last_clean":"2024-09-11T23:57:40.489186+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:57:40.489186+0000","last_undegraded":"2024-09-11T23:57:40.489186+0000","last_fullsized":"2024-09-11T23:57:40.489186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491160+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:57:40.491160+0000","last_peered":"2024-09-11T23:57:40.491160+0000","last_clean":"2024-09-11T23:57:40.491160+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:57:40.491160+0000","last_undegraded":"2024-09-11T23:57:40.491160+0000","last_fullsized":"2024-09-11T23:57:40.491160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489537+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:57:40.489537+0000","last_peered":"2024-09-11T23:57:40.489537+0000","last_clean":"2024-09-11T23:57:40.489537+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:57:40.489537+0000","last_undegraded":"2024-09-11T23:57:40.489537+0000","last_fullsized":"2024-09-11T23:57:40.489537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490110+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:57:40.490110+0000","last_peered":"2024-09-11T23:57:40.490110+0000","last_clean":"2024-09-11T23:57:40.490110+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:57:40.490110+0000","last_undegraded":"2024-09-11T23:57:40.490110+0000","last_fullsized":"2024-09-11T23:57:40.490110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488877+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:57:40.488877+0000","last_peered":"2024-09-11T23:57:40.488877+0000","last_clean":"2024-09-11T23:57:40.488877+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:57:40.488877+0000","last_undegraded":"2024-09-11T23:57:40.488877+0000","last_fullsized":"2024-09-11T23:57:40.488877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487540+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:57:40.487540+0000","last_peered":"2024-09-11T23:57:40.487540+0000","last_clean":"2024-09-11T23:57:40.487540+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:57:40.487540+0000","last_undegraded":"2024-09-11T23:57:40.487540+0000","last_fullsized":"2024-09-11T23:57:40.487540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:57:40.799410+0000","last_peered":"2024-09-11T23:57:40.799410+0000","last_clean":"2024-09-11T23:57:40.799410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:57:40.799410+0000","last_undegraded":"2024-09-11T23:57:40.799410+0000","last_fullsized":"2024-09-11T23:57:40.799410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489720+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:57:40.489720+0000","last_peered":"2024-09-11T23:57:40.489720+0000","last_clean":"2024-09-11T23:57:40.489720+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:57:40.489720+0000","last_undegraded":"2024-09-11T23:57:40.489720+0000","last_fullsized":"2024-09-11T23:57:40.489720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.493188+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:57:40.493188+0000","last_peered":"2024-09-11T23:57:40.493188+0000","last_clean":"2024-09-11T23:57:40.493188+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:57:40.493188+0000","last_undegraded":"2024-09-11T23:57:40.493188+0000","last_fullsized":"2024-09-11T23:57:40.493188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488168+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:57:40.488168+0000","last_peered":"2024-09-11T23:57:40.488168+0000","last_clean":"2024-09-11T23:57:40.488168+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:57:40.488168+0000","last_undegraded":"2024-09-11T23:57:40.488168+0000","last_fullsized":"2024-09-11T23:57:40.488168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491663+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:57:40.491663+0000","last_peered":"2024-09-11T23:57:40.491663+0000","last_clean":"2024-09-11T23:57:40.491663+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:57:40.491663+0000","last_undegraded":"2024-09-11T23:57:40.491663+0000","last_fullsized":"2024-09-11T23:57:40.491663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:26.573464+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:58:26.573464+0000","last_peered":"2024-09-11T23:58:26.573464+0000","last_clean":"2024-09-11T23:58:26.573464+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:58:26.573464+0000","last_undegraded":"2024-09-11T23:58:26.573464+0000","last_fullsized":"2024-09-11T23:58:26.573464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491546+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:57:40.491546+0000","last_peered":"2024-09-11T23:57:40.491546+0000","last_clean":"2024-09-11T23:57:40.491546+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:57:40.491546+0000","last_undegraded":"2024-09-11T23:57:40.491546+0000","last_fullsized":"2024-09-11T23:57:40.491546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799644+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:57:40.799644+0000","last_peered":"2024-09-11T23:57:40.799644+0000","last_clean":"2024-09-11T23:57:40.799644+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:57:40.799644+0000","last_undegraded":"2024-09-11T23:57:40.799644+0000","last_fullsized":"2024-09-11T23:57:40.799644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487353+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:57:40.487353+0000","last_peered":"2024-09-11T23:57:40.487353+0000","last_clean":"2024-09-11T23:57:40.487353+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:57:40.487353+0000","last_undegraded":"2024-09-11T23:57:40.487353+0000","last_fullsized":"2024-09-11T23:57:40.487353+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489034+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:57:40.489034+0000","last_peered":"2024-09-11T23:57:40.489034+0000","last_clean":"2024-09-11T23:57:40.489034+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:57:40.489034+0000","last_undegraded":"2024-09-11T23:57:40.489034+0000","last_fullsized":"2024-09-11T23:57:40.489034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491451+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:57:40.491451+0000","last_peered":"2024-09-11T23:57:40.491451+0000","last_clean":"2024-09-11T23:57:40.491451+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:57:40.491451+0000","last_undegraded":"2024-09-11T23:57:40.491451+0000","last_fullsized":"2024-09-11T23:57:40.491451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490361+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:57:40.490361+0000","last_peered":"2024-09-11T23:57:40.490361+0000","last_clean":"2024-09-11T23:57:40.490361+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:57:40.490361+0000","last_undegraded":"2024-09-11T23:57:40.490361+0000","last_fullsized":"2024-09-11T23:57:40.490361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:27.574139+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:58:27.574139+0000","last_peered":"2024-09-11T23:58:27.574139+0000","last_clean":"2024-09-11T23:58:27.574139+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:58:27.574139+0000","last_undegraded":"2024-09-11T23:58:27.574139+0000","last_fullsized":"2024-09-11T23:58:27.574139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800707+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:57:40.800707+0000","last_peered":"2024-09-11T23:57:40.800707+0000","last_clean":"2024-09-11T23:57:40.800707+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:57:40.800707+0000","last_undegraded":"2024-09-11T23:57:40.800707+0000","last_fullsized":"2024-09-11T23:57:40.800707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488921+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:57:40.488921+0000","last_peered":"2024-09-11T23:57:40.488921+0000","last_clean":"2024-09-11T23:57:40.488921+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:57:40.488921+0000","last_undegraded":"2024-09-11T23:57:40.488921+0000","last_fullsized":"2024-09-11T23:57:40.488921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799598+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:57:40.799598+0000","last_peered":"2024-09-11T23:57:40.799598+0000","last_clean":"2024-09-11T23:57:40.799598+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:57:40.799598+0000","last_undegraded":"2024-09-11T23:57:40.799598+0000","last_fullsized":"2024-09-11T23:57:40.799598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491653+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:57:40.491653+0000","last_peered":"2024-09-11T23:57:40.491653+0000","last_clean":"2024-09-11T23:57:40.491653+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:57:40.491653+0000","last_undegraded":"2024-09-11T23:57:40.491653+0000","last_fullsized":"2024-09-11T23:57:40.491653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800834+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:57:40.800834+0000","last_peered":"2024-09-11T23:57:40.800834+0000","last_clean":"2024-09-11T23:57:40.800834+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:57:40.800834+0000","last_undegraded":"2024-09-11T23:57:40.800834+0000","last_fullsized":"2024-09-11T23:57:40.800834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:27.573808+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:58:27.573808+0000","last_peered":"2024-09-11T23:58:27.573808+0000","last_clean":"2024-09-11T23:58:27.573808+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:58:27.573808+0000","last_undegraded":"2024-09-11T23:58:27.573808+0000","last_fullsized":"2024-09-11T23:58:27.573808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":109,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491931+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:57:40.491931+0000","last_peered":"2024-09-11T23:57:40.491931+0000","last_clean":"2024-09-11T23:57:40.491931+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:57:40.491931+0000","last_undegraded":"2024-09-11T23:57:40.491931+0000","last_fullsized":"2024-09-11T23:57:40.491931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.513007+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:57:41.513007+0000","last_peered":"2024-09-11T23:57:41.513007+0000","last_clean":"2024-09-11T23:57:41.513007+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:57:41.513007+0000","last_undegraded":"2024-09-11T23:57:41.513007+0000","last_fullsized":"2024-09-11T23:57:41.513007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487257+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:57:40.487257+0000","last_peered":"2024-09-11T23:57:40.487257+0000","last_clean":"2024-09-11T23:57:40.487257+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:57:40.487257+0000","last_undegraded":"2024-09-11T23:57:40.487257+0000","last_fullsized":"2024-09-11T23:57:40.487257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491147+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:57:40.491147+0000","last_peered":"2024-09-11T23:57:40.491147+0000","last_clean":"2024-09-11T23:57:40.491147+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:57:40.491147+0000","last_undegraded":"2024-09-11T23:57:40.491147+0000","last_fullsized":"2024-09-11T23:57:40.491147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491962+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:57:40.491962+0000","last_peered":"2024-09-11T23:57:40.491962+0000","last_clean":"2024-09-11T23:57:40.491962+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:57:40.491962+0000","last_undegraded":"2024-09-11T23:57:40.491962+0000","last_fullsized":"2024-09-11T23:57:40.491962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:27.573782+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:58:27.573782+0000","last_peered":"2024-09-11T23:58:27.573782+0000","last_clean":"2024-09-11T23:58:27.573782+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:58:27.573782+0000","last_undegraded":"2024-09-11T23:58:27.573782+0000","last_fullsized":"2024-09-11T23:58:27.573782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488670+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:57:40.488670+0000","last_peered":"2024-09-11T23:57:40.488670+0000","last_clean":"2024-09-11T23:57:40.488670+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:57:40.488670+0000","last_undegraded":"2024-09-11T23:57:40.488670+0000","last_fullsized":"2024-09-11T23:57:40.488670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491641+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:57:40.491641+0000","last_peered":"2024-09-11T23:57:40.491641+0000","last_clean":"2024-09-11T23:57:40.491641+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:57:40.491641+0000","last_undegraded":"2024-09-11T23:57:40.491641+0000","last_fullsized":"2024-09-11T23:57:40.491641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490860+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:57:40.490860+0000","last_peered":"2024-09-11T23:57:40.490860+0000","last_clean":"2024-09-11T23:57:40.490860+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:57:40.490860+0000","last_undegraded":"2024-09-11T23:57:40.490860+0000","last_fullsized":"2024-09-11T23:57:40.490860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491899+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:57:40.491899+0000","last_peered":"2024-09-11T23:57:40.491899+0000","last_clean":"2024-09-11T23:57:40.491899+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:57:40.491899+0000","last_undegraded":"2024-09-11T23:57:40.491899+0000","last_fullsized":"2024-09-11T23:57:40.491899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488299+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:57:40.488299+0000","last_peered":"2024-09-11T23:57:40.488299+0000","last_clean":"2024-09-11T23:57:40.488299+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:57:40.488299+0000","last_undegraded":"2024-09-11T23:57:40.488299+0000","last_fullsized":"2024-09-11T23:57:40.488299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.805290+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:57:40.805290+0000","last_peered":"2024-09-11T23:57:40.805290+0000","last_clean":"2024-09-11T23:57:40.805290+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:57:40.805290+0000","last_undegraded":"2024-09-11T23:57:40.805290+0000","last_fullsized":"2024-09-11T23:57:40.805290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488979+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:57:40.488979+0000","last_peered":"2024-09-11T23:57:40.488979+0000","last_clean":"2024-09-11T23:57:40.488979+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:57:40.488979+0000","last_undegraded":"2024-09-11T23:57:40.488979+0000","last_fullsized":"2024-09-11T23:57:40.488979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491752+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:57:40.491752+0000","last_peered":"2024-09-11T23:57:40.491752+0000","last_clean":"2024-09-11T23:57:40.491752+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:57:40.491752+0000","last_undegraded":"2024-09-11T23:57:40.491752+0000","last_fullsized":"2024-09-11T23:57:40.491752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489696+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:57:40.489696+0000","last_peered":"2024-09-11T23:57:40.489696+0000","last_clean":"2024-09-11T23:57:40.489696+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:57:40.489696+0000","last_undegraded":"2024-09-11T23:57:40.489696+0000","last_fullsized":"2024-09-11T23:57:40.489696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:26.573424+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:58:26.573424+0000","last_peered":"2024-09-11T23:58:26.573424+0000","last_clean":"2024-09-11T23:58:26.573424+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:58:26.573424+0000","last_undegraded":"2024-09-11T23:58:26.573424+0000","last_fullsized":"2024-09-11T23:58:26.573424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489088+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:57:40.489088+0000","last_peered":"2024-09-11T23:57:40.489088+0000","last_clean":"2024-09-11T23:57:40.489088+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:57:40.489088+0000","last_undegraded":"2024-09-11T23:57:40.489088+0000","last_fullsized":"2024-09-11T23:57:40.489088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":345,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489001+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:57:40.489001+0000","last_peered":"2024-09-11T23:57:40.489001+0000","last_clean":"2024-09-11T23:57:40.489001+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:57:40.489001+0000","last_undegraded":"2024-09-11T23:57:40.489001+0000","last_fullsized":"2024-09-11T23:57:40.489001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.513119+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:57:41.513119+0000","last_peered":"2024-09-11T23:57:41.513119+0000","last_clean":"2024-09-11T23:57:41.513119+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:57:41.513119+0000","last_undegraded":"2024-09-11T23:57:41.513119+0000","last_fullsized":"2024-09-11T23:57:41.513119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489307+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:57:40.489307+0000","last_peered":"2024-09-11T23:57:40.489307+0000","last_clean":"2024-09-11T23:57:40.489307+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:57:40.489307+0000","last_undegraded":"2024-09-11T23:57:40.489307+0000","last_fullsized":"2024-09-11T23:57:40.489307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.498988+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:57:40.498988+0000","last_peered":"2024-09-11T23:57:40.498988+0000","last_clean":"2024-09-11T23:57:40.498988+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:57:40.498988+0000","last_undegraded":"2024-09-11T23:57:40.498988+0000","last_fullsized":"2024-09-11T23:57:40.498988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487248+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:57:40.487248+0000","last_peered":"2024-09-11T23:57:40.487248+0000","last_clean":"2024-09-11T23:57:40.487248+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:57:40.487248+0000","last_undegraded":"2024-09-11T23:57:40.487248+0000","last_fullsized":"2024-09-11T23:57:40.487248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:28.574597+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:58:28.574597+0000","last_peered":"2024-09-11T23:58:28.574597+0000","last_clean":"2024-09-11T23:58:28.574597+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:58:28.574597+0000","last_undegraded":"2024-09-11T23:58:28.574597+0000","last_fullsized":"2024-09-11T23:58:28.574597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491275+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:57:40.491275+0000","last_peered":"2024-09-11T23:57:40.491275+0000","last_clean":"2024-09-11T23:57:40.491275+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:57:40.491275+0000","last_undegraded":"2024-09-11T23:57:40.491275+0000","last_fullsized":"2024-09-11T23:57:40.491275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:26.572371+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:58:26.572371+0000","last_peered":"2024-09-11T23:58:26.572371+0000","last_clean":"2024-09-11T23:58:26.572371+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:58:26.572371+0000","last_undegraded":"2024-09-11T23:58:26.572371+0000","last_fullsized":"2024-09-11T23:58:26.572371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799994+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:57:40.799994+0000","last_peered":"2024-09-11T23:57:40.799994+0000","last_clean":"2024-09-11T23:57:40.799994+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:57:40.799994+0000","last_undegraded":"2024-09-11T23:57:40.799994+0000","last_fullsized":"2024-09-11T23:57:40.799994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491288+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:57:40.491288+0000","last_peered":"2024-09-11T23:57:40.491288+0000","last_clean":"2024-09-11T23:57:40.491288+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:57:40.491288+0000","last_undegraded":"2024-09-11T23:57:40.491288+0000","last_fullsized":"2024-09-11T23:57:40.491288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800126+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:57:40.800126+0000","last_peered":"2024-09-11T23:57:40.800126+0000","last_clean":"2024-09-11T23:57:40.800126+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:57:40.800126+0000","last_undegraded":"2024-09-11T23:57:40.800126+0000","last_fullsized":"2024-09-11T23:57:40.800126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.492087+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:57:40.492087+0000","last_peered":"2024-09-11T23:57:40.492087+0000","last_clean":"2024-09-11T23:57:40.492087+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:57:40.492087+0000","last_undegraded":"2024-09-11T23:57:40.492087+0000","last_fullsized":"2024-09-11T23:57:40.492087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487615+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:57:40.487615+0000","last_peered":"2024-09-11T23:57:40.487615+0000","last_clean":"2024-09-11T23:57:40.487615+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:57:40.487615+0000","last_undegraded":"2024-09-11T23:57:40.487615+0000","last_fullsized":"2024-09-11T23:57:40.487615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.438068+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:57:52.438068+0000","last_peered":"2024-09-11T23:57:52.438068+0000","last_clean":"2024-09-11T23:57:52.438068+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:57:52.438068+0000","last_undegraded":"2024-09-11T23:57:52.438068+0000","last_fullsized":"2024-09-11T23:57:52.438068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489719+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:57:40.489719+0000","last_peered":"2024-09-11T23:57:40.489719+0000","last_clean":"2024-09-11T23:57:40.489719+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:57:40.489719+0000","last_undegraded":"2024-09-11T23:57:40.489719+0000","last_fullsized":"2024-09-11T23:57:40.489719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488806+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:57:40.488806+0000","last_peered":"2024-09-11T23:57:40.488806+0000","last_clean":"2024-09-11T23:57:40.488806+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:57:40.488806+0000","last_undegraded":"2024-09-11T23:57:40.488806+0000","last_fullsized":"2024-09-11T23:57:40.488806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799613+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:57:40.799613+0000","last_peered":"2024-09-11T23:57:40.799613+0000","last_clean":"2024-09-11T23:57:40.799613+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:57:40.799613+0000","last_undegraded":"2024-09-11T23:57:40.799613+0000","last_fullsized":"2024-09-11T23:57:40.799613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800369+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:57:40.800369+0000","last_peered":"2024-09-11T23:57:40.800369+0000","last_clean":"2024-09-11T23:57:40.800369+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:57:40.800369+0000","last_undegraded":"2024-09-11T23:57:40.800369+0000","last_fullsized":"2024-09-11T23:57:40.800369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491088+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:57:40.491088+0000","last_peered":"2024-09-11T23:57:40.491088+0000","last_clean":"2024-09-11T23:57:40.491088+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:57:40.491088+0000","last_undegraded":"2024-09-11T23:57:40.491088+0000","last_fullsized":"2024-09-11T23:57:40.491088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489374+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:57:40.489374+0000","last_peered":"2024-09-11T23:57:40.489374+0000","last_clean":"2024-09-11T23:57:40.489374+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:57:40.489374+0000","last_undegraded":"2024-09-11T23:57:40.489374+0000","last_fullsized":"2024-09-11T23:57:40.489374+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488316+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:57:40.488316+0000","last_peered":"2024-09-11T23:57:40.488316+0000","last_clean":"2024-09-11T23:57:40.488316+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:57:40.488316+0000","last_undegraded":"2024-09-11T23:57:40.488316+0000","last_fullsized":"2024-09-11T23:57:40.488316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489841+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:57:40.489841+0000","last_peered":"2024-09-11T23:57:40.489841+0000","last_clean":"2024-09-11T23:57:40.489841+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:57:40.489841+0000","last_undegraded":"2024-09-11T23:57:40.489841+0000","last_fullsized":"2024-09-11T23:57:40.489841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489180+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:57:40.489180+0000","last_peered":"2024-09-11T23:57:40.489180+0000","last_clean":"2024-09-11T23:57:40.489180+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:57:40.489180+0000","last_undegraded":"2024-09-11T23:57:40.489180+0000","last_fullsized":"2024-09-11T23:57:40.489180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491384+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:57:40.491384+0000","last_peered":"2024-09-11T23:57:40.491384+0000","last_clean":"2024-09-11T23:57:40.491384+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:57:40.491384+0000","last_undegraded":"2024-09-11T23:57:40.491384+0000","last_fullsized":"2024-09-11T23:57:40.491384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489563+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:57:40.489563+0000","last_peered":"2024-09-11T23:57:40.489563+0000","last_clean":"2024-09-11T23:57:40.489563+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:57:40.489563+0000","last_undegraded":"2024-09-11T23:57:40.489563+0000","last_fullsized":"2024-09-11T23:57:40.489563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491508+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:57:40.491508+0000","last_peered":"2024-09-11T23:57:40.491508+0000","last_clean":"2024-09-11T23:57:40.491508+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:57:40.491508+0000","last_undegraded":"2024-09-11T23:57:40.491508+0000","last_fullsized":"2024-09-11T23:57:40.491508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491868+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:57:40.491868+0000","last_peered":"2024-09-11T23:57:40.491868+0000","last_clean":"2024-09-11T23:57:40.491868+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:57:40.491868+0000","last_undegraded":"2024-09-11T23:57:40.491868+0000","last_fullsized":"2024-09-11T23:57:40.491868+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800371+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:57:40.800371+0000","last_peered":"2024-09-11T23:57:40.800371+0000","last_clean":"2024-09-11T23:57:40.800371+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:57:40.800371+0000","last_undegraded":"2024-09-11T23:57:40.800371+0000","last_fullsized":"2024-09-11T23:57:40.800371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.512639+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:57:41.512639+0000","last_peered":"2024-09-11T23:57:41.512639+0000","last_clean":"2024-09-11T23:57:41.512639+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:57:41.512639+0000","last_undegraded":"2024-09-11T23:57:41.512639+0000","last_fullsized":"2024-09-11T23:57:41.512639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799601+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:57:40.799601+0000","last_peered":"2024-09-11T23:57:40.799601+0000","last_clean":"2024-09-11T23:57:40.799601+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:57:40.799601+0000","last_undegraded":"2024-09-11T23:57:40.799601+0000","last_fullsized":"2024-09-11T23:57:40.799601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489988+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:57:40.489988+0000","last_peered":"2024-09-11T23:57:40.489988+0000","last_clean":"2024-09-11T23:57:40.489988+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:57:40.489988+0000","last_undegraded":"2024-09-11T23:57:40.489988+0000","last_fullsized":"2024-09-11T23:57:40.489988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489745+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:57:40.489745+0000","last_peered":"2024-09-11T23:57:40.489745+0000","last_clean":"2024-09-11T23:57:40.489745+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:57:40.489745+0000","last_undegraded":"2024-09-11T23:57:40.489745+0000","last_fullsized":"2024-09-11T23:57:40.489745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:28.574393+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:58:28.574393+0000","last_peered":"2024-09-11T23:58:28.574393+0000","last_clean":"2024-09-11T23:58:28.574393+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:58:28.574393+0000","last_undegraded":"2024-09-11T23:58:28.574393+0000","last_fullsized":"2024-09-11T23:58:28.574393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67365,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":516,"num_read_kb":334,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285260,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":434178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":1085364,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":434108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201319,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":434486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430253,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1027792,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":434218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1026684,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":435094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":433650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":494100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":494895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":435164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:58:33.889 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:58:33.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:33 smithi105 ceph-mon[34805]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:34.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:33 smithi192 ceph-mon[35487]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:34.165 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:34.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.642+0000 7f2472da9640 1 -- 172.21.15.60:0/1340869539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 msgr2=0x7f246c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:34.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.642+0000 7f2472da9640 1 --2- 172.21.15.60:0/1340869539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 0x7f246c103120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f245c009900 tx=0x7f245c02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.642+0000 7f2472da9640 1 -- 172.21.15.60:0/1340869539 shutdown_connections 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.642+0000 7f2472da9640 1 --2- 172.21.15.60:0/1340869539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246c10c170 0x7f246c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.642+0000 7f2472da9640 1 --2- 172.21.15.60:0/1340869539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f246c103660 0x7f246c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.642+0000 7f2472da9640 1 --2- 172.21.15.60:0/1340869539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 0x7f246c103120 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.642+0000 7f2472da9640 1 -- 172.21.15.60:0/1340869539 >> 172.21.15.60:0/1340869539 conn(0x7f246c0fc7a0 msgr2=0x7f246c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 -- 172.21.15.60:0/1340869539 shutdown_connections 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 -- 172.21.15.60:0/1340869539 wait complete. 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 Processor -- start 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 -- start start 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 0x7f246c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f246c103660 0x7f246c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:34.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246c10c170 0x7f246c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f246c112090 con 0x7f246c102d40 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f246c111f10 con 0x7f246c10c170 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2472da9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f246c112210 con 0x7f246c103660 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2470b45640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 0x7f246c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.643+0000 7f2470b45640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 0x7f246c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44366/0 (socket says 172.21.15.60:44366) 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2470b45640 1 -- 172.21.15.60:0/461132351 learned_addr learned my addr 172.21.15.60:0/461132351 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f246bfff640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f246c103660 0x7f246c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2471346640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246c10c170 0x7f246c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2470b45640 1 -- 172.21.15.60:0/461132351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f246c103660 msgr2=0x7f246c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2470b45640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f246c103660 0x7f246c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2470b45640 1 -- 172.21.15.60:0/461132351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246c10c170 msgr2=0x7f246c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:34.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2470b45640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246c10c170 0x7f246c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2470b45640 1 -- 172.21.15.60:0/461132351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246c19d4a0 con 0x7f246c102d40 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2470b45640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 0x7f246c1984f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f245c006010 tx=0x7f245c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2469ffb640 1 -- 172.21.15.60:0/461132351 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c03f030 con 0x7f246c102d40 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2469ffb640 1 -- 172.21.15.60:0/461132351 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f245c003d00 con 0x7f246c102d40 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f246c19d730 con 0x7f246c102d40 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2469ffb640 1 -- 172.21.15.60:0/461132351 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c035070 con 0x7f246c102d40 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.644+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f246c1a5070 con 0x7f246c102d40 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.645+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f246c103120 con 0x7f246c102d40 2024-09-11T23:58:34.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.647+0000 7f2469ffb640 1 -- 172.21.15.60:0/461132351 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f245c042030 con 0x7f246c102d40 2024-09-11T23:58:34.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.647+0000 7f2469ffb640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f24540a2c90 0x7f24540a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:34.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.648+0000 7f246bfff640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f24540a2c90 0x7f24540a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:34.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.648+0000 7f2469ffb640 1 -- 172.21.15.60:0/461132351 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f245c0ef8b0 con 0x7f246c102d40 2024-09-11T23:58:34.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.648+0000 7f246bfff640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f24540a2c90 0x7f24540a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f246c0fed50 tx=0x7f246000b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:34.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.652+0000 7f2469ffb640 1 -- 172.21.15.60:0/461132351 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f245c0bc030 con 0x7f246c102d40 2024-09-11T23:58:34.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.828+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f246c0fe4c0 con 0x7f24540a2c90 2024-09-11T23:58:34.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.834+0000 7f2469ffb640 1 -- 172.21.15.60:0/461132351 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258921 (secure 0 0 0) 0x7f246c0fe4c0 con 0x7f24540a2c90 2024-09-11T23:58:34.835 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:34.838 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f24540a2c90 msgr2=0x7f24540a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f24540a2c90 0x7f24540a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f246c0fed50 tx=0x7f246000b360 comp rx=0 tx=0).stop 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 msgr2=0x7f246c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 0x7f246c1984f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f245c006010 tx=0x7f245c0042f0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 shutdown_connections 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246c10c170 0x7f246c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f246c103660 0x7f246c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f24540a2c90 0x7f24540a5150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 --2- 172.21.15.60:0/461132351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f246c102d40 0x7f246c1984f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:34.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 >> 172.21.15.60:0/461132351 conn(0x7f246c0fc7a0 msgr2=0x7f246c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:34.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 shutdown_connections 2024-09-11T23:58:34.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:34.838+0000 7f2472da9640 1 -- 172.21.15.60:0/461132351 wait complete. 2024-09-11T23:58:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:35 smithi060 ceph-mon[30953]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:58:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:58:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:35 smithi060 ceph-mon[30953]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:35 smithi105 ceph-mon[34805]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:35.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:58:35.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:58:35.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:35 smithi105 ceph-mon[34805]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:35 smithi192 ceph-mon[35487]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:58:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:58:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:35 smithi192 ceph-mon[35487]: from='mgr.14150 172.21.15.60:0/930726748' entity='mgr.x' 2024-09-11T23:58:35.536 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-11T23:58:33.383462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657967,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":662,"num_read_kb":453,"num_write":426,"num_write_kb":3074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368660,"kb_used_data":11088,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573164,"statfs":{"total":1151940427776,"available":1151562919936,"internally_reserved":0,"allocated":11354112,"data_stored":7169733,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003257"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488874+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:57:40.488874+0000","last_peered":"2024-09-11T23:57:40.488874+0000","last_clean":"2024-09-11T23:57:40.488874+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:57:40.488874+0000","last_undegraded":"2024-09-11T23:57:40.488874+0000","last_fullsized":"2024-09-11T23:57:40.488874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799409+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:57:40.799409+0000","last_peered":"2024-09-11T23:57:40.799409+0000","last_clean":"2024-09-11T23:57:40.799409+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:57:40.799409+0000","last_undegraded":"2024-09-11T23:57:40.799409+0000","last_fullsized":"2024-09-11T23:57:40.799409+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799455+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:57:40.799455+0000","last_peered":"2024-09-11T23:57:40.799455+0000","last_clean":"2024-09-11T23:57:40.799455+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:57:40.799455+0000","last_undegraded":"2024-09-11T23:57:40.799455+0000","last_fullsized":"2024-09-11T23:57:40.799455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488696+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:57:40.488696+0000","last_peered":"2024-09-11T23:57:40.488696+0000","last_clean":"2024-09-11T23:57:40.488696+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:57:40.488696+0000","last_undegraded":"2024-09-11T23:57:40.488696+0000","last_fullsized":"2024-09-11T23:57:40.488696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491218+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:57:40.491218+0000","last_peered":"2024-09-11T23:57:40.491218+0000","last_clean":"2024-09-11T23:57:40.491218+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:57:40.491218+0000","last_undegraded":"2024-09-11T23:57:40.491218+0000","last_fullsized":"2024-09-11T23:57:40.491218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799682+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:57:40.799682+0000","last_peered":"2024-09-11T23:57:40.799682+0000","last_clean":"2024-09-11T23:57:40.799682+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:57:40.799682+0000","last_undegraded":"2024-09-11T23:57:40.799682+0000","last_fullsized":"2024-09-11T23:57:40.799682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489139+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:57:40.489139+0000","last_peered":"2024-09-11T23:57:40.489139+0000","last_clean":"2024-09-11T23:57:40.489139+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:57:40.489139+0000","last_undegraded":"2024-09-11T23:57:40.489139+0000","last_fullsized":"2024-09-11T23:57:40.489139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488986+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:57:40.488986+0000","last_peered":"2024-09-11T23:57:40.488986+0000","last_clean":"2024-09-11T23:57:40.488986+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:57:40.488986+0000","last_undegraded":"2024-09-11T23:57:40.488986+0000","last_fullsized":"2024-09-11T23:57:40.488986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800714+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:57:40.800714+0000","last_peered":"2024-09-11T23:57:40.800714+0000","last_clean":"2024-09-11T23:57:40.800714+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:57:40.800714+0000","last_undegraded":"2024-09-11T23:57:40.800714+0000","last_fullsized":"2024-09-11T23:57:40.800714+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800173+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:57:40.800173+0000","last_peered":"2024-09-11T23:57:40.800173+0000","last_clean":"2024-09-11T23:57:40.800173+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:57:40.800173+0000","last_undegraded":"2024-09-11T23:57:40.800173+0000","last_fullsized":"2024-09-11T23:57:40.800173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488801+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:57:40.488801+0000","last_peered":"2024-09-11T23:57:40.488801+0000","last_clean":"2024-09-11T23:57:40.488801+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:57:40.488801+0000","last_undegraded":"2024-09-11T23:57:40.488801+0000","last_fullsized":"2024-09-11T23:57:40.488801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800804+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:57:40.800804+0000","last_peered":"2024-09-11T23:57:40.800804+0000","last_clean":"2024-09-11T23:57:40.800804+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:57:40.800804+0000","last_undegraded":"2024-09-11T23:57:40.800804+0000","last_fullsized":"2024-09-11T23:57:40.800804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487617+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:57:40.487617+0000","last_peered":"2024-09-11T23:57:40.487617+0000","last_clean":"2024-09-11T23:57:40.487617+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:57:40.487617+0000","last_undegraded":"2024-09-11T23:57:40.487617+0000","last_fullsized":"2024-09-11T23:57:40.487617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799293+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:57:40.799293+0000","last_peered":"2024-09-11T23:57:40.799293+0000","last_clean":"2024-09-11T23:57:40.799293+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:57:40.799293+0000","last_undegraded":"2024-09-11T23:57:40.799293+0000","last_fullsized":"2024-09-11T23:57:40.799293+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799209+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:57:40.799209+0000","last_peered":"2024-09-11T23:57:40.799209+0000","last_clean":"2024-09-11T23:57:40.799209+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:57:40.799209+0000","last_undegraded":"2024-09-11T23:57:40.799209+0000","last_fullsized":"2024-09-11T23:57:40.799209+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800297+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:57:40.800297+0000","last_peered":"2024-09-11T23:57:40.800297+0000","last_clean":"2024-09-11T23:57:40.800297+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:57:40.800297+0000","last_undegraded":"2024-09-11T23:57:40.800297+0000","last_fullsized":"2024-09-11T23:57:40.800297+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489035+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:57:40.489035+0000","last_peered":"2024-09-11T23:57:40.489035+0000","last_clean":"2024-09-11T23:57:40.489035+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:57:40.489035+0000","last_undegraded":"2024-09-11T23:57:40.489035+0000","last_fullsized":"2024-09-11T23:57:40.489035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491181+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:57:40.491181+0000","last_peered":"2024-09-11T23:57:40.491181+0000","last_clean":"2024-09-11T23:57:40.491181+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:57:40.491181+0000","last_undegraded":"2024-09-11T23:57:40.491181+0000","last_fullsized":"2024-09-11T23:57:40.491181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489817+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:57:40.489817+0000","last_peered":"2024-09-11T23:57:40.489817+0000","last_clean":"2024-09-11T23:57:40.489817+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:57:40.489817+0000","last_undegraded":"2024-09-11T23:57:40.489817+0000","last_fullsized":"2024-09-11T23:57:40.489817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488148+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:57:40.488148+0000","last_peered":"2024-09-11T23:57:40.488148+0000","last_clean":"2024-09-11T23:57:40.488148+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:57:40.488148+0000","last_undegraded":"2024-09-11T23:57:40.488148+0000","last_fullsized":"2024-09-11T23:57:40.488148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487703+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:57:40.487703+0000","last_peered":"2024-09-11T23:57:40.487703+0000","last_clean":"2024-09-11T23:57:40.487703+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:57:40.487703+0000","last_undegraded":"2024-09-11T23:57:40.487703+0000","last_fullsized":"2024-09-11T23:57:40.487703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800467+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:57:40.800467+0000","last_peered":"2024-09-11T23:57:40.800467+0000","last_clean":"2024-09-11T23:57:40.800467+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:57:40.800467+0000","last_undegraded":"2024-09-11T23:57:40.800467+0000","last_fullsized":"2024-09-11T23:57:40.800467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489186+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:57:40.489186+0000","last_peered":"2024-09-11T23:57:40.489186+0000","last_clean":"2024-09-11T23:57:40.489186+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:57:40.489186+0000","last_undegraded":"2024-09-11T23:57:40.489186+0000","last_fullsized":"2024-09-11T23:57:40.489186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491160+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:57:40.491160+0000","last_peered":"2024-09-11T23:57:40.491160+0000","last_clean":"2024-09-11T23:57:40.491160+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:57:40.491160+0000","last_undegraded":"2024-09-11T23:57:40.491160+0000","last_fullsized":"2024-09-11T23:57:40.491160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489537+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:57:40.489537+0000","last_peered":"2024-09-11T23:57:40.489537+0000","last_clean":"2024-09-11T23:57:40.489537+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:57:40.489537+0000","last_undegraded":"2024-09-11T23:57:40.489537+0000","last_fullsized":"2024-09-11T23:57:40.489537+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490110+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:57:40.490110+0000","last_peered":"2024-09-11T23:57:40.490110+0000","last_clean":"2024-09-11T23:57:40.490110+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:57:40.490110+0000","last_undegraded":"2024-09-11T23:57:40.490110+0000","last_fullsized":"2024-09-11T23:57:40.490110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488877+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:57:40.488877+0000","last_peered":"2024-09-11T23:57:40.488877+0000","last_clean":"2024-09-11T23:57:40.488877+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:57:40.488877+0000","last_undegraded":"2024-09-11T23:57:40.488877+0000","last_fullsized":"2024-09-11T23:57:40.488877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487540+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:57:40.487540+0000","last_peered":"2024-09-11T23:57:40.487540+0000","last_clean":"2024-09-11T23:57:40.487540+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:57:40.487540+0000","last_undegraded":"2024-09-11T23:57:40.487540+0000","last_fullsized":"2024-09-11T23:57:40.487540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:57:40.799410+0000","last_peered":"2024-09-11T23:57:40.799410+0000","last_clean":"2024-09-11T23:57:40.799410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:57:40.799410+0000","last_undegraded":"2024-09-11T23:57:40.799410+0000","last_fullsized":"2024-09-11T23:57:40.799410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489720+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:57:40.489720+0000","last_peered":"2024-09-11T23:57:40.489720+0000","last_clean":"2024-09-11T23:57:40.489720+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:57:40.489720+0000","last_undegraded":"2024-09-11T23:57:40.489720+0000","last_fullsized":"2024-09-11T23:57:40.489720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.493188+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:57:40.493188+0000","last_peered":"2024-09-11T23:57:40.493188+0000","last_clean":"2024-09-11T23:57:40.493188+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:57:40.493188+0000","last_undegraded":"2024-09-11T23:57:40.493188+0000","last_fullsized":"2024-09-11T23:57:40.493188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488168+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:57:40.488168+0000","last_peered":"2024-09-11T23:57:40.488168+0000","last_clean":"2024-09-11T23:57:40.488168+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:57:40.488168+0000","last_undegraded":"2024-09-11T23:57:40.488168+0000","last_fullsized":"2024-09-11T23:57:40.488168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491663+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:57:40.491663+0000","last_peered":"2024-09-11T23:57:40.491663+0000","last_clean":"2024-09-11T23:57:40.491663+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:57:40.491663+0000","last_undegraded":"2024-09-11T23:57:40.491663+0000","last_fullsized":"2024-09-11T23:57:40.491663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:31.579801+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:58:31.579801+0000","last_peered":"2024-09-11T23:58:31.579801+0000","last_clean":"2024-09-11T23:58:31.579801+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:58:31.579801+0000","last_undegraded":"2024-09-11T23:58:31.579801+0000","last_fullsized":"2024-09-11T23:58:31.579801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491546+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:57:40.491546+0000","last_peered":"2024-09-11T23:57:40.491546+0000","last_clean":"2024-09-11T23:57:40.491546+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:57:40.491546+0000","last_undegraded":"2024-09-11T23:57:40.491546+0000","last_fullsized":"2024-09-11T23:57:40.491546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799644+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:57:40.799644+0000","last_peered":"2024-09-11T23:57:40.799644+0000","last_clean":"2024-09-11T23:57:40.799644+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:57:40.799644+0000","last_undegraded":"2024-09-11T23:57:40.799644+0000","last_fullsized":"2024-09-11T23:57:40.799644+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487353+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:57:40.487353+0000","last_peered":"2024-09-11T23:57:40.487353+0000","last_clean":"2024-09-11T23:57:40.487353+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:57:40.487353+0000","last_undegraded":"2024-09-11T23:57:40.487353+0000","last_fullsized":"2024-09-11T23:57:40.487353+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489034+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:57:40.489034+0000","last_peered":"2024-09-11T23:57:40.489034+0000","last_clean":"2024-09-11T23:57:40.489034+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:57:40.489034+0000","last_undegraded":"2024-09-11T23:57:40.489034+0000","last_fullsized":"2024-09-11T23:57:40.489034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491451+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:57:40.491451+0000","last_peered":"2024-09-11T23:57:40.491451+0000","last_clean":"2024-09-11T23:57:40.491451+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:57:40.491451+0000","last_undegraded":"2024-09-11T23:57:40.491451+0000","last_fullsized":"2024-09-11T23:57:40.491451+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490361+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:57:40.490361+0000","last_peered":"2024-09-11T23:57:40.490361+0000","last_clean":"2024-09-11T23:57:40.490361+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:57:40.490361+0000","last_undegraded":"2024-09-11T23:57:40.490361+0000","last_fullsized":"2024-09-11T23:57:40.490361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:27.574139+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:58:27.574139+0000","last_peered":"2024-09-11T23:58:27.574139+0000","last_clean":"2024-09-11T23:58:27.574139+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:58:27.574139+0000","last_undegraded":"2024-09-11T23:58:27.574139+0000","last_fullsized":"2024-09-11T23:58:27.574139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800707+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:57:40.800707+0000","last_peered":"2024-09-11T23:57:40.800707+0000","last_clean":"2024-09-11T23:57:40.800707+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:57:40.800707+0000","last_undegraded":"2024-09-11T23:57:40.800707+0000","last_fullsized":"2024-09-11T23:57:40.800707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488921+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:57:40.488921+0000","last_peered":"2024-09-11T23:57:40.488921+0000","last_clean":"2024-09-11T23:57:40.488921+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:57:40.488921+0000","last_undegraded":"2024-09-11T23:57:40.488921+0000","last_fullsized":"2024-09-11T23:57:40.488921+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799598+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:57:40.799598+0000","last_peered":"2024-09-11T23:57:40.799598+0000","last_clean":"2024-09-11T23:57:40.799598+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:57:40.799598+0000","last_undegraded":"2024-09-11T23:57:40.799598+0000","last_fullsized":"2024-09-11T23:57:40.799598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491653+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:57:40.491653+0000","last_peered":"2024-09-11T23:57:40.491653+0000","last_clean":"2024-09-11T23:57:40.491653+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:57:40.491653+0000","last_undegraded":"2024-09-11T23:57:40.491653+0000","last_fullsized":"2024-09-11T23:57:40.491653+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800834+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:57:40.800834+0000","last_peered":"2024-09-11T23:57:40.800834+0000","last_clean":"2024-09-11T23:57:40.800834+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:57:40.800834+0000","last_undegraded":"2024-09-11T23:57:40.800834+0000","last_fullsized":"2024-09-11T23:57:40.800834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:27.573808+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:58:27.573808+0000","last_peered":"2024-09-11T23:58:27.573808+0000","last_clean":"2024-09-11T23:58:27.573808+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:58:27.573808+0000","last_undegraded":"2024-09-11T23:58:27.573808+0000","last_fullsized":"2024-09-11T23:58:27.573808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":109,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491931+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:57:40.491931+0000","last_peered":"2024-09-11T23:57:40.491931+0000","last_clean":"2024-09-11T23:57:40.491931+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:57:40.491931+0000","last_undegraded":"2024-09-11T23:57:40.491931+0000","last_fullsized":"2024-09-11T23:57:40.491931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.513007+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:57:41.513007+0000","last_peered":"2024-09-11T23:57:41.513007+0000","last_clean":"2024-09-11T23:57:41.513007+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:57:41.513007+0000","last_undegraded":"2024-09-11T23:57:41.513007+0000","last_fullsized":"2024-09-11T23:57:41.513007+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487257+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:57:40.487257+0000","last_peered":"2024-09-11T23:57:40.487257+0000","last_clean":"2024-09-11T23:57:40.487257+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:57:40.487257+0000","last_undegraded":"2024-09-11T23:57:40.487257+0000","last_fullsized":"2024-09-11T23:57:40.487257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491147+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:57:40.491147+0000","last_peered":"2024-09-11T23:57:40.491147+0000","last_clean":"2024-09-11T23:57:40.491147+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:57:40.491147+0000","last_undegraded":"2024-09-11T23:57:40.491147+0000","last_fullsized":"2024-09-11T23:57:40.491147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491962+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:57:40.491962+0000","last_peered":"2024-09-11T23:57:40.491962+0000","last_clean":"2024-09-11T23:57:40.491962+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:57:40.491962+0000","last_undegraded":"2024-09-11T23:57:40.491962+0000","last_fullsized":"2024-09-11T23:57:40.491962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:27.573782+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:58:27.573782+0000","last_peered":"2024-09-11T23:58:27.573782+0000","last_clean":"2024-09-11T23:58:27.573782+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:58:27.573782+0000","last_undegraded":"2024-09-11T23:58:27.573782+0000","last_fullsized":"2024-09-11T23:58:27.573782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488670+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:57:40.488670+0000","last_peered":"2024-09-11T23:57:40.488670+0000","last_clean":"2024-09-11T23:57:40.488670+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:57:40.488670+0000","last_undegraded":"2024-09-11T23:57:40.488670+0000","last_fullsized":"2024-09-11T23:57:40.488670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491641+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:57:40.491641+0000","last_peered":"2024-09-11T23:57:40.491641+0000","last_clean":"2024-09-11T23:57:40.491641+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:57:40.491641+0000","last_undegraded":"2024-09-11T23:57:40.491641+0000","last_fullsized":"2024-09-11T23:57:40.491641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.490860+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:57:40.490860+0000","last_peered":"2024-09-11T23:57:40.490860+0000","last_clean":"2024-09-11T23:57:40.490860+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:57:40.490860+0000","last_undegraded":"2024-09-11T23:57:40.490860+0000","last_fullsized":"2024-09-11T23:57:40.490860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491899+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:57:40.491899+0000","last_peered":"2024-09-11T23:57:40.491899+0000","last_clean":"2024-09-11T23:57:40.491899+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:57:40.491899+0000","last_undegraded":"2024-09-11T23:57:40.491899+0000","last_fullsized":"2024-09-11T23:57:40.491899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488299+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:57:40.488299+0000","last_peered":"2024-09-11T23:57:40.488299+0000","last_clean":"2024-09-11T23:57:40.488299+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:57:40.488299+0000","last_undegraded":"2024-09-11T23:57:40.488299+0000","last_fullsized":"2024-09-11T23:57:40.488299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.805290+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:57:40.805290+0000","last_peered":"2024-09-11T23:57:40.805290+0000","last_clean":"2024-09-11T23:57:40.805290+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:57:40.805290+0000","last_undegraded":"2024-09-11T23:57:40.805290+0000","last_fullsized":"2024-09-11T23:57:40.805290+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488979+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:57:40.488979+0000","last_peered":"2024-09-11T23:57:40.488979+0000","last_clean":"2024-09-11T23:57:40.488979+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:57:40.488979+0000","last_undegraded":"2024-09-11T23:57:40.488979+0000","last_fullsized":"2024-09-11T23:57:40.488979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491752+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:57:40.491752+0000","last_peered":"2024-09-11T23:57:40.491752+0000","last_clean":"2024-09-11T23:57:40.491752+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:57:40.491752+0000","last_undegraded":"2024-09-11T23:57:40.491752+0000","last_fullsized":"2024-09-11T23:57:40.491752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489696+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:57:40.489696+0000","last_peered":"2024-09-11T23:57:40.489696+0000","last_clean":"2024-09-11T23:57:40.489696+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:57:40.489696+0000","last_undegraded":"2024-09-11T23:57:40.489696+0000","last_fullsized":"2024-09-11T23:57:40.489696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:31.579689+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:58:31.579689+0000","last_peered":"2024-09-11T23:58:31.579689+0000","last_clean":"2024-09-11T23:58:31.579689+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:58:31.579689+0000","last_undegraded":"2024-09-11T23:58:31.579689+0000","last_fullsized":"2024-09-11T23:58:31.579689+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489088+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:57:40.489088+0000","last_peered":"2024-09-11T23:57:40.489088+0000","last_clean":"2024-09-11T23:57:40.489088+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:57:40.489088+0000","last_undegraded":"2024-09-11T23:57:40.489088+0000","last_fullsized":"2024-09-11T23:57:40.489088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":345,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489001+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:57:40.489001+0000","last_peered":"2024-09-11T23:57:40.489001+0000","last_clean":"2024-09-11T23:57:40.489001+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:57:40.489001+0000","last_undegraded":"2024-09-11T23:57:40.489001+0000","last_fullsized":"2024-09-11T23:57:40.489001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.513119+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:57:41.513119+0000","last_peered":"2024-09-11T23:57:41.513119+0000","last_clean":"2024-09-11T23:57:41.513119+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:57:41.513119+0000","last_undegraded":"2024-09-11T23:57:41.513119+0000","last_fullsized":"2024-09-11T23:57:41.513119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489307+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:57:40.489307+0000","last_peered":"2024-09-11T23:57:40.489307+0000","last_clean":"2024-09-11T23:57:40.489307+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:57:40.489307+0000","last_undegraded":"2024-09-11T23:57:40.489307+0000","last_fullsized":"2024-09-11T23:57:40.489307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.498988+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:57:40.498988+0000","last_peered":"2024-09-11T23:57:40.498988+0000","last_clean":"2024-09-11T23:57:40.498988+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:57:40.498988+0000","last_undegraded":"2024-09-11T23:57:40.498988+0000","last_fullsized":"2024-09-11T23:57:40.498988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487248+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:57:40.487248+0000","last_peered":"2024-09-11T23:57:40.487248+0000","last_clean":"2024-09-11T23:57:40.487248+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:57:40.487248+0000","last_undegraded":"2024-09-11T23:57:40.487248+0000","last_fullsized":"2024-09-11T23:57:40.487248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:28.574597+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:58:28.574597+0000","last_peered":"2024-09-11T23:58:28.574597+0000","last_clean":"2024-09-11T23:58:28.574597+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:58:28.574597+0000","last_undegraded":"2024-09-11T23:58:28.574597+0000","last_fullsized":"2024-09-11T23:58:28.574597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491275+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:57:40.491275+0000","last_peered":"2024-09-11T23:57:40.491275+0000","last_clean":"2024-09-11T23:57:40.491275+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:57:40.491275+0000","last_undegraded":"2024-09-11T23:57:40.491275+0000","last_fullsized":"2024-09-11T23:57:40.491275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:26.572371+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:58:26.572371+0000","last_peered":"2024-09-11T23:58:26.572371+0000","last_clean":"2024-09-11T23:58:26.572371+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:58:26.572371+0000","last_undegraded":"2024-09-11T23:58:26.572371+0000","last_fullsized":"2024-09-11T23:58:26.572371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799994+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:57:40.799994+0000","last_peered":"2024-09-11T23:57:40.799994+0000","last_clean":"2024-09-11T23:57:40.799994+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:57:40.799994+0000","last_undegraded":"2024-09-11T23:57:40.799994+0000","last_fullsized":"2024-09-11T23:57:40.799994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491288+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:57:40.491288+0000","last_peered":"2024-09-11T23:57:40.491288+0000","last_clean":"2024-09-11T23:57:40.491288+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:57:40.491288+0000","last_undegraded":"2024-09-11T23:57:40.491288+0000","last_fullsized":"2024-09-11T23:57:40.491288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800126+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:57:40.800126+0000","last_peered":"2024-09-11T23:57:40.800126+0000","last_clean":"2024-09-11T23:57:40.800126+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:57:40.800126+0000","last_undegraded":"2024-09-11T23:57:40.800126+0000","last_fullsized":"2024-09-11T23:57:40.800126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.492087+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:57:40.492087+0000","last_peered":"2024-09-11T23:57:40.492087+0000","last_clean":"2024-09-11T23:57:40.492087+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:57:40.492087+0000","last_undegraded":"2024-09-11T23:57:40.492087+0000","last_fullsized":"2024-09-11T23:57:40.492087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.487615+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:57:40.487615+0000","last_peered":"2024-09-11T23:57:40.487615+0000","last_clean":"2024-09-11T23:57:40.487615+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:57:40.487615+0000","last_undegraded":"2024-09-11T23:57:40.487615+0000","last_fullsized":"2024-09-11T23:57:40.487615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:52.438068+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:57:52.438068+0000","last_peered":"2024-09-11T23:57:52.438068+0000","last_clean":"2024-09-11T23:57:52.438068+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:57:52.438068+0000","last_undegraded":"2024-09-11T23:57:52.438068+0000","last_fullsized":"2024-09-11T23:57:52.438068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489719+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:57:40.489719+0000","last_peered":"2024-09-11T23:57:40.489719+0000","last_clean":"2024-09-11T23:57:40.489719+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:57:40.489719+0000","last_undegraded":"2024-09-11T23:57:40.489719+0000","last_fullsized":"2024-09-11T23:57:40.489719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488806+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:57:40.488806+0000","last_peered":"2024-09-11T23:57:40.488806+0000","last_clean":"2024-09-11T23:57:40.488806+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:57:40.488806+0000","last_undegraded":"2024-09-11T23:57:40.488806+0000","last_fullsized":"2024-09-11T23:57:40.488806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799613+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:57:40.799613+0000","last_peered":"2024-09-11T23:57:40.799613+0000","last_clean":"2024-09-11T23:57:40.799613+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:57:40.799613+0000","last_undegraded":"2024-09-11T23:57:40.799613+0000","last_fullsized":"2024-09-11T23:57:40.799613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800369+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:57:40.800369+0000","last_peered":"2024-09-11T23:57:40.800369+0000","last_clean":"2024-09-11T23:57:40.800369+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:57:40.800369+0000","last_undegraded":"2024-09-11T23:57:40.800369+0000","last_fullsized":"2024-09-11T23:57:40.800369+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491088+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:57:40.491088+0000","last_peered":"2024-09-11T23:57:40.491088+0000","last_clean":"2024-09-11T23:57:40.491088+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:57:40.491088+0000","last_undegraded":"2024-09-11T23:57:40.491088+0000","last_fullsized":"2024-09-11T23:57:40.491088+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489374+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:57:40.489374+0000","last_peered":"2024-09-11T23:57:40.489374+0000","last_clean":"2024-09-11T23:57:40.489374+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:57:40.489374+0000","last_undegraded":"2024-09-11T23:57:40.489374+0000","last_fullsized":"2024-09-11T23:57:40.489374+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.488316+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:57:40.488316+0000","last_peered":"2024-09-11T23:57:40.488316+0000","last_clean":"2024-09-11T23:57:40.488316+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:57:40.488316+0000","last_undegraded":"2024-09-11T23:57:40.488316+0000","last_fullsized":"2024-09-11T23:57:40.488316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489841+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:57:40.489841+0000","last_peered":"2024-09-11T23:57:40.489841+0000","last_clean":"2024-09-11T23:57:40.489841+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:57:40.489841+0000","last_undegraded":"2024-09-11T23:57:40.489841+0000","last_fullsized":"2024-09-11T23:57:40.489841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489180+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:57:40.489180+0000","last_peered":"2024-09-11T23:57:40.489180+0000","last_clean":"2024-09-11T23:57:40.489180+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:57:40.489180+0000","last_undegraded":"2024-09-11T23:57:40.489180+0000","last_fullsized":"2024-09-11T23:57:40.489180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491384+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:57:40.491384+0000","last_peered":"2024-09-11T23:57:40.491384+0000","last_clean":"2024-09-11T23:57:40.491384+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:57:40.491384+0000","last_undegraded":"2024-09-11T23:57:40.491384+0000","last_fullsized":"2024-09-11T23:57:40.491384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489563+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:57:40.489563+0000","last_peered":"2024-09-11T23:57:40.489563+0000","last_clean":"2024-09-11T23:57:40.489563+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:57:40.489563+0000","last_undegraded":"2024-09-11T23:57:40.489563+0000","last_fullsized":"2024-09-11T23:57:40.489563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491508+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:57:40.491508+0000","last_peered":"2024-09-11T23:57:40.491508+0000","last_clean":"2024-09-11T23:57:40.491508+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:57:40.491508+0000","last_undegraded":"2024-09-11T23:57:40.491508+0000","last_fullsized":"2024-09-11T23:57:40.491508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.491868+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:57:40.491868+0000","last_peered":"2024-09-11T23:57:40.491868+0000","last_clean":"2024-09-11T23:57:40.491868+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:57:40.491868+0000","last_undegraded":"2024-09-11T23:57:40.491868+0000","last_fullsized":"2024-09-11T23:57:40.491868+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.800371+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:57:40.800371+0000","last_peered":"2024-09-11T23:57:40.800371+0000","last_clean":"2024-09-11T23:57:40.800371+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:57:40.800371+0000","last_undegraded":"2024-09-11T23:57:40.800371+0000","last_fullsized":"2024-09-11T23:57:40.800371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:41.512639+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:57:41.512639+0000","last_peered":"2024-09-11T23:57:41.512639+0000","last_clean":"2024-09-11T23:57:41.512639+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:57:41.512639+0000","last_undegraded":"2024-09-11T23:57:41.512639+0000","last_fullsized":"2024-09-11T23:57:41.512639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.799601+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:57:40.799601+0000","last_peered":"2024-09-11T23:57:40.799601+0000","last_clean":"2024-09-11T23:57:40.799601+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:57:40.799601+0000","last_undegraded":"2024-09-11T23:57:40.799601+0000","last_fullsized":"2024-09-11T23:57:40.799601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489988+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:57:40.489988+0000","last_peered":"2024-09-11T23:57:40.489988+0000","last_clean":"2024-09-11T23:57:40.489988+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:57:40.489988+0000","last_undegraded":"2024-09-11T23:57:40.489988+0000","last_fullsized":"2024-09-11T23:57:40.489988+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:57:40.489745+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:57:40.489745+0000","last_peered":"2024-09-11T23:57:40.489745+0000","last_clean":"2024-09-11T23:57:40.489745+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:57:40.489745+0000","last_undegraded":"2024-09-11T23:57:40.489745+0000","last_fullsized":"2024-09-11T23:57:40.489745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-11T23:58:28.574393+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:58:28.574393+0000","last_peered":"2024-09-11T23:58:28.574393+0000","last_clean":"2024-09-11T23:58:28.574393+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:58:28.574393+0000","last_undegraded":"2024-09-11T23:58:28.574393+0000","last_fullsized":"2024-09-11T23:58:28.574393+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67365,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":526,"num_read_kb":334,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285260,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":434178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":1085364,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":434108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201320,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":434486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430253,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1027792,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":434218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1026684,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":435094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":433650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":494100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":494895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":435164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34635,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:58:35.541 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:58:35.541 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T23:58:35.541 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T23:58:35.541 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T23:58:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:36.179 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:36 smithi060 ceph-mon[30953]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:36.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 -- 172.21.15.60:0/2000764605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 msgr2=0x7fce6c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:36.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 --2- 172.21.15.60:0/2000764605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 0x7fce6c103120 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009900 tx=0x7fce5c02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 -- 172.21.15.60:0/2000764605 shutdown_connections 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 --2- 172.21.15.60:0/2000764605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce6c10c170 0x7fce6c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 --2- 172.21.15.60:0/2000764605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce6c103660 0x7fce6c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 --2- 172.21.15.60:0/2000764605 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 0x7fce6c103120 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 -- 172.21.15.60:0/2000764605 >> 172.21.15.60:0/2000764605 conn(0x7fce6c0fc7a0 msgr2=0x7fce6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 -- 172.21.15.60:0/2000764605 shutdown_connections 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.257+0000 7fce70b4c640 1 -- 172.21.15.60:0/2000764605 wait complete. 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce70b4c640 1 Processor -- start 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce70b4c640 1 -- start start 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce70b4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 0x7fce6c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce70b4c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce6c103660 0x7fce6c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce70b4c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce6c10c170 0x7fce6c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce70b4c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c112160 con 0x7fce6c102d40 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce70b4c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c111fe0 con 0x7fce6c10c170 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce70b4c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce6c1122e0 con 0x7fce6c103660 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 0x7fce6c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 0x7fce6c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44372/0 (socket says 172.21.15.60:44372) 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce6a59c640 1 -- 172.21.15.60:0/3539999276 learned_addr learned my addr 172.21.15.60:0/3539999276 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce69d9b640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce6c103660 0x7fce6c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.258+0000 7fce6ad9d640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce6c10c170 0x7fce6c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce6a59c640 1 -- 172.21.15.60:0/3539999276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce6c103660 msgr2=0x7fce6c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce6a59c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce6c103660 0x7fce6c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce6a59c640 1 -- 172.21.15.60:0/3539999276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce6c10c170 msgr2=0x7fce6c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce6a59c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce6c10c170 0x7fce6c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce6a59c640 1 -- 172.21.15.60:0/3539999276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c19d530 con 0x7fce6c102d40 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce6ad9d640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce6c10c170 0x7fce6c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce6a59c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 0x7fce6c198580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fce5c004770 tx=0x7fce5c032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce5b7fe640 1 -- 172.21.15.60:0/3539999276 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c03f030 con 0x7fce6c102d40 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce5b7fe640 1 -- 172.21.15.60:0/3539999276 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce5c003d00 con 0x7fce6c102d40 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6c19d7c0 con 0x7fce6c102d40 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce5b7fe640 1 -- 172.21.15.60:0/3539999276 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c035070 con 0x7fce6c102d40 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.259+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6c1a5100 con 0x7fce6c102d40 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.260+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6c06b070 con 0x7fce6c102d40 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.261+0000 7fce5b7fe640 1 -- 172.21.15.60:0/3539999276 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fce5c042030 con 0x7fce6c102d40 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.262+0000 7fce5b7fe640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.262+0000 7fce69d9b640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.262+0000 7fce5b7fe640 1 -- 172.21.15.60:0/3539999276 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fce5c0ef6e0 con 0x7fce6c102d40 2024-09-11T23:58:36.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.262+0000 7fce69d9b640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce6c10d470 tx=0x7fce6000b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:36.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.266+0000 7fce5b7fe640 1 -- 172.21.15.60:0/3539999276 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce5c0bc510 con 0x7fce6c102d40 2024-09-11T23:58:36.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:36 smithi105 ceph-mon[34805]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:36.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.479+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fce6c1a52d0 con 0x7fce6c102d40 2024-09-11T23:58:36.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.479+0000 7fce5b7fe640 1 -- 172.21.15.60:0/3539999276 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fce5c0bbe10 con 0x7fce6c102d40 2024-09-11T23:58:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:36.480 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T23:58:36.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 msgr2=0x7fce540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:36.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce6c10d470 tx=0x7fce6000b2e0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 msgr2=0x7fce6c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:36.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 0x7fce6c198580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fce5c004770 tx=0x7fce5c032c90 comp rx=0 tx=0).stop 2024-09-11T23:58:36.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 shutdown_connections 2024-09-11T23:58:36.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce6c10c170 0x7fce6c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce6c103660 0x7fce6c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fce540a2c10 0x7fce540a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 --2- 172.21.15.60:0/3539999276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce6c102d40 0x7fce6c198580 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:36.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.481+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 >> 172.21.15.60:0/3539999276 conn(0x7fce6c0fc7a0 msgr2=0x7fce6c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:36.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.482+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 shutdown_connections 2024-09-11T23:58:36.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:36.482+0000 7fce70b4c640 1 -- 172.21.15.60:0/3539999276 wait complete. 2024-09-11T23:58:36.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:36 smithi192 ceph-mon[35487]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:58:37.184 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T23:58:37.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:58:37.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:37 smithi060 ceph-mon[30953]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:37.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:37 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3539999276' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:58:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:37 smithi105 ceph-mon[34805]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:37 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3539999276' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:58:37.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:37 smithi192 ceph-mon[35487]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:37.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:37 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3539999276' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-11T23:58:38.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 -- 172.21.15.60:0/4056637571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4102ef0 msgr2=0x7face410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 --2- 172.21.15.60:0/4056637571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4102ef0 0x7face410da40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7facd4009900 tx=0x7facd402a480 comp rx=0 tx=0).stop 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 -- 172.21.15.60:0/4056637571 shutdown_connections 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 --2- 172.21.15.60:0/4056637571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4102ef0 0x7face410da40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 --2- 172.21.15.60:0/4056637571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face4102570 0x7face41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 --2- 172.21.15.60:0/4056637571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4100e20 0x7face4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 -- 172.21.15.60:0/4056637571 >> 172.21.15.60:0/4056637571 conn(0x7face40fc7d0 msgr2=0x7face40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 -- 172.21.15.60:0/4056637571 shutdown_connections 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.003+0000 7face8838640 1 -- 172.21.15.60:0/4056637571 wait complete. 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face8838640 1 Processor -- start 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face8838640 1 -- start start 2024-09-11T23:58:38.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face8838640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4100e20 0x7face4197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face8838640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face4102570 0x7face41978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face8838640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4102ef0 0x7face419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face8838640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7face41110a0 con 0x7face4100e20 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face8838640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7face4110f20 con 0x7face4102570 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face8838640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7face4111220 con 0x7face4102ef0 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4100e20 0x7face4197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4100e20 0x7face4197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44388/0 (socket says 172.21.15.60:44388) 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face259c640 1 -- 172.21.15.60:0/3333481819 learned_addr learned my addr 172.21.15.60:0/3333481819 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.004+0000 7face1d9b640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face4102570 0x7face41978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face2d9d640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4102ef0 0x7face419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face259c640 1 -- 172.21.15.60:0/3333481819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4102ef0 msgr2=0x7face419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face259c640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4102ef0 0x7face419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face259c640 1 -- 172.21.15.60:0/3333481819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face4102570 msgr2=0x7face41978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face259c640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face4102570 0x7face41978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face259c640 1 -- 172.21.15.60:0/3333481819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face419c330 con 0x7face4100e20 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face259c640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4100e20 0x7face4197380 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7facdc00cce0 tx=0x7facdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7facdb7fe640 1 -- 172.21.15.60:0/3333481819 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc00f650 con 0x7face4100e20 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7facdb7fe640 1 -- 172.21.15.60:0/3333481819 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7facdc00fcf0 con 0x7face4100e20 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face419c620 con 0x7face4100e20 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7facdb7fe640 1 -- 172.21.15.60:0/3333481819 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc018d20 con 0x7face4100e20 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.005+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face41a3f00 con 0x7face4100e20 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.006+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face4101200 con 0x7face4100e20 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.007+0000 7facdb7fe640 1 -- 172.21.15.60:0/3333481819 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7facdc00f7f0 con 0x7face4100e20 2024-09-11T23:58:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.008+0000 7facdb7fe640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7facd00a2c10 0x7facd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:38.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.008+0000 7face1d9b640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7facd00a2c10 0x7facd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:38.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.008+0000 7facdb7fe640 1 -- 172.21.15.60:0/3333481819 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7facdc0cf760 con 0x7face4100e20 2024-09-11T23:58:38.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.008+0000 7face1d9b640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7facd00a2c10 0x7facd00a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7face40feca0 tx=0x7faccc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:38.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.012+0000 7facdb7fe640 1 -- 172.21.15.60:0/3333481819 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facdc014030 con 0x7face4100e20 2024-09-11T23:58:38.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.224+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7face41a40d0 con 0x7face4100e20 2024-09-11T23:58:38.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.225+0000 7facdb7fe640 1 -- 172.21.15.60:0/3333481819 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7facdc09c530 con 0x7face4100e20 2024-09-11T23:58:38.225 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:38.225 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"btime":"2024-09-11T23:57:41:505965+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:57:41.505953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-11T23:58:38.226 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7facd00a2c10 msgr2=0x7facd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7facd00a2c10 0x7facd00a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7face40feca0 tx=0x7faccc005f90 comp rx=0 tx=0).stop 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4100e20 msgr2=0x7face4197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4100e20 0x7face4197380 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7facdc00cce0 tx=0x7facdc00a620 comp rx=0 tx=0).stop 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 shutdown_connections 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7face4102ef0 0x7face419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7face4102570 0x7face41978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7facd00a2c10 0x7facd00a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 --2- 172.21.15.60:0/3333481819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7face4100e20 0x7face4197380 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 >> 172.21.15.60:0/3333481819 conn(0x7face40fc7d0 msgr2=0x7face40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 shutdown_connections 2024-09-11T23:58:38.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:38.229+0000 7face8838640 1 -- 172.21.15.60:0/3333481819 wait complete. 2024-09-11T23:58:38.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:58:39.188 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:39.309 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:39 smithi060 ceph-mon[30953]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:39.309 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:39 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3333481819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:39.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:39 smithi105 ceph-mon[34805]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:39.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:39 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3333481819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:39.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:39 smithi192 ceph-mon[35487]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:39.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:39 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3333481819' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 -- 172.21.15.60:0/164879062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100e30 msgr2=0x7fdad4104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 --2- 172.21.15.60:0/164879062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100e30 0x7fdad4104e80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009ca0 tx=0x7fdac802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 -- 172.21.15.60:0/164879062 shutdown_connections 2024-09-11T23:58:39.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 --2- 172.21.15.60:0/164879062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdad41055b0 0x7fdad410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 --2- 172.21.15.60:0/164879062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100e30 0x7fdad4104e80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 --2- 172.21.15.60:0/164879062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdad4100480 0x7fdad4100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 -- 172.21.15.60:0/164879062 >> 172.21.15.60:0/164879062 conn(0x7fdad4077210 msgr2=0x7fdad40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 -- 172.21.15.60:0/164879062 shutdown_connections 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.679+0000 7fdad88f4640 1 -- 172.21.15.60:0/164879062 wait complete. 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad88f4640 1 Processor -- start 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad88f4640 1 -- start start 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad88f4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100480 0x7fdad4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad88f4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdad4100e30 0x7fdad4199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad88f4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdad41055b0 0x7fdad41a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad88f4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdad41106f0 con 0x7fdad4100480 2024-09-11T23:58:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad88f4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdad4110570 con 0x7fdad41055b0 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad88f4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdad4110870 con 0x7fdad4100e30 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100480 0x7fdad4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100480 0x7fdad4199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44404/0 (socket says 172.21.15.60:44404) 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad259c640 1 -- 172.21.15.60:0/2517379861 learned_addr learned my addr 172.21.15.60:0/2517379861 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad1d9b640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdad4100e30 0x7fdad4199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.680+0000 7fdad2d9d640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdad41055b0 0x7fdad41a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdad259c640 1 -- 172.21.15.60:0/2517379861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdad4100e30 msgr2=0x7fdad4199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdad259c640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdad4100e30 0x7fdad4199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdad259c640 1 -- 172.21.15.60:0/2517379861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdad41055b0 msgr2=0x7fdad41a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdad259c640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdad41055b0 0x7fdad41a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdad259c640 1 -- 172.21.15.60:0/2517379861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad41a4900 con 0x7fdad4100480 2024-09-11T23:58:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdad259c640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100480 0x7fdad4199340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c920 tx=0x7fdac400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdac37fe640 1 -- 172.21.15.60:0/2517379861 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4007c70 con 0x7fdad4100480 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdac37fe640 1 -- 172.21.15.60:0/2517379861 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdac4007e10 con 0x7fdad4100480 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad41a4ad0 con 0x7fdad4100480 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdac37fe640 1 -- 172.21.15.60:0/2517379861 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4018940 con 0x7fdad4100480 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.681+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad41a4fe0 con 0x7fdad4100480 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.682+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad4100860 con 0x7fdad4100480 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.683+0000 7fdac37fe640 1 -- 172.21.15.60:0/2517379861 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdac4018b20 con 0x7fdad4100480 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.684+0000 7fdac37fe640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdabc0a2c10 0x7fdabc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.684+0000 7fdad1d9b640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdabc0a2c10 0x7fdabc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.684+0000 7fdac37fe640 1 -- 172.21.15.60:0/2517379861 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fdac40cf230 con 0x7fdad4100480 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.684+0000 7fdad1d9b640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdabc0a2c10 0x7fdabc0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdad4111a00 tx=0x7fdac8005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.689+0000 7fdac37fe640 1 -- 172.21.15.60:0/2517379861 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdac4014030 con 0x7fdad4100480 2024-09-11T23:58:39.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.901+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdad41a5270 con 0x7fdad4100480 2024-09-11T23:58:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.902+0000 7fdac37fe640 1 -- 172.21.15.60:0/2517379861 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fdac409c060 con 0x7fdad4100480 2024-09-11T23:58:39.902 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:39.902 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"btime":"2024-09-11T23:57:41:505965+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:57:41.505953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-11T23:58:39.902 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-09-11T23:58:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdabc0a2c10 msgr2=0x7fdabc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdabc0a2c10 0x7fdabc0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdad4111a00 tx=0x7fdac8005f70 comp rx=0 tx=0).stop 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100480 msgr2=0x7fdad4199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100480 0x7fdad4199340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c920 tx=0x7fdac400cde0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 shutdown_connections 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdad41055b0 0x7fdad41a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdad4100e30 0x7fdad4199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fdabc0a2c10 0x7fdabc0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 --2- 172.21.15.60:0/2517379861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdad4100480 0x7fdad4199340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 >> 172.21.15.60:0/2517379861 conn(0x7fdad4077210 msgr2=0x7fdad4104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 shutdown_connections 2024-09-11T23:58:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:39.904+0000 7fdad88f4640 1 -- 172.21.15.60:0/2517379861 wait complete. 2024-09-11T23:58:40.228 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:40 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2517379861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:40.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:40 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2517379861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:40.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:40 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2517379861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:40.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:58:40.800 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:41.192 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:41 smithi060 ceph-mon[30953]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:41.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 -- 172.21.15.60:0/2874288822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930108300 msgr2=0x7ff93010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:41.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 --2- 172.21.15.60:0/2874288822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930108300 0x7ff93010ec70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff928009930 tx=0x7ff92802a420 comp rx=0 tx=0).stop 2024-09-11T23:58:41.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 -- 172.21.15.60:0/2874288822 shutdown_connections 2024-09-11T23:58:41.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 --2- 172.21.15.60:0/2874288822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930108300 0x7ff93010ec70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 --2- 172.21.15.60:0/2874288822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff930103780 0x7ff930107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 --2- 172.21.15.60:0/2874288822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff930102dd0 0x7ff9301031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 -- 172.21.15.60:0/2874288822 >> 172.21.15.60:0/2874288822 conn(0x7ff9300fc7d0 msgr2=0x7ff9300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 -- 172.21.15.60:0/2874288822 shutdown_connections 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 -- 172.21.15.60:0/2874288822 wait complete. 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 Processor -- start 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.276+0000 7ff93760f640 1 -- start start 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff93760f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff930102dd0 0x7ff930198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff93760f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930103780 0x7ff930198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff93760f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff930108300 0x7ff93019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff93760f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff9301121f0 con 0x7ff930103780 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff93760f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff930112070 con 0x7ff930108300 2024-09-11T23:58:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff93760f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff930112370 con 0x7ff930102dd0 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930103780 0x7ff930198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930103780 0x7ff930198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44414/0 (socket says 172.21.15.60:44414) 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 -- 172.21.15.60:0/2972224601 learned_addr learned my addr 172.21.15.60:0/2972224601 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff9353ab640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff930102dd0 0x7ff930198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff935bac640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff930108300 0x7ff93019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 -- 172.21.15.60:0/2972224601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff930102dd0 msgr2=0x7ff930198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff930102dd0 0x7ff930198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 -- 172.21.15.60:0/2972224601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff930108300 msgr2=0x7ff93019cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff930108300 0x7ff93019cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 -- 172.21.15.60:0/2972224601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93019d600 con 0x7ff930103780 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff935bac640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff930108300 0x7ff93019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff934baa640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930103780 0x7ff930198b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d740 tx=0x7ff92400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff92e7fc640 1 -- 172.21.15.60:0/2972224601 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924017070 con 0x7ff930103780 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff92e7fc640 1 -- 172.21.15.60:0/2972224601 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff92400de50 con 0x7ff930103780 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.277+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93019d8f0 con 0x7ff930103780 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.278+0000 7ff92e7fc640 1 -- 172.21.15.60:0/2972224601 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92400f740 con 0x7ff930103780 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.278+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9301a51d0 con 0x7ff930103780 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.278+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9301031b0 con 0x7ff930103780 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.280+0000 7ff92e7fc640 1 -- 172.21.15.60:0/2972224601 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff92401a070 con 0x7ff930103780 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.280+0000 7ff92e7fc640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff9180a2c90 0x7ff9180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.281+0000 7ff9353ab640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff9180a2c90 0x7ff9180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.281+0000 7ff92e7fc640 1 -- 172.21.15.60:0/2972224601 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7ff9240cea40 con 0x7ff930103780 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.281+0000 7ff9353ab640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff9180a2c90 0x7ff9180a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff920007ec0 tx=0x7ff9200075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.284+0000 7ff92e7fc640 1 -- 172.21.15.60:0/2972224601 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff92409b8f0 con 0x7ff930103780 2024-09-11T23:58:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.461+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9301a53a0 con 0x7ff930103780 2024-09-11T23:58:41.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.463+0000 7ff92e7fc640 1 -- 172.21.15.60:0/2972224601 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22645 (secure 0 0 0) 0x7ff92409b1f0 con 0x7ff930103780 2024-09-11T23:58:41.462 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:41.463 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":82,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:57:40.484442+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.465+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff9180a2c90 msgr2=0x7ff9180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.465+0000 7ff93760f640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff9180a2c90 0x7ff9180a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff920007ec0 tx=0x7ff9200075b0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.465+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930103780 msgr2=0x7ff930198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.465+0000 7ff93760f640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930103780 0x7ff930198b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff92400d740 tx=0x7ff92400dc00 comp rx=0 tx=0).stop 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.466+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 shutdown_connections 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.466+0000 7ff93760f640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff930108300 0x7ff93019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.466+0000 7ff93760f640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff9180a2c90 0x7ff9180a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.466+0000 7ff93760f640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff930103780 0x7ff930198b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.466+0000 7ff93760f640 1 --2- 172.21.15.60:0/2972224601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff930102dd0 0x7ff930198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:41.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.466+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 >> 172.21.15.60:0/2972224601 conn(0x7ff9300fc7d0 msgr2=0x7ff9300fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:41.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.466+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 shutdown_connections 2024-09-11T23:58:41.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:41.466+0000 7ff93760f640 1 -- 172.21.15.60:0/2972224601 wait complete. 2024-09-11T23:58:41.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:41 smithi105 ceph-mon[34805]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:41.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:41 smithi192 ceph-mon[35487]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:42.145 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:58:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:42 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2972224601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:42.403 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:42 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2972224601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:42 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2972224601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:58:42.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 -- 172.21.15.60:0/3622172564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998102790 msgr2=0x7fb9981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 --2- 172.21.15.60:0/3622172564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998102790 0x7fb9981067e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb98c009900 tx=0x7fb98c02a410 comp rx=0 tx=0).stop 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 -- 172.21.15.60:0/3622172564 shutdown_connections 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 --2- 172.21.15.60:0/3622172564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb998106f10 0x7fb99810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 --2- 172.21.15.60:0/3622172564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998102790 0x7fb9981067e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 --2- 172.21.15.60:0/3622172564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb998101de0 0x7fb9981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 -- 172.21.15.60:0/3622172564 >> 172.21.15.60:0/3622172564 conn(0x7fb9980fd8c0 msgr2=0x7fb9980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 -- 172.21.15.60:0/3622172564 shutdown_connections 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.886+0000 7fb99d842640 1 -- 172.21.15.60:0/3622172564 wait complete. 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb99d842640 1 Processor -- start 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb99d842640 1 -- start start 2024-09-11T23:58:42.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb99d842640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998101de0 0x7fb998198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb99d842640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb998102790 0x7fb998198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb99d842640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb998106f10 0x7fb99819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb99d842640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb998112120 con 0x7fb998101de0 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb99d842640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb998111fa0 con 0x7fb998102790 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb99d842640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb9981122a0 con 0x7fb998106f10 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb996ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998101de0 0x7fb998198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb996ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998101de0 0x7fb998198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46936/0 (socket says 172.21.15.60:46936) 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb996ffd640 1 -- 172.21.15.60:0/2528757476 learned_addr learned my addr 172.21.15.60:0/2528757476 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:42.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb9967fc640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb998102790 0x7fb998198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.887+0000 7fb9977fe640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb998106f10 0x7fb99819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb996ffd640 1 -- 172.21.15.60:0/2528757476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb998106f10 msgr2=0x7fb99819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb996ffd640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb998106f10 0x7fb99819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb996ffd640 1 -- 172.21.15.60:0/2528757476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb998102790 msgr2=0x7fb998198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb996ffd640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb998102790 0x7fb998198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb996ffd640 1 -- 172.21.15.60:0/2528757476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99819d530 con 0x7fb998101de0 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb9977fe640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb998106f10 0x7fb99819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb996ffd640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998101de0 0x7fb998198580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb98800ba50 tx=0x7fb98800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb99c840640 1 -- 172.21.15.60:0/2528757476 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988019070 con 0x7fb998101de0 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb99c840640 1 -- 172.21.15.60:0/2528757476 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb98800cbe0 con 0x7fb998101de0 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99819d820 con 0x7fb998101de0 2024-09-11T23:58:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb99c840640 1 -- 172.21.15.60:0/2528757476 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988007770 con 0x7fb998101de0 2024-09-11T23:58:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.888+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9981a5100 con 0x7fb998101de0 2024-09-11T23:58:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.889+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9981021c0 con 0x7fb998101de0 2024-09-11T23:58:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.890+0000 7fb99c840640 1 -- 172.21.15.60:0/2528757476 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb98801c070 con 0x7fb998101de0 2024-09-11T23:58:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.891+0000 7fb99c840640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb9800a2c90 0x7fb9800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.891+0000 7fb9967fc640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb9800a2c90 0x7fb9800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.891+0000 7fb99c840640 1 -- 172.21.15.60:0/2528757476 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fb9880ce660 con 0x7fb998101de0 2024-09-11T23:58:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.891+0000 7fb9967fc640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb9800a2c90 0x7fb9800a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb98c000c00 tx=0x7fb98c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:42.895+0000 7fb99c840640 1 -- 172.21.15.60:0/2528757476 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb98809aef0 con 0x7fb998101de0 2024-09-11T23:58:43.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.106+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb99810a120 con 0x7fb998101de0 2024-09-11T23:58:43.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.106+0000 7fb99c840640 1 -- 172.21.15.60:0/2528757476 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fb98809f1f0 con 0x7fb998101de0 2024-09-11T23:58:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:58:43.106 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"btime":"2024-09-11T23:57:41:505965+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:57:41.505953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-11T23:58:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-09-11T23:58:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb9800a2c90 msgr2=0x7fb9800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb9800a2c90 0x7fb9800a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb98c000c00 tx=0x7fb98c005e80 comp rx=0 tx=0).stop 2024-09-11T23:58:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998101de0 msgr2=0x7fb998198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998101de0 0x7fb998198580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb98800ba50 tx=0x7fb98800bf10 comp rx=0 tx=0).stop 2024-09-11T23:58:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 shutdown_connections 2024-09-11T23:58:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb998106f10 0x7fb99819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb998102790 0x7fb998198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:43.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fb9800a2c90 0x7fb9800a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 --2- 172.21.15.60:0/2528757476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb998101de0 0x7fb998198580 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 >> 172.21.15.60:0/2528757476 conn(0x7fb9980fd8c0 msgr2=0x7fb9980febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 shutdown_connections 2024-09-11T23:58:43.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:43.109+0000 7fb99d842640 1 -- 172.21.15.60:0/2528757476 wait complete. 2024-09-11T23:58:43.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:43 smithi060 ceph-mon[30953]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:43 smithi105 ceph-mon[34805]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:43.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:43 smithi192 ceph-mon[35487]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:43.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:57:29.107465+0000', 'modified': '2024-09-11T23:57:41.505953+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24496, 'mds_1': 24485, 'mds_2': 24484, 'mds_3': 24475, 'mds_4': 24467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14601': {'gid': 14601, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6839/4061424559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 4061424559}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 4061424559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6841/1402291177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6840', 'nonce': 1402291177}, {'type': 'v1', 'addr': '172.21.15.60:6841', 'nonce': 1402291177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6833/967941361', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 967941361}, {'type': 'v1', 'addr': '172.21.15.105:6833', 'nonce': 967941361}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6833/1968112880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 1968112880}, {'type': 'v1', 'addr': '172.21.15.192:6833', 'nonce': 1968112880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6835/3186850870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 3186850870}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 3186850870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.105:6837/2264507638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6836', 'nonce': 2264507638}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 2264507638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6835/968968600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 968968600}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 968968600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6837/1338489089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 1338489089}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 1338489089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.105:6839/525386561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6838', 'nonce': 525386561}, {'type': 'v1', 'addr': '172.21.15.105:6839', 'nonce': 525386561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.192:6839/3310133932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 3310133932}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 3310133932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24496, 'qdb_cluster': [24496, 24485, 24484, 24475, 24467]} 2024-09-11T23:58:43.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-11T23:58:43.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:58:44.020 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:44.077 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:44 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2528757476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:44 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2528757476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/2555772322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 msgr2=0x7fe2c810ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/2555772322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 0x7fe2c810ec50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009cd0 tx=0x7fe2b802a910 comp rx=0 tx=0).stop 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/2555772322 shutdown_connections 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/2555772322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 0x7fe2c810ec50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/2555772322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c8103760 0x7fe2c8107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/2555772322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2c8102db0 0x7fe2c8103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/2555772322 >> 172.21.15.60:0/2555772322 conn(0x7fe2c80fc7d0 msgr2=0x7fe2c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/2555772322 shutdown_connections 2024-09-11T23:58:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/2555772322 wait complete. 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.521+0000 7fe2cd3dd640 1 Processor -- start 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2cd3dd640 1 -- start start 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2cd3dd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2c8102db0 0x7fe2c8100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2cd3dd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c8103760 0x7fe2c8100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2cd3dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 0x7fe2c8101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2cd3dd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c81122b0 con 0x7fe2c81082e0 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2cd3dd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8112130 con 0x7fe2c8103760 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2cd3dd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8112430 con 0x7fe2c8102db0 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 0x7fe2c8101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 0x7fe2c8101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46954/0 (socket says 172.21.15.60:46954) 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c77fe640 1 -- 172.21.15.60:0/3291493189 learned_addr learned my addr 172.21.15.60:0/3291493189 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c8103760 0x7fe2c8100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2c8102db0 0x7fe2c8100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c77fe640 1 -- 172.21.15.60:0/3291493189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2c8102db0 msgr2=0x7fe2c8100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c77fe640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2c8102db0 0x7fe2c8100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c77fe640 1 -- 172.21.15.60:0/3291493189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c8103760 msgr2=0x7fe2c8100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c77fe640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c8103760 0x7fe2c8100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.522+0000 7fe2c77fe640 1 -- 172.21.15.60:0/3291493189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c81a6c90 con 0x7fe2c81082e0 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.523+0000 7fe2c77fe640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 0x7fe2c8101490 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009ca0 tx=0x7fe2b8031710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.523+0000 7fe2bffff640 1 -- 172.21.15.60:0/3291493189 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8003e20 con 0x7fe2c81082e0 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.523+0000 7fe2bffff640 1 -- 172.21.15.60:0/3291493189 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2b8004540 con 0x7fe2c81082e0 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.523+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/3291493189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c81a6f20 con 0x7fe2c81082e0 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.523+0000 7fe2bffff640 1 -- 172.21.15.60:0/3291493189 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b802fe90 con 0x7fe2c81082e0 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.523+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/3291493189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c81a7430 con 0x7fe2c81082e0 2024-09-11T23:58:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.525+0000 7fe2bffff640 1 -- 172.21.15.60:0/3291493189 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe2b80046f0 con 0x7fe2c81082e0 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.525+0000 7fe2cf7b6740 1 Processor -- start 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.525+0000 7fe2cf7b6740 1 -- start start 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd30db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd312f0 0x55f2fcd3b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd3dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcc97090 con 0x55f2fcd309d0 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcc3ea70 con 0x55f2fcd312f0 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcc93050 con 0x55f2fcd3bbb0 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd30db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd30db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46966/0 (socket says 172.21.15.60:46966) 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 -- 172.21.15.60:0/987360003 learned_addr learned my addr 172.21.15.60:0/987360003 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2bffff640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe2b40a2c10 0x7fe2b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd312f0 0x55f2fcd3b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c77fe640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe2b40a2c10 0x7fe2b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 -- 172.21.15.60:0/987360003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 msgr2=0x55f2fcd3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 -- 172.21.15.60:0/987360003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd312f0 msgr2=0x55f2fcd3b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd312f0 0x55f2fcd3b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2bffff640 1 -- 172.21.15.60:0/3291493189 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe2b80f0690 con 0x7fe2c81082e0 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c67fc640 1 -- 172.21.15.60:0/987360003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2fcc4b130 con 0x55f2fcd309d0 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.526+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd312f0 0x55f2fcd3b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.527+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd30db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0006e10 tx=0x7fe2b000b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b939163fc0e5f9af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.527+0000 7fe2bd7fa640 1 -- 172.21.15.60:0/987360003 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00173f0 con 0x55f2fcd309d0 2024-09-11T23:58:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.527+0000 7fe2c77fe640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe2b40a2c10 0x7fe2b40a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80bce60 tx=0x7fe2b8031b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.527+0000 7fe2bd7fa640 1 -- 172.21.15.60:0/987360003 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2b0010040 con 0x55f2fcd309d0 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.527+0000 7fe2bd7fa640 1 -- 172.21.15.60:0/987360003 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0016a20 con 0x55f2fcd309d0 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/987360003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 msgr2=0x55f2fcd30db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd30db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0006e10 tx=0x7fe2b000b400 comp rx=0 tx=0).stop 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/987360003 shutdown_connections 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd312f0 0x55f2fcd3b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/987360003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd30db0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/987360003 >> 172.21.15.60:0/987360003 conn(0x55f2fcd2cf60 msgr2=0x55f2fcd2d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/987360003 shutdown_connections 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/987360003 wait complete. 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- start start 2024-09-11T23:58:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 Processor -- start 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd309d0 0x55f2fcd3b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd38760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd38ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcd3e780 con 0x55f2fcd312f0 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcc51f20 con 0x55f2fcd3bbb0 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcd3e900 con 0x55f2fcd309d0 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.528+0000 7fe2cf7b6740 10 client.0 _ll_register_callbacks cb 0x55f2fcc1b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd38760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd38760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46968/0 (socket says 172.21.15.60:46968) 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 -- 172.21.15.60:0/1140913833 learned_addr learned my addr 172.21.15.60:0/1140913833 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd309d0 0x55f2fcd3b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 -- 172.21.15.60:0/1140913833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd309d0 msgr2=0x55f2fcd3b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd38ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd309d0 0x55f2fcd3b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 -- 172.21.15.60:0/1140913833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 msgr2=0x55f2fcd38ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd38ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 -- 172.21.15.60:0/1140913833 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2fca082b0 con 0x55f2fcd312f0 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd38760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000bf10 tx=0x7fe2c000f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9153d1b3668bd900 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/1140913833 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0019020 con 0x55f2fcd312f0 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/1140913833 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe2c0014660 con 0x55f2fcd312f0 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1140913833 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2b0010040 con 0x55f2fcd312f0 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/1140913833 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2c0014860 con 0x55f2fcd312f0 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2cf7b6740 10 client.14970 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:44.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.529+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1140913833 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2fcd4a130 con 0x55f2fcd312f0 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/1140913833 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2b0010040 con 0x55f2fcd312f0 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/1140913833 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe2c00133c0 con 0x55f2fcd312f0 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2cf7b6740 10 client.14970 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2cf7b6740 10 client.14970 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2cf7b6740 20 client.14970 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f2fcd4c780 0x55f2fcd4dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2cf7b6740 4 client.14970 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1140913833 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2fcca4600 con 0x55f2fcd4c780 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.530+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f2fcd4c780 0x55f2fcd4dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.531+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f2fcd4c780 0x55f2fcd4dbf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=12ea2a13cb38bad6 server_cookie=9c3e726c9e9d4652 in_seq=0 out_seq=0 2024-09-11T23:58:44.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.531+0000 7fe2ae7fc640 10 client.14970 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-11T23:58:44.539 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:44 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2528757476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:58:44.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/1140913833 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2fcca4600 con 0x55f2fcd4c780 2024-09-11T23:58:44.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2ae7fc640 10 client.14970 handle_command_reply: tid=0 2024-09-11T23:58:44.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 client.14970 shutdown 2024-09-11T23:58:44.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1140913833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 msgr2=0x55f2fcd38760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd38760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000bf10 tx=0x7fe2c000f5b0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1140913833 shutdown_connections 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f2fcd4c780 0x55f2fcd4dbf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd38ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd38760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1140913833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd309d0 0x55f2fcd3b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2ae7fc640 0 client.14970 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1140913833 >> 172.21.15.60:0/1140913833 conn(0x55f2fcd2cf60 msgr2=0x55f2fcd32c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1140913833 shutdown_connections 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1140913833 wait complete. 2024-09-11T23:58:44.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.532+0000 7fe2cf7b6740 20 client.14970 trim_cache size 0 max 16384 2024-09-11T23:58:44.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.550+0000 7fe2cf7b6740 1 Processor -- start 2024-09-11T23:58:44.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.550+0000 7fe2cf7b6740 1 -- start start 2024-09-11T23:58:44.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd27ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd312f0 0x55f2fcd37030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd37570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcd4bf30 con 0x55f2fcd309d0 2024-09-11T23:58:44.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcd4c600 con 0x55f2fcd3bbb0 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcd4ccd0 con 0x55f2fcd312f0 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd27ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd27ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46976/0 (socket says 172.21.15.60:46976) 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 -- 172.21.15.60:0/1819140700 learned_addr learned my addr 172.21.15.60:0/1819140700 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/1819140700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd312f0 0x55f2fcd37030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 -- 172.21.15.60:0/1819140700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd312f0 msgr2=0x55f2fcd37030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/1819140700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd312f0 0x55f2fcd37030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 -- 172.21.15.60:0/1819140700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 msgr2=0x55f2fcd37570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/1819140700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd37570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 -- 172.21.15.60:0/1819140700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2fcd397a0 con 0x55f2fcd309d0 2024-09-11T23:58:44.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/1819140700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd27ce0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0016410 tx=0x7fe2b0016660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d65918598d412f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:44.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2bcff9640 1 -- 172.21.15.60:0/1819140700 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0031070 con 0x55f2fcd309d0 2024-09-11T23:58:44.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2bcff9640 1 -- 172.21.15.60:0/1819140700 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2b0016e20 con 0x55f2fcd309d0 2024-09-11T23:58:44.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.551+0000 7fe2bcff9640 1 -- 172.21.15.60:0/1819140700 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0017d60 con 0x55f2fcd309d0 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1819140700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 msgr2=0x55f2fcd27ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1819140700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd27ce0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0016410 tx=0x7fe2b0016660 comp rx=0 tx=0).stop 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1819140700 shutdown_connections 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1819140700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd37570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1819140700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd312f0 0x55f2fcd37030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/1819140700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd309d0 0x55f2fcd27ce0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1819140700 >> 172.21.15.60:0/1819140700 conn(0x55f2fcd2cf60 msgr2=0x55f2fcd38720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1819140700 shutdown_connections 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.552+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/1819140700 wait complete. 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 1 -- start start 2024-09-11T23:58:44.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 1 Processor -- start 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd309d0 0x55f2fcd566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd35530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd35ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcd4da70 con 0x55f2fcd312f0 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcd4d3a0 con 0x55f2fcd309d0 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f2fcd4e140 con 0x55f2fcd3bbb0 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2cf7b6740 10 client.0 _ll_register_callbacks cb 0x7fe2c000b220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd35530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd35530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46984/0 (socket says 172.21.15.60:46984) 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c6ffd640 1 -- 172.21.15.60:0/494753689 learned_addr learned my addr 172.21.15.60:0/494753689 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd309d0 0x55f2fcd566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd35ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c6ffd640 1 -- 172.21.15.60:0/494753689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 msgr2=0x55f2fcd35ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd35ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c6ffd640 1 -- 172.21.15.60:0/494753689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd309d0 msgr2=0x55f2fcd566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd309d0 0x55f2fcd566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c6ffd640 1 -- 172.21.15.60:0/494753689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2fcd36300 con 0x55f2fcd312f0 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.553+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd35ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2c6ffd640 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd35530 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00139d0 tx=0x7fe2c0014460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382dcb2a2c3436b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/494753689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c002d060 con 0x55f2fcd312f0 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/494753689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2b0016e20 con 0x55f2fcd312f0 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/494753689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe2c0013a50 con 0x55f2fcd312f0 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/494753689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2c0019050 con 0x55f2fcd312f0 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2cf7b6740 10 client.14976 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:44.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/494753689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2fcdb6f50 con 0x55f2fcd312f0 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/494753689 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2b0016e20 con 0x55f2fcd312f0 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/494753689 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe2c0027030 con 0x55f2fcd312f0 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2cf7b6740 10 client.14976 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2cf7b6740 10 client.14976 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.554+0000 7fe2cf7b6740 20 client.14976 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.555+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f2fcdbbad0 0x55f2fcdba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.555+0000 7fe2cf7b6740 4 client.14976 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.555+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/494753689 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "status"}) -- 0x55f2fcc9eb10 con 0x55f2fcdbbad0 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.555+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f2fcdbbad0 0x55f2fcdba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.555+0000 7fe2c67fc640 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f2fcdbbad0 0x55f2fcdba7e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=52518aa88587a93e server_cookie=1a4d2175926b2918 in_seq=0 out_seq=0 2024-09-11T23:58:44.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.555+0000 7fe2ae7fc640 10 client.14976 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2ae7fc640 1 -- 172.21.15.60:0/494753689 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f2fcc9eb10 con 0x55f2fcdbbad0 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2ae7fc640 10 client.14976 handle_command_reply: tid=0 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 client.14976 shutdown 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/494753689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 msgr2=0x55f2fcd35530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd35530 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00139d0 tx=0x7fe2c0014460 comp rx=0 tx=0).stop 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/494753689 shutdown_connections 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f2fcd3bbb0 0x55f2fcd35ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2fcd312f0 0x55f2fcd35530 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f2fcdbbad0 0x55f2fcdba7e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 --2- 172.21.15.60:0/494753689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f2fcd309d0 0x55f2fcd566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/494753689 >> 172.21.15.60:0/494753689 conn(0x55f2fcd2cf60 msgr2=0x55f2fcd36f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:44.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2ae7fc640 0 client.14976 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-11T23:58:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/494753689 shutdown_connections 2024-09-11T23:58:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 1 -- 172.21.15.60:0/494753689 wait complete. 2024-09-11T23:58:44.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cf7b6740 20 client.14976 trim_cache size 0 max 16384 2024-09-11T23:58:44.561 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:58:44.561 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:44.561 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 4, 2024-09-11T23:58:44.561 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24467, 2024-09-11T23:58:44.561 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:58:44.562 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:58:44.562 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:58:44.562 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 65.059680486000005, 2024-09-11T23:58:44.562 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:58:44.562 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:58:44.562 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:58:44.562 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 98.21927101 2024-09-11T23:58:44.562 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe2b40a2c10 msgr2=0x7fe2b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe2b40a2c10 0x7fe2b40a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80bce60 tx=0x7fe2b8031b00 comp rx=0 tx=0).stop 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 msgr2=0x7fe2c8101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 0x7fe2c8101490 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009ca0 tx=0x7fe2b8031710 comp rx=0 tx=0).stop 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/3291493189 shutdown_connections 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.556+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe2b40a2c10 0x7fe2b40a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.557+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c81082e0 0x7fe2c8101490 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.557+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c8103760 0x7fe2c8100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.557+0000 7fe2cd3dd640 1 --2- 172.21.15.60:0/3291493189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2c8102db0 0x7fe2c8100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:44.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.557+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/3291493189 >> 172.21.15.60:0/3291493189 conn(0x7fe2c80fc7d0 msgr2=0x7fe2c8106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:44.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.557+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/3291493189 shutdown_connections 2024-09-11T23:58:44.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:44.557+0000 7fe2cd3dd640 1 -- 172.21.15.60:0/3291493189 wait complete. 2024-09-11T23:58:45.327 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:45 smithi060 ceph-mon[30953]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:45.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-11T23:58:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:45 smithi105 ceph-mon[34805]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:45.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:45 smithi192 ceph-mon[35487]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:45.619 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:46.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1375850735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0101de0 msgr2=0x7ff6c01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1375850735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0101de0 0x7ff6c01021c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009900 tx=0x7ff6bc02a410 comp rx=0 tx=0).stop 2024-09-11T23:58:46.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1375850735 shutdown_connections 2024-09-11T23:58:46.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1375850735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6c0106f10 0x7ff6c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1375850735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c0102790 0x7ff6c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1375850735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0101de0 0x7ff6c01021c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1375850735 >> 172.21.15.60:0/1375850735 conn(0x7ff6c00fd8c0 msgr2=0x7ff6c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1375850735 shutdown_connections 2024-09-11T23:58:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.116+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1375850735 wait complete. 2024-09-11T23:58:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c81c0640 1 Processor -- start 2024-09-11T23:58:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c81c0640 1 -- start start 2024-09-11T23:58:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c81c0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c0101de0 0x7ff6c0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c81c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0102790 0x7ff6c0198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c81c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6c0106f10 0x7ff6c019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c81c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c0112090 con 0x7ff6c0102790 2024-09-11T23:58:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c81c0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c0111f10 con 0x7ff6c0106f10 2024-09-11T23:58:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c81c0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c0112210 con 0x7ff6c0101de0 2024-09-11T23:58:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c575b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0102790 0x7ff6c0198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c575b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0102790 0x7ff6c0198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47002/0 (socket says 172.21.15.60:47002) 2024-09-11T23:58:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c575b640 1 -- 172.21.15.60:0/1289112403 learned_addr learned my addr 172.21.15.60:0/1289112403 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.117+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c0101de0 0x7ff6c0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c675d640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6c0106f10 0x7ff6c019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c575b640 1 -- 172.21.15.60:0/1289112403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c0101de0 msgr2=0x7ff6c0198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c575b640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c0101de0 0x7ff6c0198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c575b640 1 -- 172.21.15.60:0/1289112403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6c0106f10 msgr2=0x7ff6c019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c575b640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6c0106f10 0x7ff6c019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c575b640 1 -- 172.21.15.60:0/1289112403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c019d4e0 con 0x7ff6c0102790 2024-09-11T23:58:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c0101de0 0x7ff6c0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:46.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c675d640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6c0106f10 0x7ff6c019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c575b640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0102790 0x7ff6c0198a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000d950 tx=0x7ff6b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6b6ffd640 1 -- 172.21.15.60:0/1289112403 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0017030 con 0x7ff6c0102790 2024-09-11T23:58:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6b6ffd640 1 -- 172.21.15.60:0/1289112403 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6b0004020 con 0x7ff6c0102790 2024-09-11T23:58:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1289112403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c019d7d0 con 0x7ff6c0102790 2024-09-11T23:58:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6b6ffd640 1 -- 172.21.15.60:0/1289112403 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0004a00 con 0x7ff6c0102790 2024-09-11T23:58:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.118+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1289112403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c01a50b0 con 0x7ff6c0102790 2024-09-11T23:58:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.120+0000 7ff6b6ffd640 1 -- 172.21.15.60:0/1289112403 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff6b00041d0 con 0x7ff6c0102790 2024-09-11T23:58:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.120+0000 7ff6ca599740 1 Processor -- start 2024-09-11T23:58:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6ca599740 1 -- start start 2024-09-11T23:58:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dbec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dd03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6ca599740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1d25090 con 0x55c1f1dbe890 2024-09-11T23:58:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6ca599740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1ccca70 con 0x55c1f1dbf1b0 2024-09-11T23:58:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6ca599740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1d21050 con 0x55c1f1dcdfc0 2024-09-11T23:58:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6b6ffd640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff6ac0a2c10 0x7ff6ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6c675d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dbec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6c675d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dbec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47014/0 (socket says 172.21.15.60:47014) 2024-09-11T23:58:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6c675d640 1 -- 172.21.15.60:0/1850782217 learned_addr learned my addr 172.21.15.60:0/1850782217 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6c675d640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff6ac0a2c10 0x7ff6ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6b6ffd640 1 -- 172.21.15.60:0/1289112403 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7ff6b00cec70 con 0x7ff6c0102790 2024-09-11T23:58:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.121+0000 7ff6c575b640 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dd03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6c675d640 1 -- 172.21.15.60:0/1850782217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 msgr2=0x55c1f1dd03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:46.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6c675d640 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dd03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6c675d640 1 -- 172.21.15.60:0/1850782217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 msgr2=0x55c1f1dcda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:46.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6c675d640 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6c675d640 1 -- 172.21.15.60:0/1850782217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1f1cd9130 con 0x55c1f1dbe890 2024-09-11T23:58:46.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:58:46.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6c675d640 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dbec70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8013de0 tx=0x7ff6b8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d1827e6c593fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:46.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6c675d640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff6ac0a2c10 0x7ff6ac0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8010c40 tx=0x7ff6b8015000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6abfff640 1 -- 172.21.15.60:0/1850782217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8010e50 con 0x55c1f1dbe890 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6abfff640 1 -- 172.21.15.60:0/1850782217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6b8013740 con 0x55c1f1dbe890 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.122+0000 7ff6abfff640 1 -- 172.21.15.60:0/1850782217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8005520 con 0x55c1f1dbe890 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 -- 172.21.15.60:0/1850782217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 msgr2=0x55c1f1dbec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dbec70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8013de0 tx=0x7ff6b8010740 comp rx=0 tx=0).stop 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 -- 172.21.15.60:0/1850782217 shutdown_connections 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dd03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 --2- 172.21.15.60:0/1850782217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dbec70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 -- 172.21.15.60:0/1850782217 >> 172.21.15.60:0/1850782217 conn(0x55c1f1dbaf60 msgr2=0x55c1f1dbb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 -- 172.21.15.60:0/1850782217 shutdown_connections 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 -- 172.21.15.60:0/1850782217 wait complete. 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 -- start start 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.123+0000 7ff6ca599740 1 Processor -- start 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dcb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6ca599740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1dd0b30 con 0x55c1f1dbe890 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6ca599740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1cdff20 con 0x55c1f1dcdfc0 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6ca599740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1dd0cb0 con 0x55c1f1dbf1b0 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6ca599740 10 client.0 _ll_register_callbacks cb 0x55c1f1ca9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47030/0 (socket says 172.21.15.60:47030) 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 -- 172.21.15.60:0/2410135799 learned_addr learned my addr 172.21.15.60:0/2410135799 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c675d640 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dcb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c575b640 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 -- 172.21.15.60:0/2410135799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dbf1b0 msgr2=0x55c1f1dcac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 -- 172.21.15.60:0/2410135799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dcdfc0 msgr2=0x55c1f1dcb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dcb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 -- 172.21.15.60:0/2410135799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1f1a962b0 con 0x55c1f1dbe890 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcd930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc033000 tx=0x7ff6bc031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8c382fe14a22fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.124+0000 7ff6a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6a97fa640 1 -- 172.21.15.60:0/2410135799 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc035040 con 0x55c1f1dbe890 2024-09-11T23:58:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6a97fa640 1 -- 172.21.15.60:0/2410135799 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7ff6bc004240 con 0x55c1f1dbe890 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 1 -- 172.21.15.60:0/2410135799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6b8013740 con 0x55c1f1dbe890 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6a97fa640 1 -- 172.21.15.60:0/2410135799 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff6bc04c070 con 0x55c1f1dbe890 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 10 client.14988 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 1 -- 172.21.15.60:0/2410135799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1f1ddc540 con 0x55c1f1dbe890 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6a97fa640 1 -- 172.21.15.60:0/2410135799 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6b8013740 con 0x55c1f1dbe890 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6a97fa640 1 -- 172.21.15.60:0/2410135799 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff6bc004be0 con 0x55c1f1dbe890 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 10 client.14988 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 10 client.14988 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 20 client.14988 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c1f1ddeb40 0x55c1f1ddffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 4 client.14988 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.125+0000 7ff6ca599740 1 -- 172.21.15.60:0/2410135799 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1f1d32600 con 0x55c1f1ddeb40 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.126+0000 7ff6c575b640 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c1f1ddeb40 0x55c1f1ddffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.126+0000 7ff6c575b640 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c1f1ddeb40 0x55c1f1ddffb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a1fe655c016a13f3 server_cookie=dd275a7090ab6b01 in_seq=0 out_seq=0 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.126+0000 7ff6a97fa640 10 client.14988 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6a97fa640 1 -- 172.21.15.60:0/2410135799 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1f1d32600 con 0x55c1f1ddeb40 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6a97fa640 10 client.14988 handle_command_reply: tid=0 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 client.14988 shutdown 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 -- 172.21.15.60:0/2410135799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 msgr2=0x55c1f1dcd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcd930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc033000 tx=0x7ff6bc031980 comp rx=0 tx=0).stop 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 -- 172.21.15.60:0/2410135799 shutdown_connections 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c1f1ddeb40 0x55c1f1ddffb0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dcb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dcac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 --2- 172.21.15.60:0/2410135799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcd930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6a97fa640 0 client.14988 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-11T23:58:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 -- 172.21.15.60:0/2410135799 >> 172.21.15.60:0/2410135799 conn(0x55c1f1dbaf60 msgr2=0x55c1f1dc0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 -- 172.21.15.60:0/2410135799 shutdown_connections 2024-09-11T23:58:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 1 -- 172.21.15.60:0/2410135799 wait complete. 2024-09-11T23:58:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.127+0000 7ff6ca599740 20 client.14988 trim_cache size 0 max 16384 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6ca599740 1 Processor -- start 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6ca599740 1 -- start start 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dc6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dc7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6ca599740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1dde2f0 con 0x55c1f1dbf1b0 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6ca599740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1dde9c0 con 0x55c1f1dbe890 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6ca599740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1ddf090 con 0x55c1f1dcdfc0 2024-09-11T23:58:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6c575b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dc6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6c575b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dc6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47038/0 (socket says 172.21.15.60:47038) 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.145+0000 7ff6c575b640 1 -- 172.21.15.60:0/3538927609 learned_addr learned my addr 172.21.15.60:0/3538927609 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/3538927609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6c575b640 1 -- 172.21.15.60:0/3538927609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 msgr2=0x55c1f1dc7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6c575b640 1 --2- 172.21.15.60:0/3538927609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dc7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6c575b640 1 -- 172.21.15.60:0/3538927609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbe890 msgr2=0x55c1f1dcb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6c575b640 1 --2- 172.21.15.60:0/3538927609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6c575b640 1 -- 172.21.15.60:0/3538927609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1f1dd0ca0 con 0x55c1f1dbf1b0 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6c575b640 1 --2- 172.21.15.60:0/3538927609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dc6130 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0004770 tx=0x7ff6b0097040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57de8ff049ff0dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6ab7fe640 1 -- 172.21.15.60:0/3538927609 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a4010 con 0x55c1f1dbf1b0 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6ab7fe640 1 -- 172.21.15.60:0/3538927609 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6b0005610 con 0x55c1f1dbf1b0 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.146+0000 7ff6ab7fe640 1 -- 172.21.15.60:0/3538927609 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00a3de0 con 0x55c1f1dbf1b0 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 -- 172.21.15.60:0/3538927609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbf1b0 msgr2=0x55c1f1dc6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 --2- 172.21.15.60:0/3538927609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dc6130 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0004770 tx=0x7ff6b0097040 comp rx=0 tx=0).stop 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 -- 172.21.15.60:0/3538927609 shutdown_connections 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 --2- 172.21.15.60:0/3538927609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1dc7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 --2- 172.21.15.60:0/3538927609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1dc6130 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 --2- 172.21.15.60:0/3538927609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbe890 0x55c1f1dcb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 -- 172.21.15.60:0/3538927609 >> 172.21.15.60:0/3538927609 conn(0x55c1f1dbaf60 msgr2=0x55c1f1dc5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 -- 172.21.15.60:0/3538927609 shutdown_connections 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 -- 172.21.15.60:0/3538927609 wait complete. 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 -- start start 2024-09-11T23:58:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.147+0000 7ff6ca599740 1 Processor -- start 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1de1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1de2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1de29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1ddfe30 con 0x55c1f1dbe890 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1ddf760 con 0x55c1f1dbf1b0 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c1f1de0500 con 0x55c1f1dcdfc0 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 10 client.0 _ll_register_callbacks cb 0x7ff6bc009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1de1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1de1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47046/0 (socket says 172.21.15.60:47046) 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 -- 172.21.15.60:0/4201611049 learned_addr learned my addr 172.21.15.60:0/4201611049 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c575b640 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1de2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 -- 172.21.15.60:0/4201611049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 msgr2=0x55c1f1de29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1de29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 -- 172.21.15.60:0/4201611049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 msgr2=0x55c1f1de2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1de2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 -- 172.21.15.60:0/4201611049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1f1de6720 con 0x55c1f1dbe890 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6c5f5c640 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1de1f30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0163e0 tx=0x7ff6bc003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cab22f25c845d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6a97fa640 1 -- 172.21.15.60:0/4201611049 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc035070 con 0x55c1f1dbe890 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6a97fa640 1 -- 172.21.15.60:0/4201611049 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7ff6bc005200 con 0x55c1f1dbe890 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 1 -- 172.21.15.60:0/4201611049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6b0005610 con 0x55c1f1dbe890 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6a97fa640 1 -- 172.21.15.60:0/4201611049 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff6bc005400 con 0x55c1f1dbe890 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 10 client.14994 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.148+0000 7ff6ca599740 1 -- 172.21.15.60:0/4201611049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1f1e49560 con 0x55c1f1dbe890 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6a97fa640 1 -- 172.21.15.60:0/4201611049 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6b0005610 con 0x55c1f1dbe890 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6a97fa640 1 -- 172.21.15.60:0/4201611049 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff6bc003ed0 con 0x55c1f1dbe890 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6ca599740 10 client.14994 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6ca599740 10 client.14994 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6ca599740 20 client.14994 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6ca599740 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c1f1e4e1b0 0x55c1f1e4cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6ca599740 4 client.14994 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6ca599740 1 -- 172.21.15.60:0/4201611049 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "status"}) -- 0x55c1f1d2cb10 con 0x55c1f1e4e1b0 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6c575b640 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c1f1e4e1b0 0x55c1f1e4cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6c575b640 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c1f1e4e1b0 0x55c1f1e4cec0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dd1d7557fd9366bc server_cookie=173a23e9773a81 in_seq=0 out_seq=0 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.149+0000 7ff6a97fa640 10 client.14994 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6a97fa640 1 -- 172.21.15.60:0/4201611049 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c1f1d2cb10 con 0x55c1f1e4e1b0 2024-09-11T23:58:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6a97fa640 10 client.14994 handle_command_reply: tid=0 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 client.14994 shutdown 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 -- 172.21.15.60:0/4201611049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 msgr2=0x55c1f1de1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1de1f30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0163e0 tx=0x7ff6bc003a30 comp rx=0 tx=0).stop 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 -- 172.21.15.60:0/4201611049 shutdown_connections 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c1f1e4e1b0 0x55c1f1e4cec0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c1f1dcdfc0 0x55c1f1de29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c1f1dbf1b0 0x55c1f1de2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 --2- 172.21.15.60:0/4201611049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c1f1dbe890 0x55c1f1de1f30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6a97fa640 0 client.14994 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 -- 172.21.15.60:0/4201611049 >> 172.21.15.60:0/4201611049 conn(0x55c1f1dbaf60 msgr2=0x55c1f1dba000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 -- 172.21.15.60:0/4201611049 shutdown_connections 2024-09-11T23:58:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 1 -- 172.21.15.60:0/4201611049 wait complete. 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.150+0000 7ff6ca599740 20 client.14994 trim_cache size 0 max 16384 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 3, 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24475, 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 67.669183997999994, 2024-09-11T23:58:46.170 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:58:46.171 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:58:46.171 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:58:46.171 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 105.193479826 2024-09-11T23:58:46.171 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:58:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff6ac0a2c10 msgr2=0x7ff6ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff6ac0a2c10 0x7ff6ac0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8010c40 tx=0x7ff6b8015000 comp rx=0 tx=0).stop 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0102790 msgr2=0x7ff6c0198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0102790 0x7ff6c0198a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000d950 tx=0x7ff6b000de10 comp rx=0 tx=0).stop 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1289112403 shutdown_connections 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6c0106f10 0x7ff6c019ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7ff6ac0a2c10 0x7ff6ac0a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6c0102790 0x7ff6c0198a70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 --2- 172.21.15.60:0/1289112403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c0101de0 0x7ff6c0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1289112403 >> 172.21.15.60:0/1289112403 conn(0x7ff6c00fd8c0 msgr2=0x7ff6c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1289112403 shutdown_connections 2024-09-11T23:58:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:46.151+0000 7ff6c81c0640 1 -- 172.21.15.60:0/1289112403 wait complete. 2024-09-11T23:58:46.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T23:58:47.122 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:47.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:47 smithi060 ceph-mon[30953]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:47.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:47 smithi105 ceph-mon[34805]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:47 smithi192 ceph-mon[35487]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/2087674633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 msgr2=0x7fd2b8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/2087674633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 0x7fd2b8101200 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009900 tx=0x7fd2a802a480 comp rx=0 tx=0).stop 2024-09-11T23:58:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/2087674633 shutdown_connections 2024-09-11T23:58:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/2087674633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b8102ef0 0x7fd2b810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/2087674633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2b8102570 0x7fd2b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/2087674633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 0x7fd2b8101200 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/2087674633 >> 172.21.15.60:0/2087674633 conn(0x7fd2b80fc7d0 msgr2=0x7fd2b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/2087674633 shutdown_connections 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.658+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/2087674633 wait complete. 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2bdbf6640 1 Processor -- start 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2bdbf6640 1 -- start start 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2bdbf6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 0x7fd2b81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2bdbf6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2b8102570 0x7fd2b8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2bdbf6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b8102ef0 0x7fd2b819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2bdbf6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81110f0 con 0x7fd2b8100e20 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2bdbf6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8110f70 con 0x7fd2b8102570 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2bdbf6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8111270 con 0x7fd2b8102ef0 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2b77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 0x7fd2b81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2b77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 0x7fd2b81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47060/0 (socket says 172.21.15.60:47060) 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2b77fe640 1 -- 172.21.15.60:0/799471480 learned_addr learned my addr 172.21.15.60:0/799471480 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b8102ef0 0x7fd2b819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2b8102570 0x7fd2b8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2b77fe640 1 -- 172.21.15.60:0/799471480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b8102ef0 msgr2=0x7fd2b819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.659+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b8102ef0 0x7fd2b819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2b77fe640 1 -- 172.21.15.60:0/799471480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2b8102570 msgr2=0x7fd2b8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2b8102570 0x7fd2b8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2b77fe640 1 -- 172.21.15.60:0/799471480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b819d5a0 con 0x7fd2b8100e20 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2b8102570 0x7fd2b8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 0x7fd2b81985f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8004770 tx=0x7fd2a8031470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2b4ff9640 1 -- 172.21.15.60:0/799471480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a803f070 con 0x7fd2b8100e20 2024-09-11T23:58:47.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2b4ff9640 1 -- 172.21.15.60:0/799471480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2a8005510 con 0x7fd2b8100e20 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/799471480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b819d830 con 0x7fd2b8100e20 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2b4ff9640 1 -- 172.21.15.60:0/799471480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8035030 con 0x7fd2b8100e20 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.660+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/799471480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b81a5170 con 0x7fd2b8100e20 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.662+0000 7fd2b4ff9640 1 -- 172.21.15.60:0/799471480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd2a8042070 con 0x7fd2b8100e20 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2bffcf740 1 Processor -- start 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2bffcf740 1 -- start start 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b4ff9640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd2a00a2c10 0x7fd2a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80a9d0 0x55b25c80adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80b2f0 0x55b25c815670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 0x55b25c817fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b25c771090 con 0x55b25c80b2f0 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b25c718a70 con 0x55b25c80a9d0 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b25c76d050 con 0x55b25c815bb0 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd2a00a2c10 0x7fd2a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80b2f0 0x55b25c815670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80b2f0 0x55b25c815670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47066/0 (socket says 172.21.15.60:47066) 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b6ffd640 1 -- 172.21.15.60:0/3876809307 learned_addr learned my addr 172.21.15.60:0/3876809307 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b4ff9640 1 -- 172.21.15.60:0/799471480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fd2a80efd20 con 0x7fd2b8100e20 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 0x55b25c817fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80a9d0 0x55b25c80adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b6ffd640 1 -- 172.21.15.60:0/3876809307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 msgr2=0x55b25c817fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 0x55b25c817fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b6ffd640 1 -- 172.21.15.60:0/3876809307 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80a9d0 msgr2=0x55b25c80adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.663+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80a9d0 0x55b25c80adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.664+0000 7fd2b6ffd640 1 -- 172.21.15.60:0/3876809307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25c725130 con 0x55b25c80b2f0 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.664+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80b2f0 0x55b25c815670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009ca0 tx=0x7fd2ac00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81400b56a252daa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.664+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd2a00a2c10 0x7fd2a00a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0005fd0 tx=0x7fd2b0014b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.664+0000 7fd29dffb640 1 -- 172.21.15.60:0/3876809307 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac016070 con 0x55b25c80b2f0 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.664+0000 7fd29dffb640 1 -- 172.21.15.60:0/3876809307 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2ac005520 con 0x55b25c80b2f0 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.664+0000 7fd29dffb640 1 -- 172.21.15.60:0/3876809307 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac011690 con 0x55b25c80b2f0 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- 172.21.15.60:0/3876809307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80b2f0 msgr2=0x55b25c815670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80b2f0 0x55b25c815670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009ca0 tx=0x7fd2ac00e6c0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- 172.21.15.60:0/3876809307 shutdown_connections 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 0x55b25c817fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80b2f0 0x55b25c815670 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/3876809307 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80a9d0 0x55b25c80adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- 172.21.15.60:0/3876809307 >> 172.21.15.60:0/3876809307 conn(0x55b25c806f60 msgr2=0x55b25c807340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- 172.21.15.60:0/3876809307 shutdown_connections 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- 172.21.15.60:0/3876809307 wait complete. 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- start start 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 Processor -- start 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c8153d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80b2f0 0x55b25c812720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c815bb0 0x55b25c812c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b25c818780 con 0x55b25c80a9d0 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b25c72bf20 con 0x55b25c815bb0 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.665+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b25c818900 con 0x55b25c80b2f0 2024-09-11T23:58:47.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2bffcf740 10 client.0 _ll_register_callbacks cb 0x55b25c6f5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c8153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c8153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47076/0 (socket says 172.21.15.60:47076) 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 -- 172.21.15.60:0/2561475418 learned_addr learned my addr 172.21.15.60:0/2561475418 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c815bb0 0x55b25c812c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80b2f0 0x55b25c812720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 -- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80b2f0 msgr2=0x55b25c812720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80b2f0 0x55b25c812720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 -- 172.21.15.60:0/2561475418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c815bb0 msgr2=0x55b25c812c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c815bb0 0x55b25c812c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 -- 172.21.15.60:0/2561475418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25c4e22b0 con 0x55b25c80a9d0 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80b2f0 0x55b25c812720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:47.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c8153d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8031580 tx=0x7fd2a80b8770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adadfd883d24458 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd296ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd296ffd640 1 -- 172.21.15.60:0/2561475418 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8049040 con 0x55b25c80a9d0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd296ffd640 1 -- 172.21.15.60:0/2561475418 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fd2a80ed950 con 0x55b25c80a9d0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2561475418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2ac005520 con 0x55b25c80a9d0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd296ffd640 1 -- 172.21.15.60:0/2561475418 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2a80bbdb0 con 0x55b25c80a9d0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2bffcf740 10 client.15006 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.666+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2561475418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b25c824030 con 0x55b25c80a9d0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd296ffd640 1 -- 172.21.15.60:0/2561475418 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2ac005520 con 0x55b25c80a9d0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd296ffd640 1 -- 172.21.15.60:0/2561475418 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2a80e8570 con 0x55b25c80a9d0 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd2bffcf740 10 client.15006 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd2bffcf740 10 client.15006 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd2bffcf740 20 client.15006 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:47.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b25c8266a0 0x55b25c827b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd2bffcf740 4 client.15006 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2561475418 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b25c77e600 con 0x55b25c8266a0 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.667+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b25c8266a0 0x55b25c827b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.668+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b25c8266a0 0x55b25c827b10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=95e997e2de4175ef server_cookie=62a31085f498c49 in_seq=0 out_seq=0 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.668+0000 7fd296ffd640 10 client.15006 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.668+0000 7fd296ffd640 1 -- 172.21.15.60:0/2561475418 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b25c77e600 con 0x55b25c8266a0 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.668+0000 7fd296ffd640 10 client.15006 handle_command_reply: tid=0 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 client.15006 shutdown 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2561475418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 msgr2=0x55b25c8153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c8153d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8031580 tx=0x7fd2a80b8770 comp rx=0 tx=0).stop 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2561475418 shutdown_connections 2024-09-11T23:58:47.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b25c8266a0 0x55b25c827b10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c815bb0 0x55b25c812c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80b2f0 0x55b25c812720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2561475418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c8153d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd296ffd640 0 client.15006 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-11T23:58:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2561475418 >> 172.21.15.60:0/2561475418 conn(0x55b25c806f60 msgr2=0x55b25c80cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2561475418 shutdown_connections 2024-09-11T23:58:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2561475418 wait complete. 2024-09-11T23:58:47.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.669+0000 7fd2bffcf740 20 client.15006 trim_cache size 0 max 16384 2024-09-11T23:58:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.687+0000 7fd2bffcf740 1 Processor -- start 2024-09-11T23:58:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.687+0000 7fd2bffcf740 1 -- start start 2024-09-11T23:58:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.687+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c810ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.687+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c811530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.687+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 0x55b25c80f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.687+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b25c825e50 con 0x55b25c80a9d0 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.687+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b25c826520 con 0x55b25c80b2f0 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.687+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b25c826bf0 con 0x55b25c815bb0 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c810ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c810ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47088/0 (socket says 172.21.15.60:47088) 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 -- 172.21.15.60:0/2870694 learned_addr learned my addr 172.21.15.60:0/2870694 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 0x55b25c80f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c811530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 -- 172.21.15.60:0/2870694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 msgr2=0x55b25c80f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 0x55b25c80f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 -- 172.21.15.60:0/2870694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 msgr2=0x55b25c811530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c811530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 -- 172.21.15.60:0/2870694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b25c806d90 con 0x55b25c80a9d0 2024-09-11T23:58:47.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c810ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80bc3e0 tx=0x7fd2a80e8900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba7d64a012e8ca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd29d7fa640 1 -- 172.21.15.60:0/2870694 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80d5070 con 0x55b25c80a9d0 2024-09-11T23:58:47.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd29d7fa640 1 -- 172.21.15.60:0/2870694 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2a80bcb50 con 0x55b25c80a9d0 2024-09-11T23:58:47.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.688+0000 7fd29d7fa640 1 -- 172.21.15.60:0/2870694 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8049070 con 0x55b25c80a9d0 2024-09-11T23:58:47.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2870694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 msgr2=0x55b25c810ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c810ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80bc3e0 tx=0x7fd2a80e8900 comp rx=0 tx=0).stop 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2870694 shutdown_connections 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c815bb0 0x55b25c80f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c811530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/2870694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c80a9d0 0x55b25c810ff0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2870694 >> 172.21.15.60:0/2870694 conn(0x55b25c806f60 msgr2=0x55b25c825380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2870694 shutdown_connections 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 -- 172.21.15.60:0/2870694 wait complete. 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.689+0000 7fd2bffcf740 1 -- start start 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2bffcf740 1 Processor -- start 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80a9d0 0x55b25c82ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c82b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2bffcf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c815bb0 0x55b25c88eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b25c827990 con 0x55b25c815bb0 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b25c8272c0 con 0x55b25c80b2f0 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2bffcf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b25c828060 con 0x55b25c80a9d0 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2bffcf740 10 client.0 _ll_register_callbacks cb 0x7fd2a8005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2b7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c815bb0 0x55b25c88eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2b7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c815bb0 0x55b25c88eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47094/0 (socket says 172.21.15.60:47094) 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2b7fff640 1 -- 172.21.15.60:0/4051800718 learned_addr learned my addr 172.21.15.60:0/4051800718 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c82b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.690+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80a9d0 0x55b25c82ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2b7fff640 1 -- 172.21.15.60:0/4051800718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80a9d0 msgr2=0x55b25c82ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80a9d0 0x55b25c82ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2b7fff640 1 -- 172.21.15.60:0/4051800718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 msgr2=0x55b25c82b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c82b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2b7fff640 1 -- 172.21.15.60:0/4051800718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b25c82bc80 con 0x55b25c815bb0 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2b6ffd640 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c82b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2b7fff640 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c815bb0 0x55b25c88eda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0012f30 tx=0x7fd2b0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b6db79652c0a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd296ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd296ffd640 1 -- 172.21.15.60:0/4051800718 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0004510 con 0x55b25c815bb0 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd296ffd640 1 -- 172.21.15.60:0/4051800718 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fd2b00046b0 con 0x55b25c815bb0 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2bffcf740 1 -- 172.21.15.60:0/4051800718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2a80bcb50 con 0x55b25c815bb0 2024-09-11T23:58:47.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd296ffd640 1 -- 172.21.15.60:0/4051800718 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2b0033070 con 0x55b25c815bb0 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2bffcf740 10 client.15012 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd2bffcf740 1 -- 172.21.15.60:0/4051800718 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b25c8903e0 con 0x55b25c815bb0 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.691+0000 7fd296ffd640 1 -- 172.21.15.60:0/4051800718 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2a80bcb50 con 0x55b25c815bb0 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd296ffd640 1 -- 172.21.15.60:0/4051800718 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2b000f040 con 0x55b25c815bb0 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd2bffcf740 10 client.15012 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd2bffcf740 10 client.15012 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd2bffcf740 20 client.15012 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b25c895000 0x55b25c893d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd2bffcf740 4 client.15012 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:47.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd2bffcf740 1 -- 172.21.15.60:0/4051800718 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "status"}) -- 0x55b25c778b10 con 0x55b25c895000 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b25c895000 0x55b25c893d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd296ffd640 10 client.15012 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.692+0000 7fd2b77fe640 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b25c895000 0x55b25c893d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3dce6bccfed5d2f4 server_cookie=9471439b5e588142 in_seq=0 out_seq=0 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd296ffd640 1 -- 172.21.15.60:0/4051800718 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b25c778b10 con 0x55b25c895000 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd296ffd640 10 client.15012 handle_command_reply: tid=0 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 client.15012 shutdown 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 -- 172.21.15.60:0/4051800718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c815bb0 msgr2=0x55b25c88eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c815bb0 0x55b25c88eda0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0012f30 tx=0x7fd2b0004ab0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 -- 172.21.15.60:0/4051800718 shutdown_connections 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b25c895000 0x55b25c893d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b25c815bb0 0x55b25c88eda0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b25c80b2f0 0x55b25c82b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 --2- 172.21.15.60:0/4051800718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b25c80a9d0 0x55b25c82ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 -- 172.21.15.60:0/4051800718 >> 172.21.15.60:0/4051800718 conn(0x55b25c806f60 msgr2=0x55b25c810bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd296ffd640 0 client.15012 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 -- 172.21.15.60:0/4051800718 shutdown_connections 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 1 -- 172.21.15.60:0/4051800718 wait complete. 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.693+0000 7fd2bffcf740 20 client.15012 trim_cache size 0 max 16384 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 2, 2024-09-11T23:58:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24484, 2024-09-11T23:58:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:58:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:58:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:58:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 70.222100631999993, 2024-09-11T23:58:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:58:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:58:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:58:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 104.129962741 2024-09-11T23:58:47.700 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:58:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd2a00a2c10 msgr2=0x7fd2a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd2a00a2c10 0x7fd2a00a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0005fd0 tx=0x7fd2b0014b70 comp rx=0 tx=0).stop 2024-09-11T23:58:47.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 msgr2=0x7fd2b81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 0x7fd2b81985f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8004770 tx=0x7fd2a8031470 comp rx=0 tx=0).stop 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/799471480 shutdown_connections 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b8102ef0 0x7fd2b819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2b8102570 0x7fd2b8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd2a00a2c10 0x7fd2a00a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 --2- 172.21.15.60:0/799471480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2b8100e20 0x7fd2b81985f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/799471480 >> 172.21.15.60:0/799471480 conn(0x7fd2b80fc7d0 msgr2=0x7fd2b806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/799471480 shutdown_connections 2024-09-11T23:58:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:47.694+0000 7fd2bdbf6640 1 -- 172.21.15.60:0/799471480 wait complete. 2024-09-11T23:58:48.446 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:58:48.705 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 -- 172.21.15.60:0/1668164812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 msgr2=0x7f42441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 --2- 172.21.15.60:0/1668164812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 0x7f42441067e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4238009900 tx=0x7f423802a410 comp rx=0 tx=0).stop 2024-09-11T23:58:49.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 -- 172.21.15.60:0/1668164812 shutdown_connections 2024-09-11T23:58:49.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 --2- 172.21.15.60:0/1668164812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4244106f10 0x7f424410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 --2- 172.21.15.60:0/1668164812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 0x7f42441067e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 --2- 172.21.15.60:0/1668164812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4244101de0 0x7f42441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 -- 172.21.15.60:0/1668164812 >> 172.21.15.60:0/1668164812 conn(0x7f42440fd8c0 msgr2=0x7f42440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 -- 172.21.15.60:0/1668164812 shutdown_connections 2024-09-11T23:58:49.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.209+0000 7f42488e3640 1 -- 172.21.15.60:0/1668164812 wait complete. 2024-09-11T23:58:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.210+0000 7f42488e3640 1 Processor -- start 2024-09-11T23:58:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.210+0000 7f42488e3640 1 -- start start 2024-09-11T23:58:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42488e3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4244101de0 0x7f42441985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42488e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 0x7f4244198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42488e3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4244106f10 0x7f424419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42488e3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42441120d0 con 0x7f4244102790 2024-09-11T23:58:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42488e3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4244111f50 con 0x7f4244106f10 2024-09-11T23:58:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42488e3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4244112250 con 0x7f4244101de0 2024-09-11T23:58:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 0x7f4244198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 0x7f4244198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47106/0 (socket says 172.21.15.60:47106) 2024-09-11T23:58:49.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 -- 172.21.15.60:0/3676588857 learned_addr learned my addr 172.21.15.60:0/3676588857 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f424259c640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4244101de0 0x7f42441985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4242d9d640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4244106f10 0x7f424419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 -- 172.21.15.60:0/3676588857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4244101de0 msgr2=0x7f42441985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4244101de0 0x7f42441985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 -- 172.21.15.60:0/3676588857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4244106f10 msgr2=0x7f424419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4244106f10 0x7f424419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 -- 172.21.15.60:0/3676588857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f424419d560 con 0x7f4244102790 2024-09-11T23:58:49.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f424259c640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4244101de0 0x7f42441985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:49.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f4241d9b640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 0x7f4244198af0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4238006010 tx=0x7f42380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42337fe640 1 -- 172.21.15.60:0/3676588857 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423803f030 con 0x7f4244102790 2024-09-11T23:58:49.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42488e3640 1 -- 172.21.15.60:0/3676588857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424419d7f0 con 0x7f4244102790 2024-09-11T23:58:49.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.211+0000 7f42337fe640 1 -- 172.21.15.60:0/3676588857 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4238003d00 con 0x7f4244102790 2024-09-11T23:58:49.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.212+0000 7f42337fe640 1 -- 172.21.15.60:0/3676588857 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238035070 con 0x7f4244102790 2024-09-11T23:58:49.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.212+0000 7f42488e3640 1 -- 172.21.15.60:0/3676588857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42441a5130 con 0x7f4244102790 2024-09-11T23:58:49.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.214+0000 7f42337fe640 1 -- 172.21.15.60:0/3676588857 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4238042030 con 0x7f4244102790 2024-09-11T23:58:49.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.214+0000 7f424acbc740 1 Processor -- start 2024-09-11T23:58:49.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.214+0000 7f424acbc740 1 -- start start 2024-09-11T23:58:49.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.214+0000 7f424acbc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dc8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.214+0000 7f424acbc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc92f0 0x5627c6dd3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f424acbc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f424acbc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5627c6d2f090 con 0x5627c6dd3bb0 2024-09-11T23:58:49.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f424acbc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5627c6cd6a70 con 0x5627c6dc92f0 2024-09-11T23:58:49.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f424acbc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5627c6d2b050 con 0x5627c6dc89d0 2024-09-11T23:58:49.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47108/0 (socket says 172.21.15.60:47108) 2024-09-11T23:58:49.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 -- 172.21.15.60:0/1417071725 learned_addr learned my addr 172.21.15.60:0/1417071725 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:49.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f424259c640 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc92f0 0x5627c6dd3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4242d9d640 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dc8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 -- 172.21.15.60:0/1417071725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 msgr2=0x5627c6dc8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f42337fe640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f422c0a2c10 0x7f422c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dc8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 -- 172.21.15.60:0/1417071725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc92f0 msgr2=0x5627c6dd3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc92f0 0x5627c6dd3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 -- 172.21.15.60:0/1417071725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c6ce3130 con 0x5627c6dd3bb0 2024-09-11T23:58:49.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4242d9d640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f422c0a2c10 0x7f422c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f42337fe640 1 -- 172.21.15.60:0/3676588857 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f42380efbd0 con 0x7f4244102790 2024-09-11T23:58:49.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.215+0000 7f4241d9b640 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd5fa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f42380d6340 tx=0x7f42380b8370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d714d59dd55906c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f4230ff9640 1 -- 172.21.15.60:0/1417071725 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380bbde0 con 0x5627c6dd3bb0 2024-09-11T23:58:49.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f4230ff9640 1 -- 172.21.15.60:0/1417071725 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f423803be30 con 0x5627c6dd3bb0 2024-09-11T23:58:49.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f4230ff9640 1 -- 172.21.15.60:0/1417071725 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380bbc00 con 0x5627c6dd3bb0 2024-09-11T23:58:49.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f424acbc740 1 -- 172.21.15.60:0/1417071725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dd3bb0 msgr2=0x5627c6dd5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f424acbc740 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd5fa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f42380d6340 tx=0x7f42380b8370 comp rx=0 tx=0).stop 2024-09-11T23:58:49.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f4242d9d640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f422c0a2c10 0x7f422c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f423c005c40 tx=0x7f423c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f424acbc740 1 -- 172.21.15.60:0/1417071725 shutdown_connections 2024-09-11T23:58:49.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f424acbc740 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd5fa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f424acbc740 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc92f0 0x5627c6dd3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f424acbc740 1 --2- 172.21.15.60:0/1417071725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dc8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f424acbc740 1 -- 172.21.15.60:0/1417071725 >> 172.21.15.60:0/1417071725 conn(0x5627c6dc4f60 msgr2=0x5627c6dc5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.216+0000 7f424acbc740 1 -- 172.21.15.60:0/1417071725 shutdown_connections 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 -- 172.21.15.60:0/1417071725 wait complete. 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 -- start start 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 Processor -- start 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dd3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dd07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5627c6dd6540 con 0x5627c6dc92f0 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5627c6ce9f20 con 0x5627c6dd3bb0 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5627c6dd66c0 con 0x5627c6dc89d0 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424acbc740 10 client.0 _ll_register_callbacks cb 0x5627c6cb3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dd07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dd07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47122/0 (socket says 172.21.15.60:47122) 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f4241d9b640 1 -- 172.21.15.60:0/3317530380 learned_addr learned my addr 172.21.15.60:0/3317530380 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f424259c640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dd3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.217+0000 7f4242d9d640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4241d9b640 1 -- 172.21.15.60:0/3317530380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 msgr2=0x5627c6dd3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4241d9b640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dd3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4241d9b640 1 -- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dd3bb0 msgr2=0x5627c6dd0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4241d9b640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4241d9b640 1 -- 172.21.15.60:0/3317530380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627c6aa02b0 con 0x5627c6dc92f0 2024-09-11T23:58:49.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f424259c640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dd3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:49.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4242d9d640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:49.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4241d9b640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dd07d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f42380b84e0 tx=0x7f42380045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dc8acf44cd610 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:49.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4229ffb640 1 -- 172.21.15.60:0/3317530380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238049070 con 0x5627c6dc92f0 2024-09-11T23:58:49.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4229ffb640 1 -- 172.21.15.60:0/3317530380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f42380b8910 con 0x5627c6dc92f0 2024-09-11T23:58:49.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f424acbc740 1 -- 172.21.15.60:0/3317530380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f423803be30 con 0x5627c6dc92f0 2024-09-11T23:58:49.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f4229ffb640 1 -- 172.21.15.60:0/3317530380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42380bbc00 con 0x5627c6dc92f0 2024-09-11T23:58:49.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f424acbc740 10 client.15024 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.218+0000 7f424acbc740 1 -- 172.21.15.60:0/3317530380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5627c6dd6540 con 0x5627c6dc92f0 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f4229ffb640 1 -- 172.21.15.60:0/3317530380 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f423803be30 con 0x5627c6dc92f0 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f4229ffb640 1 -- 172.21.15.60:0/3317530380 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f42380ed7a0 con 0x5627c6dc92f0 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f424acbc740 10 client.15024 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f424acbc740 10 client.15024 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f424acbc740 20 client.15024 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f424acbc740 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627c6de4170 0x5627c6de55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f424acbc740 4 client.15024 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:49.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f424acbc740 1 -- 172.21.15.60:0/3317530380 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627c6d3c600 con 0x5627c6de4170 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.219+0000 7f424259c640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627c6de4170 0x5627c6de55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.220+0000 7f424259c640 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627c6de4170 0x5627c6de55e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=938536e34f9aab20 server_cookie=56045f2b19f7e242 in_seq=0 out_seq=0 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.220+0000 7f4229ffb640 10 client.15024 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f4229ffb640 1 -- 172.21.15.60:0/3317530380 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627c6d3c600 con 0x5627c6de4170 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f4229ffb640 10 client.15024 handle_command_reply: tid=0 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 client.15024 shutdown 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 -- 172.21.15.60:0/3317530380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 msgr2=0x5627c6dd07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dd07d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f42380b84e0 tx=0x7f42380045a0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 -- 172.21.15.60:0/3317530380 shutdown_connections 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627c6de4170 0x5627c6de55e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dd3bb0 0x5627c6dd0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dd07d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 --2- 172.21.15.60:0/3317530380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dc89d0 0x5627c6dd3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 -- 172.21.15.60:0/3317530380 >> 172.21.15.60:0/3317530380 conn(0x5627c6dc4f60 msgr2=0x5627c6dcac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f4229ffb640 0 client.15024 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-11T23:58:49.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 -- 172.21.15.60:0/3317530380 shutdown_connections 2024-09-11T23:58:49.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 1 -- 172.21.15.60:0/3317530380 wait complete. 2024-09-11T23:58:49.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.221+0000 7f424acbc740 20 client.15024 trim_cache size 0 max 16384 2024-09-11T23:58:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.239+0000 7f424acbc740 1 Processor -- start 2024-09-11T23:58:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.239+0000 7f424acbc740 1 -- start start 2024-09-11T23:58:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.239+0000 7f424acbc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 0x5627c6de4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.239+0000 7f424acbc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dcf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.239+0000 7f424acbc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6dcda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.239+0000 7f424acbc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5627c6de3920 con 0x5627c6dc92f0 2024-09-11T23:58:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.239+0000 7f424acbc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5627c6de3ff0 con 0x5627c6dc89d0 2024-09-11T23:58:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.239+0000 7f424acbc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5627c6de46c0 con 0x5627c6dd3bb0 2024-09-11T23:58:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dcf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dcf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47124/0 (socket says 172.21.15.60:47124) 2024-09-11T23:58:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 -- 172.21.15.60:0/2872541099 learned_addr learned my addr 172.21.15.60:0/2872541099 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f424259c640 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 0x5627c6de4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4242d9d640 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6dcda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 -- 172.21.15.60:0/2872541099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 msgr2=0x5627c6dcda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6dcda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 -- 172.21.15.60:0/2872541099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 msgr2=0x5627c6de4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 0x5627c6de4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 -- 172.21.15.60:0/2872541099 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627c6dd37f0 con 0x5627c6dc92f0 2024-09-11T23:58:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4242d9d640 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6dcda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f4241d9b640 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dcf7b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4238005ec0 tx=0x7f423803b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75a9c9bbe57904d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f422bfff640 1 -- 172.21.15.60:0/2872541099 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238049020 con 0x5627c6dc92f0 2024-09-11T23:58:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f422bfff640 1 -- 172.21.15.60:0/2872541099 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f423803be30 con 0x5627c6dc92f0 2024-09-11T23:58:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.240+0000 7f422bfff640 1 -- 172.21.15.60:0/2872541099 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380d4070 con 0x5627c6dc92f0 2024-09-11T23:58:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 -- 172.21.15.60:0/2872541099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 msgr2=0x5627c6dcf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dcf7b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4238005ec0 tx=0x7f423803b460 comp rx=0 tx=0).stop 2024-09-11T23:58:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 -- 172.21.15.60:0/2872541099 shutdown_connections 2024-09-11T23:58:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6dcda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6dcf7b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 --2- 172.21.15.60:0/2872541099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 0x5627c6de4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 -- 172.21.15.60:0/2872541099 >> 172.21.15.60:0/2872541099 conn(0x5627c6dc4f60 msgr2=0x5627c6dcf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 -- 172.21.15.60:0/2872541099 shutdown_connections 2024-09-11T23:58:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 -- 172.21.15.60:0/2872541099 wait complete. 2024-09-11T23:58:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 -- start start 2024-09-11T23:58:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.241+0000 7f424acbc740 1 Processor -- start 2024-09-11T23:58:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f424acbc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 0x5627c6dee020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f424acbc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6de67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f424acbc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6de6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f424acbc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5627c6de5460 con 0x5627c6dc92f0 2024-09-11T23:58:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f424acbc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5627c6de4d90 con 0x5627c6dc89d0 2024-09-11T23:58:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f424acbc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5627c6de5b30 con 0x5627c6dd3bb0 2024-09-11T23:58:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f424acbc740 10 client.0 _ll_register_callbacks cb 0x7f42340071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6de67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6de67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47128/0 (socket says 172.21.15.60:47128) 2024-09-11T23:58:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 -- 172.21.15.60:0/2875765327 learned_addr learned my addr 172.21.15.60:0/2875765327 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f424259c640 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 0x5627c6dee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4242d9d640 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6de6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 -- 172.21.15.60:0/2875765327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 msgr2=0x5627c6de6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6de6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 -- 172.21.15.60:0/2875765327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 msgr2=0x5627c6dee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 0x5627c6dee020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 -- 172.21.15.60:0/2875765327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627c6de7570 con 0x5627c6dc92f0 2024-09-11T23:58:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4242d9d640 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6de6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4241d9b640 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6de67e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f42380bc460 tx=0x7f42380ba7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb2d828d04fd5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.242+0000 7f4229ffb640 1 -- 172.21.15.60:0/2875765327 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380d4050 con 0x5627c6dc92f0 2024-09-11T23:58:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f4229ffb640 1 -- 172.21.15.60:0/2875765327 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f42380c4a80 con 0x5627c6dc92f0 2024-09-11T23:58:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 1 -- 172.21.15.60:0/2875765327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f423803be30 con 0x5627c6dc92f0 2024-09-11T23:58:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f4229ffb640 1 -- 172.21.15.60:0/2875765327 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4238049070 con 0x5627c6dc92f0 2024-09-11T23:58:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 10 client.15030 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 1 -- 172.21.15.60:0/2875765327 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5627c6de7570 con 0x5627c6dc92f0 2024-09-11T23:58:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f4229ffb640 1 -- 172.21.15.60:0/2875765327 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f423803be30 con 0x5627c6dc92f0 2024-09-11T23:58:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f4229ffb640 1 -- 172.21.15.60:0/2875765327 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f42380bc500 con 0x5627c6dc92f0 2024-09-11T23:58:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 10 client.15030 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 10 client.15030 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:58:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 20 client.15030 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627c6e51cc0 0x5627c6e509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 4 client.15030 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424acbc740 1 -- 172.21.15.60:0/2875765327 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "status"}) -- 0x5627c6d36b10 con 0x5627c6e51cc0 2024-09-11T23:58:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.243+0000 7f424259c640 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627c6e51cc0 0x5627c6e509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424259c640 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627c6e51cc0 0x5627c6e509d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=171ecaeef0bf4f74 server_cookie=83d09eeadba24209 in_seq=0 out_seq=0 2024-09-11T23:58:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f4229ffb640 10 client.15030 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-11T23:58:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f4229ffb640 1 -- 172.21.15.60:0/2875765327 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5627c6d36b10 con 0x5627c6e51cc0 2024-09-11T23:58:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f4229ffb640 10 client.15030 handle_command_reply: tid=0 2024-09-11T23:58:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 client.15030 shutdown 2024-09-11T23:58:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 -- 172.21.15.60:0/2875765327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 msgr2=0x5627c6de67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6de67e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f42380bc460 tx=0x7f42380ba7b0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 -- 172.21.15.60:0/2875765327 shutdown_connections 2024-09-11T23:58:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627c6e51cc0 0x5627c6e509d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627c6dd3bb0 0x5627c6de6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f4229ffb640 0 client.15030 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-11T23:58:49.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627c6dc92f0 0x5627c6de67e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 --2- 172.21.15.60:0/2875765327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627c6dc89d0 0x5627c6dee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.244+0000 7f424acbc740 1 -- 172.21.15.60:0/2875765327 >> 172.21.15.60:0/2875765327 conn(0x5627c6dc4f60 msgr2=0x5627c6dcbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f424acbc740 1 -- 172.21.15.60:0/2875765327 shutdown_connections 2024-09-11T23:58:49.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f424acbc740 1 -- 172.21.15.60:0/2875765327 wait complete. 2024-09-11T23:58:49.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f424acbc740 20 client.15030 trim_cache size 0 max 16384 2024-09-11T23:58:49.264 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:58:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 1, 2024-09-11T23:58:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24485, 2024-09-11T23:58:49.264 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:58:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:58:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:58:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 72.783621440999994, 2024-09-11T23:58:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:58:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:58:49.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:58:49.266 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 90.736803339999994 2024-09-11T23:58:49.266 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:58:49.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 -- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f422c0a2c10 msgr2=0x7f422c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f422c0a2c10 0x7f422c0a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f423c005c40 tx=0x7f423c004ab0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 -- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 msgr2=0x7f4244198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 0x7f4244198af0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4238006010 tx=0x7f42380042f0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 -- 172.21.15.60:0/3676588857 shutdown_connections 2024-09-11T23:58:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4244106f10 0x7f424419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f422c0a2c10 0x7f422c0a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4244102790 0x7f4244198af0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 --2- 172.21.15.60:0/3676588857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4244101de0 0x7f42441985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 -- 172.21.15.60:0/3676588857 >> 172.21.15.60:0/3676588857 conn(0x7f42440fd8c0 msgr2=0x7f42440feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 -- 172.21.15.60:0/3676588857 shutdown_connections 2024-09-11T23:58:49.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:49.245+0000 7f42488e3640 1 -- 172.21.15.60:0/3676588857 wait complete. 2024-09-11T23:58:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:49 smithi060 ceph-mon[30953]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:49 smithi105 ceph-mon[34805]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:49.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:49 smithi192 ceph-mon[35487]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:50.056 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:58:50.316 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:50.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 -- 172.21.15.60:0/2106965641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64103660 msgr2=0x7f9a6410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 --2- 172.21.15.60:0/2106965641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64103660 0x7f9a6410bb50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009900 tx=0x7f9a4c02a480 comp rx=0 tx=0).stop 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 -- 172.21.15.60:0/2106965641 shutdown_connections 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 --2- 172.21.15.60:0/2106965641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a6410c170 0x7f9a6410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 --2- 172.21.15.60:0/2106965641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64103660 0x7f9a6410bb50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 --2- 172.21.15.60:0/2106965641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a64102d40 0x7f9a64103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 -- 172.21.15.60:0/2106965641 >> 172.21.15.60:0/2106965641 conn(0x7f9a640fc7a0 msgr2=0x7f9a640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 -- 172.21.15.60:0/2106965641 shutdown_connections 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.795+0000 7f9a6b198640 1 -- 172.21.15.60:0/2106965641 wait complete. 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a6b198640 1 Processor -- start 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a6b198640 1 -- start start 2024-09-11T23:58:50.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a6b198640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64102d40 0x7f9a64198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a6b198640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a64103660 0x7f9a64198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a6b198640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a6410c170 0x7f9a6419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a6b198640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641120f0 con 0x7f9a64102d40 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a6b198640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64111f70 con 0x7f9a64103660 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a6b198640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64112270 con 0x7f9a6410c170 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a68f34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64102d40 0x7f9a64198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a68f34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64102d40 0x7f9a64198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47144/0 (socket says 172.21.15.60:47144) 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a68f34640 1 -- 172.21.15.60:0/1621036081 learned_addr learned my addr 172.21.15.60:0/1621036081 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a63fff640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a64103660 0x7f9a64198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a69735640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a6410c170 0x7f9a6419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a68f34640 1 -- 172.21.15.60:0/1621036081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a6410c170 msgr2=0x7f9a6419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a68f34640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a6410c170 0x7f9a6419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a68f34640 1 -- 172.21.15.60:0/1621036081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a64103660 msgr2=0x7f9a64198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a68f34640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a64103660 0x7f9a64198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a68f34640 1 -- 172.21.15.60:0/1621036081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6419d500 con 0x7f9a64102d40 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.796+0000 7f9a69735640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a6410c170 0x7f9a6419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.797+0000 7f9a68f34640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64102d40 0x7f9a64198550 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400d950 tx=0x7f9a5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.797+0000 7f9a61ffb640 1 -- 172.21.15.60:0/1621036081 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a54017070 con 0x7f9a64102d40 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.797+0000 7f9a61ffb640 1 -- 172.21.15.60:0/1621036081 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a54009c30 con 0x7f9a64102d40 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.797+0000 7f9a6b198640 1 -- 172.21.15.60:0/1621036081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6419d7f0 con 0x7f9a64102d40 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.797+0000 7f9a61ffb640 1 -- 172.21.15.60:0/1621036081 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400f740 con 0x7f9a64102d40 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.797+0000 7f9a6b198640 1 -- 172.21.15.60:0/1621036081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a641a50d0 con 0x7f9a64102d40 2024-09-11T23:58:50.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.799+0000 7f9a61ffb640 1 -- 172.21.15.60:0/1621036081 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9a54010a80 con 0x7f9a64102d40 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.799+0000 7f9a6d571740 1 Processor -- start 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.799+0000 7f9a6d571740 1 -- start start 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee19d0 0x55d146ee1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a61ffb640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9a500a2c10 0x7f9a500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146eec670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146eecbb0 0x55d146eeefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a6d571740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d146e48090 con 0x55d146eecbb0 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a6d571740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d146defa70 con 0x55d146ee22f0 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a6d571740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d146e44050 con 0x55d146ee19d0 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9a500a2c10 0x7f9a500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a61ffb640 1 -- 172.21.15.60:0/1621036081 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f9a540ceea0 con 0x7f9a64102d40 2024-09-11T23:58:50.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146eecbb0 0x55d146eeefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146eecbb0 0x55d146eeefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47156/0 (socket says 172.21.15.60:47156) 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 -- 172.21.15.60:0/421508070 learned_addr learned my addr 172.21.15.60:0/421508070 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a63fff640 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146eec670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a68f34640 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee19d0 0x55d146ee1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 -- 172.21.15.60:0/421508070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee19d0 msgr2=0x55d146ee1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee19d0 0x55d146ee1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 -- 172.21.15.60:0/421508070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 msgr2=0x55d146eec670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146eec670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 -- 172.21.15.60:0/421508070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d146dfc130 con 0x55d146eecbb0 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.800+0000 7f9a69735640 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146eecbb0 0x55d146eeefa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00ed70 tx=0x7f9a5c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565787333f7dce8d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.801+0000 7f9a69735640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9a500a2c10 0x7f9a500a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00bc30 tx=0x7f9a5c019000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.801+0000 7f9a5affd640 1 -- 172.21.15.60:0/421508070 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c00be40 con 0x55d146eecbb0 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.801+0000 7f9a5affd640 1 -- 172.21.15.60:0/421508070 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a5c018b70 con 0x55d146eecbb0 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.801+0000 7f9a5affd640 1 -- 172.21.15.60:0/421508070 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c01a420 con 0x55d146eecbb0 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.801+0000 7f9a6d571740 1 -- 172.21.15.60:0/421508070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146eecbb0 msgr2=0x55d146eeefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.801+0000 7f9a6d571740 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146eecbb0 0x55d146eeefa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00ed70 tx=0x7f9a5c00b730 comp rx=0 tx=0).stop 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 -- 172.21.15.60:0/421508070 shutdown_connections 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146eecbb0 0x55d146eeefa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146eec670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 --2- 172.21.15.60:0/421508070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee19d0 0x55d146ee1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 -- 172.21.15.60:0/421508070 >> 172.21.15.60:0/421508070 conn(0x55d146eddf60 msgr2=0x55d146ede340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 -- 172.21.15.60:0/421508070 shutdown_connections 2024-09-11T23:58:50.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 -- 172.21.15.60:0/421508070 wait complete. 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 -- start start 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.802+0000 7f9a6d571740 1 Processor -- start 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146eec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146ee9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146ee9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d146eef780 con 0x55d146ee19d0 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d146e02f20 con 0x55d146ee22f0 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d146eef900 con 0x55d146eecbb0 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 10 client.0 _ll_register_callbacks cb 0x55d146dcc030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146eec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146eec4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47168/0 (socket says 172.21.15.60:47168) 2024-09-11T23:58:50.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 -- 172.21.15.60:0/3138938441 learned_addr learned my addr 172.21.15.60:0/3138938441 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a69735640 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146ee9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a63fff640 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146ee9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 -- 172.21.15.60:0/3138938441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 msgr2=0x55d146ee9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146ee9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 -- 172.21.15.60:0/3138938441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 msgr2=0x55d146ee9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146ee9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 -- 172.21.15.60:0/3138938441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d146bb92b0 con 0x55d146ee19d0 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a63fff640 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146ee9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:50.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a68f34640 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146eec4f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9a54010fd0 tx=0x7f9a540ccd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f212caf997502310 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a43fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a43fff640 1 -- 172.21.15.60:0/3138938441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a54020040 con 0x55d146ee19d0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a43fff640 1 -- 172.21.15.60:0/3138938441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f9a54099b90 con 0x55d146ee19d0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 1 -- 172.21.15.60:0/3138938441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a5c018b70 con 0x55d146ee19d0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a43fff640 1 -- 172.21.15.60:0/3138938441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a5409bcd0 con 0x55d146ee19d0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 10 client.15042 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.803+0000 7f9a6d571740 1 -- 172.21.15.60:0/3138938441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d146efb130 con 0x55d146ee19d0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a43fff640 1 -- 172.21.15.60:0/3138938441 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a5c018b70 con 0x55d146ee19d0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a43fff640 1 -- 172.21.15.60:0/3138938441 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a54084b60 con 0x55d146ee19d0 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a6d571740 10 client.15042 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:50.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a6d571740 10 client.15042 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a6d571740 20 client.15042 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d146efd6c0 0x55d146efeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a6d571740 4 client.15042 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a6d571740 1 -- 172.21.15.60:0/3138938441 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d146e55600 con 0x55d146efd6c0 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.804+0000 7f9a63fff640 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d146efd6c0 0x55d146efeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.805+0000 7f9a63fff640 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d146efd6c0 0x55d146efeb30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70c8ab7ac9c33e7d server_cookie=bb3a6c04842c540a in_seq=0 out_seq=0 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.805+0000 7f9a43fff640 10 client.15042 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a43fff640 1 -- 172.21.15.60:0/3138938441 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d146e55600 con 0x55d146efd6c0 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a43fff640 10 client.15042 handle_command_reply: tid=0 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 client.15042 shutdown 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 -- 172.21.15.60:0/3138938441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 msgr2=0x55d146eec4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146eec4f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9a54010fd0 tx=0x7f9a540ccd00 comp rx=0 tx=0).stop 2024-09-11T23:58:50.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 -- 172.21.15.60:0/3138938441 shutdown_connections 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d146efd6c0 0x55d146efeb30 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146ee9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee22f0 0x55d146ee9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3138938441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146eec4f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 -- 172.21.15.60:0/3138938441 >> 172.21.15.60:0/3138938441 conn(0x55d146eddf60 msgr2=0x55d146ee3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a43fff640 0 client.15042 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 -- 172.21.15.60:0/3138938441 shutdown_connections 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 1 -- 172.21.15.60:0/3138938441 wait complete. 2024-09-11T23:58:50.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.806+0000 7f9a6d571740 20 client.15042 trim_cache size 0 max 16384 2024-09-11T23:58:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a6d571740 1 Processor -- start 2024-09-11T23:58:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a6d571740 1 -- start start 2024-09-11T23:58:50.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146efeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee22f0 0x55d146ee4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146eecbb0 0x55d146ee4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a6d571740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d146efce70 con 0x55d146ee19d0 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a6d571740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d146efd540 con 0x55d146eecbb0 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a6d571740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d146efdc10 con 0x55d146ee22f0 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a68f34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146efeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a68f34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146efeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47178/0 (socket says 172.21.15.60:47178) 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a68f34640 1 -- 172.21.15.60:0/4235901063 learned_addr learned my addr 172.21.15.60:0/4235901063 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a63fff640 1 --2- 172.21.15.60:0/4235901063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee22f0 0x55d146ee4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a68f34640 1 -- 172.21.15.60:0/4235901063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee22f0 msgr2=0x55d146ee4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a68f34640 1 --2- 172.21.15.60:0/4235901063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee22f0 0x55d146ee4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a68f34640 1 -- 172.21.15.60:0/4235901063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146eecbb0 msgr2=0x55d146ee4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a68f34640 1 --2- 172.21.15.60:0/4235901063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146eecbb0 0x55d146ee4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.824+0000 7f9a68f34640 1 -- 172.21.15.60:0/4235901063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d146eec110 con 0x55d146ee19d0 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a68f34640 1 --2- 172.21.15.60:0/4235901063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146efeb30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009610 tx=0x7f9a540979a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3928e3a87652c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a5a7fc640 1 -- 172.21.15.60:0/4235901063 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a54020070 con 0x55d146ee19d0 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a5a7fc640 1 -- 172.21.15.60:0/4235901063 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a54015020 con 0x55d146ee19d0 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a5a7fc640 1 -- 172.21.15.60:0/4235901063 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5409a0b0 con 0x55d146ee19d0 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a6d571740 1 -- 172.21.15.60:0/4235901063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 msgr2=0x55d146efeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a6d571740 1 --2- 172.21.15.60:0/4235901063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146efeb30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009610 tx=0x7f9a540979a0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a6d571740 1 -- 172.21.15.60:0/4235901063 shutdown_connections 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a6d571740 1 --2- 172.21.15.60:0/4235901063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146eecbb0 0x55d146ee4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a6d571740 1 --2- 172.21.15.60:0/4235901063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146ee22f0 0x55d146ee4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.825+0000 7f9a6d571740 1 --2- 172.21.15.60:0/4235901063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee19d0 0x55d146efeb30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 -- 172.21.15.60:0/4235901063 >> 172.21.15.60:0/4235901063 conn(0x55d146eddf60 msgr2=0x55d146ee8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 -- 172.21.15.60:0/4235901063 shutdown_connections 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 -- 172.21.15.60:0/4235901063 wait complete. 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 -- start start 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 Processor -- start 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee19d0 0x55d146f01740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee22f0 0x55d146f069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146f06ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d146efe9b0 con 0x55d146ee22f0 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d146efe2e0 con 0x55d146ee19d0 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d146eff080 con 0x55d146eecbb0 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.826+0000 7f9a6d571740 10 client.0 _ll_register_callbacks cb 0x7f9a5409b1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:58:50.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee22f0 0x55d146f069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee22f0 0x55d146f069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47192/0 (socket says 172.21.15.60:47192) 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 -- 172.21.15.60:0/3161047509 learned_addr learned my addr 172.21.15.60:0/3161047509 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a68f34640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee19d0 0x55d146f01740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 -- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 msgr2=0x55d146f06ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a69735640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146f06ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146f06ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 -- 172.21.15.60:0/3161047509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee19d0 msgr2=0x55d146f01740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee19d0 0x55d146f01740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 -- 172.21.15.60:0/3161047509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d146f076c0 con 0x55d146ee22f0 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a69735640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146f06ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a68f34640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee19d0 0x55d146f01740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:50.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a63fff640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee22f0 0x55d146f069a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009900 tx=0x7f9a4c004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9671c8b8b69d1657 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a43fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a43fff640 1 -- 172.21.15.60:0/3161047509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c035040 con 0x55d146ee22f0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a43fff640 1 -- 172.21.15.60:0/3161047509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f9a4c005230 con 0x55d146ee22f0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a6d571740 1 -- 172.21.15.60:0/3161047509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a54015020 con 0x55d146ee22f0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.827+0000 7f9a43fff640 1 -- 172.21.15.60:0/3161047509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a4c005430 con 0x55d146ee22f0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a6d571740 10 client.15048 fetch_fsmap learned FSMap version 28 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a6d571740 1 -- 172.21.15.60:0/3161047509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d146f6be70 con 0x55d146ee22f0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a43fff640 1 -- 172.21.15.60:0/3161047509 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9a54015020 con 0x55d146ee22f0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a43fff640 1 -- 172.21.15.60:0/3161047509 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9a4c031840 con 0x55d146ee22f0 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a6d571740 10 client.15048 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a6d571740 10 client.15048 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a6d571740 20 client.15048 populate_metadata read hostname 'smithi060' 2024-09-11T23:58:50.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d146f70b30 0x55d146f6f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a6d571740 4 client.15048 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a6d571740 1 -- 172.21.15.60:0/3161047509 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "status"}) -- 0x55d146e4fb10 con 0x55d146f70b30 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.828+0000 7f9a68f34640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d146f70b30 0x55d146f6f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a68f34640 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d146f70b30 0x55d146f6f840 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=416fdceca8642b95 server_cookie=eca7448f0072c338 in_seq=0 out_seq=0 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a43fff640 10 client.15048 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a43fff640 1 -- 172.21.15.60:0/3161047509 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d146e4fb10 con 0x55d146f70b30 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a43fff640 10 client.15048 handle_command_reply: tid=0 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 client.15048 shutdown 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 -- 172.21.15.60:0/3161047509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee22f0 msgr2=0x55d146f069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee22f0 0x55d146f069a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c009900 tx=0x7f9a4c004280 comp rx=0 tx=0).stop 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 -- 172.21.15.60:0/3161047509 shutdown_connections 2024-09-11T23:58:50.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d146f70b30 0x55d146f6f840 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a43fff640 0 client.15048 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d146eecbb0 0x55d146f06ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d146ee22f0 0x55d146f069a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 --2- 172.21.15.60:0/3161047509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d146ee19d0 0x55d146f01740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 -- 172.21.15.60:0/3161047509 >> 172.21.15.60:0/3161047509 conn(0x55d146eddf60 msgr2=0x55d146ee4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 -- 172.21.15.60:0/3161047509 shutdown_connections 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 1 -- 172.21.15.60:0/3161047509 wait complete. 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.829+0000 7f9a6d571740 20 client.15048 trim_cache size 0 max 16384 2024-09-11T23:58:50.836 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24496, 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 81.399286454000006, 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 101.876308181 2024-09-11T23:58:50.837 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:58:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 -- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9a500a2c10 msgr2=0x7f9a500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9a500a2c10 0x7f9a500a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00bc30 tx=0x7f9a5c019000 comp rx=0 tx=0).stop 2024-09-11T23:58:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 -- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64102d40 msgr2=0x7f9a64198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64102d40 0x7f9a64198550 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400d950 tx=0x7f9a5400de10 comp rx=0 tx=0).stop 2024-09-11T23:58:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 -- 172.21.15.60:0/1621036081 shutdown_connections 2024-09-11T23:58:50.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a6410c170 0x7f9a6419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a64103660 0x7f9a64198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9a500a2c10 0x7f9a500a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 --2- 172.21.15.60:0/1621036081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a64102d40 0x7f9a64198550 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 -- 172.21.15.60:0/1621036081 >> 172.21.15.60:0/1621036081 conn(0x7f9a640fc7a0 msgr2=0x7f9a640fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 -- 172.21.15.60:0/1621036081 shutdown_connections 2024-09-11T23:58:50.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:50.830+0000 7f9a6b198640 1 -- 172.21.15.60:0/1621036081 wait complete. 2024-09-11T23:58:51.336 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:51 smithi192 ceph-mon[35487]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:51.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:51 smithi060 ceph-mon[30953]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:51.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:51 smithi105 ceph-mon[34805]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:58:51.506 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T23:58:51.506 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T23:58:51.516 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-11T23:58:51.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T23:58:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 -- 172.21.15.60:0/2948994548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 msgr2=0x7fd0ac108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2948994548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 0x7fd0ac108f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009ca0 tx=0x7fd0a402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 -- 172.21.15.60:0/2948994548 shutdown_connections 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2948994548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 0x7fd0ac108f60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2948994548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0ac101d10 0x7fd0ac102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2948994548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0ac100b10 0x7fd0ac100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 -- 172.21.15.60:0/2948994548 >> 172.21.15.60:0/2948994548 conn(0x7fd0ac0fc2a0 msgr2=0x7fd0ac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 -- 172.21.15.60:0/2948994548 shutdown_connections 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 -- 172.21.15.60:0/2948994548 wait complete. 2024-09-11T23:58:52.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 Processor -- start 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 -- start start 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0ac100b10 0x7fd0ac197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.238+0000 7fd0b464e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0ac101d10 0x7fd0ac198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b464e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 0x7fd0ac19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b464e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac10c910 con 0x7fd0ac1026d0 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b464e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac10c790 con 0x7fd0ac101d10 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b464e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac10ca90 con 0x7fd0ac100b10 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b2beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 0x7fd0ac19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b23ea640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0ac100b10 0x7fd0ac197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b2beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 0x7fd0ac19f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43178/0 (socket says 172.21.15.60:43178) 2024-09-11T23:58:52.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b2beb640 1 -- 172.21.15.60:0/2703373858 learned_addr learned my addr 172.21.15.60:0/2703373858 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b1be9640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0ac101d10 0x7fd0ac198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b23ea640 1 -- 172.21.15.60:0/2703373858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0ac101d10 msgr2=0x7fd0ac198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b23ea640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0ac101d10 0x7fd0ac198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b23ea640 1 -- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 msgr2=0x7fd0ac19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b23ea640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 0x7fd0ac19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b23ea640 1 -- 172.21.15.60:0/2703373858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac19faf0 con 0x7fd0ac100b10 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b23ea640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0ac100b10 0x7fd0ac197ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c940 tx=0x7fd0a800ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0a37fe640 1 -- 172.21.15.60:0/2703373858 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8007bb0 con 0x7fd0ac100b10 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0a37fe640 1 -- 172.21.15.60:0/2703373858 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd0a8007d50 con 0x7fd0ac100b10 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ac19fde0 con 0x7fd0ac100b10 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.239+0000 7fd0a37fe640 1 -- 172.21.15.60:0/2703373858 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8018850 con 0x7fd0ac100b10 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.240+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ac1a0230 con 0x7fd0ac100b10 2024-09-11T23:58:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.240+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ac1088d0 con 0x7fd0ac100b10 2024-09-11T23:58:52.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.242+0000 7fd0a37fe640 1 -- 172.21.15.60:0/2703373858 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd0a8044b60 con 0x7fd0ac100b10 2024-09-11T23:58:52.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.242+0000 7fd0a37fe640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd0980a2c40 0x7fd0980a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:52.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.242+0000 7fd0b1be9640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd0980a2c40 0x7fd0980a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:52.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.243+0000 7fd0a37fe640 1 -- 172.21.15.60:0/2703373858 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fd0a80cf2d0 con 0x7fd0ac100b10 2024-09-11T23:58:52.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.243+0000 7fd0b1be9640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd0980a2c40 0x7fd0980a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac1993e0 tx=0x7fd09c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:52.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.245+0000 7fd0a37fe640 1 -- 172.21.15.60:0/2703373858 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0a8014030 con 0x7fd0ac100b10 2024-09-11T23:58:52.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.437+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fd0ac062630 con 0x7fd0980a2c40 2024-09-11T23:58:52.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.439+0000 7fd0a37fe640 1 -- 172.21.15.60:0/2703373858 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fd0ac062630 con 0x7fd0980a2c40 2024-09-11T23:58:52.438 INFO:teuthology.orchestra.run.smithi060.stdout:Backend: cephadm 2024-09-11T23:58:52.438 INFO:teuthology.orchestra.run.smithi060.stdout:Available: Yes 2024-09-11T23:58:52.438 INFO:teuthology.orchestra.run.smithi060.stdout:Paused: No 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd0980a2c40 msgr2=0x7fd0980a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd0980a2c40 0x7fd0980a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac1993e0 tx=0x7fd09c005f90 comp rx=0 tx=0).stop 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0ac100b10 msgr2=0x7fd0ac197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0ac100b10 0x7fd0ac197ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c940 tx=0x7fd0a800ce00 comp rx=0 tx=0).stop 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 shutdown_connections 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd0980a2c40 0x7fd0980a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0ac1026d0 0x7fd0ac19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0ac101d10 0x7fd0ac198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 --2- 172.21.15.60:0/2703373858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0ac100b10 0x7fd0ac197ec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 >> 172.21.15.60:0/2703373858 conn(0x7fd0ac0fc2a0 msgr2=0x7fd0ac0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 shutdown_connections 2024-09-11T23:58:52.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:52.441+0000 7fd0b464e640 1 -- 172.21.15.60:0/2703373858 wait complete. 2024-09-11T23:58:53.140 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T23:58:53.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:53 smithi060 ceph-mon[30953]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:53.399 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:53.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:53 smithi105 ceph-mon[34805]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:53.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:53 smithi192 ceph-mon[35487]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:58:53.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 -- 172.21.15.60:0/2590133119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac104fd0 msgr2=0x7f0aac1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:53.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/2590133119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac104fd0 0x7f0aac1073c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009900 tx=0x7f0a9402a410 comp rx=0 tx=0).stop 2024-09-11T23:58:53.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 -- 172.21.15.60:0/2590133119 shutdown_connections 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/2590133119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aac107900 0x7f0aac109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/2590133119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac104fd0 0x7f0aac1073c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/2590133119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aac1026a0 0x7f0aac104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 -- 172.21.15.60:0/2590133119 >> 172.21.15.60:0/2590133119 conn(0x7f0aac0fc2a0 msgr2=0x7f0aac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 -- 172.21.15.60:0/2590133119 shutdown_connections 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.865+0000 7f0ab25aa640 1 -- 172.21.15.60:0/2590133119 wait complete. 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab25aa640 1 Processor -- start 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab25aa640 1 -- start start 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab25aa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aac1026a0 0x7f0aac197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab25aa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aac104fd0 0x7f0aac1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:53.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab25aa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac107900 0x7f0aac19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab25aa640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac10d9d0 con 0x7f0aac107900 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab25aa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac10d850 con 0x7f0aac1026a0 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab25aa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac10db50 con 0x7f0aac104fd0 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab0b47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac107900 0x7f0aac19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab0b47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac107900 0x7f0aac19f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43204/0 (socket says 172.21.15.60:43204) 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0ab0b47640 1 -- 172.21.15.60:0/1891190126 learned_addr learned my addr 172.21.15.60:0/1891190126 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.866+0000 7f0aa3fff640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aac104fd0 0x7f0aac1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0aabfff640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aac1026a0 0x7f0aac197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0ab0b47640 1 -- 172.21.15.60:0/1891190126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aac104fd0 msgr2=0x7f0aac1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0ab0b47640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aac104fd0 0x7f0aac1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0ab0b47640 1 -- 172.21.15.60:0/1891190126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aac1026a0 msgr2=0x7f0aac197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0ab0b47640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aac1026a0 0x7f0aac197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0ab0b47640 1 -- 172.21.15.60:0/1891190126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac19fb90 con 0x7f0aac107900 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0aabfff640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aac1026a0 0x7f0aac197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0ab0b47640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac107900 0x7f0aac19f520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400eaa0 tx=0x7f0aa400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0aa9ffb640 1 -- 172.21.15.60:0/1891190126 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400cdb0 con 0x7f0aac107900 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0aa9ffb640 1 -- 172.21.15.60:0/1891190126 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0aa4004b20 con 0x7f0aac107900 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac19fe80 con 0x7f0aac107900 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0aa9ffb640 1 -- 172.21.15.60:0/1891190126 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4011760 con 0x7f0aac107900 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.867+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac1a0380 con 0x7f0aac107900 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.868+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac0fdd90 con 0x7f0aac107900 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.869+0000 7f0aa9ffb640 1 -- 172.21.15.60:0/1891190126 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0aa4004cd0 con 0x7f0aac107900 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.870+0000 7f0aa9ffb640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a980a2cc0 0x7f0a980a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.870+0000 7f0aabfff640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a980a2cc0 0x7f0a980a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.870+0000 7f0aa9ffb640 1 -- 172.21.15.60:0/1891190126 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f0aa40cf380 con 0x7f0aac107900 2024-09-11T23:58:53.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.870+0000 7f0aabfff640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a980a2cc0 0x7f0a980a5180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00abe0 tx=0x7f0a9c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:53.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:53.874+0000 7f0aa9ffb640 1 -- 172.21.15.60:0/1891190126 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0aa4016030 con 0x7f0aac107900 2024-09-11T23:58:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.059+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0aac062630 con 0x7f0a980a2cc0 2024-09-11T23:58:54.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.073+0000 7f0aa9ffb640 1 -- 172.21.15.60:0/1891190126 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f0aac062630 con 0x7f0a980a2cc0 2024-09-11T23:58:54.072 INFO:teuthology.orchestra.run.smithi060.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T23:58:54.072 INFO:teuthology.orchestra.run.smithi060.stdout:mds.a smithi060 running (98s) 20s ago 98s 16.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 1492d6ffa433 2024-09-11T23:58:54.072 INFO:teuthology.orchestra.run.smithi060.stdout:mds.b smithi105 running (95s) 28s ago 95s 18.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 d5501e64e6b7 2024-09-11T23:58:54.072 INFO:teuthology.orchestra.run.smithi060.stdout:mds.c smithi192 running (110s) 28s ago 110s 18.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 d940b80e1672 2024-09-11T23:58:54.072 INFO:teuthology.orchestra.run.smithi060.stdout:mds.d smithi060 running (118s) 20s ago 118s 14.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 91df50013e27 2024-09-11T23:58:54.072 INFO:teuthology.orchestra.run.smithi060.stdout:mds.e smithi105 running (116s) 28s ago 115s 17.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 15045d79e23b 2024-09-11T23:58:54.072 INFO:teuthology.orchestra.run.smithi060.stdout:mds.f smithi192 running (113s) 28s ago 113s 17.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 787b82838218 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mds.g smithi060 running (102s) 20s ago 101s 19.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 7020f48b6041 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mds.h smithi105 running (108s) 28s ago 107s 19.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 5fca091dea74 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mds.i smithi192 running (105s) 28s ago 105s 25.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 309f4e53aaf6 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mds.j smithi060 running (2m) 20s ago 2m 15.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 88d5c272bd1d 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mds.k smithi105 running (2m) 28s ago 2m 16.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 6d0218333b60 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mds.l smithi192 running (2m) 28s ago 2m 16.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 514f0b36f1bb 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.x smithi060 *:9283,8765 running (8m) 20s ago 8m 509M - 19.1.1-298-gb53b6d3e 54467abc55f8 7c8c10ab78ab 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.y smithi105 *:8443,8765 running (7m) 28s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 55dbd2b8e62d 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mgr.z smithi192 *:8443,8765 running (7m) 28s ago 7m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 cae99f383f4e 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mon.a smithi060 running (8m) 20s ago 9m 50.3M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 7c49f3335b08 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mon.b smithi105 running (7m) 28s ago 7m 46.8M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 075629e84e6e 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:mon.c smithi192 running (7m) 28s ago 7m 39.9M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 6e6cfd1a1b59 2024-09-11T23:58:54.073 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 smithi060 running (6m) 20s ago 6m 56.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 b59fbfa09b1a 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 smithi105 running (6m) 28s ago 6m 57.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 359c6a00ece8 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 smithi192 running (6m) 28s ago 6m 58.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 a6f5de50ce03 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 smithi060 running (5m) 20s ago 5m 43.5M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 3ed6065fcf6a 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 smithi105 running (5m) 28s ago 5m 43.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 7ce59771b3fc 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 smithi192 running (4m) 28s ago 4m 44.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 576bd29f6a6e 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6 smithi060 running (4m) 20s ago 4m 52.7M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 3cce3f41e9ba 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7 smithi105 running (4m) 28s ago 4m 43.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 331c41d24a25 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8 smithi192 running (3m) 28s ago 3m 42.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 3900b469a1f4 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9 smithi060 running (3m) 20s ago 3m 40.9M 4273M 19.1.1-298-gb53b6d3e 54467abc55f8 30286caa36f9 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10 smithi105 running (2m) 28s ago 2m 46.7M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 bffa296b1485 2024-09-11T23:58:54.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11 smithi192 running (2m) 28s ago 2m 40.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 1812f045490e 2024-09-11T23:58:54.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a980a2cc0 msgr2=0x7f0a980a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a980a2cc0 0x7f0a980a5180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00abe0 tx=0x7f0a9c00a5c0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac107900 msgr2=0x7f0aac19f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:54.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac107900 0x7f0aac19f520 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400eaa0 tx=0x7f0aa400ef60 comp rx=0 tx=0).stop 2024-09-11T23:58:54.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 shutdown_connections 2024-09-11T23:58:54.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0a980a2cc0 0x7f0a980a5180 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0aac107900 0x7f0aac19f520 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aac104fd0 0x7f0aac1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 --2- 172.21.15.60:0/1891190126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0aac1026a0 0x7f0aac197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:54.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 >> 172.21.15.60:0/1891190126 conn(0x7f0aac0fc2a0 msgr2=0x7f0aac102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:54.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 shutdown_connections 2024-09-11T23:58:54.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:54.075+0000 7f0ab25aa640 1 -- 172.21.15.60:0/1891190126 wait complete. 2024-09-11T23:58:54.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:54 smithi060 ceph-mon[30953]: from='client.24763 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:54.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:54 smithi105 ceph-mon[34805]: from='client.24763 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:54.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:54 smithi192 ceph-mon[35487]: from='client.24763 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:54.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T23:58:54.984 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:55.366 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:55 smithi060 ceph-mon[30953]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:55.366 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:55 smithi060 ceph-mon[30953]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:55.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:55 smithi105 ceph-mon[34805]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:55.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:55 smithi105 ceph-mon[34805]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/729629810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f81026d0 msgr2=0x7fc1f8108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/729629810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f81026d0 0x7fc1f8108f60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009ca0 tx=0x7fc1f002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/729629810 shutdown_connections 2024-09-11T23:58:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/729629810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f81026d0 0x7fc1f8108f60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/729629810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1f8101d10 0x7fc1f8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/729629810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1f8100b10 0x7fc1f8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/729629810 >> 172.21.15.60:0/729629810 conn(0x7fc1f80fc2a0 msgr2=0x7fc1f80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:55.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/729629810 shutdown_connections 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.455+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/729629810 wait complete. 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1fd7a1640 1 Processor -- start 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1fd7a1640 1 -- start start 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1fd7a1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1f8100b10 0x7fc1f8197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1fd7a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f8101d10 0x7fc1f8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1fd7a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1f81026d0 0x7fc1f819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1fd7a1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f810c8c0 con 0x7fc1f8101d10 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1fd7a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f810c740 con 0x7fc1f81026d0 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1fd7a1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f810ca40 con 0x7fc1f8100b10 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1effff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f8101d10 0x7fc1f8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:55.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1effff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f8101d10 0x7fc1f8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43226/0 (socket says 172.21.15.60:43226) 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1effff640 1 -- 172.21.15.60:0/4107160310 learned_addr learned my addr 172.21.15.60:0/4107160310 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1f6ffd640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1f8100b10 0x7fc1f8197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1f77fe640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1f81026d0 0x7fc1f819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1effff640 1 -- 172.21.15.60:0/4107160310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1f8100b10 msgr2=0x7fc1f8197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1effff640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1f8100b10 0x7fc1f8197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1effff640 1 -- 172.21.15.60:0/4107160310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1f81026d0 msgr2=0x7fc1f819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1effff640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1f81026d0 0x7fc1f819f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1effff640 1 -- 172.21.15.60:0/4107160310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f819fb20 con 0x7fc1f8101d10 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.456+0000 7fc1f77fe640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1f81026d0 0x7fc1f819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.457+0000 7fc1effff640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f8101d10 0x7fc1f8198430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d950 tx=0x7fc1e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.457+0000 7fc1f4ff9640 1 -- 172.21.15.60:0/4107160310 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0017070 con 0x7fc1f8101d10 2024-09-11T23:58:55.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.457+0000 7fc1f4ff9640 1 -- 172.21.15.60:0/4107160310 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc1e0009c30 con 0x7fc1f8101d10 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.457+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f819fe10 con 0x7fc1f8101d10 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.457+0000 7fc1f4ff9640 1 -- 172.21.15.60:0/4107160310 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000f740 con 0x7fc1f8101d10 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.457+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f81a0310 con 0x7fc1f8101d10 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.458+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f81a0600 con 0x7fc1f8101d10 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.459+0000 7fc1f4ff9640 1 -- 172.21.15.60:0/4107160310 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc1e0010a80 con 0x7fc1f8101d10 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.460+0000 7fc1f4ff9640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc1e40a2cc0 0x7fc1e40a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.460+0000 7fc1f6ffd640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc1e40a2cc0 0x7fc1e40a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.460+0000 7fc1f4ff9640 1 -- 172.21.15.60:0/4107160310 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fc1e00ced30 con 0x7fc1f8101d10 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.460+0000 7fc1f6ffd640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc1e40a2cc0 0x7fc1e40a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8101b70 tx=0x7fc1e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:55.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.463+0000 7fc1f4ff9640 1 -- 172.21.15.60:0/4107160310 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1e009bb80 con 0x7fc1f8101d10 2024-09-11T23:58:55.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:55 smithi192 ceph-mon[35487]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:58:55.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:55 smithi192 ceph-mon[35487]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:55.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.648+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fc1f80fe3f0 con 0x7fc1e40a2cc0 2024-09-11T23:58:55.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.654+0000 7fc1f4ff9640 1 -- 172.21.15.60:0/4107160310 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fc1f80fe3f0 con 0x7fc1e40a2cc0 2024-09-11T23:58:55.653 INFO:teuthology.orchestra.run.smithi060.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T23:58:55.653 INFO:teuthology.orchestra.run.smithi060.stdout:mds.all 12/12 30s ago 2m smithi060=a;smithi060=d;smithi060=g;smithi060=j;smithi105=b;smithi105=e;smithi105=h;smithi105=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-11T23:58:55.654 INFO:teuthology.orchestra.run.smithi060.stdout:mgr 3/3 30s ago 7m smithi060=x;smithi105=y;smithi192=z;count:3 2024-09-11T23:58:55.654 INFO:teuthology.orchestra.run.smithi060.stdout:mon 3/3 30s ago 7m smithi060:172.21.15.60=a;smithi105:172.21.15.105=b;smithi192:172.21.15.192=c;count:3 2024-09-11T23:58:55.654 INFO:teuthology.orchestra.run.smithi060.stdout:osd 12 30s ago - 2024-09-11T23:58:55.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc1e40a2cc0 msgr2=0x7fc1e40a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc1e40a2cc0 0x7fc1e40a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8101b70 tx=0x7fc1e8005f90 comp rx=0 tx=0).stop 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f8101d10 msgr2=0x7fc1f8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f8101d10 0x7fc1f8198430 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d950 tx=0x7fc1e000de10 comp rx=0 tx=0).stop 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 shutdown_connections 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1f81026d0 0x7fc1f819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fc1e40a2cc0 0x7fc1e40a5180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1f8101d10 0x7fc1f8198430 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 --2- 172.21.15.60:0/4107160310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1f8100b10 0x7fc1f8197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.656+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 >> 172.21.15.60:0/4107160310 conn(0x7fc1f80fc2a0 msgr2=0x7fc1f80fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.657+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 shutdown_connections 2024-09-11T23:58:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:55.657+0000 7fc1fd7a1640 1 -- 172.21.15.60:0/4107160310 wait complete. 2024-09-11T23:58:56.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T23:58:56.633 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:57.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 -- 172.21.15.60:0/3674602071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec102690 msgr2=0x7f64ec108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 --2- 172.21.15.60:0/3674602071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec102690 0x7f64ec108f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009ca0 tx=0x7f64e402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 -- 172.21.15.60:0/3674602071 shutdown_connections 2024-09-11T23:58:57.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 --2- 172.21.15.60:0/3674602071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec102690 0x7f64ec108f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 --2- 172.21.15.60:0/3674602071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec101cd0 0x7f64ec102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 --2- 172.21.15.60:0/3674602071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64ec100ad0 0x7f64ec100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 -- 172.21.15.60:0/3674602071 >> 172.21.15.60:0/3674602071 conn(0x7f64ec0fc280 msgr2=0x7f64ec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 -- 172.21.15.60:0/3674602071 shutdown_connections 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 -- 172.21.15.60:0/3674602071 wait complete. 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 Processor -- start 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.104+0000 7f64f130a640 1 -- start start 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64f130a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64ec100ad0 0x7f64ec19a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64f130a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec101cd0 0x7f64ec19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64f130a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec102690 0x7f64ec1a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:57.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64f130a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec10c890 con 0x7f64ec101cd0 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64f130a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec10c710 con 0x7f64ec102690 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64f130a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec10ca10 con 0x7f64ec100ad0 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec101cd0 0x7f64ec19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec101cd0 0x7f64ec19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43250/0 (socket says 172.21.15.60:43250) 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 -- 172.21.15.60:0/1041170563 learned_addr learned my addr 172.21.15.60:0/1041170563 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64eb7fe640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec102690 0x7f64ec1a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64eaffd640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64ec100ad0 0x7f64ec19a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 -- 172.21.15.60:0/1041170563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64ec100ad0 msgr2=0x7f64ec19a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64ec100ad0 0x7f64ec19a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 -- 172.21.15.60:0/1041170563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec102690 msgr2=0x7f64ec1a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec102690 0x7f64ec1a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 -- 172.21.15.60:0/1041170563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec1a1dd0 con 0x7f64ec101cd0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64eb7fe640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec102690 0x7f64ec1a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e3fff640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec101cd0 0x7f64ec19a6e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f64d400e9f0 tx=0x7f64d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e8ff9640 1 -- 172.21.15.60:0/1041170563 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d400cd80 con 0x7f64ec101cd0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec1a20c0 con 0x7f64ec101cd0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e8ff9640 1 -- 172.21.15.60:0/1041170563 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f64d4010930 con 0x7f64ec101cd0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64e8ff9640 1 -- 172.21.15.60:0/1041170563 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4018b00 con 0x7f64ec101cd0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.105+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec1a2650 con 0x7f64ec101cd0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.106+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ec1a28b0 con 0x7f64ec101cd0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.108+0000 7f64e8ff9640 1 -- 172.21.15.60:0/1041170563 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f64d4018ca0 con 0x7f64ec101cd0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.108+0000 7f64e8ff9640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f64d80a2c40 0x7f64d80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.108+0000 7f64eaffd640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f64d80a2c40 0x7f64d80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:57.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.108+0000 7f64e8ff9640 1 -- 172.21.15.60:0/1041170563 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f64d40cf990 con 0x7f64ec101cd0 2024-09-11T23:58:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.109+0000 7f64eaffd640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f64d80a2c40 0x7f64d80a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f64ec101b30 tx=0x7f64dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:57.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.111+0000 7f64e8ff9640 1 -- 172.21.15.60:0/1041170563 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64d409c7c0 con 0x7f64ec101cd0 2024-09-11T23:58:57.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.293+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f64ec0fe460 con 0x7f64d80a2c40 2024-09-11T23:58:57.292 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:57 smithi060 ceph-mon[30953]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:57.292 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:57 smithi060 ceph-mon[30953]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:57.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.294+0000 7f64e8ff9640 1 -- 172.21.15.60:0/1041170563 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f64ec0fe460 con 0x7f64d80a2c40 2024-09-11T23:58:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:HOST ADDR LABELS STATUS 2024-09-11T23:58:57.293 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 172.21.15.60 2024-09-11T23:58:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:smithi105 172.21.15.105 2024-09-11T23:58:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:smithi192 172.21.15.192 2024-09-11T23:58:57.294 INFO:teuthology.orchestra.run.smithi060.stdout:3 hosts in cluster 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.297+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f64d80a2c40 msgr2=0x7f64d80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.297+0000 7f64f130a640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f64d80a2c40 0x7f64d80a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f64ec101b30 tx=0x7f64dc005f90 comp rx=0 tx=0).stop 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.297+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec101cd0 msgr2=0x7f64ec19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.297+0000 7f64f130a640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec101cd0 0x7f64ec19a6e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f64d400e9f0 tx=0x7f64d400eeb0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.298+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 shutdown_connections 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.298+0000 7f64f130a640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64ec102690 0x7f64ec1a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.298+0000 7f64f130a640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f64d80a2c40 0x7f64d80a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.298+0000 7f64f130a640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64ec101cd0 0x7f64ec19a6e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.298+0000 7f64f130a640 1 --2- 172.21.15.60:0/1041170563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64ec100ad0 0x7f64ec19a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.298+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 >> 172.21.15.60:0/1041170563 conn(0x7f64ec0fc280 msgr2=0x7f64ec0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:57.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.298+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 shutdown_connections 2024-09-11T23:58:57.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:57.298+0000 7f64f130a640 1 -- 172.21.15.60:0/1041170563 wait complete. 2024-09-11T23:58:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:57 smithi105 ceph-mon[34805]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:57 smithi105 ceph-mon[34805]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:57.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:57 smithi192 ceph-mon[35487]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:58:57.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:57 smithi192 ceph-mon[35487]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:57.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T23:58:58.194 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:58:58.316 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:58 smithi060 ceph-mon[30953]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:58.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:58 smithi105 ceph-mon[34805]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:58.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:58 smithi192 ceph-mon[35487]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:58:58.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 -- 172.21.15.60:0/3284480397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4100b10 msgr2=0x7f50e4100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:58.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 --2- 172.21.15.60:0/3284480397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4100b10 0x7f50e4100f10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009900 tx=0x7f50d402a410 comp rx=0 tx=0).stop 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 -- 172.21.15.60:0/3284480397 shutdown_connections 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 --2- 172.21.15.60:0/3284480397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50e41026d0 0x7f50e4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 --2- 172.21.15.60:0/3284480397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50e4101d10 0x7f50e4102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 --2- 172.21.15.60:0/3284480397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e4100b10 0x7f50e4100f10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 -- 172.21.15.60:0/3284480397 >> 172.21.15.60:0/3284480397 conn(0x7f50e40fc2a0 msgr2=0x7f50e40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 -- 172.21.15.60:0/3284480397 shutdown_connections 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 -- 172.21.15.60:0/3284480397 wait complete. 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.663+0000 7f50e9a95640 1 Processor -- start 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e9a95640 1 -- start start 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e9a95640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50e4100b10 0x7f50e4198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e9a95640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50e4101d10 0x7f50e4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e9a95640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e41026d0 0x7f50e419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e9a95640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50e410da80 con 0x7f50e41026d0 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e9a95640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50e410d900 con 0x7f50e4101d10 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e9a95640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f50e410dc00 con 0x7f50e4100b10 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e41026d0 0x7f50e419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e41026d0 0x7f50e419f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43266/0 (socket says 172.21.15.60:43266) 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e3fff640 1 -- 172.21.15.60:0/182157540 learned_addr learned my addr 172.21.15.60:0/182157540 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e37fe640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50e4100b10 0x7f50e4198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e2ffd640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50e4101d10 0x7f50e4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e3fff640 1 -- 172.21.15.60:0/182157540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50e4100b10 msgr2=0x7f50e4198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e3fff640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50e4100b10 0x7f50e4198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e3fff640 1 -- 172.21.15.60:0/182157540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50e4101d10 msgr2=0x7f50e4198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e3fff640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50e4101d10 0x7f50e4198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e3fff640 1 -- 172.21.15.60:0/182157540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e419fc80 con 0x7f50e41026d0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.664+0000 7f50e2ffd640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50e4101d10 0x7f50e4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.665+0000 7f50e3fff640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e41026d0 0x7f50e419f610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00eaa0 tx=0x7f50dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.665+0000 7f50e0ff9640 1 -- 172.21.15.60:0/182157540 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00cdb0 con 0x7f50e41026d0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.665+0000 7f50e0ff9640 1 -- 172.21.15.60:0/182157540 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f50dc004b20 con 0x7f50e41026d0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.665+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e419ff70 con 0x7f50e41026d0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.665+0000 7f50e0ff9640 1 -- 172.21.15.60:0/182157540 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc011760 con 0x7f50e41026d0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.665+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e41a04a0 con 0x7f50e41026d0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.666+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e4107e40 con 0x7f50e41026d0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.667+0000 7f50e0ff9640 1 -- 172.21.15.60:0/182157540 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f50dc004cd0 con 0x7f50e41026d0 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.667+0000 7f50e0ff9640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50cc0a2cc0 0x7f50cc0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:58:58.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.668+0000 7f50e37fe640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50cc0a2cc0 0x7f50cc0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:58:58.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.668+0000 7f50e0ff9640 1 -- 172.21.15.60:0/182157540 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f50dc0cf370 con 0x7f50e41026d0 2024-09-11T23:58:58.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.668+0000 7f50e37fe640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50cc0a2cc0 0x7f50cc0a5180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50d402aa00 tx=0x7f50d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:58:58.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.672+0000 7f50e0ff9640 1 -- 172.21.15.60:0/182157540 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50dc016030 con 0x7f50e41026d0 2024-09-11T23:58:58.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.855+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 --> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f50e4062630 con 0x7f50cc0a2cc0 2024-09-11T23:58:58.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.857+0000 7f50e0ff9640 1 -- 172.21.15.60:0/182157540 <== mgr.14150 v2:172.21.15.60:6800/1180183286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f50e4062630 con 0x7f50cc0a2cc0 2024-09-11T23:58:58.856 INFO:teuthology.orchestra.run.smithi060.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T23:58:58.856 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-11T23:58:58.856 INFO:teuthology.orchestra.run.smithi060.stdout:smithi105 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400TR400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T23:58:58.856 INFO:teuthology.orchestra.run.smithi060.stdout:smithi192 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500NN400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-11T23:58:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50cc0a2cc0 msgr2=0x7f50cc0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50cc0a2cc0 0x7f50cc0a5180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50d402aa00 tx=0x7f50d4005a20 comp rx=0 tx=0).stop 2024-09-11T23:58:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e41026d0 msgr2=0x7f50e419f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:58:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e41026d0 0x7f50e419f610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00eaa0 tx=0x7f50dc00ef60 comp rx=0 tx=0).stop 2024-09-11T23:58:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 shutdown_connections 2024-09-11T23:58:58.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f50cc0a2cc0 0x7f50cc0a5180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50e41026d0 0x7f50e419f610 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50e4101d10 0x7f50e4198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 --2- 172.21.15.60:0/182157540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50e4100b10 0x7f50e4198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:58:58.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 >> 172.21.15.60:0/182157540 conn(0x7f50e40fc2a0 msgr2=0x7f50e4105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:58:58.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 shutdown_connections 2024-09-11T23:58:58.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:58:58.859+0000 7f50e9a95640 1 -- 172.21.15.60:0/182157540 wait complete. 2024-09-11T23:58:59.223 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:58:59 smithi060 ceph-mon[30953]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:58:59 smithi105 ceph-mon[34805]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:59.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:58:59 smithi192 ceph-mon[35487]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:58:59.541 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T23:58:59.550 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-11T23:58:59.550 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T23:58:59.813 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:00.229 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:00 smithi060 ceph-mon[30953]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.312+0000 7f68a0cb1640 1 -- 172.21.15.60:0/2245314049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 msgr2=0x7f689c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.312+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/2245314049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 0x7f689c1073c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6890009900 tx=0x7f689002a410 comp rx=0 tx=0).stop 2024-09-11T23:59:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 -- 172.21.15.60:0/2245314049 shutdown_connections 2024-09-11T23:59:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/2245314049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c107900 0x7f689c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/2245314049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 0x7f689c1073c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/2245314049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689c1026a0 0x7f689c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 -- 172.21.15.60:0/2245314049 >> 172.21.15.60:0/2245314049 conn(0x7f689c0fc2a0 msgr2=0x7f689c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 -- 172.21.15.60:0/2245314049 shutdown_connections 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 -- 172.21.15.60:0/2245314049 wait complete. 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 Processor -- start 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.313+0000 7f68a0cb1640 1 -- start start 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f68a0cb1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689c1026a0 0x7f689c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f68a0cb1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 0x7f689c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f68a0cb1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c107900 0x7f689c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f68a0cb1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10d9d0 con 0x7f689c104fd0 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f68a0cb1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10d850 con 0x7f689c1026a0 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f68a0cb1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f689c10db50 con 0x7f689c107900 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 0x7f689c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 0x7f689c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43288/0 (socket says 172.21.15.60:43288) 2024-09-11T23:59:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 -- 172.21.15.60:0/4058846514 learned_addr learned my addr 172.21.15.60:0/4058846514 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f689a59c640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689c1026a0 0x7f689c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 -- 172.21.15.60:0/4058846514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c107900 msgr2=0x7f689c19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f689ad9d640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c107900 0x7f689c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c107900 0x7f689c19f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 -- 172.21.15.60:0/4058846514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689c1026a0 msgr2=0x7f689c197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689c1026a0 0x7f689c197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 -- 172.21.15.60:0/4058846514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c19fbd0 con 0x7f689c104fd0 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f6899d9b640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 0x7f689c1984e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6890009230 tx=0x7f6890004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.314+0000 7f688b7fe640 1 -- 172.21.15.60:0/4058846514 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689003f030 con 0x7f689c104fd0 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.315+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c19fe60 con 0x7f689c104fd0 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.315+0000 7f688b7fe640 1 -- 172.21.15.60:0/4058846514 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6890003d00 con 0x7f689c104fd0 2024-09-11T23:59:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.315+0000 7f688b7fe640 1 -- 172.21.15.60:0/4058846514 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890035070 con 0x7f689c104fd0 2024-09-11T23:59:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.315+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c1a02c0 con 0x7f689c104fd0 2024-09-11T23:59:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.315+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689c0fdd90 con 0x7f689c104fd0 2024-09-11T23:59:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.317+0000 7f688b7fe640 1 -- 172.21.15.60:0/4058846514 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6890042030 con 0x7f689c104fd0 2024-09-11T23:59:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.317+0000 7f688b7fe640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f68840a2c40 0x7f68840a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.318+0000 7f688b7fe640 1 -- 172.21.15.60:0/4058846514 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f68900ef910 con 0x7f689c104fd0 2024-09-11T23:59:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.318+0000 7f689a59c640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f68840a2c40 0x7f68840a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.318+0000 7f689a59c640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f68840a2c40 0x7f68840a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f688c0058c0 tx=0x7f688c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.321+0000 7f688b7fe640 1 -- 172.21.15.60:0/4058846514 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68900bc740 con 0x7f689c104fd0 2024-09-11T23:59:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.533+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f689c02d7c0 con 0x7f689c104fd0 2024-09-11T23:59:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.533+0000 7f688b7fe640 1 -- 172.21.15.60:0/4058846514 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3129 (secure 0 0 0) 0x7f68900bc040 con 0x7f689c104fd0 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:e28 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:btime 2024-09-11T23:57:41:505965+0000 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:legacy client fscid: 1 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:Filesystem 'cephfs' (1) 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:fs_name cephfs 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 28 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T23:59:00.533 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-11T23:57:29.107465+0000 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-11T23:57:41.505953+0000 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:tableserver 0 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:root 0 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:session_timeout 300 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:session_autoclose 300 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:max_file_size 1099511627776 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:max_xattr_size 65536 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:required_client_features {} 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure 0 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:last_failure_osd_epoch 0 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:max_mds 5 2024-09-11T23:59:00.534 INFO:teuthology.orchestra.run.smithi060.stdout:in 0,1,2,3,4 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:up {0=24496,1=24485,2=24484,3=24475,4=24467} 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:failed 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:damaged 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:stopped 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:data_pools [3] 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:metadata_pool 2 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:inline_data disabled 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:balancer 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:bal_rank_mask -1 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:standby_count_wanted 0 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:qdb_cluster leader: 24496 members: 24496,24485,24484,24475,24467 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.i{0:24496} state up:active seq 7 addr [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.535 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.e{0:24446} state up:standby-replay seq 1 addr [v2:172.21.15.105:6834/3186850870,v1:172.21.15.105:6835/3186850870] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b{1:24485} state up:active seq 6 addr [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.l{1:24442} state up:standby-replay seq 1 addr [v2:172.21.15.192:6832/1968112880,v1:172.21.15.192:6833/1968112880] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c{2:24484} state up:active seq 10 addr [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.k{2:24431} state up:standby-replay seq 1 addr [v2:172.21.15.105:6832/967941361,v1:172.21.15.105:6833/967941361] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.f{3:24475} state up:active seq 11 addr [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a{3:14613} state up:standby-replay seq 1 addr [v2:172.21.15.60:6840/1402291177,v1:172.21.15.60:6841/1402291177] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.h{4:24467} state up:active seq 10 addr [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.g{4:14601} state up:standby-replay seq 1 addr [v2:172.21.15.60:6838/4061424559,v1:172.21.15.60:6839/4061424559] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:Standby daemons: 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.j{-1:14532} state up:standby seq 1 addr [v2:172.21.15.60:6834/84261893,v1:172.21.15.60:6835/84261893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.537 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d{-1:14544} state up:standby seq 1 addr [v2:172.21.15.60:6836/2489903500,v1:172.21.15.60:6837/2489903500] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T23:59:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-09-11T23:59:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f68840a2c40 msgr2=0x7f68840a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f68840a2c40 0x7f68840a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f688c0058c0 tx=0x7f688c00a2d0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 msgr2=0x7f689c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 0x7f689c1984e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6890009230 tx=0x7f6890004430 comp rx=0 tx=0).stop 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 shutdown_connections 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c107900 0x7f689c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f68840a2c40 0x7f68840a5100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f689c104fd0 0x7f689c1984e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 --2- 172.21.15.60:0/4058846514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689c1026a0 0x7f689c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 >> 172.21.15.60:0/4058846514 conn(0x7f689c0fc2a0 msgr2=0x7f689c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 shutdown_connections 2024-09-11T23:59:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:00.535+0000 7f68a0cb1640 1 -- 172.21.15.60:0/4058846514 wait complete. 2024-09-11T23:59:00.539 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:00 smithi192 ceph-mon[35487]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:00.685 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:00 smithi105 ceph-mon[34805]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:01.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T23:59:01.219 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:01 smithi060 ceph-mon[30953]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:59:01.220 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:01 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4058846514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:59:01.455 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:01 smithi105 ceph-mon[34805]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:59:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:01 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4058846514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:59:01.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:01 smithi192 ceph-mon[35487]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:59:01.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:01 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4058846514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-11T23:59:01.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 -- 172.21.15.60:0/1684681298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc105070 msgr2=0x7f99fc107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 --2- 172.21.15.60:0/1684681298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc105070 0x7f99fc107460 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f99e4009900 tx=0x7f99e402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 -- 172.21.15.60:0/1684681298 shutdown_connections 2024-09-11T23:59:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 --2- 172.21.15.60:0/1684681298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99fc1079a0 0x7f99fc109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 --2- 172.21.15.60:0/1684681298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc105070 0x7f99fc107460 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 --2- 172.21.15.60:0/1684681298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99fc102740 0x7f99fc104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 -- 172.21.15.60:0/1684681298 >> 172.21.15.60:0/1684681298 conn(0x7f99fc0fc2a0 msgr2=0x7f99fc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 -- 172.21.15.60:0/1684681298 shutdown_connections 2024-09-11T23:59:01.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 -- 172.21.15.60:0/1684681298 wait complete. 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 Processor -- start 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 -- start start 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.960+0000 7f9a01b26640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc102740 0x7f99fc197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f9a01b26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99fc105070 0x7f99fc198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f9a01b26640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99fc1079a0 0x7f99fc19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f9a01b26640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc10d9f0 con 0x7f99fc102740 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f9a01b26640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc10d870 con 0x7f99fc105070 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f9a01b26640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc10db70 con 0x7f99fc1079a0 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc102740 0x7f99fc197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc102740 0x7f99fc197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53468/0 (socket says 172.21.15.60:53468) 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 -- 172.21.15.60:0/987898631 learned_addr learned my addr 172.21.15.60:0/987898631 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:01.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99f3fff640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99fc105070 0x7f99fc198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 -- 172.21.15.60:0/987898631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99fc1079a0 msgr2=0x7f99fc19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99fc1079a0 0x7f99fc19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 -- 172.21.15.60:0/987898631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99fc105070 msgr2=0x7f99fc198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99fc105070 0x7f99fc198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 -- 172.21.15.60:0/987898631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc19fb00 con 0x7f99fc102740 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99fb7fe640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc102740 0x7f99fc197ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c920 tx=0x7f99ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99f97fa640 1 -- 172.21.15.60:0/987898631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec007c70 con 0x7f99fc102740 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99f97fa640 1 -- 172.21.15.60:0/987898631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f99ec007e10 con 0x7f99fc102740 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99fc19fdf0 con 0x7f99fc102740 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f99f97fa640 1 -- 172.21.15.60:0/987898631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec018940 con 0x7f99fc102740 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.961+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99fc1a02a0 con 0x7f99fc102740 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.962+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99fc0fdd90 con 0x7f99fc102740 2024-09-11T23:59:01.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.963+0000 7f99f97fa640 1 -- 172.21.15.60:0/987898631 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f99ec018ae0 con 0x7f99fc102740 2024-09-11T23:59:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.964+0000 7f99f97fa640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f99e80a2cc0 0x7f99e80a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.964+0000 7f99f3fff640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f99e80a2cc0 0x7f99e80a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.964+0000 7f99f97fa640 1 -- 172.21.15.60:0/987898631 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f99ec0cf2e0 con 0x7f99fc102740 2024-09-11T23:59:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.965+0000 7f99f3fff640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f99e80a2cc0 0x7f99e80a5180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f99e4006010 tx=0x7f99e4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:01.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:01.968+0000 7f99f97fa640 1 -- 172.21.15.60:0/987898631 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99ec014030 con 0x7f99fc102740 2024-09-11T23:59:02.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.147+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f99fc02da70 con 0x7f99fc102740 2024-09-11T23:59:02.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.148+0000 7f99f97fa640 1 -- 172.21.15.60:0/987898631 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5265 (secure 0 0 0) 0x7f99ec01f300 con 0x7f99fc102740 2024-09-11T23:59:02.147 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 82 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:fsid 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-11T23:49:46.707649+0000 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-11T23:57:40.484442+0000 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:crush_version 26 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:full_ratio 0.95 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:backfillfull_ratio 0.9 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:nearfull_ratio 0.85 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:require_min_compat_client luminous 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:min_compat_client luminous 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:require_osd_release squid 2024-09-11T23:59:02.148 INFO:teuthology.orchestra.run.smithi060.stdout:stretch_mode_enabled false 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:max_osd 12 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 up in weight 1 up_from 8 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6802/2876211481,v1:172.21.15.60:6803/2876211481] [v2:172.21.15.60:6804/2876211481,v1:172.21.15.60:6805/2876211481] exists,up 1786002e-18f0-4bcc-97cc-315be3a3995f 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6800/2839535181,v1:172.21.15.105:6801/2839535181] [v2:172.21.15.105:6802/2839535181,v1:172.21.15.105:6803/2839535181] exists,up df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6800/4171786693,v1:172.21.15.192:6801/4171786693] [v2:172.21.15.192:6802/4171786693,v1:172.21.15.192:6803/4171786693] exists,up 8c58b9ec-e216-484b-b579-783f4e6a0a23 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 up in weight 1 up_from 24 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6810/1798770509,v1:172.21.15.60:6811/1798770509] [v2:172.21.15.60:6812/1798770509,v1:172.21.15.60:6813/1798770509] exists,up b4ea1fe8-4668-4a6b-bef9-b52f838be94b 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6808/1760564347,v1:172.21.15.105:6809/1760564347] [v2:172.21.15.105:6810/1760564347,v1:172.21.15.105:6811/1760564347] exists,up 877161c8-96cd-4464-92f3-c19d4f06c754 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 up in weight 1 up_from 36 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6808/3136840060,v1:172.21.15.192:6809/3136840060] [v2:172.21.15.192:6810/3136840060,v1:172.21.15.192:6811/3136840060] exists,up da1e7304-48a6-4f9f-aa12-f1384eb2a389 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6 up in weight 1 up_from 43 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6818/2796525273,v1:172.21.15.60:6819/2796525273] [v2:172.21.15.60:6820/2796525273,v1:172.21.15.60:6821/2796525273] exists,up fb057ead-4a04-43af-a276-78a3ce33a7b2 2024-09-11T23:59:02.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7 up in weight 1 up_from 48 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6816/1526057205,v1:172.21.15.105:6817/1526057205] [v2:172.21.15.105:6818/1526057205,v1:172.21.15.105:6819/1526057205] exists,up 619f7189-29d8-481a-ac46-3196f2ecf4cc 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8 up in weight 1 up_from 55 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6816/4104765194,v1:172.21.15.192:6817/4104765194] [v2:172.21.15.192:6818/4104765194,v1:172.21.15.192:6819/4104765194] exists,up 9e3058f6-2733-4939-bc0e-5eb46604ee41 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6826/3531170684,v1:172.21.15.60:6827/3531170684] [v2:172.21.15.60:6828/3531170684,v1:172.21.15.60:6829/3531170684] exists,up 0037e8d4-e270-4ac3-a8f0-24e19d972822 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10 up in weight 1 up_from 67 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.105:6824/3699246515,v1:172.21.15.105:6825/3699246515] [v2:172.21.15.105:6826/3699246515,v1:172.21.15.105:6827/3699246515] exists,up 0d94bbac-c12a-441d-b9b7-512ad1320413 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6824/885041669,v1:172.21.15.192:6825/885041669] [v2:172.21.15.192:6826/885041669,v1:172.21.15.192:6827/885041669] exists,up d5b7201d-7b7c-4897-a701-1ef840aa17dc 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 2.0 [7,11] 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 2.6 [8,11] 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 2.e [2,1] 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 2.1b [2,4] 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.13 [4,9] 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.21 [5,9] 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:pg_upmap_items 3.34 [4,9] 2024-09-11T23:59:02.150 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6800/2264238576 expires 2024-09-12T23:50:39.288772+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/2901365948 expires 2024-09-12T23:50:39.288772+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/470113182 expires 2024-09-12T23:50:39.288772+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/3000754372 expires 2024-09-12T23:50:15.574174+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/2365716663 expires 2024-09-12T23:50:15.574174+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/3516356414 expires 2024-09-12T23:50:39.288772+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:0/814308514 expires 2024-09-12T23:50:15.574174+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6801/2313774435 expires 2024-09-12T23:50:15.574174+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6801/2264238576 expires 2024-09-12T23:50:39.288772+0000 2024-09-11T23:59:02.151 INFO:teuthology.orchestra.run.smithi060.stdout:blocklist 172.21.15.60:6800/2313774435 expires 2024-09-12T23:50:15.574174+0000 2024-09-11T23:59:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f99e80a2cc0 msgr2=0x7f99e80a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f99e80a2cc0 0x7f99e80a5180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f99e4006010 tx=0x7f99e4000bc0 comp rx=0 tx=0).stop 2024-09-11T23:59:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc102740 msgr2=0x7f99fc197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:02.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc102740 0x7f99fc197ed0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c920 tx=0x7f99ec00cde0 comp rx=0 tx=0).stop 2024-09-11T23:59:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 shutdown_connections 2024-09-11T23:59:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99fc1079a0 0x7f99fc19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99fc105070 0x7f99fc198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f99e80a2cc0 0x7f99e80a5180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 --2- 172.21.15.60:0/987898631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99fc102740 0x7f99fc197ed0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 >> 172.21.15.60:0/987898631 conn(0x7f99fc0fc2a0 msgr2=0x7f99fc102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 shutdown_connections 2024-09-11T23:59:02.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:02.151+0000 7f9a01b26640 1 -- 172.21.15.60:0/987898631 wait complete. 2024-09-11T23:59:02.781 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T23:59:02.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:03.170 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:03.470 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:03 smithi060 ceph-mon[30953]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:59:03.470 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:03 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/987898631' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:59:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:03 smithi105 ceph-mon[34805]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:59:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:03 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/987898631' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:59:03.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:03 smithi192 ceph-mon[35487]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-11T23:59:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:03 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/987898631' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-11T23:59:03.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 -- 172.21.15.60:0/1705717536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 msgr2=0x7fec3810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 --2- 172.21.15.60:0/1705717536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 0x7fec3810ea90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fec30009ca0 tx=0x7fec3002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 -- 172.21.15.60:0/1705717536 shutdown_connections 2024-09-11T23:59:03.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 --2- 172.21.15.60:0/1705717536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 0x7fec3810ea90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 --2- 172.21.15.60:0/1705717536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec38102790 0x7fec381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 --2- 172.21.15.60:0/1705717536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec38101de0 0x7fec381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 -- 172.21.15.60:0/1705717536 >> 172.21.15.60:0/1705717536 conn(0x7fec380fd8c0 msgr2=0x7fec380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 -- 172.21.15.60:0/1705717536 shutdown_connections 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.689+0000 7fec3d867640 1 -- 172.21.15.60:0/1705717536 wait complete. 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec3d867640 1 Processor -- start 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec3d867640 1 -- start start 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec3d867640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec38101de0 0x7fec380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec3d867640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec38102790 0x7fec38074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec3d867640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 0x7fec38074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec3d867640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec38112090 con 0x7fec38106f10 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec3d867640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec38111f10 con 0x7fec38102790 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec3d867640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec38112210 con 0x7fec38101de0 2024-09-11T23:59:03.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 0x7fec38074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 0x7fec38074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53486/0 (socket says 172.21.15.60:53486) 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec377fe640 1 -- 172.21.15.60:0/3880384769 learned_addr learned my addr 172.21.15.60:0/3880384769 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec36ffd640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec38101de0 0x7fec380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.690+0000 7fec367fc640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec38102790 0x7fec38074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec377fe640 1 -- 172.21.15.60:0/3880384769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec38101de0 msgr2=0x7fec380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec377fe640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec38101de0 0x7fec380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec377fe640 1 -- 172.21.15.60:0/3880384769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec38102790 msgr2=0x7fec38074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec377fe640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec38102790 0x7fec38074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec377fe640 1 -- 172.21.15.60:0/3880384769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec381a6960 con 0x7fec38106f10 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec36ffd640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec38101de0 0x7fec380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec367fc640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec38102790 0x7fec38074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:03.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec377fe640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 0x7fec38074f70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec30006010 tx=0x7fec300319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec3c865640 1 -- 172.21.15.60:0/3880384769 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3002fa20 con 0x7fec38106f10 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec381a6bf0 con 0x7fec38106f10 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec3c865640 1 -- 172.21.15.60:0/3880384769 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec3002fbc0 con 0x7fec38106f10 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec3c865640 1 -- 172.21.15.60:0/3880384769 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30046860 con 0x7fec38106f10 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.691+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec381a7130 con 0x7fec38106f10 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.692+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec381021c0 con 0x7fec38106f10 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.693+0000 7fec3c865640 1 -- 172.21.15.60:0/3880384769 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fec30046a00 con 0x7fec38106f10 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.694+0000 7fec3c865640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fec200a2c10 0x7fec200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.694+0000 7fec36ffd640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fec200a2c10 0x7fec200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.694+0000 7fec3c865640 1 -- 172.21.15.60:0/3880384769 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fec300f0680 con 0x7fec38106f10 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.694+0000 7fec36ffd640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fec200a2c10 0x7fec200a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fec280058c0 tx=0x7fec28005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:03.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.698+0000 7fec3c865640 1 -- 172.21.15.60:0/3880384769 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec300bd650 con 0x7fec38106f10 2024-09-11T23:59:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.912+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec3810a0f0 con 0x7fec38106f10 2024-09-11T23:59:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.912+0000 7fec3c865640 1 -- 172.21.15.60:0/3880384769 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fec300bcf50 con 0x7fec38106f10 2024-09-11T23:59:03.912 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:03.912 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"btime":"2024-09-11T23:57:41:505965+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:57:41.505953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-11T23:59:03.912 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-09-11T23:59:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fec200a2c10 msgr2=0x7fec200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fec200a2c10 0x7fec200a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fec280058c0 tx=0x7fec28005850 comp rx=0 tx=0).stop 2024-09-11T23:59:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 msgr2=0x7fec38074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 0x7fec38074f70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec30006010 tx=0x7fec300319f0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 shutdown_connections 2024-09-11T23:59:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fec200a2c10 0x7fec200a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38106f10 0x7fec38074f70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec38102790 0x7fec38074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 --2- 172.21.15.60:0/3880384769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec38101de0 0x7fec380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:03.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 >> 172.21.15.60:0/3880384769 conn(0x7fec380fd8c0 msgr2=0x7fec380febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:03.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 shutdown_connections 2024-09-11T23:59:03.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:03.915+0000 7fec3d867640 1 -- 172.21.15.60:0/3880384769 wait complete. 2024-09-11T23:59:04.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:04 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3880384769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:04.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:04 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3880384769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:04.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:04 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3880384769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:04.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:04.857 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:05.241 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:05 smithi060 ceph-mon[30953]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 -- 172.21.15.60:0/490335107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68101de0 msgr2=0x7fbd681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/490335107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68101de0 0x7fbd681021c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009900 tx=0x7fbd6402a410 comp rx=0 tx=0).stop 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 -- 172.21.15.60:0/490335107 shutdown_connections 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/490335107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd68106f10 0x7fbd6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/490335107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd68102790 0x7fbd681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/490335107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68101de0 0x7fbd681021c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 -- 172.21.15.60:0/490335107 >> 172.21.15.60:0/490335107 conn(0x7fbd680fd8c0 msgr2=0x7fbd680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 -- 172.21.15.60:0/490335107 shutdown_connections 2024-09-11T23:59:05.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.325+0000 7fbd6f51b640 1 -- 172.21.15.60:0/490335107 wait complete. 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6f51b640 1 Processor -- start 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6f51b640 1 -- start start 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6f51b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd68101de0 0x7fbd681984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6f51b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd68102790 0x7fbd68198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6f51b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68106f10 0x7fbd6819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6f51b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681120d0 con 0x7fbd68106f10 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6f51b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68111f50 con 0x7fbd68102790 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6f51b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68112250 con 0x7fbd68101de0 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6dab8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68106f10 0x7fbd6819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:05.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6dab8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68106f10 0x7fbd6819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53500/0 (socket says 172.21.15.60:53500) 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6dab8640 1 -- 172.21.15.60:0/1471889386 learned_addr learned my addr 172.21.15.60:0/1471889386 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6cab6640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd68102790 0x7fbd68198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6d2b7640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd68101de0 0x7fbd681984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6dab8640 1 -- 172.21.15.60:0/1471889386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd68101de0 msgr2=0x7fbd681984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6dab8640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd68101de0 0x7fbd681984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6dab8640 1 -- 172.21.15.60:0/1471889386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd68102790 msgr2=0x7fbd68198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.326+0000 7fbd6dab8640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd68102790 0x7fbd68198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.327+0000 7fbd6dab8640 1 -- 172.21.15.60:0/1471889386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6819d4a0 con 0x7fbd68106f10 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.327+0000 7fbd6d2b7640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd68101de0 0x7fbd681984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.327+0000 7fbd6dab8640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68106f10 0x7fbd6819cdc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000cce0 tx=0x7fbd6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.327+0000 7fbd5e7fc640 1 -- 172.21.15.60:0/1471889386 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000f450 con 0x7fbd68106f10 2024-09-11T23:59:05.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.327+0000 7fbd5e7fc640 1 -- 172.21.15.60:0/1471889386 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbd6000faf0 con 0x7fbd68106f10 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.327+0000 7fbd5e7fc640 1 -- 172.21.15.60:0/1471889386 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60018c50 con 0x7fbd68106f10 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.327+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6819d790 con 0x7fbd68106f10 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.327+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a5070 con 0x7fbd68106f10 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.328+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd681021c0 con 0x7fbd68106f10 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.329+0000 7fbd5e7fc640 1 -- 172.21.15.60:0/1471889386 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbd6000fca0 con 0x7fbd68106f10 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.330+0000 7fbd5e7fc640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd540a2c90 0x7fbd540a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.330+0000 7fbd6d2b7640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd540a2c90 0x7fbd540a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.330+0000 7fbd5e7fc640 1 -- 172.21.15.60:0/1471889386 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fbd600cf820 con 0x7fbd68106f10 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.331+0000 7fbd6d2b7640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd540a2c90 0x7fbd540a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000c00 tx=0x7fbd64032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:05.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.333+0000 7fbd5e7fc640 1 -- 172.21.15.60:0/1471889386 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd60014030 con 0x7fbd68106f10 2024-09-11T23:59:05.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:05 smithi105 ceph-mon[34805]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:05.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:05 smithi192 ceph-mon[35487]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-11T23:59:05.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.546+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd6802d7c0 con 0x7fbd68106f10 2024-09-11T23:59:05.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.547+0000 7fbd5e7fc640 1 -- 172.21.15.60:0/1471889386 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11974 (secure 0 0 0) 0x7fbd6009c760 con 0x7fbd68106f10 2024-09-11T23:59:05.546 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:05.546 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"btime":"2024-09-11T23:57:41:505965+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:57:41.505953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-11T23:59:05.546 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 28 2024-09-11T23:59:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd540a2c90 msgr2=0x7fbd540a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd540a2c90 0x7fbd540a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000c00 tx=0x7fbd64032d60 comp rx=0 tx=0).stop 2024-09-11T23:59:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68106f10 msgr2=0x7fbd6819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:05.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68106f10 0x7fbd6819cdc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000cce0 tx=0x7fbd6000a620 comp rx=0 tx=0).stop 2024-09-11T23:59:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 shutdown_connections 2024-09-11T23:59:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fbd540a2c90 0x7fbd540a5150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbd68106f10 0x7fbd6819cdc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd68102790 0x7fbd68198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 --2- 172.21.15.60:0/1471889386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd68101de0 0x7fbd681984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 >> 172.21.15.60:0/1471889386 conn(0x7fbd680fd8c0 msgr2=0x7fbd680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 shutdown_connections 2024-09-11T23:59:05.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:05.549+0000 7fbd6f51b640 1 -- 172.21.15.60:0/1471889386 wait complete. 2024-09-11T23:59:06.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:59:06.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:06 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1471889386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:06.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:06 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1471889386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:06.569 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:06.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:06 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1471889386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:07.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.083+0000 7faa700e8640 1 -- 172.21.15.60:0/137924784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 msgr2=0x7faa681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.083+0000 7faa700e8640 1 --2- 172.21.15.60:0/137924784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 0x7faa681067e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faa64009900 tx=0x7faa6402a410 comp rx=0 tx=0).stop 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.083+0000 7faa700e8640 1 -- 172.21.15.60:0/137924784 shutdown_connections 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.083+0000 7faa700e8640 1 --2- 172.21.15.60:0/137924784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa68106f10 0x7faa6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.083+0000 7faa700e8640 1 --2- 172.21.15.60:0/137924784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 0x7faa681067e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.083+0000 7faa700e8640 1 --2- 172.21.15.60:0/137924784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa68101de0 0x7faa681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.083+0000 7faa700e8640 1 -- 172.21.15.60:0/137924784 >> 172.21.15.60:0/137924784 conn(0x7faa680fd8c0 msgr2=0x7faa680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.084+0000 7faa700e8640 1 -- 172.21.15.60:0/137924784 shutdown_connections 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.084+0000 7faa700e8640 1 -- 172.21.15.60:0/137924784 wait complete. 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.084+0000 7faa700e8640 1 Processor -- start 2024-09-11T23:59:07.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.084+0000 7faa700e8640 1 -- start start 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa700e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa68101de0 0x7faa681a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa700e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 0x7faa681a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa700e8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa68106f10 0x7faa6819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa700e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faa68112050 con 0x7faa68102790 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa700e8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa68111ed0 con 0x7faa68101de0 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa700e8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faa681121d0 con 0x7faa68106f10 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 0x7faa681a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 0x7faa681a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53518/0 (socket says 172.21.15.60:53518) 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 -- 172.21.15.60:0/589539794 learned_addr learned my addr 172.21.15.60:0/589539794 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:07.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6de84640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa68101de0 0x7faa681a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6e685640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa68106f10 0x7faa6819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 -- 172.21.15.60:0/589539794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa68106f10 msgr2=0x7faa6819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa68106f10 0x7faa6819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 -- 172.21.15.60:0/589539794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa68101de0 msgr2=0x7faa681a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa68101de0 0x7faa681a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 -- 172.21.15.60:0/589539794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6819acf0 con 0x7faa68102790 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6de84640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa68101de0 0x7faa681a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa6d683640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 0x7faa681a0940 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faa64006010 tx=0x7faa640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.085+0000 7faa5effd640 1 -- 172.21.15.60:0/589539794 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6403f030 con 0x7faa68102790 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.086+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6819af80 con 0x7faa68102790 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.086+0000 7faa5effd640 1 -- 172.21.15.60:0/589539794 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faa64003d00 con 0x7faa68102790 2024-09-11T23:59:07.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.086+0000 7faa5effd640 1 -- 172.21.15.60:0/589539794 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64035070 con 0x7faa68102790 2024-09-11T23:59:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.086+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa681a72d0 con 0x7faa68102790 2024-09-11T23:59:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.087+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa681021c0 con 0x7faa68102790 2024-09-11T23:59:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.088+0000 7faa5effd640 1 -- 172.21.15.60:0/589539794 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faa64042030 con 0x7faa68102790 2024-09-11T23:59:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.089+0000 7faa5effd640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa540a2c10 0x7faa540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.089+0000 7faa6de84640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa540a2c10 0x7faa540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.089+0000 7faa5effd640 1 -- 172.21.15.60:0/589539794 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7faa640efb50 con 0x7faa68102790 2024-09-11T23:59:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.090+0000 7faa6de84640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa540a2c10 0x7faa540a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa580058c0 tx=0x7faa58005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.092+0000 7faa5effd640 1 -- 172.21.15.60:0/589539794 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa640bc9e0 con 0x7faa68102790 2024-09-11T23:59:07.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.269+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa681a74a0 con 0x7faa68102790 2024-09-11T23:59:07.269 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:07 smithi060 ceph-mon[30953]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:59:07.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.272+0000 7faa5effd640 1 -- 172.21.15.60:0/589539794 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22645 (secure 0 0 0) 0x7faa640bc2e0 con 0x7faa68102790 2024-09-11T23:59:07.271 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:07.272 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":82,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:57:40.484442+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:59:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa540a2c10 msgr2=0x7faa540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa540a2c10 0x7faa540a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa580058c0 tx=0x7faa58005850 comp rx=0 tx=0).stop 2024-09-11T23:59:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 msgr2=0x7faa681a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 0x7faa681a0940 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faa64006010 tx=0x7faa640042f0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 shutdown_connections 2024-09-11T23:59:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa68106f10 0x7faa6819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7faa540a2c10 0x7faa540a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa68102790 0x7faa681a0940 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 --2- 172.21.15.60:0/589539794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa68101de0 0x7faa681a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:07.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 >> 172.21.15.60:0/589539794 conn(0x7faa680fd8c0 msgr2=0x7faa680ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:07.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 shutdown_connections 2024-09-11T23:59:07.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:07.274+0000 7faa700e8640 1 -- 172.21.15.60:0/589539794 wait complete. 2024-09-11T23:59:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:07 smithi105 ceph-mon[34805]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:59:07.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:07 smithi192 ceph-mon[35487]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-11T23:59:08.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:57:29.107465+0000', 'modified': '2024-09-11T23:57:41.505953+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24496, 'mds_1': 24485, 'mds_2': 24484, 'mds_3': 24475, 'mds_4': 24467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14601': {'gid': 14601, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6839/4061424559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 4061424559}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 4061424559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6841/1402291177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6840', 'nonce': 1402291177}, {'type': 'v1', 'addr': '172.21.15.60:6841', 'nonce': 1402291177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6833/967941361', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 967941361}, {'type': 'v1', 'addr': '172.21.15.105:6833', 'nonce': 967941361}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6833/1968112880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 1968112880}, {'type': 'v1', 'addr': '172.21.15.192:6833', 'nonce': 1968112880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6835/3186850870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 3186850870}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 3186850870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.105:6837/2264507638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6836', 'nonce': 2264507638}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 2264507638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6835/968968600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 968968600}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 968968600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6837/1338489089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 1338489089}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 1338489089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.105:6839/525386561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6838', 'nonce': 525386561}, {'type': 'v1', 'addr': '172.21.15.105:6839', 'nonce': 525386561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.192:6839/3310133932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 3310133932}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 3310133932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24496, 'qdb_cluster': [24496, 24485, 24484, 24475, 24467]} 2024-09-11T23:59:08.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-11T23:59:08.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:59:08.314 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:08.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:08 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/589539794' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:08.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:08 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/589539794' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:08.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:08 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/589539794' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3353954274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8101420 msgr2=0x7f6fd810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3353954274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8101420 0x7f6fd810d950 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009cd0 tx=0x7f6fd002a8e0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3353954274 shutdown_connections 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3353954274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8101420 0x7f6fd810d950 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3353954274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd8100a80 0x7f6fd8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3353954274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8106a80 0x7f6fd8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3353954274 >> 172.21.15.60:0/3353954274 conn(0x7f6fd80fc7a0 msgr2=0x7f6fd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3353954274 shutdown_connections 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3353954274 wait complete. 2024-09-11T23:59:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 Processor -- start 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- start start 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8100a80 0x7f6fd81993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd8101420 0x7f6fd81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8106a80 0x7f6fd81a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd8110fe0 con 0x7f6fd8106a80 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd8110e60 con 0x7f6fd8100a80 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.791+0000 7f6fdf21b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd8111160 con 0x7f6fd8101420 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8106a80 0x7f6fd81a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8106a80 0x7f6fd81a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53536/0 (socket says 172.21.15.60:53536) 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 -- 172.21.15.60:0/3363738474 learned_addr learned my addr 172.21.15.60:0/3363738474 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8100a80 0x7f6fd81993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd8101420 0x7f6fd81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 -- 172.21.15.60:0/3363738474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd8101420 msgr2=0x7f6fd81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd8101420 0x7f6fd81998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 -- 172.21.15.60:0/3363738474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8100a80 msgr2=0x7f6fd81993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8100a80 0x7f6fd81993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 -- 172.21.15.60:0/3363738474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd81a4970 con 0x7f6fd8106a80 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd8101420 0x7f6fd81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fdd7b8640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8106a80 0x7f6fd81a4430 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009df0 tx=0x7f6fd0032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.792+0000 7f6fd5ffb640 1 -- 172.21.15.60:0/3363738474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0004240 con 0x7f6fd8106a80 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.793+0000 7f6fd5ffb640 1 -- 172.21.15.60:0/3363738474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6fd00305a0 con 0x7f6fd8106a80 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.793+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3363738474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd81a4b40 con 0x7f6fd8106a80 2024-09-11T23:59:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.793+0000 7f6fd5ffb640 1 -- 172.21.15.60:0/3363738474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd003a660 con 0x7f6fd8106a80 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.793+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3363738474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd81a5020 con 0x7f6fd8106a80 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.795+0000 7f6fd5ffb640 1 -- 172.21.15.60:0/3363738474 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6fd0030b50 con 0x7f6fd8106a80 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.795+0000 7f6fe15f4740 1 Processor -- start 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fe15f4740 1 -- start start 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 0x5575ecf76c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf771b0 0x5575ecf85a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5575ecedd090 con 0x5575ecf85fc0 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5575ece84a70 con 0x5575ecf771b0 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5575eced9050 con 0x5575ecf76890 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd5ffb640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6fc80a2c90 0x7f6fc80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf883b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53538/0 (socket says 172.21.15.60:53538) 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 -- 172.21.15.60:0/2822465786 learned_addr learned my addr 172.21.15.60:0/2822465786 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 0x5575ecf76c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf771b0 0x5575ecf85a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fdd7b8640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6fc80a2c90 0x7f6fc80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 -- 172.21.15.60:0/2822465786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 msgr2=0x5575ecf76c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 0x5575ecf76c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 -- 172.21.15.60:0/2822465786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf771b0 msgr2=0x5575ecf85a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf771b0 0x5575ecf85a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd5ffb640 1 -- 172.21.15.60:0/3363738474 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6fd002e030 con 0x7f6fd8106a80 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.796+0000 7f6fd7fff640 1 -- 172.21.15.60:0/2822465786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ece91130 con 0x5575ecf85fc0 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.797+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf883b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400bfa0 tx=0x7f6fc400b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacee36f3e32477b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.797+0000 7f6fc2ffd640 1 -- 172.21.15.60:0/2822465786 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4018030 con 0x5575ecf85fc0 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.797+0000 7f6fc2ffd640 1 -- 172.21.15.60:0/2822465786 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6fc4005020 con 0x5575ecf85fc0 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.797+0000 7f6fc2ffd640 1 -- 172.21.15.60:0/2822465786 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4004a70 con 0x5575ecf85fc0 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 -- 172.21.15.60:0/2822465786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 msgr2=0x5575ecf883b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf883b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400bfa0 tx=0x7f6fc400b660 comp rx=0 tx=0).stop 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fdd7b8640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6fc80a2c90 0x7f6fc80a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00bc9d0 tx=0x7f6fd00a7040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 -- 172.21.15.60:0/2822465786 shutdown_connections 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf883b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf771b0 0x5575ecf85a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/2822465786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 0x5575ecf76c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 -- 172.21.15.60:0/2822465786 >> 172.21.15.60:0/2822465786 conn(0x5575ecf72f60 msgr2=0x5575ecf73340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 -- 172.21.15.60:0/2822465786 shutdown_connections 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 -- 172.21.15.60:0/2822465786 wait complete. 2024-09-11T23:59:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 -- start start 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 Processor -- start 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 0x5575ecf857f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.798+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf771b0 0x5575ecf82b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf85fc0 0x5575ecf830d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5575ecf88b90 con 0x5575ecf771b0 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5575ece97f20 con 0x5575ecf85fc0 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5575ecf88d10 con 0x5575ecf76890 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fe15f4740 10 client.0 _ll_register_callbacks cb 0x5575ece61030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:08.970 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 4, 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24467, 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 89.328609169000003, 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 122.488199384 2024-09-11T23:59:08.971 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf771b0 0x5575ecf82b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf771b0 0x5575ecf82b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53546/0 (socket says 172.21.15.60:53546) 2024-09-11T23:59:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/1128078646 learned_addr learned my addr 172.21.15.60:0/1128078646 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 0x5575ecf857f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf85fc0 0x5575ecf830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/1128078646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 msgr2=0x5575ecf857f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 0x5575ecf857f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf85fc0 msgr2=0x5575ecf830d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf85fc0 0x5575ecf830d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/1128078646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ecc4e2b0 con 0x5575ecf771b0 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf85fc0 0x5575ecf830d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf771b0 0x5575ecf82b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0104a0 tx=0x7f6fcc010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e744cebd0fb611c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fb7fff640 1 -- 172.21.15.60:0/1128078646 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc018070 con 0x5575ecf771b0 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fb7fff640 1 -- 172.21.15.60:0/1128078646 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6fcc014800 con 0x5575ecf771b0 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fe15f4740 1 -- 172.21.15.60:0/1128078646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fc4005020 con 0x5575ecf771b0 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fb7fff640 1 -- 172.21.15.60:0/1128078646 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6fcc024050 con 0x5575ecf771b0 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fe15f4740 10 client.15120 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.799+0000 7f6fe15f4740 1 -- 172.21.15.60:0/1128078646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575ecf94590 con 0x5575ecf771b0 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fb7fff640 1 -- 172.21.15.60:0/1128078646 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6fc4005020 con 0x5575ecf771b0 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fb7fff640 1 -- 172.21.15.60:0/1128078646 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6fcc01cce0 con 0x5575ecf771b0 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fe15f4740 10 client.15120 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fe15f4740 10 client.15120 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fe15f4740 20 client.15120 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5575ecf96b90 0x5575ecf98000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fe15f4740 4 client.15120 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fe15f4740 1 -- 172.21.15.60:0/1128078646 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575eceea600 con 0x5575ecf96b90 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.800+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5575ecf96b90 0x5575ecf98000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.801+0000 7f6fb7fff640 10 client.15120 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.801+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5575ecf96b90 0x5575ecf98000 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=42755580c0acc369 server_cookie=5d163be5c9156891 in_seq=0 out_seq=0 2024-09-11T23:59:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.801+0000 7f6fb7fff640 1 -- 172.21.15.60:0/1128078646 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575eceea600 con 0x5575ecf96b90 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.801+0000 7f6fb7fff640 10 client.15120 handle_command_reply: tid=0 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.801+0000 7f6fe15f4740 1 client.15120 shutdown 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 -- 172.21.15.60:0/1128078646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf771b0 msgr2=0x5575ecf82b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf771b0 0x5575ecf82b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0104a0 tx=0x7f6fcc010960 comp rx=0 tx=0).stop 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 -- 172.21.15.60:0/1128078646 shutdown_connections 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5575ecf96b90 0x5575ecf98000 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf85fc0 0x5575ecf830d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf771b0 0x5575ecf82b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fb7fff640 0 client.15120 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/1128078646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf76890 0x5575ecf857f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 -- 172.21.15.60:0/1128078646 >> 172.21.15.60:0/1128078646 conn(0x5575ecf72f60 msgr2=0x5575ecf78cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 -- 172.21.15.60:0/1128078646 shutdown_connections 2024-09-11T23:59:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 1 -- 172.21.15.60:0/1128078646 wait complete. 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.802+0000 7f6fe15f4740 20 client.15120 trim_cache size 0 max 16384 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fe15f4740 1 Processor -- start 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fe15f4740 1 -- start start 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 0x5575ecf7e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf7fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf80330 0x5575ecf807b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5575ecf96340 con 0x5575ecf85fc0 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5575ecf96a10 con 0x5575ecf76890 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5575ecf970e0 con 0x5575ecf80330 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fdcfb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf7fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fdcfb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf7fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53554/0 (socket says 172.21.15.60:53554) 2024-09-11T23:59:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/940784665 learned_addr learned my addr 172.21.15.60:0/940784665 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 0x5575ecf7e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/940784665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf80330 msgr2=0x5575ecf807b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf80330 0x5575ecf807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf80330 0x5575ecf807b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/940784665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 msgr2=0x5575ecf7e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 0x5575ecf7e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/940784665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ecf810e0 con 0x5575ecf85fc0 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.820+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf80330 0x5575ecf807b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.821+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf7fdf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc001eb0 tx=0x7f6fcc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2553c547282b051c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.821+0000 7f6fc27fc640 1 -- 172.21.15.60:0/940784665 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc02c070 con 0x5575ecf85fc0 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.821+0000 7f6fc27fc640 1 -- 172.21.15.60:0/940784665 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6fcc010e60 con 0x5575ecf85fc0 2024-09-11T23:59:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.821+0000 7f6fc27fc640 1 -- 172.21.15.60:0/940784665 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc018040 con 0x5575ecf85fc0 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.821+0000 7f6fe15f4740 1 -- 172.21.15.60:0/940784665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 msgr2=0x5575ecf7fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.821+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf7fdf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc001eb0 tx=0x7f6fcc009cd0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 -- 172.21.15.60:0/940784665 shutdown_connections 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf80330 0x5575ecf807b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf85fc0 0x5575ecf7fdf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/940784665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 0x5575ecf7e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 -- 172.21.15.60:0/940784665 >> 172.21.15.60:0/940784665 conn(0x5575ecf72f60 msgr2=0x5575ecf7da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 -- 172.21.15.60:0/940784665 shutdown_connections 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 -- 172.21.15.60:0/940784665 wait complete. 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 -- start start 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 Processor -- start 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 0x5575ecf7efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf80330 0x5575ecf7f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf85fc0 0x5575ecf9f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5575ecf97e80 con 0x5575ecf80330 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5575ecf977b0 con 0x5575ecf76890 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5575ecf98550 con 0x5575ecf85fc0 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fe15f4740 10 client.0 _ll_register_callbacks cb 0x7f6fcc009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fdcfb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf80330 0x5575ecf7f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.822+0000 7f6fdcfb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf80330 0x5575ecf7f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53570/0 (socket says 172.21.15.60:53570) 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/339014825 learned_addr learned my addr 172.21.15.60:0/339014825 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 0x5575ecf7efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf85fc0 0x5575ecf9f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/339014825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf85fc0 msgr2=0x5575ecf9f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf85fc0 0x5575ecf9f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/339014825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 msgr2=0x5575ecf7efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 0x5575ecf7efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fdcfb7640 1 -- 172.21.15.60:0/339014825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ecf9f840 con 0x5575ecf80330 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf85fc0 0x5575ecf9f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fdcfb7640 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf80330 0x5575ecf7f500 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0109a0 tx=0x7f6fcc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474dc31f6754d558 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fb7fff640 1 -- 172.21.15.60:0/339014825 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc035070 con 0x5575ecf80330 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fe15f4740 1 -- 172.21.15.60:0/339014825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fcc010e60 con 0x5575ecf80330 2024-09-11T23:59:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fb7fff640 1 -- 172.21.15.60:0/339014825 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6fcc0063d0 con 0x5575ecf80330 2024-09-11T23:59:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fb7fff640 1 -- 172.21.15.60:0/339014825 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6fcc018070 con 0x5575ecf80330 2024-09-11T23:59:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fe15f4740 10 client.15126 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fe15f4740 1 -- 172.21.15.60:0/339014825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5575ecfa0a90 con 0x5575ecf80330 2024-09-11T23:59:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.823+0000 7f6fb7fff640 1 -- 172.21.15.60:0/339014825 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6fcc010e60 con 0x5575ecf80330 2024-09-11T23:59:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fb7fff640 1 -- 172.21.15.60:0/339014825 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6fcc038030 con 0x5575ecf80330 2024-09-11T23:59:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fe15f4740 10 client.15126 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fe15f4740 10 client.15126 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fe15f4740 20 client.15126 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5575ed005550 0x5575ed004260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fe15f4740 4 client.15126 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fe15f4740 1 -- 172.21.15.60:0/339014825 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "status"}) -- 0x5575ecee4b10 con 0x5575ed005550 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5575ed005550 0x5575ed004260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fd7fff640 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5575ed005550 0x5575ed004260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6d6a073be25b83d2 server_cookie=3146e812874142b1 in_seq=0 out_seq=0 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fb7fff640 10 client.15126 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fb7fff640 1 -- 172.21.15.60:0/339014825 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5575ecee4b10 con 0x5575ed005550 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fb7fff640 10 client.15126 handle_command_reply: tid=0 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.824+0000 7f6fe15f4740 1 client.15126 shutdown 2024-09-11T23:59:08.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 -- 172.21.15.60:0/339014825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf80330 msgr2=0x5575ecf7f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf80330 0x5575ecf7f500 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0109a0 tx=0x7f6fcc000bc0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 -- 172.21.15.60:0/339014825 shutdown_connections 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575ecf85fc0 0x5575ecf9f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575ecf80330 0x5575ecf7f500 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5575ed005550 0x5575ed004260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 --2- 172.21.15.60:0/339014825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575ecf76890 0x5575ecf7efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fb7fff640 0 client.15126 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 -- 172.21.15.60:0/339014825 >> 172.21.15.60:0/339014825 conn(0x5575ecf72f60 msgr2=0x5575ecf7e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 -- 172.21.15.60:0/339014825 shutdown_connections 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 1 -- 172.21.15.60:0/339014825 wait complete. 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fe15f4740 20 client.15126 trim_cache size 0 max 16384 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6fc80a2c90 msgr2=0x7f6fc80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6fc80a2c90 0x7f6fc80a5150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00bc9d0 tx=0x7f6fd00a7040 comp rx=0 tx=0).stop 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8106a80 msgr2=0x7f6fd81a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8106a80 0x7f6fd81a4430 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009df0 tx=0x7f6fd0032c00 comp rx=0 tx=0).stop 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3363738474 shutdown_connections 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6fc80a2c90 0x7f6fc80a5150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fd8106a80 0x7f6fd81a4430 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fd8101420 0x7f6fd81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.825+0000 7f6fdf21b640 1 --2- 172.21.15.60:0/3363738474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fd8100a80 0x7f6fd81993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.826+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3363738474 >> 172.21.15.60:0/3363738474 conn(0x7f6fd80fc7a0 msgr2=0x7f6fd80fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.826+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3363738474 shutdown_connections 2024-09-11T23:59:08.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:08.826+0000 7f6fdf21b640 1 -- 172.21.15.60:0/3363738474 wait complete. 2024-09-11T23:59:09.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:09 smithi060 ceph-mon[30953]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:09 smithi105 ceph-mon[34805]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:09.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:09 smithi192 ceph-mon[35487]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:09.824 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-11T23:59:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:10.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 -- 172.21.15.60:0/2030202045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c106f10 msgr2=0x7f6b4c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 --2- 172.21.15.60:0/2030202045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c106f10 0x7f6b4c10ea90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009ca0 tx=0x7f6b4402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 -- 172.21.15.60:0/2030202045 shutdown_connections 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 --2- 172.21.15.60:0/2030202045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c106f10 0x7f6b4c10ea90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 --2- 172.21.15.60:0/2030202045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c102790 0x7f6b4c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 --2- 172.21.15.60:0/2030202045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c101de0 0x7f6b4c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 -- 172.21.15.60:0/2030202045 >> 172.21.15.60:0/2030202045 conn(0x7f6b4c0fd8c0 msgr2=0x7f6b4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 -- 172.21.15.60:0/2030202045 shutdown_connections 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.566+0000 7f6b511d5640 1 -- 172.21.15.60:0/2030202045 wait complete. 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.567+0000 7f6b511d5640 1 Processor -- start 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.567+0000 7f6b511d5640 1 -- start start 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.567+0000 7f6b511d5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c101de0 0x7f6b4c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.567+0000 7f6b511d5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c102790 0x7f6b4c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.567+0000 7f6b511d5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c106f10 0x7f6b4c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.567+0000 7f6b511d5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c112090 con 0x7f6b4c102790 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.567+0000 7f6b511d5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c111f10 con 0x7f6b4c106f10 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.567+0000 7f6b511d5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c112210 con 0x7f6b4c101de0 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c102790 0x7f6b4c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c102790 0x7f6b4c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53586/0 (socket says 172.21.15.60:53586) 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 -- 172.21.15.60:0/94495929 learned_addr learned my addr 172.21.15.60:0/94495929 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c101de0 0x7f6b4c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c106f10 0x7f6b4c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 -- 172.21.15.60:0/94495929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c101de0 msgr2=0x7f6b4c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c101de0 0x7f6b4c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 -- 172.21.15.60:0/94495929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c106f10 msgr2=0x7f6b4c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c106f10 0x7f6b4c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 -- 172.21.15.60:0/94495929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c19d3c0 con 0x7f6b4c102790 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b4a59c640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c102790 0x7f6b4c198950 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000d770 tx=0x7f6b4000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b33fff640 1 -- 172.21.15.60:0/94495929 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40017070 con 0x7f6b4c102790 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b33fff640 1 -- 172.21.15.60:0/94495929 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b40009820 con 0x7f6b4c102790 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b511d5640 1 -- 172.21.15.60:0/94495929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c19d6b0 con 0x7f6b4c102790 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b33fff640 1 -- 172.21.15.60:0/94495929 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40004dd0 con 0x7f6b4c102790 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.568+0000 7f6b511d5640 1 -- 172.21.15.60:0/94495929 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c1a4f90 con 0x7f6b4c102790 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b33fff640 1 -- 172.21.15.60:0/94495929 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6b400099d0 con 0x7f6b4c102790 2024-09-11T23:59:10.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b535ae740 1 Processor -- start 2024-09-11T23:59:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b535ae740 1 -- start start 2024-09-11T23:59:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda83ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 0x55edda848670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda84afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b535ae740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55edda7a4090 con 0x55edda848bb0 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b535ae740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55edda74ba70 con 0x55edda83e2f0 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.571+0000 7f6b535ae740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55edda7a0050 con 0x55edda83d9d0 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda84afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda84afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53592/0 (socket says 172.21.15.60:53592) 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4a59c640 1 -- 172.21.15.60:0/3785953237 learned_addr learned my addr 172.21.15.60:0/3785953237 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda83ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b33fff640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b340a2b80 0x7f6b340a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 0x55edda848670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b340a2b80 0x7f6b340a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4b59e640 1 -- 172.21.15.60:0/3785953237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 msgr2=0x55edda848670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 0x55edda848670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4b59e640 1 -- 172.21.15.60:0/3785953237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 msgr2=0x55edda84afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b33fff640 1 -- 172.21.15.60:0/94495929 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6b400cea70 con 0x7f6b4c102790 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda84afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4b59e640 1 -- 172.21.15.60:0/3785953237 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edda758130 con 0x55edda83d9d0 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4a59c640 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda84afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.572+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda83ddb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009430 tx=0x7f6b440039f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be9ba4a13e3f0be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b340a2b80 0x7f6b340a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b44047000 tx=0x7f6b44049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b317fa640 1 -- 172.21.15.60:0/3785953237 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4404d070 con 0x55edda83d9d0 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b317fa640 1 -- 172.21.15.60:0/3785953237 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b44036070 con 0x55edda83d9d0 2024-09-11T23:59:10.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b317fa640 1 -- 172.21.15.60:0/3785953237 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4402fc90 con 0x55edda83d9d0 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 -- 172.21.15.60:0/3785953237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 msgr2=0x55edda83ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda83ddb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009430 tx=0x7f6b440039f0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 -- 172.21.15.60:0/3785953237 shutdown_connections 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda84afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 0x55edda848670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3785953237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda83ddb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 -- 172.21.15.60:0/3785953237 >> 172.21.15.60:0/3785953237 conn(0x55edda839f60 msgr2=0x55edda83a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 -- 172.21.15.60:0/3785953237 shutdown_connections 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.573+0000 7f6b535ae740 1 -- 172.21.15.60:0/3785953237 wait complete. 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 1 -- start start 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 1 Processor -- start 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda8484d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 0x55edda845820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda845d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55edda84b5a0 con 0x55edda848bb0 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55edda75ef20 con 0x55edda83d9d0 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55edda84b720 con 0x55edda83e2f0 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b535ae740 10 client.0 _ll_register_callbacks cb 0x55edda728030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b4b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda845d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b4b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda845d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53602/0 (socket says 172.21.15.60:53602) 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b4b59e640 1 -- 172.21.15.60:0/3036265748 learned_addr learned my addr 172.21.15.60:0/3036265748 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b4a59c640 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 0x55edda845820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda8484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.574+0000 7f6b4b59e640 1 -- 172.21.15.60:0/3036265748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 msgr2=0x55edda845820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 0x55edda845820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b4b59e640 1 -- 172.21.15.60:0/3036265748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 msgr2=0x55edda8484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda8484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b4b59e640 1 -- 172.21.15.60:0/3036265748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edda5152b0 con 0x55edda848bb0 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda8484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda845d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6b44004010 tx=0x7f6b44009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36ad160460850bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b2eff5640 1 -- 172.21.15.60:0/3036265748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4404d070 con 0x55edda848bb0 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b535ae740 1 -- 172.21.15.60:0/3036265748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b44036070 con 0x55edda848bb0 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b2eff5640 1 -- 172.21.15.60:0/3036265748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6b44004410 con 0x55edda848bb0 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b2eff5640 1 -- 172.21.15.60:0/3036265748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6b440319a0 con 0x55edda848bb0 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b535ae740 10 client.15138 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:10.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b535ae740 1 -- 172.21.15.60:0/3036265748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edda84b5a0 con 0x55edda848bb0 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b2eff5640 1 -- 172.21.15.60:0/3036265748 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b44036070 con 0x55edda848bb0 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.575+0000 7f6b2eff5640 1 -- 172.21.15.60:0/3036265748 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6b44049470 con 0x55edda848bb0 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b535ae740 10 client.15138 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b535ae740 10 client.15138 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b535ae740 20 client.15138 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55edda8592b0 0x55edda85a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b535ae740 4 client.15138 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b535ae740 1 -- 172.21.15.60:0/3036265748 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edda7b1600 con 0x55edda8592b0 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55edda8592b0 0x55edda85a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b2eff5640 10 client.15138 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.576+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55edda8592b0 0x55edda85a720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7b13bd682da30033 server_cookie=fe8e056bc1d7ac77 in_seq=0 out_seq=0 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b2eff5640 1 -- 172.21.15.60:0/3036265748 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55edda7b1600 con 0x55edda8592b0 2024-09-11T23:59:10.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b2eff5640 10 client.15138 handle_command_reply: tid=0 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 client.15138 shutdown 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 -- 172.21.15.60:0/3036265748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 msgr2=0x55edda845d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda845d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6b44004010 tx=0x7f6b44009360 comp rx=0 tx=0).stop 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 -- 172.21.15.60:0/3036265748 shutdown_connections 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55edda8592b0 0x55edda85a720 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda845d60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 0x55edda845820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 --2- 172.21.15.60:0/3036265748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda8484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b2eff5640 0 client.15138 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 -- 172.21.15.60:0/3036265748 >> 172.21.15.60:0/3036265748 conn(0x55edda839f60 msgr2=0x55edda83fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 -- 172.21.15.60:0/3036265748 shutdown_connections 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 1 -- 172.21.15.60:0/3036265748 wait complete. 2024-09-11T23:59:10.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.577+0000 7f6b535ae740 20 client.15138 trim_cache size 0 max 16384 2024-09-11T23:59:10.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b535ae740 1 Processor -- start 2024-09-11T23:59:10.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b535ae740 1 -- start start 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda85a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 0x55edda847680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda842a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b535ae740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55edda858a60 con 0x55edda848bb0 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b535ae740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55edda859130 con 0x55edda83d9d0 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b535ae740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55edda859800 con 0x55edda83e2f0 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b4b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda842a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.596+0000 7f6b4b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda842a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53610/0 (socket says 172.21.15.60:53610) 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4b59e640 1 -- 172.21.15.60:0/1893614371 learned_addr learned my addr 172.21.15.60:0/1893614371 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4a59c640 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 0x55edda847680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda85a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4b59e640 1 -- 172.21.15.60:0/1893614371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 msgr2=0x55edda847680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 0x55edda847680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4b59e640 1 -- 172.21.15.60:0/1893614371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 msgr2=0x55edda85a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda85a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4b59e640 1 -- 172.21.15.60:0/1893614371 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edda843d70 con 0x55edda848bb0 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda842a80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6b44002230 tx=0x7f6b440095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda9e67c4411253a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b30ff9640 1 -- 172.21.15.60:0/1893614371 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4404d070 con 0x55edda848bb0 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b30ff9640 1 -- 172.21.15.60:0/1893614371 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b44036040 con 0x55edda848bb0 2024-09-11T23:59:10.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.597+0000 7f6b30ff9640 1 -- 172.21.15.60:0/1893614371 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4402fbe0 con 0x55edda848bb0 2024-09-11T23:59:10.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 -- 172.21.15.60:0/1893614371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 msgr2=0x55edda842a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda842a80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6b44002230 tx=0x7f6b440095c0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 -- 172.21.15.60:0/1893614371 shutdown_connections 2024-09-11T23:59:10.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda842a80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83e2f0 0x55edda847680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1893614371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83d9d0 0x55edda85a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 -- 172.21.15.60:0/1893614371 >> 172.21.15.60:0/1893614371 conn(0x55edda839f60 msgr2=0x55edda846f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 -- 172.21.15.60:0/1893614371 shutdown_connections 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 -- 172.21.15.60:0/1893614371 wait complete. 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 -- start start 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.598+0000 7f6b535ae740 1 Processor -- start 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda8631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 0x55edda85e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b535ae740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda85eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b535ae740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55edda85a5a0 con 0x55edda848bb0 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b535ae740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55edda859ed0 con 0x55edda83e2f0 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b535ae740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55edda85ac70 con 0x55edda83d9d0 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b535ae740 10 client.0 _ll_register_callbacks cb 0x7f6b400975c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:10.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda85eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda85eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53622/0 (socket says 172.21.15.60:53622) 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 -- 172.21.15.60:0/1290512349 learned_addr learned my addr 172.21.15.60:0/1290512349 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda8631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4a59c640 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 0x55edda85e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 -- 172.21.15.60:0/1290512349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 msgr2=0x55edda8631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda8631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 -- 172.21.15.60:0/1290512349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 msgr2=0x55edda85e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 0x55edda85e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 -- 172.21.15.60:0/1290512349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edda85f340 con 0x55edda848bb0 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b4b59e640 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda85eb10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6b4402ade0 tx=0x7f6b4402f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98fd3ed3d099d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:10.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.599+0000 7f6b2eff5640 1 -- 172.21.15.60:0/1290512349 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4404d070 con 0x55edda848bb0 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b2eff5640 1 -- 172.21.15.60:0/1290512349 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f6b4402fde0 con 0x55edda848bb0 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 1 -- 172.21.15.60:0/1290512349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b44036040 con 0x55edda848bb0 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b2eff5640 1 -- 172.21.15.60:0/1290512349 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6b44004410 con 0x55edda848bb0 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 10 client.15144 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 1 -- 172.21.15.60:0/1290512349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edda8c3a90 con 0x55edda848bb0 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b2eff5640 1 -- 172.21.15.60:0/1290512349 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b44036040 con 0x55edda848bb0 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b2eff5640 1 -- 172.21.15.60:0/1290512349 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6b44064070 con 0x55edda848bb0 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 10 client.15144 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 10 client.15144 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 20 client.15144 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55edda8c8140 0x55edda8c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:10.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 4 client.15144 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b535ae740 1 -- 172.21.15.60:0/1290512349 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "status"}) -- 0x55edda7abb10 con 0x55edda8c8140 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.600+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55edda8c8140 0x55edda8c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b2eff5640 10 client.15144 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b4ad9d640 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55edda8c8140 0x55edda8c6e50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=362e0250b47cd94a server_cookie=66852a13470793e5 in_seq=0 out_seq=0 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b2eff5640 1 -- 172.21.15.60:0/1290512349 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55edda7abb10 con 0x55edda8c8140 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b2eff5640 10 client.15144 handle_command_reply: tid=0 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 client.15144 shutdown 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 -- 172.21.15.60:0/1290512349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 msgr2=0x55edda85eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda85eb10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6b4402ade0 tx=0x7f6b4402f6d0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 -- 172.21.15.60:0/1290512349 shutdown_connections 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55edda8c8140 0x55edda8c6e50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55edda848bb0 0x55edda85eb10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55edda83e2f0 0x55edda85e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 --2- 172.21.15.60:0/1290512349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edda83d9d0 0x55edda8631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b2eff5640 0 client.15144 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.601+0000 7f6b535ae740 1 -- 172.21.15.60:0/1290512349 >> 172.21.15.60:0/1290512349 conn(0x55edda839f60 msgr2=0x55edda845900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b535ae740 1 -- 172.21.15.60:0/1290512349 shutdown_connections 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b535ae740 1 -- 172.21.15.60:0/1290512349 wait complete. 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b535ae740 20 client.15144 trim_cache size 0 max 16384 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 3, 2024-09-11T23:59:10.607 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24475, 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 92.120770491000002, 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 129.64506595399999 2024-09-11T23:59:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 -- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b340a2b80 msgr2=0x7f6b340a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b340a2b80 0x7f6b340a5040 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b44047000 tx=0x7f6b44049000 comp rx=0 tx=0).stop 2024-09-11T23:59:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 -- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c102790 msgr2=0x7f6b4c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c102790 0x7f6b4c198950 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000d770 tx=0x7f6b4000db70 comp rx=0 tx=0).stop 2024-09-11T23:59:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 -- 172.21.15.60:0/94495929 shutdown_connections 2024-09-11T23:59:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c106f10 0x7f6b4c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f6b340a2b80 0x7f6b340a5040 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4c102790 0x7f6b4c198950 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 --2- 172.21.15.60:0/94495929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b4c101de0 0x7f6b4c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:10.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 -- 172.21.15.60:0/94495929 >> 172.21.15.60:0/94495929 conn(0x7f6b4c0fd8c0 msgr2=0x7f6b4c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:10.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 -- 172.21.15.60:0/94495929 shutdown_connections 2024-09-11T23:59:10.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:10.602+0000 7f6b511d5640 1 -- 172.21.15.60:0/94495929 wait complete. 2024-09-11T23:59:11.255 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:11 smithi060 ceph-mon[30953]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:59:11.255 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:11 smithi060 ceph-mon[30953]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T23:59:11.284 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T23:59:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:11 smithi105 ceph-mon[34805]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:59:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:11 smithi105 ceph-mon[34805]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T23:59:11.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:11 smithi192 ceph-mon[35487]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-11T23:59:11.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:11 smithi192 ceph-mon[35487]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-11T23:59:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:12.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 -- 172.21.15.60:0/1299003633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 msgr2=0x7f9ba4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 --2- 172.21.15.60:0/1299003633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 0x7f9ba4100ee0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009930 tx=0x7f9b9402a420 comp rx=0 tx=0).stop 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 -- 172.21.15.60:0/1299003633 shutdown_connections 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 --2- 172.21.15.60:0/1299003633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ba4101420 0x7f9ba410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 --2- 172.21.15.60:0/1299003633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 0x7f9ba4100ee0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 --2- 172.21.15.60:0/1299003633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ba4106a80 0x7f9ba4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 -- 172.21.15.60:0/1299003633 >> 172.21.15.60:0/1299003633 conn(0x7f9ba40fc7a0 msgr2=0x7f9ba40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 -- 172.21.15.60:0/1299003633 shutdown_connections 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.010+0000 7f9babeb9640 1 -- 172.21.15.60:0/1299003633 wait complete. 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9babeb9640 1 Processor -- start 2024-09-11T23:59:12.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9babeb9640 1 -- start start 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9babeb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 0x7f9ba4198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9babeb9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ba4101420 0x7f9ba4198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9babeb9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ba4106a80 0x7f9ba419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9babeb9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba4111060 con 0x7f9ba4100a80 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9babeb9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba4110ee0 con 0x7f9ba4106a80 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9babeb9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba41111e0 con 0x7f9ba4101420 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9ba9c55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 0x7f9ba4198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9ba9c55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 0x7f9ba4198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42014/0 (socket says 172.21.15.60:42014) 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9ba9c55640 1 -- 172.21.15.60:0/2291384781 learned_addr learned my addr 172.21.15.60:0/2291384781 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.011+0000 7f9ba9454640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ba4101420 0x7f9ba4198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9baa456640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ba4106a80 0x7f9ba419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9ba9c55640 1 -- 172.21.15.60:0/2291384781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ba4101420 msgr2=0x7f9ba4198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ba4101420 0x7f9ba4198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9ba9c55640 1 -- 172.21.15.60:0/2291384781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ba4106a80 msgr2=0x7f9ba419cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ba4106a80 0x7f9ba419cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9ba9c55640 1 -- 172.21.15.60:0/2291384781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba419d640 con 0x7f9ba4100a80 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 0x7f9ba4198690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000b4a0 tx=0x7f9ba000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9b9affd640 1 -- 172.21.15.60:0/2291384781 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0014070 con 0x7f9ba4100a80 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9b9affd640 1 -- 172.21.15.60:0/2291384781 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ba0010b10 con 0x7f9ba4100a80 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9babeb9640 1 -- 172.21.15.60:0/2291384781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba419d930 con 0x7f9ba4100a80 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9b9affd640 1 -- 172.21.15.60:0/2291384781 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0017d60 con 0x7f9ba4100a80 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.012+0000 7f9babeb9640 1 -- 172.21.15.60:0/2291384781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba41a5210 con 0x7f9ba4100a80 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.014+0000 7f9b9affd640 1 -- 172.21.15.60:0/2291384781 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9ba0017070 con 0x7f9ba4100a80 2024-09-11T23:59:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9bae292740 1 Processor -- start 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9bae292740 1 -- start start 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9bae292740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9bae292740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9bae292740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9bae292740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5563ca226090 con 0x5563ca2c02f0 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9b9affd640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9b900a2b80 0x7f9b900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9bae292740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5563ca1cda70 con 0x5563ca2bf9d0 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9bae292740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563ca222050 con 0x5563ca2cabb0 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.015+0000 7f9ba9c55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9baa456640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9b900a2b80 0x7f9b900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9c55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42030/0 (socket says 172.21.15.60:42030) 2024-09-11T23:59:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9c55640 1 -- 172.21.15.60:0/2280538617 learned_addr learned my addr 172.21.15.60:0/2280538617 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9b9affd640 1 -- 172.21.15.60:0/2291384781 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f9ba00ce3b0 con 0x7f9ba4100a80 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9baa456640 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9454640 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9c55640 1 -- 172.21.15.60:0/2280538617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 msgr2=0x5563ca2ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9c55640 1 -- 172.21.15.60:0/2280538617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 msgr2=0x5563ca2bfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2bfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9c55640 1 -- 172.21.15.60:0/2280538617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ca1da130 con 0x5563ca2c02f0 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9baa456640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9b900a2b80 0x7f9b900a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00a6b0 tx=0x7f9b9c00aab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2ca670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00970a0 tx=0x7f9ba0090120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d10e030699af52b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9b8ffff640 1 -- 172.21.15.60:0/2280538617 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba001e070 con 0x5563ca2c02f0 2024-09-11T23:59:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9b8ffff640 1 -- 172.21.15.60:0/2280538617 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ba009b340 con 0x5563ca2c02f0 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.016+0000 7f9b8ffff640 1 -- 172.21.15.60:0/2280538617 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00173f0 con 0x5563ca2c02f0 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 -- 172.21.15.60:0/2280538617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 msgr2=0x5563ca2ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2ca670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00970a0 tx=0x7f9ba0090120 comp rx=0 tx=0).stop 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 -- 172.21.15.60:0/2280538617 shutdown_connections 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2ca670 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 --2- 172.21.15.60:0/2280538617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2bfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 -- 172.21.15.60:0/2280538617 >> 172.21.15.60:0/2280538617 conn(0x5563ca2bbf60 msgr2=0x5563ca2bc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 -- 172.21.15.60:0/2280538617 shutdown_connections 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 -- 172.21.15.60:0/2280538617 wait complete. 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 -- start start 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.017+0000 7f9bae292740 1 Processor -- start 2024-09-11T23:59:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9bae292740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9bae292740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9bae292740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9bae292740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5563ca2cd780 con 0x5563ca2c02f0 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9bae292740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5563ca1e0f20 con 0x5563ca2bf9d0 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9bae292740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563ca2cd900 con 0x5563ca2cabb0 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9bae292740 10 client.0 _ll_register_callbacks cb 0x5563ca1aa030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9454640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9454640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42038/0 (socket says 172.21.15.60:42038) 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9454640 1 -- 172.21.15.60:0/4124129085 learned_addr learned my addr 172.21.15.60:0/4124129085 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9baa456640 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9454640 1 -- 172.21.15.60:0/4124129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 msgr2=0x5563ca2c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9454640 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9454640 1 -- 172.21.15.60:0/4124129085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 msgr2=0x5563ca2ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9454640 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.018+0000 7f9ba9454640 1 -- 172.21.15.60:0/4124129085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c9f972b0 con 0x5563ca2c02f0 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9ba9454640 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2c7840 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009930 tx=0x7f9b940318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29869abc6217dde2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9b8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/4124129085 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94040070 con 0x5563ca2c02f0 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/4124129085 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f9b94004450 con 0x5563ca2c02f0 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 1 -- 172.21.15.60:0/4124129085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ba009b340 con 0x5563ca2c02f0 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/4124129085 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b9404b070 con 0x5563ca2c02f0 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 10 client.15156 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 1 -- 172.21.15.60:0/4124129085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5563ca2d9130 con 0x5563ca2c02f0 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/4124129085 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ba009b340 con 0x5563ca2c02f0 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/4124129085 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9b940035f0 con 0x5563ca2c02f0 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 10 client.15156 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 10 client.15156 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 20 client.15156 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5563ca2db790 0x5563ca2dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 4 client.15156 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.019+0000 7f9bae292740 1 -- 172.21.15.60:0/4124129085 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563ca233600 con 0x5563ca2db790 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.020+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5563ca2db790 0x5563ca2dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.020+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5563ca2db790 0x5563ca2dcc00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f8f59311a148f3f server_cookie=d9aa5279137331bc in_seq=0 out_seq=0 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.020+0000 7f9b8d7fa640 10 client.15156 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-11T23:59:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/4124129085 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563ca233600 con 0x5563ca2db790 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9b8d7fa640 10 client.15156 handle_command_reply: tid=0 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 client.15156 shutdown 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 -- 172.21.15.60:0/4124129085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 msgr2=0x5563ca2c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2c7840 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009930 tx=0x7f9b940318e0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 -- 172.21.15.60:0/4124129085 shutdown_connections 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5563ca2db790 0x5563ca2dcc00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2c7840 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9b8d7fa640 0 client.15156 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 --2- 172.21.15.60:0/4124129085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 -- 172.21.15.60:0/4124129085 >> 172.21.15.60:0/4124129085 conn(0x5563ca2bbf60 msgr2=0x5563ca2c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 -- 172.21.15.60:0/4124129085 shutdown_connections 2024-09-11T23:59:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 1 -- 172.21.15.60:0/4124129085 wait complete. 2024-09-11T23:59:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.021+0000 7f9bae292740 20 client.15156 trim_cache size 0 max 16384 2024-09-11T23:59:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.039+0000 7f9bae292740 1 Processor -- start 2024-09-11T23:59:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9bae292740 1 -- start start 2024-09-11T23:59:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9bae292740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9bae292740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2c02f0 0x5563ca2e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9bae292740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9bae292740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5563ca2daf40 con 0x5563ca2bf9d0 2024-09-11T23:59:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9bae292740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5563ca2db610 con 0x5563ca2c02f0 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9bae292740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563ca2dbce0 con 0x5563ca2cabb0 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42052/0 (socket says 172.21.15.60:42052) 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 -- 172.21.15.60:0/3819335344 learned_addr learned my addr 172.21.15.60:0/3819335344 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9454640 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2c02f0 0x5563ca2e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9baa456640 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 -- 172.21.15.60:0/3819335344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 msgr2=0x5563ca2e53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2e53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 -- 172.21.15.60:0/3819335344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2c02f0 msgr2=0x5563ca2e4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2c02f0 0x5563ca2e4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 -- 172.21.15.60:0/3819335344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ca2cd890 con 0x5563ca2bf9d0 2024-09-11T23:59:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9baa456640 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2e53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.040+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9ba009a940 tx=0x7f9ba00177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fed235693c8d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9b8f7fe640 1 -- 172.21.15.60:0/3819335344 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba001e040 con 0x5563ca2bf9d0 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9b8f7fe640 1 -- 172.21.15.60:0/3819335344 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ba0098f40 con 0x5563ca2bf9d0 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9b8f7fe640 1 -- 172.21.15.60:0/3819335344 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00972b0 con 0x5563ca2bf9d0 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 -- 172.21.15.60:0/3819335344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2bf9d0 msgr2=0x5563ca2ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9ba009a940 tx=0x7f9ba00177c0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 -- 172.21.15.60:0/3819335344 shutdown_connections 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca2e53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2c02f0 0x5563ca2e4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 --2- 172.21.15.60:0/3819335344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2bf9d0 0x5563ca2ca4a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 -- 172.21.15.60:0/3819335344 >> 172.21.15.60:0/3819335344 conn(0x5563ca2bbf60 msgr2=0x5563ca2c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 -- 172.21.15.60:0/3819335344 shutdown_connections 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.041+0000 7f9bae292740 1 -- 172.21.15.60:0/3819335344 wait complete. 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 1 -- start start 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 1 Processor -- start 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca343e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5563ca2dca80 con 0x5563ca2c02f0 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5563ca2dc3b0 con 0x5563ca2bf9d0 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563ca2dd150 con 0x5563ca2cabb0 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9bae292740 10 client.0 _ll_register_callbacks cb 0x7f9b94009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.042+0000 7f9ba9454640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9454640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2e0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42064/0 (socket says 172.21.15.60:42064) 2024-09-11T23:59:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9454640 1 -- 172.21.15.60:0/2376693611 learned_addr learned my addr 172.21.15.60:0/2376693611 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9454640 1 -- 172.21.15.60:0/2376693611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 msgr2=0x5563ca343e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9454640 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca343e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9454640 1 -- 172.21.15.60:0/2376693611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 msgr2=0x5563ca2dfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9454640 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2dfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9454640 1 -- 172.21.15.60:0/2376693611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ca3443d0 con 0x5563ca2c02f0 2024-09-11T23:59:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2dfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9ba9454640 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2e0530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b9402a940 tx=0x7f9b94005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7476ee2b8642dac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9b8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/2376693611 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94040040 con 0x5563ca2c02f0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/2376693611 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f9b94004250 con 0x5563ca2c02f0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9bae292740 1 -- 172.21.15.60:0/2376693611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ba0098f40 con 0x5563ca2c02f0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.043+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/2376693611 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b94060050 con 0x5563ca2c02f0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9bae292740 10 client.15162 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9bae292740 1 -- 172.21.15.60:0/2376693611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5563ca3454b0 con 0x5563ca2c02f0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/2376693611 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ba0098f40 con 0x5563ca2c02f0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/2376693611 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9b94004880 con 0x5563ca2c02f0 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9bae292740 10 client.15162 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9bae292740 10 client.15162 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9bae292740 20 client.15162 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9bae292740 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5563ca34a090 0x5563ca348da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9bae292740 4 client.15162 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9bae292740 1 -- 172.21.15.60:0/2376693611 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "status"}) -- 0x5563ca22db10 con 0x5563ca34a090 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.044+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5563ca34a090 0x5563ca348da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9ba9c55640 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5563ca34a090 0x5563ca348da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5959963dabc88a2c server_cookie=cd56aa17341a52c3 in_seq=0 out_seq=0 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9b8d7fa640 10 client.15162 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9b8d7fa640 1 -- 172.21.15.60:0/2376693611 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5563ca22db10 con 0x5563ca34a090 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9b8d7fa640 10 client.15162 handle_command_reply: tid=0 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 client.15162 shutdown 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 -- 172.21.15.60:0/2376693611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 msgr2=0x5563ca2e0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2e0530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b9402a940 tx=0x7f9b94005b50 comp rx=0 tx=0).stop 2024-09-11T23:59:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 -- 172.21.15.60:0/2376693611 shutdown_connections 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5563ca34a090 0x5563ca348da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563ca2cabb0 0x5563ca343e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5563ca2c02f0 0x5563ca2e0530 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 --2- 172.21.15.60:0/2376693611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5563ca2bf9d0 0x5563ca2dfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9b8d7fa640 0 client.15162 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 -- 172.21.15.60:0/2376693611 >> 172.21.15.60:0/2376693611 conn(0x5563ca2bbf60 msgr2=0x5563ca2c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 -- 172.21.15.60:0/2376693611 shutdown_connections 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 1 -- 172.21.15.60:0/2376693611 wait complete. 2024-09-11T23:59:12.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.045+0000 7f9bae292740 20 client.15162 trim_cache size 0 max 16384 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 2, 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24484, 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 94.574448654999998, 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:12.059 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 128.48231122999999 2024-09-11T23:59:12.060 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:12.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 -- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9b900a2b80 msgr2=0x7f9b900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9b900a2b80 0x7f9b900a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00a6b0 tx=0x7f9b9c00aab0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 -- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 msgr2=0x7f9ba4198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:12.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 0x7f9ba4198690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000b4a0 tx=0x7f9ba000b960 comp rx=0 tx=0).stop 2024-09-11T23:59:12.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 -- 172.21.15.60:0/2291384781 shutdown_connections 2024-09-11T23:59:12.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ba4106a80 0x7f9ba419cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ba4101420 0x7f9ba4198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f9b900a2b80 0x7f9b900a5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 --2- 172.21.15.60:0/2291384781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ba4100a80 0x7f9ba4198690 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:12.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 -- 172.21.15.60:0/2291384781 >> 172.21.15.60:0/2291384781 conn(0x7f9ba40fc7a0 msgr2=0x7f9ba406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:12.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 -- 172.21.15.60:0/2291384781 shutdown_connections 2024-09-11T23:59:12.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:12.046+0000 7f9babeb9640 1 -- 172.21.15.60:0/2291384781 wait complete. 2024-09-11T23:59:12.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:59:12.946 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:13.336 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:13 smithi060 ceph-mon[30953]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 -- 172.21.15.60:0/1325933139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c102570 msgr2=0x7fa22c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 --2- 172.21.15.60:0/1325933139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c102570 0x7fa22c1029b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009900 tx=0x7fa21c02a480 comp rx=0 tx=0).stop 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 -- 172.21.15.60:0/1325933139 shutdown_connections 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 --2- 172.21.15.60:0/1325933139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa22c102ef0 0x7fa22c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 --2- 172.21.15.60:0/1325933139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c102570 0x7fa22c1029b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 --2- 172.21.15.60:0/1325933139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c100e20 0x7fa22c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 -- 172.21.15.60:0/1325933139 >> 172.21.15.60:0/1325933139 conn(0x7fa22c0fc7d0 msgr2=0x7fa22c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 -- 172.21.15.60:0/1325933139 shutdown_connections 2024-09-11T23:59:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 -- 172.21.15.60:0/1325933139 wait complete. 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 Processor -- start 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.420+0000 7fa233e20640 1 -- start start 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa233e20640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c100e20 0x7fa22c1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa233e20640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa22c102570 0x7fa22c1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa233e20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c102ef0 0x7fa22c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa233e20640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c112260 con 0x7fa22c100e20 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa233e20640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c1120e0 con 0x7fa22c102570 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa233e20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c1123e0 con 0x7fa22c102ef0 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c100e20 0x7fa22c1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c100e20 0x7fa22c1a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42088/0 (socket says 172.21.15.60:42088) 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 -- 172.21.15.60:0/315923960 learned_addr learned my addr 172.21.15.60:0/315923960 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa2313bb640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa22c102570 0x7fa22c1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa2323bd640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c102ef0 0x7fa22c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 -- 172.21.15.60:0/315923960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c102ef0 msgr2=0x7fa22c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c102ef0 0x7fa22c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 -- 172.21.15.60:0/315923960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa22c102570 msgr2=0x7fa22c1a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa22c102570 0x7fa22c1a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 -- 172.21.15.60:0/315923960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c19af20 con 0x7fa22c100e20 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa2313bb640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa22c102570 0x7fa22c1a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa2323bd640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c102ef0 0x7fa22c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.421+0000 7fa231bbc640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c100e20 0x7fa22c1a05e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa22800b4a0 tx=0x7fa22800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.422+0000 7fa222ffd640 1 -- 172.21.15.60:0/315923960 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228014070 con 0x7fa22c100e20 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.422+0000 7fa222ffd640 1 -- 172.21.15.60:0/315923960 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa228010b10 con 0x7fa22c100e20 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.422+0000 7fa233e20640 1 -- 172.21.15.60:0/315923960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c19b210 con 0x7fa22c100e20 2024-09-11T23:59:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.422+0000 7fa222ffd640 1 -- 172.21.15.60:0/315923960 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228017d60 con 0x7fa22c100e20 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.422+0000 7fa233e20640 1 -- 172.21.15.60:0/315923960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c1a7410 con 0x7fa22c100e20 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.424+0000 7fa222ffd640 1 -- 172.21.15.60:0/315923960 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa228017070 con 0x7fa22c100e20 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.424+0000 7fa2361f9740 1 Processor -- start 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.424+0000 7fa2361f9740 1 -- start start 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.424+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b449d0 0x55ecf0b44db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.424+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b51fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2361f9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0aab090 con 0x55ecf0b452f0 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2361f9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0a52a70 con 0x55ecf0b4fbb0 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2361f9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0aa7050 con 0x55ecf0b449d0 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42098/0 (socket says 172.21.15.60:42098) 2024-09-11T23:59:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 -- 172.21.15.60:0/834512291 learned_addr learned my addr 172.21.15.60:0/834512291 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa222ffd640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa2180a2b80 0x7fa2180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2313bb640 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b51fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2323bd640 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b449d0 0x55ecf0b44db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2323bd640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa2180a2b80 0x7fa2180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa222ffd640 1 -- 172.21.15.60:0/315923960 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fa2280ce4d0 con 0x7fa22c100e20 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 -- 172.21.15.60:0/834512291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b449d0 msgr2=0x55ecf0b44db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b449d0 0x55ecf0b44db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 -- 172.21.15.60:0/834512291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b4fbb0 msgr2=0x55ecf0b51fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b51fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 -- 172.21.15.60:0/834512291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf0a5f130 con 0x55ecf0b452f0 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2323bd640 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b449d0 0x55ecf0b44db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa231bbc640 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4f670 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa22809acf0 tx=0x7fa228017360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c6da426f2de34b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa2323bd640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa2180a2b80 0x7fa2180a5040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa22400e6b0 tx=0x7fa224008220 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.425+0000 7fa217fff640 1 -- 172.21.15.60:0/834512291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22801e070 con 0x55ecf0b452f0 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa217fff640 1 -- 172.21.15.60:0/834512291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa22809b460 con 0x55ecf0b452f0 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa217fff640 1 -- 172.21.15.60:0/834512291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa228099130 con 0x55ecf0b452f0 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 -- 172.21.15.60:0/834512291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 msgr2=0x55ecf0b4f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4f670 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa22809acf0 tx=0x7fa228017360 comp rx=0 tx=0).stop 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 -- 172.21.15.60:0/834512291 shutdown_connections 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b51fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4f670 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 --2- 172.21.15.60:0/834512291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b449d0 0x55ecf0b44db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 -- 172.21.15.60:0/834512291 >> 172.21.15.60:0/834512291 conn(0x55ecf0b40f60 msgr2=0x55ecf0b41340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 -- 172.21.15.60:0/834512291 shutdown_connections 2024-09-11T23:59:13.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.426+0000 7fa2361f9740 1 -- 172.21.15.60:0/834512291 wait complete. 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 1 -- start start 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 1 Processor -- start 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b4f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b4cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0b52780 con 0x55ecf0b449d0 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0a65f20 con 0x55ecf0b452f0 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0b52900 con 0x55ecf0b4fbb0 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2361f9740 10 client.0 _ll_register_callbacks cb 0x55ecf0a2f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa231bbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b4f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa231bbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b4f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42114/0 (socket says 172.21.15.60:42114) 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa231bbc640 1 -- 172.21.15.60:0/11939341 learned_addr learned my addr 172.21.15.60:0/11939341 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:13.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.427+0000 7fa2323bd640 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b4cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2313bb640 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa231bbc640 1 -- 172.21.15.60:0/11939341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 msgr2=0x55ecf0b4cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa231bbc640 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b4cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa231bbc640 1 -- 172.21.15.60:0/11939341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 msgr2=0x55ecf0b4c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa231bbc640 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa231bbc640 1 -- 172.21.15.60:0/11939341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf081c2b0 con 0x55ecf0b449d0 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa231bbc640 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b4f480 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa2280cc050 tx=0x7fa2280047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c06a2b43f2f2d24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2157fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2157fa640 1 -- 172.21.15.60:0/11939341 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22801e070 con 0x55ecf0b449d0 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2157fa640 1 -- 172.21.15.60:0/11939341 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fa228010cc0 con 0x55ecf0b449d0 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2361f9740 1 -- 172.21.15.60:0/11939341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa22809b460 con 0x55ecf0b449d0 2024-09-11T23:59:13.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2157fa640 1 -- 172.21.15.60:0/11939341 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa2280a39d0 con 0x55ecf0b449d0 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2361f9740 10 client.15174 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2361f9740 1 -- 172.21.15.60:0/11939341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ecf0b5e0d0 con 0x55ecf0b449d0 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2157fa640 1 -- 172.21.15.60:0/11939341 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa22809b460 con 0x55ecf0b449d0 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.428+0000 7fa2157fa640 1 -- 172.21.15.60:0/11939341 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa228085050 con 0x55ecf0b449d0 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2361f9740 10 client.15174 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2361f9740 10 client.15174 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2361f9740 20 client.15174 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2361f9740 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ecf0b5f420 0x55ecf0b61600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2361f9740 4 client.15174 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2361f9740 1 -- 172.21.15.60:0/11939341 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecf0ab8600 con 0x55ecf0b5f420 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2313bb640 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ecf0b5f420 0x55ecf0b61600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2313bb640 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ecf0b5f420 0x55ecf0b61600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eb854ff4cc76fde5 server_cookie=f20d289bb39919de in_seq=0 out_seq=0 2024-09-11T23:59:13.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.429+0000 7fa2157fa640 10 client.15174 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-11T23:59:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2157fa640 1 -- 172.21.15.60:0/11939341 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ecf0ab8600 con 0x55ecf0b5f420 2024-09-11T23:59:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2157fa640 10 client.15174 handle_command_reply: tid=0 2024-09-11T23:59:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 client.15174 shutdown 2024-09-11T23:59:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 -- 172.21.15.60:0/11939341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 msgr2=0x55ecf0b4f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b4f480 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa2280cc050 tx=0x7fa2280047d0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 -- 172.21.15.60:0/11939341 shutdown_connections 2024-09-11T23:59:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ecf0b5f420 0x55ecf0b61600 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b4cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 0x55ecf0b4c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 --2- 172.21.15.60:0/11939341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b4f480 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2157fa640 0 client.15174 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-11T23:59:13.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 -- 172.21.15.60:0/11939341 >> 172.21.15.60:0/11939341 conn(0x55ecf0b40f60 msgr2=0x55ecf0b46c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:13.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 -- 172.21.15.60:0/11939341 shutdown_connections 2024-09-11T23:59:13.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 1 -- 172.21.15.60:0/11939341 wait complete. 2024-09-11T23:59:13.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.430+0000 7fa2361f9740 20 client.15174 trim_cache size 0 max 16384 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2361f9740 1 Processor -- start 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2361f9740 1 -- start start 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b449d0 0x55ecf0b60860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b60190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b5fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2361f9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0b5f940 con 0x55ecf0b452f0 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2361f9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0b60010 con 0x55ecf0b449d0 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2361f9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0b606e0 con 0x55ecf0b4fbb0 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b60190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b60190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42116/0 (socket says 172.21.15.60:42116) 2024-09-11T23:59:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 -- 172.21.15.60:0/3823019501 learned_addr learned my addr 172.21.15.60:0/3823019501 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2323bd640 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b5fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa231bbc640 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b449d0 0x55ecf0b60860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 -- 172.21.15.60:0/3823019501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 msgr2=0x55ecf0b5fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b5fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 -- 172.21.15.60:0/3823019501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b449d0 msgr2=0x55ecf0b60860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b449d0 0x55ecf0b60860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 -- 172.21.15.60:0/3823019501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecf0b45120 con 0x55ecf0b452f0 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.449+0000 7fa2313bb640 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b60190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa21c02a4c0 tx=0x7fa21c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1af25987ce0ab08 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2177fe640 1 -- 172.21.15.60:0/3823019501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c049020 con 0x55ecf0b452f0 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2177fe640 1 -- 172.21.15.60:0/3823019501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa21c031a20 con 0x55ecf0b452f0 2024-09-11T23:59:13.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2177fe640 1 -- 172.21.15.60:0/3823019501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c035040 con 0x55ecf0b452f0 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2361f9740 1 -- 172.21.15.60:0/3823019501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 msgr2=0x55ecf0b60190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b60190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa21c02a4c0 tx=0x7fa21c009560 comp rx=0 tx=0).stop 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2361f9740 1 -- 172.21.15.60:0/3823019501 shutdown_connections 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b5fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b452f0 0x55ecf0b60190 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3823019501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b449d0 0x55ecf0b60860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.450+0000 7fa2361f9740 1 -- 172.21.15.60:0/3823019501 >> 172.21.15.60:0/3823019501 conn(0x55ecf0b40f60 msgr2=0x55ecf0b3f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.451+0000 7fa2361f9740 1 -- 172.21.15.60:0/3823019501 shutdown_connections 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.451+0000 7fa2361f9740 1 -- 172.21.15.60:0/3823019501 wait complete. 2024-09-11T23:59:13.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.451+0000 7fa2361f9740 1 -- start start 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.451+0000 7fa2361f9740 1 Processor -- start 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.451+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b69fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.451+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 0x55ecf0b632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2361f9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b63810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2361f9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0b61480 con 0x55ecf0b449d0 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2361f9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0b60db0 con 0x55ecf0b452f0 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2361f9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ecf0b61b50 con 0x55ecf0b4fbb0 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2361f9740 10 client.0 _ll_register_callbacks cb 0x7fa21c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b69fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b69fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42126/0 (socket says 172.21.15.60:42126) 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 -- 172.21.15.60:0/3316110299 learned_addr learned my addr 172.21.15.60:0/3316110299 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2313bb640 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 0x55ecf0b632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2323bd640 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b63810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 -- 172.21.15.60:0/3316110299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 msgr2=0x55ecf0b63810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b63810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 -- 172.21.15.60:0/3316110299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 msgr2=0x55ecf0b632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 0x55ecf0b632d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 -- 172.21.15.60:0/3316110299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecf0b63ff0 con 0x55ecf0b449d0 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2323bd640 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b63810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa231bbc640 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b69fa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa228097730 tx=0x7fa228097080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6633437046557f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2157fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:13.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2157fa640 1 -- 172.21.15.60:0/3316110299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22801e070 con 0x55ecf0b449d0 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2157fa640 1 -- 172.21.15.60:0/3316110299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fa228010cc0 con 0x55ecf0b449d0 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2361f9740 1 -- 172.21.15.60:0/3316110299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa21c031a20 con 0x55ecf0b449d0 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2157fa640 1 -- 172.21.15.60:0/3316110299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa22809f110 con 0x55ecf0b449d0 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2361f9740 10 client.15180 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.452+0000 7fa2361f9740 1 -- 172.21.15.60:0/3316110299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ecf0bca8a0 con 0x55ecf0b449d0 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2157fa640 1 -- 172.21.15.60:0/3316110299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa21c031a20 con 0x55ecf0b449d0 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2157fa640 1 -- 172.21.15.60:0/3316110299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa228085070 con 0x55ecf0b449d0 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2361f9740 10 client.15180 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2361f9740 10 client.15180 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2361f9740 20 client.15180 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ecf0bcf140 0x55ecf0bcde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:13.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2361f9740 4 client.15180 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2361f9740 1 -- 172.21.15.60:0/3316110299 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "status"}) -- 0x55ecf0ab2b10 con 0x55ecf0bcf140 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.453+0000 7fa2313bb640 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ecf0bcf140 0x55ecf0bcde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2157fa640 10 client.15180 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2313bb640 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ecf0bcf140 0x55ecf0bcde50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=23dddc3665d1f1b2 server_cookie=266fd09e5413d265 in_seq=0 out_seq=0 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2157fa640 1 -- 172.21.15.60:0/3316110299 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ecf0ab2b10 con 0x55ecf0bcf140 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2157fa640 10 client.15180 handle_command_reply: tid=0 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 client.15180 shutdown 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 -- 172.21.15.60:0/3316110299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 msgr2=0x55ecf0b69fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b69fa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa228097730 tx=0x7fa228097080 comp rx=0 tx=0).stop 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 -- 172.21.15.60:0/3316110299 shutdown_connections 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ecf0bcf140 0x55ecf0bcde50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ecf0b4fbb0 0x55ecf0b63810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ecf0b452f0 0x55ecf0b632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 --2- 172.21.15.60:0/3316110299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ecf0b449d0 0x55ecf0b69fa0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2157fa640 0 client.15180 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 -- 172.21.15.60:0/3316110299 >> 172.21.15.60:0/3316110299 conn(0x55ecf0b40f60 msgr2=0x55ecf0b40000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 -- 172.21.15.60:0/3316110299 shutdown_connections 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 1 -- 172.21.15.60:0/3316110299 wait complete. 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.454+0000 7fa2361f9740 20 client.15180 trim_cache size 0 max 16384 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 1, 2024-09-11T23:59:13.459 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24485, 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 96.993263033999995, 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 114.946457223 2024-09-11T23:59:13.460 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 -- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa2180a2b80 msgr2=0x7fa2180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa2180a2b80 0x7fa2180a5040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa22400e6b0 tx=0x7fa224008220 comp rx=0 tx=0).stop 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 -- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c100e20 msgr2=0x7fa22c1a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c100e20 0x7fa22c1a05e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa22800b4a0 tx=0x7fa22800b960 comp rx=0 tx=0).stop 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 -- 172.21.15.60:0/315923960 shutdown_connections 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c102ef0 0x7fa22c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa22c102570 0x7fa22c1a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fa2180a2b80 0x7fa2180a5040 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 --2- 172.21.15.60:0/315923960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c100e20 0x7fa22c1a05e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:13.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 -- 172.21.15.60:0/315923960 >> 172.21.15.60:0/315923960 conn(0x7fa22c0fc7d0 msgr2=0x7fa22c105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:13.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 -- 172.21.15.60:0/315923960 shutdown_connections 2024-09-11T23:59:13.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:13.455+0000 7fa233e20640 1 -- 172.21.15.60:0/315923960 wait complete. 2024-09-11T23:59:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:13 smithi105 ceph-mon[34805]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-11T23:59:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:13 smithi192 ceph-mon[35487]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-11T23:59:14.155 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:59:14.414 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 -- 172.21.15.60:0/3320412735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 msgr2=0x7fe6b010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/3320412735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 0x7fe6b010ea90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009ca0 tx=0x7fe6a802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 -- 172.21.15.60:0/3320412735 shutdown_connections 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/3320412735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 0x7fe6b010ea90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/3320412735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b0102790 0x7fe6b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/3320412735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6b0101de0 0x7fe6b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 -- 172.21.15.60:0/3320412735 >> 172.21.15.60:0/3320412735 conn(0x7fe6b00fd8c0 msgr2=0x7fe6b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 -- 172.21.15.60:0/3320412735 shutdown_connections 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.913+0000 7fe6b80cd640 1 -- 172.21.15.60:0/3320412735 wait complete. 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b80cd640 1 Processor -- start 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b80cd640 1 -- start start 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b80cd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b0101de0 0x7fe6b01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b80cd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6b0102790 0x7fe6b0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b80cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 0x7fe6b019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b80cd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0112090 con 0x7fe6b0106f10 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b80cd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0111f10 con 0x7fe6b0101de0 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b80cd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0112210 con 0x7fe6b0102790 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b666a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 0x7fe6b019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b666a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 0x7fe6b019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42150/0 (socket says 172.21.15.60:42150) 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b666a640 1 -- 172.21.15.60:0/822277106 learned_addr learned my addr 172.21.15.60:0/822277106 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.914+0000 7fe6b5668640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6b0102790 0x7fe6b0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b0101de0 0x7fe6b01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b666a640 1 -- 172.21.15.60:0/822277106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6b0102790 msgr2=0x7fe6b0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b666a640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6b0102790 0x7fe6b0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b666a640 1 -- 172.21.15.60:0/822277106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b0101de0 msgr2=0x7fe6b01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b666a640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b0101de0 0x7fe6b01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b666a640 1 -- 172.21.15.60:0/822277106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b019d3a0 con 0x7fe6b0106f10 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b0101de0 0x7fe6b01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b666a640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 0x7fe6b019ccc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009dc0 tx=0x7fe6a8031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6a6ffd640 1 -- 172.21.15.60:0/822277106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a802fba0 con 0x7fe6b0106f10 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6a6ffd640 1 -- 172.21.15.60:0/822277106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6a802fd40 con 0x7fe6b0106f10 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b80cd640 1 -- 172.21.15.60:0/822277106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b019d630 con 0x7fe6b0106f10 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6a6ffd640 1 -- 172.21.15.60:0/822277106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8046a70 con 0x7fe6b0106f10 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.915+0000 7fe6b80cd640 1 -- 172.21.15.60:0/822277106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b01a4f70 con 0x7fe6b0106f10 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.917+0000 7fe6a6ffd640 1 -- 172.21.15.60:0/822277106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe6a80305c0 con 0x7fe6b0106f10 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6ba4a6740 1 Processor -- start 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6ba4a6740 1 -- start start 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6badb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f6c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55781f621090 con 0x55781f6ba9d0 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55781f5c8a70 con 0x55781f6c5bb0 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55781f61d050 con 0x55781f6bb2f0 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6b5668640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6a6ffd640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe69c0a2b80 0x7fe69c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6b5668640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6badb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42154/0 (socket says 172.21.15.60:42154) 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.918+0000 7fe6b5668640 1 -- 172.21.15.60:0/1159542683 learned_addr learned my addr 172.21.15.60:0/1159542683 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/1159542683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b666a640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe69c0a2b80 0x7fe69c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b5668640 1 -- 172.21.15.60:0/1159542683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 msgr2=0x55781f6c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b5668640 1 --2- 172.21.15.60:0/1159542683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b5668640 1 -- 172.21.15.60:0/1159542683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 msgr2=0x55781f6c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b5668640 1 --2- 172.21.15.60:0/1159542683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f6c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b5668640 1 -- 172.21.15.60:0/1159542683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781f5d5130 con 0x55781f6ba9d0 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6a6ffd640 1 -- 172.21.15.60:0/822277106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe6a80f06e0 con 0x7fe6b0106f10 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b5668640 1 --2- 172.21.15.60:0/1159542683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6badb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000abf0 tx=0x7fe6a00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4060d6dba9f1b695 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe69bfff640 1 -- 172.21.15.60:0/1159542683 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0005020 con 0x55781f6ba9d0 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe6b666a640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe69c0a2b80 0x7fe69c0a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80b98e0 tx=0x7fe6a808ffd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe69bfff640 1 -- 172.21.15.60:0/1159542683 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6a00047a0 con 0x55781f6ba9d0 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.919+0000 7fe69bfff640 1 -- 172.21.15.60:0/1159542683 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00126b0 con 0x55781f6ba9d0 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1159542683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 msgr2=0x55781f6badb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1159542683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6badb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000abf0 tx=0x7fe6a00117b0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1159542683 shutdown_connections 2024-09-11T23:59:14.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1159542683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f6c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1159542683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1159542683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6badb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1159542683 >> 172.21.15.60:0/1159542683 conn(0x55781f6b6f60 msgr2=0x55781f6b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1159542683 shutdown_connections 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1159542683 wait complete. 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.920+0000 7fe6ba4a6740 1 -- start start 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6ba4a6740 1 Processor -- start 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6ba9d0 0x55781f6c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6c5bb0 0x55781f6c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55781f6c8780 con 0x55781f6c5bb0 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55781f5dbf20 con 0x55781f6ba9d0 2024-09-11T23:59:14.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55781f6c8900 con 0x55781f6bb2f0 2024-09-11T23:59:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6ba4a6740 10 client.0 _ll_register_callbacks cb 0x55781f5a5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6c5bb0 0x55781f6c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6c5bb0 0x55781f6c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42156/0 (socket says 172.21.15.60:42156) 2024-09-11T23:59:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 -- 172.21.15.60:0/2166024534 learned_addr learned my addr 172.21.15.60:0/2166024534 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6ba9d0 0x55781f6c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 -- 172.21.15.60:0/2166024534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 msgr2=0x55781f6c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 -- 172.21.15.60:0/2166024534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6ba9d0 msgr2=0x55781f6c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6ba9d0 0x55781f6c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.921+0000 7fe6b5668640 1 -- 172.21.15.60:0/2166024534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55781f3922b0 con 0x55781f6c5bb0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6b5668640 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6c5bb0 0x55781f6c2c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0011cb0 tx=0x7fe6a00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ea1d9f8ed584af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6997fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6997fa640 1 -- 172.21.15.60:0/2166024534 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a001e020 con 0x55781f6c5bb0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6997fa640 1 -- 172.21.15.60:0/2166024534 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe6a00054b0 con 0x55781f6c5bb0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/2166024534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a00047a0 con 0x55781f6c5bb0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6997fa640 1 -- 172.21.15.60:0/2166024534 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6a002c450 con 0x55781f6c5bb0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6ba4a6740 10 client.15192 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/2166024534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55781f6d4050 con 0x55781f6c5bb0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6997fa640 1 -- 172.21.15.60:0/2166024534 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6a00047a0 con 0x55781f6c5bb0 2024-09-11T23:59:14.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6997fa640 1 -- 172.21.15.60:0/2166024534 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe6a00126f0 con 0x55781f6c5bb0 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.922+0000 7fe6ba4a6740 10 client.15192 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.923+0000 7fe6ba4a6740 10 client.15192 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.923+0000 7fe6ba4a6740 20 client.15192 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.923+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55781f6d6520 0x55781f6d7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.923+0000 7fe6ba4a6740 4 client.15192 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.923+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/2166024534 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55781f62e600 con 0x55781f6d6520 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.923+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55781f6d6520 0x55781f6d7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.923+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55781f6d6520 0x55781f6d7990 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f3fb16be05cd5e server_cookie=2c1a512237208a5d in_seq=0 out_seq=0 2024-09-11T23:59:14.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.923+0000 7fe6997fa640 10 client.15192 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6997fa640 1 -- 172.21.15.60:0/2166024534 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55781f62e600 con 0x55781f6d6520 2024-09-11T23:59:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6997fa640 10 client.15192 handle_command_reply: tid=0 2024-09-11T23:59:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 client.15192 shutdown 2024-09-11T23:59:14.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/2166024534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6c5bb0 msgr2=0x55781f6c2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6c5bb0 0x55781f6c2c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0011cb0 tx=0x7fe6a00058a0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/2166024534 shutdown_connections 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55781f6d6520 0x55781f6d7990 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6c5bb0 0x55781f6c2c90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/2166024534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6ba9d0 0x55781f6c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6997fa640 0 client.15192 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/2166024534 >> 172.21.15.60:0/2166024534 conn(0x55781f6b6f60 msgr2=0x55781f6bcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/2166024534 shutdown_connections 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.924+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/2166024534 wait complete. 2024-09-11T23:59:14.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.925+0000 7fe6ba4a6740 20 client.15192 trim_cache size 0 max 16384 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.942+0000 7fe6ba4a6740 1 Processor -- start 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.942+0000 7fe6ba4a6740 1 -- start start 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6ba9d0 0x55781f6d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6bb2f0 0x55781f6d7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f6b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55781f6d5cd0 con 0x55781f6bb2f0 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55781f6d63a0 con 0x55781f6c5bb0 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55781f6d6a70 con 0x55781f6ba9d0 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6bb2f0 0x55781f6d7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6bb2f0 0x55781f6d7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42168/0 (socket says 172.21.15.60:42168) 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 -- 172.21.15.60:0/680628177 learned_addr learned my addr 172.21.15.60:0/680628177 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5668640 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6ba9d0 0x55781f6d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5668640 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f6b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 -- 172.21.15.60:0/680628177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6ba9d0 msgr2=0x55781f6d5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6ba9d0 0x55781f6d5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 -- 172.21.15.60:0/680628177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 msgr2=0x55781f6b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f6b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 -- 172.21.15.60:0/680628177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781f6bb120 con 0x55781f6bb2f0 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5668640 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6ba9d0 0x55781f6d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.943+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6bb2f0 0x55781f6d7990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac005f00 tx=0x7fe6ac012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f5e44956e7ae14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe69b7fe640 1 -- 172.21.15.60:0/680628177 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0120d0 con 0x55781f6bb2f0 2024-09-11T23:59:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe69b7fe640 1 -- 172.21.15.60:0/680628177 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6ac012270 con 0x55781f6bb2f0 2024-09-11T23:59:14.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe69b7fe640 1 -- 172.21.15.60:0/680628177 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac024780 con 0x55781f6bb2f0 2024-09-11T23:59:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/680628177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6bb2f0 msgr2=0x55781f6d7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6bb2f0 0x55781f6d7990 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac005f00 tx=0x7fe6ac012820 comp rx=0 tx=0).stop 2024-09-11T23:59:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/680628177 shutdown_connections 2024-09-11T23:59:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f6b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6bb2f0 0x55781f6d7990 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/680628177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6ba9d0 0x55781f6d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/680628177 >> 172.21.15.60:0/680628177 conn(0x55781f6b6f60 msgr2=0x55781f6d5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/680628177 shutdown_connections 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.944+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/680628177 wait complete. 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 1 -- start start 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 1 Processor -- start 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6bf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f73bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55781f6d7810 con 0x55781f6ba9d0 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55781f6d7140 con 0x55781f6c5bb0 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55781f6d7ee0 con 0x55781f6bb2f0 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6ba4a6740 10 client.0 _ll_register_callbacks cb 0x7fe6a000aaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6b5668640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6bf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6b5668640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6bf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42182/0 (socket says 172.21.15.60:42182) 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6b5668640 1 -- 172.21.15.60:0/1000496448 learned_addr learned my addr 172.21.15.60:0/1000496448 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.945+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6b5668640 1 -- 172.21.15.60:0/1000496448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 msgr2=0x55781f6bfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6b5668640 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6bfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6b5668640 1 -- 172.21.15.60:0/1000496448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 msgr2=0x55781f73bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6b5668640 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f73bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6b5668640 1 -- 172.21.15.60:0/1000496448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55781f73c590 con 0x55781f6ba9d0 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6b5668640 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6bf6b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000b010 tx=0x7fe6a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23dac7775187999 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6997fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6997fa640 1 -- 172.21.15.60:0/1000496448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a001e040 con 0x55781f6ba9d0 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1000496448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6ac012270 con 0x55781f6ba9d0 2024-09-11T23:59:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6997fa640 1 -- 172.21.15.60:0/1000496448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fe6a000a340 con 0x55781f6ba9d0 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6997fa640 1 -- 172.21.15.60:0/1000496448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6a003e070 con 0x55781f6ba9d0 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6ba4a6740 10 client.15198 fetch_fsmap learned FSMap version 28 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1000496448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55781f744a90 con 0x55781f6ba9d0 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.946+0000 7fe6997fa640 1 -- 172.21.15.60:0/1000496448 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6ac012270 con 0x55781f6ba9d0 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6997fa640 1 -- 172.21.15.60:0/1000496448 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe6a0035020 con 0x55781f6ba9d0 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6ba4a6740 10 client.15198 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6ba4a6740 10 client.15198 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6ba4a6740 20 client.15198 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55781f7495a0 0x55781f7482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6ba4a6740 4 client.15198 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1000496448 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "status"}) -- 0x55781f628b10 con 0x55781f7495a0 2024-09-11T23:59:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55781f7495a0 0x55781f7482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6b5e69640 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55781f7495a0 0x55781f7482b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=140c683e24ee3223 server_cookie=122a50b2e7874107 in_seq=0 out_seq=0 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.947+0000 7fe6997fa640 10 client.15198 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6997fa640 1 -- 172.21.15.60:0/1000496448 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55781f628b10 con 0x55781f7495a0 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6997fa640 10 client.15198 handle_command_reply: tid=0 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 client.15198 shutdown 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1000496448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 msgr2=0x55781f6bf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6bf6b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000b010 tx=0x7fe6a0000bc0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1000496448 shutdown_connections 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55781f7495a0 0x55781f7482b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55781f6c5bb0 0x55781f73bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55781f6bb2f0 0x55781f6bfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 --2- 172.21.15.60:0/1000496448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55781f6ba9d0 0x55781f6bf6b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1000496448 >> 172.21.15.60:0/1000496448 conn(0x55781f6b6f60 msgr2=0x55781f6b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6997fa640 0 client.15198 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1000496448 shutdown_connections 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 1 -- 172.21.15.60:0/1000496448 wait complete. 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6ba4a6740 20 client.15198 trim_cache size 0 max 16384 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24496, 2024-09-11T23:59:14.953 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:14.954 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:14.954 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:14.954 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 105.51800347299999, 2024-09-11T23:59:14.954 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 28, 2024-09-11T23:59:14.954 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 82, 2024-09-11T23:59:14.954 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:14.954 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 125.995024941 2024-09-11T23:59:14.954 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.948+0000 7fe6b80cd640 1 -- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe69c0a2b80 msgr2=0x7fe69c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe69c0a2b80 0x7fe69c0a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe6a80b98e0 tx=0x7fe6a808ffd0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 -- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 msgr2=0x7fe6b019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 0x7fe6b019ccc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009dc0 tx=0x7fe6a8031b10 comp rx=0 tx=0).stop 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 -- 172.21.15.60:0/822277106 shutdown_connections 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fe69c0a2b80 0x7fe69c0a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6b0106f10 0x7fe6b019ccc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6b0102790 0x7fe6b0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 --2- 172.21.15.60:0/822277106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6b0101de0 0x7fe6b01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 -- 172.21.15.60:0/822277106 >> 172.21.15.60:0/822277106 conn(0x7fe6b00fd8c0 msgr2=0x7fe6b00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 -- 172.21.15.60:0/822277106 shutdown_connections 2024-09-11T23:59:14.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:14.949+0000 7fe6b80cd640 1 -- 172.21.15.60:0/822277106 wait complete. 2024-09-11T23:59:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:15 smithi105 ceph-mon[34805]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-11T23:59:15.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:15 smithi192 ceph-mon[35487]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-11T23:59:15.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:15 smithi060 ceph-mon[30953]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-11T23:59:15.738 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T23:59:15.750 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T23:59:15.750 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T23:59:15.750 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T23:59:15.750 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-11T23:59:15.751 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T23:59:15.751 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-11T23:59:15.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/671201933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c941037b0 msgr2=0x7f0c9410a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/671201933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c941037b0 0x7f0c9410a040 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009ca0 tx=0x7f0c8c02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/671201933 shutdown_connections 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/671201933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c941037b0 0x7f0c9410a040 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/671201933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c94102df0 0x7f0c94103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/671201933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c940ffe20 0x7f0c94100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/671201933 >> 172.21.15.60:0/671201933 conn(0x7f0c940fb980 msgr2=0x7f0c940fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/671201933 shutdown_connections 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.858+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/671201933 wait complete. 2024-09-11T23:59:15.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c9a6b7640 1 Processor -- start 2024-09-11T23:59:15.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c9a6b7640 1 -- start start 2024-09-11T23:59:15.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c9a6b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940ffe20 0x7f0c94198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c9a6b7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c94102df0 0x7f0c94198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c9a6b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c941037b0 0x7f0c9419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c9a6b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9410da30 con 0x7f0c940ffe20 2024-09-11T23:59:15.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c9a6b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9410d8b0 con 0x7f0c941037b0 2024-09-11T23:59:15.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c9a6b7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9410dbb0 con 0x7f0c94102df0 2024-09-11T23:59:15.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c93fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940ffe20 0x7f0c94198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c93fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940ffe20 0x7f0c94198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42200/0 (socket says 172.21.15.60:42200) 2024-09-11T23:59:15.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.859+0000 7f0c93fff640 1 -- 172.21.15.60:0/3855190059 learned_addr learned my addr 172.21.15.60:0/3855190059 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c937fe640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c94102df0 0x7f0c94198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c93fff640 1 -- 172.21.15.60:0/3855190059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c94102df0 msgr2=0x7f0c94198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c93fff640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c94102df0 0x7f0c94198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c93fff640 1 -- 172.21.15.60:0/3855190059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c941037b0 msgr2=0x7f0c9419f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c98c54640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c941037b0 0x7f0c9419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c93fff640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c941037b0 0x7f0c9419f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c93fff640 1 -- 172.21.15.60:0/3855190059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9419fc20 con 0x7f0c940ffe20 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c937fe640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c94102df0 0x7f0c94198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c93fff640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940ffe20 0x7f0c94198000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400b450 tx=0x7f0c8400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c917fa640 1 -- 172.21.15.60:0/3855190059 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84015020 con 0x7f0c940ffe20 2024-09-11T23:59:15.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c917fa640 1 -- 172.21.15.60:0/3855190059 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c84011d90 con 0x7f0c940ffe20 2024-09-11T23:59:15.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9419ff10 con 0x7f0c940ffe20 2024-09-11T23:59:15.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c917fa640 1 -- 172.21.15.60:0/3855190059 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400f340 con 0x7f0c940ffe20 2024-09-11T23:59:15.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.860+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c941a03f0 con 0x7f0c940ffe20 2024-09-11T23:59:15.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.861+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c941a06b0 con 0x7f0c940ffe20 2024-09-11T23:59:15.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.862+0000 7f0c917fa640 1 -- 172.21.15.60:0/3855190059 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f0c84018020 con 0x7f0c940ffe20 2024-09-11T23:59:15.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.863+0000 7f0c917fa640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0c7c0a2c30 0x7f0c7c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:15.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.863+0000 7f0c917fa640 1 -- 172.21.15.60:0/3855190059 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f0c840ceba0 con 0x7f0c940ffe20 2024-09-11T23:59:15.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.863+0000 7f0c937fe640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0c7c0a2c30 0x7f0c7c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:15.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.863+0000 7f0c937fe640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0c7c0a2c30 0x7f0c7c0a50f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c88006fd0 tx=0x7f0c88008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:15.867+0000 7f0c917fa640 1 -- 172.21.15.60:0/3855190059 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c8401f020 con 0x7f0c940ffe20 2024-09-11T23:59:16.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.092+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f0c941a0880 con 0x7f0c940ffe20 2024-09-11T23:59:16.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.183+0000 7f0c917fa640 1 -- 172.21.15.60:0/3855190059 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f0c8400d040 con 0x7f0c940ffe20 2024-09-11T23:59:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0c7c0a2c30 msgr2=0x7f0c7c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0c7c0a2c30 0x7f0c7c0a50f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c88006fd0 tx=0x7f0c88008040 comp rx=0 tx=0).stop 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940ffe20 msgr2=0x7f0c94198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940ffe20 0x7f0c94198000 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400b450 tx=0x7f0c8400b910 comp rx=0 tx=0).stop 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 shutdown_connections 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c941037b0 0x7f0c9419f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c94102df0 0x7f0c94198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f0c7c0a2c30 0x7f0c7c0a50f0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c88006fd0 tx=0x7f0c88008040 comp rx=0 tx=0).stop 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 --2- 172.21.15.60:0/3855190059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c940ffe20 0x7f0c94198000 secure :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400b450 tx=0x7f0c8400b910 comp rx=0 tx=0).stop 2024-09-11T23:59:16.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.187+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 >> 172.21.15.60:0/3855190059 conn(0x7f0c940fb980 msgr2=0x7f0c940fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.188+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 shutdown_connections 2024-09-11T23:59:16.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:16.188+0000 7f0c9a6b7640 1 -- 172.21.15.60:0/3855190059 wait complete. 2024-09-11T23:59:16.202 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T23:59:16.233 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T23:59:16.233 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-11T23:59:16.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:16.234 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-11T23:59:16.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:16.252 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-11T23:59:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2024-09-11T23:59:16.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:59:16.322 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-11T23:59:16.323 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:59:16.323 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:16.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T23:59:16.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3855190059' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T23:59:16.479 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: ignoring --setuser ceph since I am not root 2024-09-11T23:59:16.479 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: ignoring --setgroup ceph since I am not root 2024-09-11T23:59:16.480 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-mgr[36178]: -- 172.21.15.105:0/2936181026 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccb9da10e0 con 0x55ccb9d7f000 2024-09-11T23:59:16.480 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:16.338+0000 7fdfd848d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:59:16.480 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:16.394+0000 7fdfd848d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:59:16.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3855190059' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T23:59:16.534 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: ignoring --setuser ceph since I am not root 2024-09-11T23:59:16.534 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: ignoring --setgroup ceph since I am not root 2024-09-11T23:59:16.534 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-mgr[37306]: -- 172.21.15.192:0/2623341963 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f883790e0 con 0x558f88357000 2024-09-11T23:59:16.534 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:16.337+0000 7f8f0aba8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:59:16.535 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:16.395+0000 7f8f0aba8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:59:16.563 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3855190059' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-11T23:59:16.563 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ignoring --setuser ceph since I am not root 2024-09-11T23:59:16.563 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ignoring --setgroup ceph since I am not root 2024-09-11T23:59:16.563 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:16.342+0000 7fe5857b6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:59:16.563 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:16.404+0000 7fe5857b6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:59:16.563 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:16.563+0000 7fe5857b6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:59:16.626 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:16.839 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:16.640+0000 7fe5857b6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:59:16.839 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:16.797+0000 7fe5857b6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:59:16.895 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:16.542+0000 7fdfd848d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:59:16.895 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:16.607+0000 7fdfd848d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:59:16.895 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:16.755+0000 7fdfd848d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:59:16.895 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:16.896+0000 7fdfd848d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:59:16.899 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:16.545+0000 7f8f0aba8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:59:16.899 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:16.612+0000 7f8f0aba8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:59:16.899 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:16.759+0000 7f8f0aba8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:59:16.899 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:16.899+0000 7f8f0aba8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:59:17.124 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:16.949+0000 7fe5857b6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:59:17.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 -- 172.21.15.60:0/3513672566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710102d90 msgr2=0x7f2710103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 --2- 172.21.15.60:0/3513672566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710102d90 0x7f2710103170 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2700009930 tx=0x7f270002a420 comp rx=0 tx=0).stop 2024-09-11T23:59:17.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 -- 172.21.15.60:0/3513672566 shutdown_connections 2024-09-11T23:59:17.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 --2- 172.21.15.60:0/3513672566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710108290 0x7f271010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 --2- 172.21.15.60:0/3513672566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710103740 0x7f2710107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 --2- 172.21.15.60:0/3513672566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710102d90 0x7f2710103170 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 -- 172.21.15.60:0/3513672566 >> 172.21.15.60:0/3513672566 conn(0x7f27100fc7d0 msgr2=0x7f27100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 -- 172.21.15.60:0/3513672566 shutdown_connections 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.110+0000 7f2715b23640 1 -- 172.21.15.60:0/3513672566 wait complete. 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2715b23640 1 Processor -- start 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2715b23640 1 -- start start 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2715b23640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710102d90 0x7f27101009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2715b23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710103740 0x7f2710100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2715b23640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710108290 0x7f2710101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2715b23640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27101121b0 con 0x7f2710103740 2024-09-11T23:59:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2715b23640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2710112030 con 0x7f2710102d90 2024-09-11T23:59:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2715b23640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2710112330 con 0x7f2710108290 2024-09-11T23:59:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2706ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710103740 0x7f2710100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2706ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710103740 0x7f2710100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42246/0 (socket says 172.21.15.60:42246) 2024-09-11T23:59:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f270f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710102d90 0x7f27101009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f2706ffd640 1 -- 172.21.15.60:0/1737461403 learned_addr learned my addr 172.21.15.60:0/1737461403 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.111+0000 7f270ffff640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710108290 0x7f2710101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270f7fe640 1 -- 172.21.15.60:0/1737461403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710108290 msgr2=0x7f2710101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270f7fe640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710108290 0x7f2710101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270f7fe640 1 -- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710103740 msgr2=0x7f2710100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270f7fe640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710103740 0x7f2710100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270f7fe640 1 -- 172.21.15.60:0/1737461403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27101a6af0 con 0x7f2710102d90 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f2706ffd640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710103740 0x7f2710100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270f7fe640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710102d90 0x7f27101009f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2700005940 tx=0x7f2700004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270d7fa640 1 -- 172.21.15.60:0/1737461403 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270003f070 con 0x7f2710102d90 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27101a6d80 con 0x7f2710102d90 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270d7fa640 1 -- 172.21.15.60:0/1737461403 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2700003af0 con 0x7f2710102d90 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f270d7fa640 1 -- 172.21.15.60:0/1737461403 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2700035070 con 0x7f2710102d90 2024-09-11T23:59:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.112+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27101a7200 con 0x7f2710102d90 2024-09-11T23:59:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.113+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271006a7f0 con 0x7f2710102d90 2024-09-11T23:59:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.114+0000 7f270d7fa640 1 -- 172.21.15.60:0/1737461403 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f270003b460 con 0x7f2710102d90 2024-09-11T23:59:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.115+0000 7f270d7fa640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f26fc0a2bd0 0x7f26fc0a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.115+0000 7f2706ffd640 1 -- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f26fc0a2bd0 msgr2=0x7f26fc0a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1180183286 2024-09-11T23:59:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.115+0000 7f270d7fa640 1 -- 172.21.15.60:0/1737461403 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f27000ef6c0 con 0x7f2710102d90 2024-09-11T23:59:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.115+0000 7f2706ffd640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f26fc0a2bd0 0x7f26fc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:59:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.118+0000 7f270d7fa640 1 -- 172.21.15.60:0/1737461403 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27000bbfa0 con 0x7f2710102d90 2024-09-11T23:59:17.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.316+0000 7f2706ffd640 1 -- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f26fc0a2bd0 msgr2=0x7f26fc0a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1180183286 2024-09-11T23:59:17.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.316+0000 7f2706ffd640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f26fc0a2bd0 0x7f26fc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:59:17.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.334+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27101a7460 con 0x7f2710102d90 2024-09-11T23:59:17.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.335+0000 7f270d7fa640 1 -- 172.21.15.60:0/1737461403 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f27000c02a0 con 0x7f2710102d90 2024-09-11T23:59:17.334 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:59:17.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f26fc0a2bd0 msgr2=0x7f26fc0a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:59:17.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f26fc0a2bd0 0x7f26fc0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710102d90 msgr2=0x7f27101009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710102d90 0x7f27101009f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2700005940 tx=0x7f2700004040 comp rx=0 tx=0).stop 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 shutdown_connections 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710108290 0x7f2710101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f26fc0a2bd0 0x7f26fc0a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2710103740 0x7f2710100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 --2- 172.21.15.60:0/1737461403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710102d90 0x7f27101009f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 >> 172.21.15.60:0/1737461403 conn(0x7f27100fc7d0 msgr2=0x7f2710105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 shutdown_connections 2024-09-11T23:59:17.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:17.337+0000 7f2715b23640 1 -- 172.21.15.60:0/1737461403 wait complete. 2024-09-11T23:59:17.449 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:17 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3855190059' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T23:59:17.449 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:17 smithi105 ceph-mon[34805]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-11T23:59:17.450 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:17.206+0000 7fdfd848d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:59:17.450 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:17.267+0000 7fdfd848d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:59:17.450 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:17.450+0000 7fdfd848d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:59:17.459 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:17 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3855190059' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T23:59:17.459 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:17 smithi192 ceph-mon[35487]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-11T23:59:17.460 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:17 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:17.213+0000 7f8f0aba8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:59:17.460 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:17 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:17.273+0000 7f8f0aba8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:59:17.460 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:17 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:17.459+0000 7f8f0aba8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:59:17.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:17 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3855190059' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-11T23:59:17.544 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:17 smithi060 ceph-mon[30953]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-11T23:59:17.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:17.282+0000 7fe5857b6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:59:17.544 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:17.348+0000 7fe5857b6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:59:17.545 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:17.545+0000 7fe5857b6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:59:18.143 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:59:18.144 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:59:18.144 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-11T23:59:18.144 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:59:18.144 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:18.144 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:59:18.144 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:59:18.144 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:59:18.144 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:59:18.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:18.145 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-11T23:59:18.162 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42233sec preferred_lft 42233sec 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:59:18.163 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-11T23:59:18.164 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:59:18.164 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:18.164 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-11T23:59:18.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:59:18.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2024-09-11T23:59:18.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2024-09-11T23:59:18.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:59:18.164 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-11T23:59:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:18.367 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:18 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1737461403' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:59:18.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:18.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:18.396 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:59:18.422 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-11T23:59:18.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:18.425 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-11T23:59:18.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:18 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1737461403' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:59:18.479 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:18.330+0000 7fdfd848d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:59:18.479 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:18.397+0000 7fdfd848d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:59:18.506 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-11T23:59:18.507 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:59:18.507 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-11T23:59:18.507 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-11T23:59:18.507 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:59:18.507 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:18.507 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-11T23:59:18.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-11T23:59:18.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-11T23:59:18.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-11T23:59:18.508 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-11T23:59:18.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:18 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1737461403' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-11T23:59:18.534 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:18 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:18.346+0000 7f8f0aba8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:59:18.534 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:18 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:18.413+0000 7f8f0aba8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:59:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:18.720 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:18.499+0000 7fe5857b6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:59:18.721 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:18.571+0000 7fe5857b6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:59:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:18.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:18.814 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-11T23:59:18.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:18.830 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2024-09-11T23:59:18.886 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:18.887 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-11T23:59:18.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:59:18.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T23:59:18.887 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-11T23:59:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:19.011 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T23:59:19.011 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:19.011 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-11T23:59:19.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T23:59:19.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:59:19.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T23:59:19.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T23:59:19.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T23:59:19.012 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-11T23:59:19.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:19.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:19.143 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:59:19.143 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-11T23:59:19.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-11T23:59:19.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:59:19.143 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-11T23:59:19.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:19.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:19.227 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:59:19.227 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:19.243 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:59:19.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:59:19.244 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:19.300 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-11T23:59:19.300 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-11T23:59:19.300 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/4096197b-9b2b-412c-b613-d5ae5ff99b34 2024-09-11T23:59:19.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:19.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/4096197b-9b2b-412c-b613-d5ae5ff99b34 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-11T23:59:19.358 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.101+0000 7fdfd848d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:59:19.358 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.217+0000 7fdfd848d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:59:19.388 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.131+0000 7f8f0aba8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:59:19.388 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.246+0000 7f8f0aba8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:59:19.399 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-11T23:59:19.399 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-11T23:59:19.538 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-11T23:59:19.538 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-11T23:59:19.538 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.192:3300" 2024-09-11T23:59:19.538 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@6b4d616e-7098-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/4096197b-9b2b-412c-b613-d5ae5ff99b34 2024-09-11T23:59:19.538 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.192:3300" will pass to kernel 2024-09-11T23:59:19.545 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:59:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:59:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:59:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:59:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:59:19.546 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:59:19.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:59:19.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:19.574 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:59:19.629 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:19.351+0000 7fe5857b6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:59:19.629 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:19.476+0000 7fe5857b6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:59:19.637 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.359+0000 7fdfd848d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:59:19.637 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.420+0000 7fdfd848d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:59:19.637 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.570+0000 7fdfd848d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:59:19.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:59:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:19.670 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.388+0000 7f8f0aba8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:59:19.670 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.448+0000 7f8f0aba8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:59:19.670 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.600+0000 7f8f0aba8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:59:19.671 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.670+0000 7f8f0aba8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:59:19.675 INFO:teuthology.orchestra.run.smithi060.stdout:client24881 2024-09-11T23:59:19.676 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-11T23:59:19.676 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:59:19.734 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:59:19.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:59:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:19.833 INFO:teuthology.orchestra.run.smithi060.stdout:client24881 2024-09-11T23:59:19.833 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:59:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:59:19.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:19.892 INFO:teuthology.orchestra.run.smithi060.stdout:client24881 2024-09-11T23:59:19.893 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6b4d616e-7098-11ef-bcea-c7b262605968.client24881/status') 2024-09-11T23:59:19.917 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.637+0000 7fdfd848d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:59:19.918 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.697+0000 7fdfd848d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:59:19.918 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.854+0000 7fdfd848d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:59:19.918 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.918+0000 7fdfd848d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:59:19.930 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:19.630+0000 7fe5857b6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:59:19.930 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:19.696+0000 7fe5857b6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:59:19.930 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:19.857+0000 7fe5857b6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:59:19.930 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:19.931+0000 7fe5857b6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:59:19.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:59:19.954 INFO:teuthology.orchestra.run.smithi060.stdout:instance: client.24881 (3)172.21.15.60:0/388801502 2024-09-11T23:59:19.954 INFO:teuthology.orchestra.run.smithi060.stdout:blocklisted: false 2024-09-11T23:59:19.955 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2024-09-11T23:59:19.955 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2024-09-11T23:59:19.955 INFO:teuthology.orchestra.run.smithi060.stderr:70 bytes copied, 2.5036e-05 s, 2.8 MB/s 2024-09-11T23:59:19.955 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.731+0000 7f8f0aba8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:59:19.955 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.890+0000 7f8f0aba8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:59:19.955 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:19.955+0000 7f8f0aba8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:59:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:59:19.962 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T23:59:19.971 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T23:59:19.971 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-11T23:59:19.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-11T23:59:20.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 -- 172.21.15.60:0/1239156477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 msgr2=0x7f1a8c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 --2- 172.21.15.60:0/1239156477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 0x7f1a8c1020b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009860 tx=0x7f1a7c02a340 comp rx=0 tx=0).stop 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 -- 172.21.15.60:0/1239156477 shutdown_connections 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 --2- 172.21.15.60:0/1239156477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a8c1025f0 0x7f1a8c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 --2- 172.21.15.60:0/1239156477 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 0x7f1a8c1020b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 --2- 172.21.15.60:0/1239156477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c100a40 0x7f1a8c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 -- 172.21.15.60:0/1239156477 >> 172.21.15.60:0/1239156477 conn(0x7f1a8c0fc1e0 msgr2=0x7f1a8c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 -- 172.21.15.60:0/1239156477 shutdown_connections 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.110+0000 7f1a93798640 1 -- 172.21.15.60:0/1239156477 wait complete. 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a93798640 1 Processor -- start 2024-09-11T23:59:20.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a93798640 1 -- start start 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a93798640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c100a40 0x7f1a8c06a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a93798640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 0x7f1a8c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a93798640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a8c1025f0 0x7f1a8c19f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a93798640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c10c820 con 0x7f1a8c100a40 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a93798640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c10c6a0 con 0x7f1a8c101c30 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a93798640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c10c9a0 con 0x7f1a8c1025f0 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c100a40 0x7f1a8c06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c100a40 0x7f1a8c06a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42274/0 (socket says 172.21.15.60:42274) 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 -- 172.21.15.60:0/3167909416 learned_addr learned my addr 172.21.15.60:0/3167909416 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a90d33640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 0x7f1a8c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91d35640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a8c1025f0 0x7f1a8c19f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 -- 172.21.15.60:0/3167909416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a8c1025f0 msgr2=0x7f1a8c19f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a8c1025f0 0x7f1a8c19f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 -- 172.21.15.60:0/3167909416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 msgr2=0x7f1a8c19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 0x7f1a8c19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 -- 172.21.15.60:0/3167909416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c19fab0 con 0x7f1a8c100a40 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a90d33640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 0x7f1a8c19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.111+0000 7f1a91534640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c100a40 0x7f1a8c06a450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800e9a0 tx=0x7f1a8800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.112+0000 7f1a827fc640 1 -- 172.21.15.60:0/3167909416 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800cd80 con 0x7f1a8c100a40 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.112+0000 7f1a827fc640 1 -- 172.21.15.60:0/3167909416 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1a88010930 con 0x7f1a8c100a40 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.112+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8c19fda0 con 0x7f1a8c100a40 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.112+0000 7f1a827fc640 1 -- 172.21.15.60:0/3167909416 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88018a70 con 0x7f1a8c100a40 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.112+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a8c1a0200 con 0x7f1a8c100a40 2024-09-11T23:59:20.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.113+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a8c107d60 con 0x7f1a8c100a40 2024-09-11T23:59:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.114+0000 7f1a827fc640 1 -- 172.21.15.60:0/3167909416 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f1a88018c10 con 0x7f1a8c100a40 2024-09-11T23:59:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.114+0000 7f1a827fc640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1a780a2c80 0x7f1a780a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.115+0000 7f1a90d33640 1 -- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1a780a2c80 msgr2=0x7f1a780a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1180183286 2024-09-11T23:59:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.115+0000 7f1a827fc640 1 -- 172.21.15.60:0/3167909416 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f1a880cf450 con 0x7f1a8c100a40 2024-09-11T23:59:20.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.115+0000 7f1a90d33640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1a780a2c80 0x7f1a780a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:59:20.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.119+0000 7f1a827fc640 1 -- 172.21.15.60:0/3167909416 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a880541b0 con 0x7f1a8c100a40 2024-09-11T23:59:20.182 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:19.985+0000 7fdfd848d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:59:20.182 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:20.066+0000 7fdfd848d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:59:20.182 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:20.125+0000 7fdfd848d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:59:20.182 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:20.183+0000 7fdfd848d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:59:20.222 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:20.021+0000 7f8f0aba8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:59:20.222 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:20.103+0000 7f8f0aba8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:59:20.223 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:20.164+0000 7f8f0aba8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:59:20.223 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:20.222+0000 7f8f0aba8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:59:20.234 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:19.995+0000 7fe5857b6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:59:20.235 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:20.166+0000 7fe5857b6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:59:20.235 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:20.235+0000 7fe5857b6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:59:20.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.316+0000 7f1a90d33640 1 -- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1a780a2c80 msgr2=0x7f1a780a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1180183286 2024-09-11T23:59:20.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.316+0000 7f1a90d33640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1a780a2c80 0x7f1a780a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:59:20.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.336+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f1a8c02d7c0 con 0x7f1a8c100a40 2024-09-11T23:59:20.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.388+0000 7f1a827fc640 1 -- 172.21.15.60:0/3167909416 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7f1a8809c380 con 0x7f1a8c100a40 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.390+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1a780a2c80 msgr2=0x7f1a780a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.390+0000 7f1a93798640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1a780a2c80 0x7f1a780a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.390+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c100a40 msgr2=0x7f1a8c06a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.390+0000 7f1a93798640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c100a40 0x7f1a8c06a450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800e9a0 tx=0x7f1a8800ee60 comp rx=0 tx=0).stop 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.390+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 shutdown_connections 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.391+0000 7f1a93798640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a8c1025f0 0x7f1a8c19f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.391+0000 7f1a93798640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a8c101c30 0x7f1a8c19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.391+0000 7f1a93798640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f1a780a2c80 0x7f1a780a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.391+0000 7f1a93798640 1 --2- 172.21.15.60:0/3167909416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a8c100a40 0x7f1a8c06a450 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.391+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 >> 172.21.15.60:0/3167909416 conn(0x7f1a8c0fc1e0 msgr2=0x7f1a8c104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.391+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 shutdown_connections 2024-09-11T23:59:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.391+0000 7f1a93798640 1 -- 172.21.15.60:0/3167909416 wait complete. 2024-09-11T23:59:20.401 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T23:59:20.412 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-11T23:59:20.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:59:20.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:20 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3167909416' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T23:59:20.525 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:20 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3167909416' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T23:59:20.525 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:20.306+0000 7fe5857b6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:59:20.525 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:20.394+0000 7fe5857b6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:59:20.525 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:20.461+0000 7fe5857b6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:59:20.525 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:20.525+0000 7fe5857b6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:59:20.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:20 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3167909416' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-11T23:59:20.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 -- 172.21.15.60:0/1898655187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc107850 msgr2=0x7f7efc109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/1898655187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc107850 0x7f7efc109c60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009ca0 tx=0x7f7ef402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 -- 172.21.15.60:0/1898655187 shutdown_connections 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/1898655187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc107850 0x7f7efc109c60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/1898655187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7efc104f20 0x7f7efc107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/1898655187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc1025f0 0x7f7efc1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 -- 172.21.15.60:0/1898655187 >> 172.21.15.60:0/1898655187 conn(0x7f7efc0fc170 msgr2=0x7f7efc0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 -- 172.21.15.60:0/1898655187 shutdown_connections 2024-09-11T23:59:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.560+0000 7f7f01a8c640 1 -- 172.21.15.60:0/1898655187 wait complete. 2024-09-11T23:59:20.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7f01a8c640 1 Processor -- start 2024-09-11T23:59:20.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7f01a8c640 1 -- start start 2024-09-11T23:59:20.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7f01a8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc1025f0 0x7f7efc101f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7f01a8c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc104f20 0x7f7efc1005a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7f01a8c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7efc107850 0x7f7efc100ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7f01a8c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc10d8e0 con 0x7f7efc1025f0 2024-09-11T23:59:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7f01a8c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc10d760 con 0x7f7efc104f20 2024-09-11T23:59:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7f01a8c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc10da60 con 0x7f7efc107850 2024-09-11T23:59:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7efb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc1025f0 0x7f7efc101f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7efb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc1025f0 0x7f7efc101f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42286/0 (socket says 172.21.15.60:42286) 2024-09-11T23:59:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7efb7fe640 1 -- 172.21.15.60:0/3832757924 learned_addr learned my addr 172.21.15.60:0/3832757924 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7efbfff640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7efc107850 0x7f7efc100ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.561+0000 7f7ef2ffd640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc104f20 0x7f7efc1005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7efb7fe640 1 -- 172.21.15.60:0/3832757924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7efc107850 msgr2=0x7f7efc100ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7efb7fe640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7efc107850 0x7f7efc100ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7efb7fe640 1 -- 172.21.15.60:0/3832757924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc104f20 msgr2=0x7f7efc1005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7efb7fe640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc104f20 0x7f7efc1005a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7efb7fe640 1 -- 172.21.15.60:0/3832757924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc101370 con 0x7f7efc1025f0 2024-09-11T23:59:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7efb7fe640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc1025f0 0x7f7efc101f60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00e9f0 tx=0x7f7eec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3832757924 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00cd80 con 0x7f7efc1025f0 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc1a1fd0 con 0x7f7efc1025f0 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3832757924 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7eec010930 con 0x7f7efc1025f0 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3832757924 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec018b00 con 0x7f7efc1025f0 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.562+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc1a2490 con 0x7f7efc1025f0 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.563+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc0fdc60 con 0x7f7efc1025f0 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.564+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3832757924 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f7eec018ca0 con 0x7f7efc1025f0 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.566+0000 7f7ef97fa640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7ee80a2c60 0x7f7ee80a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.566+0000 7f7ef2ffd640 1 -- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7ee80a2c60 msgr2=0x7f7ee80a5120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1180183286 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.566+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3832757924 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f7eec0cf6f0 con 0x7f7efc1025f0 2024-09-11T23:59:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.566+0000 7f7ef2ffd640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7ee80a2c60 0x7f7ee80a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:59:20.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.569+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3832757924 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7eec09c010 con 0x7f7efc1025f0 2024-09-11T23:59:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.748+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7efc02da10 con 0x7f7efc1025f0 2024-09-11T23:59:20.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.750+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3832757924 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22645 (secure 0 0 0) 0x7f7eec0a4e20 con 0x7f7efc1025f0 2024-09-11T23:59:20.749 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:20.749 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":82,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:57:40.484442+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:59:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7ee80a2c60 msgr2=0x7f7ee80a5120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:59:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7ee80a2c60 0x7f7ee80a5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc1025f0 msgr2=0x7f7efc101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc1025f0 0x7f7efc101f60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00e9f0 tx=0x7f7eec00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 shutdown_connections 2024-09-11T23:59:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7efc107850 0x7f7efc100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc104f20 0x7f7efc1005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f7ee80a2c60 0x7f7ee80a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 --2- 172.21.15.60:0/3832757924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc1025f0 0x7f7efc101f60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 >> 172.21.15.60:0/3832757924 conn(0x7f7efc0fc170 msgr2=0x7f7efc102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 shutdown_connections 2024-09-11T23:59:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.752+0000 7f7f01a8c640 1 -- 172.21.15.60:0/3832757924 wait complete. 2024-09-11T23:59:20.763 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:52:53.812220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T23:57:25.194293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T23:57:27.402156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:59:20.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:59:20.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1312803524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0101bf0 msgr2=0x7fd1a0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1312803524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0101bf0 0x7fd1a0102070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd188009900 tx=0x7fd18802a410 comp rx=0 tx=0).stop 2024-09-11T23:59:20.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1312803524 shutdown_connections 2024-09-11T23:59:20.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1312803524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a01025b0 0x7fd1a0108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1312803524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0101bf0 0x7fd1a0102070 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1312803524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1a0100a00 0x7fd1a0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1312803524 >> 172.21.15.60:0/1312803524 conn(0x7fd1a00fc140 msgr2=0x7fd1a00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:20.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1312803524 shutdown_connections 2024-09-11T23:59:20.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1312803524 wait complete. 2024-09-11T23:59:20.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 Processor -- start 2024-09-11T23:59:20.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.873+0000 7fd1a6ed0640 1 -- start start 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a6ed0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0100a00 0x7fd1a010b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a6ed0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a0101bf0 0x7fd1a01099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a6ed0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1a01025b0 0x7fd1a0109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a6ed0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a010d8e0 con 0x7fd1a0100a00 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a6ed0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a010d760 con 0x7fd1a01025b0 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a6ed0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a010da60 con 0x7fd1a0101bf0 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0100a00 0x7fd1a010b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0100a00 0x7fd1a010b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42300/0 (socket says 172.21.15.60:42300) 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 -- 172.21.15.60:0/1949755921 learned_addr learned my addr 172.21.15.60:0/1949755921 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a546d640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1a01025b0 0x7fd1a0109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd19ffff640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a0101bf0 0x7fd1a01099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:20.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 -- 172.21.15.60:0/1949755921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a0101bf0 msgr2=0x7fd1a01099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a0101bf0 0x7fd1a01099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 -- 172.21.15.60:0/1949755921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1a01025b0 msgr2=0x7fd1a0109f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:20.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1a01025b0 0x7fd1a0109f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:20.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 -- 172.21.15.60:0/1949755921 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a010a790 con 0x7fd1a0100a00 2024-09-11T23:59:20.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd1a4c6c640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0100a00 0x7fd1a010b380 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd19000e9c0 tx=0x7fd19000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:20.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.874+0000 7fd19dffb640 1 -- 172.21.15.60:0/1949755921 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19000cd80 con 0x7fd1a0100a00 2024-09-11T23:59:20.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.875+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a01a1fe0 con 0x7fd1a0100a00 2024-09-11T23:59:20.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.875+0000 7fd19dffb640 1 -- 172.21.15.60:0/1949755921 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1900035f0 con 0x7fd1a0100a00 2024-09-11T23:59:20.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.875+0000 7fd19dffb640 1 -- 172.21.15.60:0/1949755921 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190010690 con 0x7fd1a0100a00 2024-09-11T23:59:20.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.875+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a01a2440 con 0x7fd1a0100a00 2024-09-11T23:59:20.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.876+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a0107e40 con 0x7fd1a0100a00 2024-09-11T23:59:20.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.877+0000 7fd19dffb640 1 -- 172.21.15.60:0/1949755921 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7fd1900037a0 con 0x7fd1a0100a00 2024-09-11T23:59:20.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.877+0000 7fd19dffb640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd18c0a2be0 0x7fd18c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:20.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.878+0000 7fd19ffff640 1 -- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd18c0a2be0 msgr2=0x7fd18c0a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1180183286 2024-09-11T23:59:20.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.878+0000 7fd19dffb640 1 -- 172.21.15.60:0/1949755921 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7fd1900cf550 con 0x7fd1a0100a00 2024-09-11T23:59:20.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.878+0000 7fd19ffff640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd18c0a2be0 0x7fd18c0a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:59:20.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:20.882+0000 7fd19dffb640 1 -- 172.21.15.60:0/1949755921 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd19009c4c0 con 0x7fd1a0100a00 2024-09-11T23:59:21.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.059+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd1a0062df0 con 0x7fd1a0100a00 2024-09-11T23:59:21.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.059+0000 7fd19dffb640 1 -- 172.21.15.60:0/1949755921 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fd19009bdc0 con 0x7fd1a0100a00 2024-09-11T23:59:21.059 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd18c0a2be0 msgr2=0x7fd18c0a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd18c0a2be0 0x7fd18c0a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0100a00 msgr2=0x7fd1a010b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0100a00 0x7fd1a010b380 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd19000e9c0 tx=0x7fd19000ee80 comp rx=0 tx=0).stop 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 shutdown_connections 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1a01025b0 0x7fd1a0109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a0101bf0 0x7fd1a01099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7fd18c0a2be0 0x7fd18c0a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 --2- 172.21.15.60:0/1949755921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1a0100a00 0x7fd1a010b380 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.061+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 >> 172.21.15.60:0/1949755921 conn(0x7fd1a00fc140 msgr2=0x7fd1a0105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.062+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 shutdown_connections 2024-09-11T23:59:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.062+0000 7fd1a6ed0640 1 -- 172.21.15.60:0/1949755921 wait complete. 2024-09-11T23:59:21.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T23:59:21.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 -- 172.21.15.60:0/3575947101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 msgr2=0x7f2b90104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 --2- 172.21.15.60:0/3575947101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 0x7f2b90104a30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009900 tx=0x7f2b8402a410 comp rx=0 tx=0).stop 2024-09-11T23:59:21.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 -- 172.21.15.60:0/3575947101 shutdown_connections 2024-09-11T23:59:21.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 --2- 172.21.15.60:0/3575947101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b901078a0 0x7f2b90109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 --2- 172.21.15.60:0/3575947101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b90104f70 0x7f2b90107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 --2- 172.21.15.60:0/3575947101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 0x7f2b90104a30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 -- 172.21.15.60:0/3575947101 >> 172.21.15.60:0/3575947101 conn(0x7f2b900fc140 msgr2=0x7f2b900fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:21.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 -- 172.21.15.60:0/3575947101 shutdown_connections 2024-09-11T23:59:21.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 -- 172.21.15.60:0/3575947101 wait complete. 2024-09-11T23:59:21.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.182+0000 7f2b97684640 1 Processor -- start 2024-09-11T23:59:21.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b97684640 1 -- start start 2024-09-11T23:59:21.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b97684640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 0x7f2b90197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:21.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b97684640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b90104f70 0x7f2b901984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b97684640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b901078a0 0x7f2b9019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b97684640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9010d8e0 con 0x7f2b90102640 2024-09-11T23:59:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b97684640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9010d760 con 0x7f2b90104f70 2024-09-11T23:59:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b97684640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9010da60 con 0x7f2b901078a0 2024-09-11T23:59:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b95420640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 0x7f2b90197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:21.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b90104f70 0x7f2b901984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b90104f70 0x7f2b901984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:37584/0 (socket says 172.21.15.60:37584) 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b95420640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 0x7f2b90197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42322/0 (socket says 172.21.15.60:42322) 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 -- 172.21.15.60:0/770211010 learned_addr learned my addr 172.21.15.60:0/770211010 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b95c21640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b901078a0 0x7f2b9019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 -- 172.21.15.60:0/770211010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b901078a0 msgr2=0x7f2b9019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b901078a0 0x7f2b9019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 -- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 msgr2=0x7f2b90197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 0x7f2b90197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 -- 172.21.15.60:0/770211010 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9019fb90 con 0x7f2b90104f70 2024-09-11T23:59:21.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.183+0000 7f2b94c1f640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b90104f70 0x7f2b901984b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00eb90 tx=0x7f2b8c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:21.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.184+0000 7f2b827fc640 1 -- 172.21.15.60:0/770211010 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c010630 con 0x7f2b90104f70 2024-09-11T23:59:21.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.184+0000 7f2b827fc640 1 -- 172.21.15.60:0/770211010 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2b8c00ee90 con 0x7f2b90104f70 2024-09-11T23:59:21.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.184+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9019fe80 con 0x7f2b90104f70 2024-09-11T23:59:21.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.184+0000 7f2b827fc640 1 -- 172.21.15.60:0/770211010 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c018cb0 con 0x7f2b90104f70 2024-09-11T23:59:21.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.184+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b901a0340 con 0x7f2b90104f70 2024-09-11T23:59:21.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.185+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b900fdc30 con 0x7f2b90104f70 2024-09-11T23:59:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.186+0000 7f2b827fc640 1 -- 172.21.15.60:0/770211010 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f2b8c004a40 con 0x7f2b90104f70 2024-09-11T23:59:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.186+0000 7f2b827fc640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2b7c0a2be0 0x7f2b7c0a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:21.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.187+0000 7f2b95420640 1 -- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2b7c0a2be0 msgr2=0x7f2b7c0a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.60:6800/1180183286 2024-09-11T23:59:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.187+0000 7f2b827fc640 1 -- 172.21.15.60:0/770211010 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8182+0+0 (secure 0 0 0) 0x7f2b8c0cf990 con 0x7f2b90104f70 2024-09-11T23:59:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.187+0000 7f2b95420640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2b7c0a2be0 0x7f2b7c0a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:59:21.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.189+0000 7f2b827fc640 1 -- 172.21.15.60:0/770211010 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b8c09c2d0 con 0x7f2b90104f70 2024-09-11T23:59:21.229 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 11 23:59:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y[36173]: 2024-09-11T23:59:20.975+0000 7fdfd848d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:59:21.284 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z[37302]: 2024-09-11T23:59:21.025+0000 7f8f0aba8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:59:21.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.369+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2b9002da10 con 0x7f2b90104f70 2024-09-11T23:59:21.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.370+0000 7f2b827fc640 1 -- 172.21.15.60:0/770211010 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f2b8c0a05d0 con 0x7f2b90104f70 2024-09-11T23:59:21.369 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-09-11T23:59:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2b7c0a2be0 msgr2=0x7f2b7c0a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:59:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2b7c0a2be0 0x7f2b7c0a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b90104f70 msgr2=0x7f2b901984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b90104f70 0x7f2b901984b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00eb90 tx=0x7f2b8c00c6a0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 shutdown_connections 2024-09-11T23:59:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b901078a0 0x7f2b9019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b90104f70 0x7f2b901984b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:6800/1180183286,v1:172.21.15.60:6801/1180183286] conn(0x7f2b7c0a2be0 0x7f2b7c0a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 --2- 172.21.15.60:0/770211010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2b90102640 0x7f2b90197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 >> 172.21.15.60:0/770211010 conn(0x7f2b900fc140 msgr2=0x7f2b90103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 shutdown_connections 2024-09-11T23:59:21.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.372+0000 7f2b97684640 1 -- 172.21.15.60:0/770211010 wait complete. 2024-09-11T23:59:21.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T23:59:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 -- 172.21.15.60:0/2148136665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44e4073990 msgr2=0x7f44e4073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 --2- 172.21.15.60:0/2148136665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44e4073990 0x7f44e4073d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009900 tx=0x7f44d402a3f0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 -- 172.21.15.60:0/2148136665 shutdown_connections 2024-09-11T23:59:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 --2- 172.21.15.60:0/2148136665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44e4109c50 0x7f44e4112540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 --2- 172.21.15.60:0/2148136665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e41091f0 0x7f44e4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 --2- 172.21.15.60:0/2148136665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44e4073990 0x7f44e4073d90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 -- 172.21.15.60:0/2148136665 >> 172.21.15.60:0/2148136665 conn(0x7f44e406eb50 msgr2=0x7f44e4070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 -- 172.21.15.60:0/2148136665 shutdown_connections 2024-09-11T23:59:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.514+0000 7f44e9e96640 1 -- 172.21.15.60:0/2148136665 wait complete. 2024-09-11T23:59:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e9e96640 1 Processor -- start 2024-09-11T23:59:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e9e96640 1 -- start start 2024-09-11T23:59:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e9e96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44e4073990 0x7f44e41a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e9e96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e41091f0 0x7f44e41a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44e4073990 0x7f44e41a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44e4073990 0x7f44e41a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:37634/0 (socket says 172.21.15.60:37634) 2024-09-11T23:59:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e37fe640 1 -- 172.21.15.60:0/4052520526 learned_addr learned my addr 172.21.15.60:0/4052520526 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e9e96640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44e4109c50 0x7f44e41ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e9e96640 1 -- 172.21.15.60:0/4052520526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4116120 con 0x7f44e41091f0 2024-09-11T23:59:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.515+0000 7f44e9e96640 1 -- 172.21.15.60:0/4052520526 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4115fa0 con 0x7f44e4073990 2024-09-11T23:59:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.516+0000 7f44e9e96640 1 -- 172.21.15.60:0/4052520526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f44e41162a0 con 0x7f44e4109c50 2024-09-11T23:59:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.516+0000 7f44e3fff640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44e4109c50 0x7f44e41ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.516+0000 7f44dbfff640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e41091f0 0x7f44e41a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:21.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.517+0000 7f44dbfff640 1 -- 172.21.15.60:0/4052520526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44e4109c50 msgr2=0x7f44e41ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.517+0000 7f44dbfff640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44e4109c50 0x7f44e41ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.517+0000 7f44dbfff640 1 -- 172.21.15.60:0/4052520526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44e4073990 msgr2=0x7f44e41a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.517+0000 7f44dbfff640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44e4073990 0x7f44e41a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.517+0000 7f44dbfff640 1 -- 172.21.15.60:0/4052520526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e41ae7f0 con 0x7f44e41091f0 2024-09-11T23:59:21.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.517+0000 7f44dbfff640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e41091f0 0x7f44e41a7110 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00d6d0 tx=0x7f44cc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:21.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.517+0000 7f44e17fa640 1 -- 172.21.15.60:0/4052520526 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc017070 con 0x7f44e41091f0 2024-09-11T23:59:21.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.518+0000 7f44e17fa640 1 -- 172.21.15.60:0/4052520526 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44cc009820 con 0x7f44e41091f0 2024-09-11T23:59:21.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.518+0000 7f44e9e96640 1 -- 172.21.15.60:0/4052520526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e41aeae0 con 0x7f44e41091f0 2024-09-11T23:59:21.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.518+0000 7f44e9e96640 1 -- 172.21.15.60:0/4052520526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e41af030 con 0x7f44e41091f0 2024-09-11T23:59:21.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.519+0000 7f44e17fa640 1 -- 172.21.15.60:0/4052520526 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004e00 con 0x7f44e41091f0 2024-09-11T23:59:21.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.519+0000 7f44da7fc640 1 -- 172.21.15.60:0/4052520526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e4062df0 con 0x7f44e41091f0 2024-09-11T23:59:21.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.521+0000 7f44e17fa640 1 -- 172.21.15.60:0/4052520526 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f44cc005220 con 0x7f44e41091f0 2024-09-11T23:59:21.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.522+0000 7f44e17fa640 1 -- 172.21.15.60:0/4052520526 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f44cc0ce4e0 con 0x7f44e41091f0 2024-09-11T23:59:21.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.532+0000 7f44e17fa640 1 -- 172.21.15.60:0/4052520526 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44cc09b0c0 con 0x7f44e41091f0 2024-09-11T23:59:21.669 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.378+0000 7fe5857b6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:59:21.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3167909416' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T23:59:21.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:59:21.682 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3832757924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: Standby manager daemon y restarted 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: Standby manager daemon y started 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: Standby manager daemon z restarted 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: Standby manager daemon z started 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:59:21.683 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:59:21.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1949755921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:59:21.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/770211010' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:59:21.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: Active manager daemon x restarted 2024-09-11T23:59:21.684 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-mon[30953]: Activating manager daemon x 2024-09-11T23:59:21.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3167909416' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3832757924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: Standby manager daemon y restarted 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: Standby manager daemon y started 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: Standby manager daemon z restarted 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: Standby manager daemon z started 2024-09-11T23:59:21.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:59:21.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:59:21.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:59:21.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:59:21.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1949755921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:59:21.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/770211010' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:59:21.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: Active manager daemon x restarted 2024-09-11T23:59:21.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:21 smithi105 ceph-mon[34805]: Activating manager daemon x 2024-09-11T23:59:21.739 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3167909416' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3832757924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: Standby manager daemon y restarted 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: Standby manager daemon y started 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.105:0/2375996037' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:59:21.740 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: Standby manager daemon z restarted 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: Standby manager daemon z started 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='mgr.? 172.21.15.192:0/4061167922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1949755921' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/770211010' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: Active manager daemon x restarted 2024-09-11T23:59:21.741 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:21 smithi192 ceph-mon[35487]: Activating manager daemon x 2024-09-11T23:59:21.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.782+0000 7f44da7fc640 1 -- 172.21.15.60:0/4052520526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f44e4062fc0 con 0x7f44e41091f0 2024-09-11T23:59:21.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.783+0000 7f44e17fa640 1 -- 172.21.15.60:0/4052520526 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7f44cc09f3c0 con 0x7f44e41091f0 2024-09-11T23:59:21.782 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2024-09-11T23:59:21.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 -- 172.21.15.60:0/4052520526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e41091f0 msgr2=0x7f44e41a7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:21.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e41091f0 0x7f44e41a7110 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00d6d0 tx=0x7f44cc00db90 comp rx=0 tx=0).stop 2024-09-11T23:59:21.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 -- 172.21.15.60:0/4052520526 shutdown_connections 2024-09-11T23:59:21.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44e4109c50 0x7f44e41ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44e41091f0 0x7f44e41a7110 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 --2- 172.21.15.60:0/4052520526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44e4073990 0x7f44e41a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 -- 172.21.15.60:0/4052520526 >> 172.21.15.60:0/4052520526 conn(0x7f44e406eb50 msgr2=0x7f44e410c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 -- 172.21.15.60:0/4052520526 shutdown_connections 2024-09-11T23:59:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:21.785+0000 7f44da7fc640 1 -- 172.21.15.60:0/4052520526 wait complete. 2024-09-11T23:59:21.795 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-11T23:59:21.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:21.939 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.670+0000 7fe4f008e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.939 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.670+0000 7fe4f008e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.939 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.670+0000 7fe4f008e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.939 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.670+0000 7fe4f008e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.939 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.670+0000 7fe4f008e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.940 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.671+0000 7fe4ed008640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.940 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.671+0000 7fe4ed008640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.940 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.671+0000 7fe4ed008640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.940 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.671+0000 7fe4ed008640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:21.940 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:21.671+0000 7fe4ed008640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:59:22.082 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:22.513 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: mgrmap e20: x(active, starting, since 0.0125634s), standbys: z, y 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:59:22.514 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:59:22.515 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:59:22.516 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:59:22.517 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:59:22.517 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:59:22.517 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: Manager daemon x is now available 2024-09-11T23:59:22.517 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:22.517 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:59:22.517 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:59:22.517 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:22 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4052520526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:59:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.597+0000 7fd133c87640 1 -- 172.21.15.60:0/3378155759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c102d30 msgr2=0x7fd12c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.597+0000 7fd133c87640 1 --2- 172.21.15.60:0/3378155759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c102d30 0x7fd12c103110 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd128009930 tx=0x7fd12802a420 comp rx=0 tx=0).stop 2024-09-11T23:59:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.597+0000 7fd133c87640 1 -- 172.21.15.60:0/3378155759 shutdown_connections 2024-09-11T23:59:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.597+0000 7fd133c87640 1 --2- 172.21.15.60:0/3378155759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd12c1082a0 0x7fd12c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.597+0000 7fd133c87640 1 --2- 172.21.15.60:0/3378155759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd12c1036e0 0x7fd12c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.597+0000 7fd133c87640 1 --2- 172.21.15.60:0/3378155759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c102d30 0x7fd12c103110 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.597+0000 7fd133c87640 1 -- 172.21.15.60:0/3378155759 >> 172.21.15.60:0/3378155759 conn(0x7fd12c0fc7d0 msgr2=0x7fd12c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.598+0000 7fd133c87640 1 -- 172.21.15.60:0/3378155759 shutdown_connections 2024-09-11T23:59:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.598+0000 7fd133c87640 1 -- 172.21.15.60:0/3378155759 wait complete. 2024-09-11T23:59:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.598+0000 7fd133c87640 1 Processor -- start 2024-09-11T23:59:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.598+0000 7fd133c87640 1 -- start start 2024-09-11T23:59:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd133c87640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd12c102d30 0x7fd12c1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd133c87640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd12c1036e0 0x7fd12c1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd133c87640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c1082a0 0x7fd12c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd133c87640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c1121c0 con 0x7fd12c1082a0 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd133c87640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c112040 con 0x7fd12c1036e0 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd133c87640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd12c112340 con 0x7fd12c102d30 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd132224640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c1082a0 0x7fd12c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd132224640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c1082a0 0x7fd12c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53502/0 (socket says 172.21.15.60:53502) 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd132224640 1 -- 172.21.15.60:0/3611596623 learned_addr learned my addr 172.21.15.60:0/3611596623 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd131222640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd12c1036e0 0x7fd12c1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd131a23640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd12c102d30 0x7fd12c1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd131222640 1 -- 172.21.15.60:0/3611596623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd12c102d30 msgr2=0x7fd12c1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd131222640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd12c102d30 0x7fd12c1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd131222640 1 -- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c1082a0 msgr2=0x7fd12c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd131222640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c1082a0 0x7fd12c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd131222640 1 -- 172.21.15.60:0/3611596623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12c19af20 con 0x7fd12c1036e0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd132224640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c1082a0 0x7fd12c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd131222640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd12c1036e0 0x7fd12c1a0b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0697d0 tx=0x7fd11c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.599+0000 7fd122ffd640 1 -- 172.21.15.60:0/3611596623 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00cc40 con 0x7fd12c1036e0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.600+0000 7fd122ffd640 1 -- 172.21.15.60:0/3611596623 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd11c00cde0 con 0x7fd12c1036e0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.600+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd12c19b210 con 0x7fd12c1036e0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.600+0000 7fd122ffd640 1 -- 172.21.15.60:0/3611596623 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c018980 con 0x7fd12c1036e0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.600+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd12c1a7560 con 0x7fd12c1036e0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.601+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd12c19b580 con 0x7fd12c1036e0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.602+0000 7fd122ffd640 1 -- 172.21.15.60:0/3611596623 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fd11c047bc0 con 0x7fd12c1036e0 2024-09-11T23:59:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.602+0000 7fd122ffd640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd1180a2970 0x7fd1180a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.602+0000 7fd131a23640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd1180a2970 0x7fd1180a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.602+0000 7fd122ffd640 1 -- 172.21.15.60:0/3611596623 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd11c0ceff0 con 0x7fd12c1036e0 2024-09-11T23:59:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.603+0000 7fd131a23640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd1180a2970 0x7fd1180a4e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd128009900 tx=0x7fd1280058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.606+0000 7fd122ffd640 1 -- 172.21.15.60:0/3611596623 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd11c09bb20 con 0x7fd12c1036e0 2024-09-11T23:59:22.725 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:59:22.725 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: mgrmap e20: x(active, starting, since 0.0125634s), standbys: z, y 2024-09-11T23:59:22.725 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:59:22.725 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:59:22.726 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:59:22.726 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:59:22.726 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:59:22.726 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:59:22.726 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:59:22.726 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:59:22.726 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:59:22.726 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:59:22.727 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:59:22.727 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:59:22.727 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:59:22.727 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:59:22.727 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:59:22.727 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:59:22.727 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:59:22.727 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:59:22.728 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:59:22.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:59:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:59:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:59:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:59:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: Manager daemon x is now available 2024-09-11T23:59:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:59:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:59:22.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:22 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4052520526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:59:22.751 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T23:59:22.751 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: mgrmap e20: x(active, starting, since 0.0125634s), standbys: z, y 2024-09-11T23:59:22.751 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-11T23:59:22.751 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-11T23:59:22.751 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-11T23:59:22.752 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-11T23:59:22.753 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: Manager daemon x is now available 2024-09-11T23:59:22.754 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:22.755 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-11T23:59:22.755 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-11T23:59:22.755 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:22 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4052520526' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-11T23:59:22.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.844+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd12c19bbe0 con 0x7fd12c1036e0 2024-09-11T23:59:22.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.845+0000 7fd122ffd640 1 -- 172.21.15.60:0/3611596623 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7fd11c09fe20 con 0x7fd12c1036e0 2024-09-11T23:59:22.845 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:22.845 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-11T23:59:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-11T23:59:22.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd1180a2970 msgr2=0x7fd1180a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:22.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd1180a2970 0x7fd1180a4e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd128009900 tx=0x7fd1280058d0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd12c1036e0 msgr2=0x7fd12c1a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:22.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd12c1036e0 0x7fd12c1a0b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd12c0697d0 tx=0x7fd11c00ee50 comp rx=0 tx=0).stop 2024-09-11T23:59:22.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 shutdown_connections 2024-09-11T23:59:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd1180a2970 0x7fd1180a4e30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd12c1082a0 0x7fd12c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd12c1036e0 0x7fd12c1a0b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 --2- 172.21.15.60:0/3611596623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd12c102d30 0x7fd12c1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.847+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 >> 172.21.15.60:0/3611596623 conn(0x7fd12c0fc7d0 msgr2=0x7fd12c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.848+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 shutdown_connections 2024-09-11T23:59:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:22.848+0000 7fd133c87640 1 -- 172.21.15.60:0/3611596623 wait complete. 2024-09-11T23:59:23.441 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:23.363+0000 7fe4d9021640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:23:59:23] ENGINE Error in HTTPServer.serve 2024-09-11T23:59:23.442 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: Traceback (most recent call last): 2024-09-11T23:59:23.442 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:59:23.442 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._connections.run(self.expiration_interval) 2024-09-11T23:59:23.442 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:59:23.442 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._run(expiration_interval) 2024-09-11T23:59:23.442 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:59:23.442 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:59:23.442 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: s = self.context.wrap_socket( 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: return self.sslsocket_class._create( 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self.do_handshake() 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:59:23.443 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: self._sslobj.do_handshake() 2024-09-11T23:59:23.444 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:59:23.444 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-11T23:59:23.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:23 smithi105 ceph-mon[34805]: mgrmap e21: x(active, since 1.06967s), standbys: z, y 2024-09-11T23:59:23.799 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:23 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3611596623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:23.799 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:23 smithi105 ceph-mon[34805]: [11/Sep/2024:23:59:23] ENGINE Bus STARTING 2024-09-11T23:59:23.800 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:23 smithi192 ceph-mon[35487]: mgrmap e21: x(active, since 1.06967s), standbys: z, y 2024-09-11T23:59:23.800 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:23 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3611596623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:23.800 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:23 smithi192 ceph-mon[35487]: [11/Sep/2024:23:59:23] ENGINE Bus STARTING 2024-09-11T23:59:23.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-mon[30953]: mgrmap e21: x(active, since 1.06967s), standbys: z, y 2024-09-11T23:59:23.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3611596623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:23.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:23 smithi060 ceph-mon[30953]: [11/Sep/2024:23:59:23] ENGINE Bus STARTING 2024-09-11T23:59:24.069 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-11T23:59:24.069 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-11T23:59:24.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:59:24.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.179+0000 7f7f82331640 1 -- 172.21.15.60:0/563237920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 msgr2=0x7f7f7c1049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.179+0000 7f7f82331640 1 --2- 172.21.15.60:0/563237920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 0x7f7f7c1049a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009900 tx=0x7f7f6c02a410 comp rx=0 tx=0).stop 2024-09-11T23:59:24.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 -- 172.21.15.60:0/563237920 shutdown_connections 2024-09-11T23:59:24.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 --2- 172.21.15.60:0/563237920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f7c107810 0x7f7f7c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 --2- 172.21.15.60:0/563237920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c104ee0 0x7f7f7c1072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 --2- 172.21.15.60:0/563237920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 0x7f7f7c1049a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 -- 172.21.15.60:0/563237920 >> 172.21.15.60:0/563237920 conn(0x7f7f7c0fc1b0 msgr2=0x7f7f7c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:24.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 -- 172.21.15.60:0/563237920 shutdown_connections 2024-09-11T23:59:24.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 -- 172.21.15.60:0/563237920 wait complete. 2024-09-11T23:59:24.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 Processor -- start 2024-09-11T23:59:24.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 -- start start 2024-09-11T23:59:24.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 0x7f7f7c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c104ee0 0x7f7f7c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.180+0000 7f7f82331640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f7c107810 0x7f7f7c19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f82331640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10d940 con 0x7f7f7c1025b0 2024-09-11T23:59:24.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f82331640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10d7c0 con 0x7f7f7c107810 2024-09-11T23:59:24.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f82331640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10dac0 con 0x7f7f7c104ee0 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 0x7f7f7c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 0x7f7f7c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53544/0 (socket says 172.21.15.60:53544) 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 -- 172.21.15.60:0/3227345180 learned_addr learned my addr 172.21.15.60:0/3227345180 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f808ce640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f7c107810 0x7f7f7c19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 -- 172.21.15.60:0/3227345180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c104ee0 msgr2=0x7f7f7c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c104ee0 0x7f7f7c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 -- 172.21.15.60:0/3227345180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f7c107810 msgr2=0x7f7f7c19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f7c107810 0x7f7f7c19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 -- 172.21.15.60:0/3227345180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c19fbb0 con 0x7f7f7c1025b0 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f7bfff640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 0x7f7f7c197f90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009a20 tx=0x7f7f6c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f797fa640 1 -- 172.21.15.60:0/3227345180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c03f030 con 0x7f7f7c1025b0 2024-09-11T23:59:24.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f797fa640 1 -- 172.21.15.60:0/3227345180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f6c003d00 con 0x7f7f7c1025b0 2024-09-11T23:59:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f797fa640 1 -- 172.21.15.60:0/3227345180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c035070 con 0x7f7f7c1025b0 2024-09-11T23:59:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c19fe40 con 0x7f7f7c1025b0 2024-09-11T23:59:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.181+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c1a02b0 con 0x7f7f7c1025b0 2024-09-11T23:59:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.182+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c0fdca0 con 0x7f7f7c1025b0 2024-09-11T23:59:24.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.184+0000 7f7f797fa640 1 -- 172.21.15.60:0/3227345180 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7f7f6c042030 con 0x7f7f7c1025b0 2024-09-11T23:59:24.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.184+0000 7f7f797fa640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f640a2d80 0x7f7f640a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.184+0000 7f7f7b7fe640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f640a2d80 0x7f7f640a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.185+0000 7f7f797fa640 1 -- 172.21.15.60:0/3227345180 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7f6c0efe20 con 0x7f7f7c1025b0 2024-09-11T23:59:24.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.185+0000 7f7f7b7fe640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f640a2d80 0x7f7f640a5240 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f70005fd0 tx=0x7f7f70005850 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:24.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.187+0000 7f7f797fa640 1 -- 172.21.15.60:0/3227345180 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f6c0bca90 con 0x7f7f7c1025b0 2024-09-11T23:59:24.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.389+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f7c062630 con 0x7f7f640a2d80 2024-09-11T23:59:24.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.396+0000 7f7f797fa640 1 -- 172.21.15.60:0/3227345180 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258025 (secure 0 0 0) 0x7f7f7c062630 con 0x7f7f640a2d80 2024-09-11T23:59:24.400 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:24.402 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:59:24.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f640a2d80 msgr2=0x7f7f640a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f640a2d80 0x7f7f640a5240 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7f70005fd0 tx=0x7f7f70005850 comp rx=0 tx=0).stop 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 msgr2=0x7f7f7c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 0x7f7f7c197f90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009a20 tx=0x7f7f6c004430 comp rx=0 tx=0).stop 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 shutdown_connections 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f640a2d80 0x7f7f640a5240 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f7c107810 0x7f7f7c19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f7c104ee0 0x7f7f7c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 --2- 172.21.15.60:0/3227345180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f7c1025b0 0x7f7f7c197f90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 >> 172.21.15.60:0/3227345180 conn(0x7f7f7c0fc1b0 msgr2=0x7f7f7c102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:24.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 shutdown_connections 2024-09-11T23:59:24.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.399+0000 7f7f82331640 1 -- 172.21.15.60:0/3227345180 wait complete. 2024-09-11T23:59:24.409 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-11T23:59:23.398697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191409,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1285,"num_read_kb":804,"num_write":555,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":939,"ondisk_log_size":939,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368960,"kb_used_data":11364,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572864,"statfs":{"total":1151940427776,"available":1151562612736,"internally_reserved":0,"allocated":11636736,"data_stored":8859039,"data_compressed":213689,"data_compressed_allocated":274432,"data_compressed_original":3399680,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.941944"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466469+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:59:21.466469+0000","last_peered":"2024-09-11T23:59:21.466469+0000","last_clean":"2024-09-11T23:59:21.466469+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:59:21.466469+0000","last_undegraded":"2024-09-11T23:59:21.466469+0000","last_fullsized":"2024-09-11T23:59:21.466469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680932+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:59:21.680932+0000","last_peered":"2024-09-11T23:59:21.680932+0000","last_clean":"2024-09-11T23:59:21.680932+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:59:21.680932+0000","last_undegraded":"2024-09-11T23:59:21.680932+0000","last_fullsized":"2024-09-11T23:59:21.680932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680758+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:59:21.680758+0000","last_peered":"2024-09-11T23:59:21.680758+0000","last_clean":"2024-09-11T23:59:21.680758+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:59:21.680758+0000","last_undegraded":"2024-09-11T23:59:21.680758+0000","last_fullsized":"2024-09-11T23:59:21.680758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645268+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:59:21.645268+0000","last_peered":"2024-09-11T23:59:21.645268+0000","last_clean":"2024-09-11T23:59:21.645268+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:59:21.645268+0000","last_undegraded":"2024-09-11T23:59:21.645268+0000","last_fullsized":"2024-09-11T23:59:21.645268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700973+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:59:21.700973+0000","last_peered":"2024-09-11T23:59:21.700973+0000","last_clean":"2024-09-11T23:59:21.700973+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:59:21.700973+0000","last_undegraded":"2024-09-11T23:59:21.700973+0000","last_fullsized":"2024-09-11T23:59:21.700973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475885+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:59:21.475885+0000","last_peered":"2024-09-11T23:59:21.475885+0000","last_clean":"2024-09-11T23:59:21.475885+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:59:21.475885+0000","last_undegraded":"2024-09-11T23:59:21.475885+0000","last_fullsized":"2024-09-11T23:59:21.475885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644131+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:59:21.644131+0000","last_peered":"2024-09-11T23:59:21.644131+0000","last_clean":"2024-09-11T23:59:21.644131+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:59:21.644131+0000","last_undegraded":"2024-09-11T23:59:21.644131+0000","last_fullsized":"2024-09-11T23:59:21.644131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466288+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:59:21.466288+0000","last_peered":"2024-09-11T23:59:21.466288+0000","last_clean":"2024-09-11T23:59:21.466288+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:59:21.466288+0000","last_undegraded":"2024-09-11T23:59:21.466288+0000","last_fullsized":"2024-09-11T23:59:21.466288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387087+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:59:21.387087+0000","last_peered":"2024-09-11T23:59:21.387087+0000","last_clean":"2024-09-11T23:59:21.387087+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:59:21.387087+0000","last_undegraded":"2024-09-11T23:59:21.387087+0000","last_fullsized":"2024-09-11T23:59:21.387087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476277+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:59:21.476277+0000","last_peered":"2024-09-11T23:59:21.476277+0000","last_clean":"2024-09-11T23:59:21.476277+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:59:21.476277+0000","last_undegraded":"2024-09-11T23:59:21.476277+0000","last_fullsized":"2024-09-11T23:59:21.476277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644423+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:59:21.644423+0000","last_peered":"2024-09-11T23:59:21.644423+0000","last_clean":"2024-09-11T23:59:21.644423+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:59:21.644423+0000","last_undegraded":"2024-09-11T23:59:21.644423+0000","last_fullsized":"2024-09-11T23:59:21.644423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385078+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:59:21.385078+0000","last_peered":"2024-09-11T23:59:21.385078+0000","last_clean":"2024-09-11T23:59:21.385078+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:59:21.385078+0000","last_undegraded":"2024-09-11T23:59:21.385078+0000","last_fullsized":"2024-09-11T23:59:21.385078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643697+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:59:21.643697+0000","last_peered":"2024-09-11T23:59:21.643697+0000","last_clean":"2024-09-11T23:59:21.643697+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:59:21.643697+0000","last_undegraded":"2024-09-11T23:59:21.643697+0000","last_fullsized":"2024-09-11T23:59:21.643697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680072+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:59:21.680072+0000","last_peered":"2024-09-11T23:59:21.680072+0000","last_clean":"2024-09-11T23:59:21.680072+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:59:21.680072+0000","last_undegraded":"2024-09-11T23:59:21.680072+0000","last_fullsized":"2024-09-11T23:59:21.680072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.679770+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:59:21.679770+0000","last_peered":"2024-09-11T23:59:21.679770+0000","last_clean":"2024-09-11T23:59:21.679770+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:59:21.679770+0000","last_undegraded":"2024-09-11T23:59:21.679770+0000","last_fullsized":"2024-09-11T23:59:21.679770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386692+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:59:21.386692+0000","last_peered":"2024-09-11T23:59:21.386692+0000","last_clean":"2024-09-11T23:59:21.386692+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:59:21.386692+0000","last_undegraded":"2024-09-11T23:59:21.386692+0000","last_fullsized":"2024-09-11T23:59:21.386692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466577+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:59:21.466577+0000","last_peered":"2024-09-11T23:59:21.466577+0000","last_clean":"2024-09-11T23:59:21.466577+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:59:21.466577+0000","last_undegraded":"2024-09-11T23:59:21.466577+0000","last_fullsized":"2024-09-11T23:59:21.466577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385256+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:59:21.385256+0000","last_peered":"2024-09-11T23:59:21.385256+0000","last_clean":"2024-09-11T23:59:21.385256+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:59:21.385256+0000","last_undegraded":"2024-09-11T23:59:21.385256+0000","last_fullsized":"2024-09-11T23:59:21.385256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387348+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:59:21.387348+0000","last_peered":"2024-09-11T23:59:21.387348+0000","last_clean":"2024-09-11T23:59:21.387348+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:59:21.387348+0000","last_undegraded":"2024-09-11T23:59:21.387348+0000","last_fullsized":"2024-09-11T23:59:21.387348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466261+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:59:21.466261+0000","last_peered":"2024-09-11T23:59:21.466261+0000","last_clean":"2024-09-11T23:59:21.466261+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:59:21.466261+0000","last_undegraded":"2024-09-11T23:59:21.466261+0000","last_fullsized":"2024-09-11T23:59:21.466261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643856+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:59:21.643856+0000","last_peered":"2024-09-11T23:59:21.643856+0000","last_clean":"2024-09-11T23:59:21.643856+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:59:21.643856+0000","last_undegraded":"2024-09-11T23:59:21.643856+0000","last_fullsized":"2024-09-11T23:59:21.643856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386866+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:59:21.386866+0000","last_peered":"2024-09-11T23:59:21.386866+0000","last_clean":"2024-09-11T23:59:21.386866+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:59:21.386866+0000","last_undegraded":"2024-09-11T23:59:21.386866+0000","last_fullsized":"2024-09-11T23:59:21.386866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466381+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:59:21.466381+0000","last_peered":"2024-09-11T23:59:21.466381+0000","last_clean":"2024-09-11T23:59:21.466381+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:59:21.466381+0000","last_undegraded":"2024-09-11T23:59:21.466381+0000","last_fullsized":"2024-09-11T23:59:21.466381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472730+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:59:21.472730+0000","last_peered":"2024-09-11T23:59:21.472730+0000","last_clean":"2024-09-11T23:59:21.472730+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:59:21.472730+0000","last_undegraded":"2024-09-11T23:59:21.472730+0000","last_fullsized":"2024-09-11T23:59:21.472730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466751+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:59:21.466751+0000","last_peered":"2024-09-11T23:59:21.466751+0000","last_clean":"2024-09-11T23:59:21.466751+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:59:21.466751+0000","last_undegraded":"2024-09-11T23:59:21.466751+0000","last_fullsized":"2024-09-11T23:59:21.466751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387391+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:59:21.387391+0000","last_peered":"2024-09-11T23:59:21.387391+0000","last_clean":"2024-09-11T23:59:21.387391+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:59:21.387391+0000","last_undegraded":"2024-09-11T23:59:21.387391+0000","last_fullsized":"2024-09-11T23:59:21.387391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466340+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:59:21.466340+0000","last_peered":"2024-09-11T23:59:21.466340+0000","last_clean":"2024-09-11T23:59:21.466340+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:59:21.466340+0000","last_undegraded":"2024-09-11T23:59:21.466340+0000","last_fullsized":"2024-09-11T23:59:21.466340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643440+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:59:21.643440+0000","last_peered":"2024-09-11T23:59:21.643440+0000","last_clean":"2024-09-11T23:59:21.643440+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:59:21.643440+0000","last_undegraded":"2024-09-11T23:59:21.643440+0000","last_fullsized":"2024-09-11T23:59:21.643440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:59:21.680410+0000","last_peered":"2024-09-11T23:59:21.680410+0000","last_clean":"2024-09-11T23:59:21.680410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:59:21.680410+0000","last_undegraded":"2024-09-11T23:59:21.680410+0000","last_fullsized":"2024-09-11T23:59:21.680410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387093+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:59:21.387093+0000","last_peered":"2024-09-11T23:59:21.387093+0000","last_clean":"2024-09-11T23:59:21.387093+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:59:21.387093+0000","last_undegraded":"2024-09-11T23:59:21.387093+0000","last_fullsized":"2024-09-11T23:59:21.387093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387125+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:59:21.387125+0000","last_peered":"2024-09-11T23:59:21.387125+0000","last_clean":"2024-09-11T23:59:21.387125+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:59:21.387125+0000","last_undegraded":"2024-09-11T23:59:21.387125+0000","last_fullsized":"2024-09-11T23:59:21.387125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700936+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:59:21.700936+0000","last_peered":"2024-09-11T23:59:21.700936+0000","last_clean":"2024-09-11T23:59:21.700936+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:59:21.700936+0000","last_undegraded":"2024-09-11T23:59:21.700936+0000","last_fullsized":"2024-09-11T23:59:21.700936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'9","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.678140+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:59:21.678140+0000","last_peered":"2024-09-11T23:59:21.678140+0000","last_clean":"2024-09-11T23:59:21.678140+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:59:21.678140+0000","last_undegraded":"2024-09-11T23:59:21.678140+0000","last_fullsized":"2024-09-11T23:59:21.678140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472907+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:59:21.472907+0000","last_peered":"2024-09-11T23:59:21.472907+0000","last_clean":"2024-09-11T23:59:21.472907+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:59:21.472907+0000","last_undegraded":"2024-09-11T23:59:21.472907+0000","last_fullsized":"2024-09-11T23:59:21.472907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475951+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:59:21.475951+0000","last_peered":"2024-09-11T23:59:21.475951+0000","last_clean":"2024-09-11T23:59:21.475951+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:59:21.475951+0000","last_undegraded":"2024-09-11T23:59:21.475951+0000","last_fullsized":"2024-09-11T23:59:21.475951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642891+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:59:21.642891+0000","last_peered":"2024-09-11T23:59:21.642891+0000","last_clean":"2024-09-11T23:59:21.642891+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:59:21.642891+0000","last_undegraded":"2024-09-11T23:59:21.642891+0000","last_fullsized":"2024-09-11T23:59:21.642891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466333+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:59:21.466333+0000","last_peered":"2024-09-11T23:59:21.466333+0000","last_clean":"2024-09-11T23:59:21.466333+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:59:21.466333+0000","last_undegraded":"2024-09-11T23:59:21.466333+0000","last_fullsized":"2024-09-11T23:59:21.466333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472936+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:59:21.472936+0000","last_peered":"2024-09-11T23:59:21.472936+0000","last_clean":"2024-09-11T23:59:21.472936+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:59:21.472936+0000","last_undegraded":"2024-09-11T23:59:21.472936+0000","last_fullsized":"2024-09-11T23:59:21.472936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385069+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:59:21.385069+0000","last_peered":"2024-09-11T23:59:21.385069+0000","last_clean":"2024-09-11T23:59:21.385069+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:59:21.385069+0000","last_undegraded":"2024-09-11T23:59:21.385069+0000","last_fullsized":"2024-09-11T23:59:21.385069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.641589+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:59:21.641589+0000","last_peered":"2024-09-11T23:59:21.641589+0000","last_clean":"2024-09-11T23:59:21.641589+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:59:21.641589+0000","last_undegraded":"2024-09-11T23:59:21.641589+0000","last_fullsized":"2024-09-11T23:59:21.641589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387218+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:59:21.387218+0000","last_peered":"2024-09-11T23:59:21.387218+0000","last_clean":"2024-09-11T23:59:21.387218+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:59:21.387218+0000","last_undegraded":"2024-09-11T23:59:21.387218+0000","last_fullsized":"2024-09-11T23:59:21.387218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644343+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:59:21.644343+0000","last_peered":"2024-09-11T23:59:21.644343+0000","last_clean":"2024-09-11T23:59:21.644343+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:59:21.644343+0000","last_undegraded":"2024-09-11T23:59:21.644343+0000","last_fullsized":"2024-09-11T23:59:21.644343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681237+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:59:21.681237+0000","last_peered":"2024-09-11T23:59:21.681237+0000","last_clean":"2024-09-11T23:59:21.681237+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:59:21.681237+0000","last_undegraded":"2024-09-11T23:59:21.681237+0000","last_fullsized":"2024-09-11T23:59:21.681237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473215+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:59:21.473215+0000","last_peered":"2024-09-11T23:59:21.473215+0000","last_clean":"2024-09-11T23:59:21.473215+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:59:21.473215+0000","last_undegraded":"2024-09-11T23:59:21.473215+0000","last_fullsized":"2024-09-11T23:59:21.473215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386888+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:59:21.386888+0000","last_peered":"2024-09-11T23:59:21.386888+0000","last_clean":"2024-09-11T23:59:21.386888+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:59:21.386888+0000","last_undegraded":"2024-09-11T23:59:21.386888+0000","last_fullsized":"2024-09-11T23:59:21.386888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":272,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.684619+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:59:21.684619+0000","last_peered":"2024-09-11T23:59:21.684619+0000","last_clean":"2024-09-11T23:59:21.684619+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:59:21.684619+0000","last_undegraded":"2024-09-11T23:59:21.684619+0000","last_fullsized":"2024-09-11T23:59:21.684619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":165,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701163+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:59:21.701163+0000","last_peered":"2024-09-11T23:59:21.701163+0000","last_clean":"2024-09-11T23:59:21.701163+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:59:21.701163+0000","last_undegraded":"2024-09-11T23:59:21.701163+0000","last_fullsized":"2024-09-11T23:59:21.701163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387205+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:59:21.387205+0000","last_peered":"2024-09-11T23:59:21.387205+0000","last_clean":"2024-09-11T23:59:21.387205+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:59:21.387205+0000","last_undegraded":"2024-09-11T23:59:21.387205+0000","last_fullsized":"2024-09-11T23:59:21.387205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643090+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:59:21.643090+0000","last_peered":"2024-09-11T23:59:21.643090+0000","last_clean":"2024-09-11T23:59:21.643090+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:59:21.643090+0000","last_undegraded":"2024-09-11T23:59:21.643090+0000","last_fullsized":"2024-09-11T23:59:21.643090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472835+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:59:21.472835+0000","last_peered":"2024-09-11T23:59:21.472835+0000","last_clean":"2024-09-11T23:59:21.472835+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:59:21.472835+0000","last_undegraded":"2024-09-11T23:59:21.472835+0000","last_fullsized":"2024-09-11T23:59:21.472835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644370+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:59:21.644370+0000","last_peered":"2024-09-11T23:59:21.644370+0000","last_clean":"2024-09-11T23:59:21.644370+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:59:21.644370+0000","last_undegraded":"2024-09-11T23:59:21.644370+0000","last_fullsized":"2024-09-11T23:59:21.644370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645135+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:59:21.645135+0000","last_peered":"2024-09-11T23:59:21.645135+0000","last_clean":"2024-09-11T23:59:21.645135+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:59:21.645135+0000","last_undegraded":"2024-09-11T23:59:21.645135+0000","last_fullsized":"2024-09-11T23:59:21.645135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644127+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:59:21.644127+0000","last_peered":"2024-09-11T23:59:21.644127+0000","last_clean":"2024-09-11T23:59:21.644127+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:59:21.644127+0000","last_undegraded":"2024-09-11T23:59:21.644127+0000","last_fullsized":"2024-09-11T23:59:21.644127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472738+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:59:21.472738+0000","last_peered":"2024-09-11T23:59:21.472738+0000","last_clean":"2024-09-11T23:59:21.472738+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:59:21.472738+0000","last_undegraded":"2024-09-11T23:59:21.472738+0000","last_fullsized":"2024-09-11T23:59:21.472738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701229+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:59:21.701229+0000","last_peered":"2024-09-11T23:59:21.701229+0000","last_clean":"2024-09-11T23:59:21.701229+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:59:21.701229+0000","last_undegraded":"2024-09-11T23:59:21.701229+0000","last_fullsized":"2024-09-11T23:59:21.701229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466415+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:59:21.466415+0000","last_peered":"2024-09-11T23:59:21.466415+0000","last_clean":"2024-09-11T23:59:21.466415+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:59:21.466415+0000","last_undegraded":"2024-09-11T23:59:21.466415+0000","last_fullsized":"2024-09-11T23:59:21.466415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643857+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:59:21.643857+0000","last_peered":"2024-09-11T23:59:21.643857+0000","last_clean":"2024-09-11T23:59:21.643857+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:59:21.643857+0000","last_undegraded":"2024-09-11T23:59:21.643857+0000","last_fullsized":"2024-09-11T23:59:21.643857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644471+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:59:21.644471+0000","last_peered":"2024-09-11T23:59:21.644471+0000","last_clean":"2024-09-11T23:59:21.644471+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:59:21.644471+0000","last_undegraded":"2024-09-11T23:59:21.644471+0000","last_fullsized":"2024-09-11T23:59:21.644471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.600003+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:59:21.600003+0000","last_peered":"2024-09-11T23:59:21.600003+0000","last_clean":"2024-09-11T23:59:21.600003+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:59:21.600003+0000","last_undegraded":"2024-09-11T23:59:21.600003+0000","last_fullsized":"2024-09-11T23:59:21.600003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644309+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:59:21.644309+0000","last_peered":"2024-09-11T23:59:21.644309+0000","last_clean":"2024-09-11T23:59:21.644309+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:59:21.644309+0000","last_undegraded":"2024-09-11T23:59:21.644309+0000","last_fullsized":"2024-09-11T23:59:21.644309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.641944+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:59:21.641944+0000","last_peered":"2024-09-11T23:59:21.641944+0000","last_clean":"2024-09-11T23:59:21.641944+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:59:21.641944+0000","last_undegraded":"2024-09-11T23:59:21.641944+0000","last_fullsized":"2024-09-11T23:59:21.641944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644569+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:59:21.644569+0000","last_peered":"2024-09-11T23:59:21.644569+0000","last_clean":"2024-09-11T23:59:21.644569+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:59:21.644569+0000","last_undegraded":"2024-09-11T23:59:21.644569+0000","last_fullsized":"2024-09-11T23:59:21.644569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644261+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:59:21.644261+0000","last_peered":"2024-09-11T23:59:21.644261+0000","last_clean":"2024-09-11T23:59:21.644261+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:59:21.644261+0000","last_undegraded":"2024-09-11T23:59:21.644261+0000","last_fullsized":"2024-09-11T23:59:21.644261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645112+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:59:21.645112+0000","last_peered":"2024-09-11T23:59:21.645112+0000","last_clean":"2024-09-11T23:59:21.645112+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:59:21.645112+0000","last_undegraded":"2024-09-11T23:59:21.645112+0000","last_fullsized":"2024-09-11T23:59:21.645112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466865+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:59:21.466865+0000","last_peered":"2024-09-11T23:59:21.466865+0000","last_clean":"2024-09-11T23:59:21.466865+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:59:21.466865+0000","last_undegraded":"2024-09-11T23:59:21.466865+0000","last_fullsized":"2024-09-11T23:59:21.466865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466169+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:59:21.466169+0000","last_peered":"2024-09-11T23:59:21.466169+0000","last_clean":"2024-09-11T23:59:21.466169+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:59:21.466169+0000","last_undegraded":"2024-09-11T23:59:21.466169+0000","last_fullsized":"2024-09-11T23:59:21.466169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642758+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:59:21.642758+0000","last_peered":"2024-09-11T23:59:21.642758+0000","last_clean":"2024-09-11T23:59:21.642758+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:59:21.642758+0000","last_undegraded":"2024-09-11T23:59:21.642758+0000","last_fullsized":"2024-09-11T23:59:21.642758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642998+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:59:21.642998+0000","last_peered":"2024-09-11T23:59:21.642998+0000","last_clean":"2024-09-11T23:59:21.642998+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:59:21.642998+0000","last_undegraded":"2024-09-11T23:59:21.642998+0000","last_fullsized":"2024-09-11T23:59:21.642998+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473034+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:59:21.473034+0000","last_peered":"2024-09-11T23:59:21.473034+0000","last_clean":"2024-09-11T23:59:21.473034+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:59:21.473034+0000","last_undegraded":"2024-09-11T23:59:21.473034+0000","last_fullsized":"2024-09-11T23:59:21.473034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'8","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644465+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:59:21.644465+0000","last_peered":"2024-09-11T23:59:21.644465+0000","last_clean":"2024-09-11T23:59:21.644465+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:59:21.644465+0000","last_undegraded":"2024-09-11T23:59:21.644465+0000","last_fullsized":"2024-09-11T23:59:21.644465+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475979+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:59:21.475979+0000","last_peered":"2024-09-11T23:59:21.475979+0000","last_clean":"2024-09-11T23:59:21.475979+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:59:21.475979+0000","last_undegraded":"2024-09-11T23:59:21.475979+0000","last_fullsized":"2024-09-11T23:59:21.475979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385258+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:59:21.385258+0000","last_peered":"2024-09-11T23:59:21.385258+0000","last_clean":"2024-09-11T23:59:21.385258+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:59:21.385258+0000","last_undegraded":"2024-09-11T23:59:21.385258+0000","last_fullsized":"2024-09-11T23:59:21.385258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476051+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:59:21.476051+0000","last_peered":"2024-09-11T23:59:21.476051+0000","last_clean":"2024-09-11T23:59:21.476051+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:59:21.476051+0000","last_undegraded":"2024-09-11T23:59:21.476051+0000","last_fullsized":"2024-09-11T23:59:21.476051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701325+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:59:21.701325+0000","last_peered":"2024-09-11T23:59:21.701325+0000","last_clean":"2024-09-11T23:59:21.701325+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:59:21.701325+0000","last_undegraded":"2024-09-11T23:59:21.701325+0000","last_fullsized":"2024-09-11T23:59:21.701325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643556+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:59:21.643556+0000","last_peered":"2024-09-11T23:59:21.643556+0000","last_clean":"2024-09-11T23:59:21.643556+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:59:21.643556+0000","last_undegraded":"2024-09-11T23:59:21.643556+0000","last_fullsized":"2024-09-11T23:59:21.643556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'50","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.603339+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:59:21.603339+0000","last_peered":"2024-09-11T23:59:21.603339+0000","last_clean":"2024-09-11T23:59:21.603339+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:59:21.603339+0000","last_undegraded":"2024-09-11T23:59:21.603339+0000","last_fullsized":"2024-09-11T23:59:21.603339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466838+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:59:21.466838+0000","last_peered":"2024-09-11T23:59:21.466838+0000","last_clean":"2024-09-11T23:59:21.466838+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:59:21.466838+0000","last_undegraded":"2024-09-11T23:59:21.466838+0000","last_fullsized":"2024-09-11T23:59:21.466838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645248+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:59:21.645248+0000","last_peered":"2024-09-11T23:59:21.645248+0000","last_clean":"2024-09-11T23:59:21.645248+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:59:21.645248+0000","last_undegraded":"2024-09-11T23:59:21.645248+0000","last_fullsized":"2024-09-11T23:59:21.645248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680966+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:59:21.680966+0000","last_peered":"2024-09-11T23:59:21.680966+0000","last_clean":"2024-09-11T23:59:21.680966+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:59:21.680966+0000","last_undegraded":"2024-09-11T23:59:21.680966+0000","last_fullsized":"2024-09-11T23:59:21.680966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386783+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:59:21.386783+0000","last_peered":"2024-09-11T23:59:21.386783+0000","last_clean":"2024-09-11T23:59:21.386783+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:59:21.386783+0000","last_undegraded":"2024-09-11T23:59:21.386783+0000","last_fullsized":"2024-09-11T23:59:21.386783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466548+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:59:21.466548+0000","last_peered":"2024-09-11T23:59:21.466548+0000","last_clean":"2024-09-11T23:59:21.466548+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:59:21.466548+0000","last_undegraded":"2024-09-11T23:59:21.466548+0000","last_fullsized":"2024-09-11T23:59:21.466548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387161+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:59:21.387161+0000","last_peered":"2024-09-11T23:59:21.387161+0000","last_clean":"2024-09-11T23:59:21.387161+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:59:21.387161+0000","last_undegraded":"2024-09-11T23:59:21.387161+0000","last_fullsized":"2024-09-11T23:59:21.387161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466575+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:59:21.466575+0000","last_peered":"2024-09-11T23:59:21.466575+0000","last_clean":"2024-09-11T23:59:21.466575+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:59:21.466575+0000","last_undegraded":"2024-09-11T23:59:21.466575+0000","last_fullsized":"2024-09-11T23:59:21.466575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701133+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:59:21.701133+0000","last_peered":"2024-09-11T23:59:21.701133+0000","last_clean":"2024-09-11T23:59:21.701133+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:59:21.701133+0000","last_undegraded":"2024-09-11T23:59:21.701133+0000","last_fullsized":"2024-09-11T23:59:21.701133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644300+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:59:21.644300+0000","last_peered":"2024-09-11T23:59:21.644300+0000","last_clean":"2024-09-11T23:59:21.644300+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:59:21.644300+0000","last_undegraded":"2024-09-11T23:59:21.644300+0000","last_fullsized":"2024-09-11T23:59:21.644300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473153+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:59:21.473153+0000","last_peered":"2024-09-11T23:59:21.473153+0000","last_clean":"2024-09-11T23:59:21.473153+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:59:21.473153+0000","last_undegraded":"2024-09-11T23:59:21.473153+0000","last_fullsized":"2024-09-11T23:59:21.473153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701254+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:59:21.701254+0000","last_peered":"2024-09-11T23:59:21.701254+0000","last_clean":"2024-09-11T23:59:21.701254+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:59:21.701254+0000","last_undegraded":"2024-09-11T23:59:21.701254+0000","last_fullsized":"2024-09-11T23:59:21.701254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386855+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:59:21.386855+0000","last_peered":"2024-09-11T23:59:21.386855+0000","last_clean":"2024-09-11T23:59:21.386855+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:59:21.386855+0000","last_undegraded":"2024-09-11T23:59:21.386855+0000","last_fullsized":"2024-09-11T23:59:21.386855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701190+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:59:21.701190+0000","last_peered":"2024-09-11T23:59:21.701190+0000","last_clean":"2024-09-11T23:59:21.701190+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:59:21.701190+0000","last_undegraded":"2024-09-11T23:59:21.701190+0000","last_fullsized":"2024-09-11T23:59:21.701190+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681315+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:59:21.681315+0000","last_peered":"2024-09-11T23:59:21.681315+0000","last_clean":"2024-09-11T23:59:21.681315+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:59:21.681315+0000","last_undegraded":"2024-09-11T23:59:21.681315+0000","last_fullsized":"2024-09-11T23:59:21.681315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466943+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:59:21.466943+0000","last_peered":"2024-09-11T23:59:21.466943+0000","last_clean":"2024-09-11T23:59:21.466943+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:59:21.466943+0000","last_undegraded":"2024-09-11T23:59:21.466943+0000","last_fullsized":"2024-09-11T23:59:21.466943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466791+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:59:21.466791+0000","last_peered":"2024-09-11T23:59:21.466791+0000","last_clean":"2024-09-11T23:59:21.466791+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:59:21.466791+0000","last_undegraded":"2024-09-11T23:59:21.466791+0000","last_fullsized":"2024-09-11T23:59:21.466791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385382+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:59:21.385382+0000","last_peered":"2024-09-11T23:59:21.385382+0000","last_clean":"2024-09-11T23:59:21.385382+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:59:21.385382+0000","last_undegraded":"2024-09-11T23:59:21.385382+0000","last_fullsized":"2024-09-11T23:59:21.385382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600807,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1149,"num_read_kb":685,"num_write":372,"num_write_kb":1463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1802421,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":836685,"data_compressed":22043,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":1232719,"data_compressed":45324,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":836222,"data_compressed":22043,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201329,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":434486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1038207,"data_compressed":39168,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593789,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":434667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822721,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1168109,"data_compressed":45324,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445060,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":967364,"data_compressed":28199,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":510107,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":987136,"data_stored":510958,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":444455,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135740,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":200350,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":394801,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:59:24.414 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:59:24.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 -- 172.21.15.60:0/3502992309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 msgr2=0x7f2710109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 --2- 172.21.15.60:0/3502992309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 0x7f2710109c60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2708009ca0 tx=0x7f270802a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 -- 172.21.15.60:0/3502992309 shutdown_connections 2024-09-11T23:59:24.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 --2- 172.21.15.60:0/3502992309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 0x7f2710109c60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 --2- 172.21.15.60:0/3502992309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710104ec0 0x7f27101072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 --2- 172.21.15.60:0/3502992309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710102590 0x7f2710104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 -- 172.21.15.60:0/3502992309 >> 172.21.15.60:0/3502992309 conn(0x7f27100fc170 msgr2=0x7f27100fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:24.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 -- 172.21.15.60:0/3502992309 shutdown_connections 2024-09-11T23:59:24.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.560+0000 7f27183b7640 1 -- 172.21.15.60:0/3502992309 wait complete. 2024-09-11T23:59:24.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.561+0000 7f27183b7640 1 Processor -- start 2024-09-11T23:59:24.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.561+0000 7f27183b7640 1 -- start start 2024-09-11T23:59:24.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.561+0000 7f27183b7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710102590 0x7f2710197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.561+0000 7f27183b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710104ec0 0x7f2710198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.561+0000 7f27183b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 0x7f271019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.561+0000 7f27183b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f271010d900 con 0x7f27101077f0 2024-09-11T23:59:24.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.561+0000 7f27183b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f271010d780 con 0x7f2710104ec0 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.561+0000 7f27183b7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f271010da80 con 0x7f2710102590 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 0x7f271019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 0x7f271019f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53562/0 (socket says 172.21.15.60:53562) 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716153640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710102590 0x7f2710197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 -- 172.21.15.60:0/2202111965 learned_addr learned my addr 172.21.15.60:0/2202111965 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2715952640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710104ec0 0x7f2710198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 -- 172.21.15.60:0/2202111965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710102590 msgr2=0x7f2710197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710102590 0x7f2710197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 -- 172.21.15.60:0/2202111965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710104ec0 msgr2=0x7f2710198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710104ec0 0x7f2710198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 -- 172.21.15.60:0/2202111965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271019fb70 con 0x7f27101077f0 2024-09-11T23:59:24.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2715952640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710104ec0 0x7f2710198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:24.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f2716954640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 0x7f271019f500 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2708031a40 tx=0x7f2708031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:24.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.562+0000 7f27077fe640 1 -- 172.21.15.60:0/2202111965 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708003c30 con 0x7f27101077f0 2024-09-11T23:59:24.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.563+0000 7f27077fe640 1 -- 172.21.15.60:0/2202111965 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2708003dd0 con 0x7f27101077f0 2024-09-11T23:59:24.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.563+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271019fe00 con 0x7f27101077f0 2024-09-11T23:59:24.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.563+0000 7f27077fe640 1 -- 172.21.15.60:0/2202111965 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270802fe80 con 0x7f27101077f0 2024-09-11T23:59:24.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.563+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27101a02c0 con 0x7f27101077f0 2024-09-11T23:59:24.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.564+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27100fdc60 con 0x7f27101077f0 2024-09-11T23:59:24.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.565+0000 7f27077fe640 1 -- 172.21.15.60:0/2202111965 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7f2708004b40 con 0x7f27101077f0 2024-09-11T23:59:24.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.566+0000 7f27077fe640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f26fc0a2d00 0x7f26fc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.566+0000 7f2716153640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f26fc0a2d00 0x7f26fc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.566+0000 7f27077fe640 1 -- 172.21.15.60:0/2202111965 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f27080f0560 con 0x7f27101077f0 2024-09-11T23:59:24.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.566+0000 7f2716153640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f26fc0a2d00 0x7f26fc0a51c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f270c005d00 tx=0x7f270c00b410 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:24.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.571+0000 7f27077fe640 1 -- 172.21.15.60:0/2202111965 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f27080bd2e0 con 0x7f27101077f0 2024-09-11T23:59:24.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: [11/Sep/2024:23:59:23] ENGINE Serving on https://172.21.15.60:7150 2024-09-11T23:59:24.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: [11/Sep/2024:23:59:23] ENGINE Error in HTTPServer.serve 2024-09-11T23:59:24.730 INFO:journalctl@ceph.mon.b.smithi105.stdout: Traceback (most recent call last): 2024-09-11T23:59:24.730 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:59:24.730 INFO:journalctl@ceph.mon.b.smithi105.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:59:24.730 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:59:24.730 INFO:journalctl@ceph.mon.b.smithi105.stdout: self._run(expiration_interval) 2024-09-11T23:59:24.730 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: s = self.context.wrap_socket( 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: return self.sslsocket_class._create( 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:59:24.732 INFO:journalctl@ceph.mon.b.smithi105.stdout: self.do_handshake() 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout: self._sslobj.do_handshake() 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: [11/Sep/2024:23:59:23] ENGINE Serving on http://172.21.15.60:8765 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: [11/Sep/2024:23:59:23] ENGINE Bus STARTED 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.734 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-11T23:59:24.735 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.735 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-11T23:59:24.735 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-11T23:59:24.735 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:24 smithi105 ceph-mon[34805]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T23:59:24.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.771+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2710062630 con 0x7f26fc0a2d00 2024-09-11T23:59:24.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.778+0000 7f27077fe640 1 -- 172.21.15.60:0/2202111965 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258025 (secure 0 0 0) 0x7f2710062630 con 0x7f26fc0a2d00 2024-09-11T23:59:24.780 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:24.782 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:59:24.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f26fc0a2d00 msgr2=0x7f26fc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f26fc0a2d00 0x7f26fc0a51c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f270c005d00 tx=0x7f270c00b410 comp rx=0 tx=0).stop 2024-09-11T23:59:24.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 msgr2=0x7f271019f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 0x7f271019f500 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2708031a40 tx=0x7f2708031ee0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 shutdown_connections 2024-09-11T23:59:24.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f26fc0a2d00 0x7f26fc0a51c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27101077f0 0x7f271019f500 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2710104ec0 0x7f2710198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 --2- 172.21.15.60:0/2202111965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2710102590 0x7f2710197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 >> 172.21.15.60:0/2202111965 conn(0x7f27100fc170 msgr2=0x7f2710102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 shutdown_connections 2024-09-11T23:59:24.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.781+0000 7f27183b7640 1 -- 172.21.15.60:0/2202111965 wait complete. 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: [11/Sep/2024:23:59:23] ENGINE Serving on https://172.21.15.60:7150 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: [11/Sep/2024:23:59:23] ENGINE Error in HTTPServer.serve 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: Traceback (most recent call last): 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: self._run(expiration_interval) 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:59:24.785 INFO:journalctl@ceph.mon.c.smithi192.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: s = self.context.wrap_socket( 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: return self.sslsocket_class._create( 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: self.do_handshake() 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: self._sslobj.do_handshake() 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:24.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-11T23:59:24.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: [11/Sep/2024:23:59:23] ENGINE Serving on http://172.21.15.60:8765 2024-09-11T23:59:24.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: [11/Sep/2024:23:59:23] ENGINE Bus STARTED 2024-09-11T23:59:24.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.787 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.788 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.789 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-11T23:59:24.789 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.789 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-11T23:59:24.789 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-11T23:59:24.789 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:24 smithi192 ceph-mon[35487]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T23:59:24.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: [11/Sep/2024:23:59:23] ENGINE Serving on https://172.21.15.60:7150 2024-09-11T23:59:24.790 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: [11/Sep/2024:23:59:23] ENGINE Error in HTTPServer.serve 2024-09-11T23:59:24.790 INFO:journalctl@ceph.mon.a.smithi060.stdout: Traceback (most recent call last): 2024-09-11T23:59:24.790 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T23:59:24.790 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._connections.run(self.expiration_interval) 2024-09-11T23:59:24.790 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T23:59:24.790 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._run(expiration_interval) 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: s = self.context.wrap_socket( 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: return self.sslsocket_class._create( 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T23:59:24.791 INFO:journalctl@ceph.mon.a.smithi060.stdout: self.do_handshake() 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout: self._sslobj.do_handshake() 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: [11/Sep/2024:23:59:23] ENGINE Serving on http://172.21.15.60:8765 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: [11/Sep/2024:23:59:23] ENGINE Bus STARTED 2024-09-11T23:59:24.792 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.793 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-11T23:59:24.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:24.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-11T23:59:24.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-11T23:59:24.794 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:24 smithi060 ceph-mon[30953]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T23:59:24.795 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-11T23:59:23.398697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191409,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1285,"num_read_kb":804,"num_write":555,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":939,"ondisk_log_size":939,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368960,"kb_used_data":11364,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572864,"statfs":{"total":1151940427776,"available":1151562612736,"internally_reserved":0,"allocated":11636736,"data_stored":8859039,"data_compressed":213689,"data_compressed_allocated":274432,"data_compressed_original":3399680,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.941944"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466469+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:59:21.466469+0000","last_peered":"2024-09-11T23:59:21.466469+0000","last_clean":"2024-09-11T23:59:21.466469+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:59:21.466469+0000","last_undegraded":"2024-09-11T23:59:21.466469+0000","last_fullsized":"2024-09-11T23:59:21.466469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680932+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:59:21.680932+0000","last_peered":"2024-09-11T23:59:21.680932+0000","last_clean":"2024-09-11T23:59:21.680932+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:59:21.680932+0000","last_undegraded":"2024-09-11T23:59:21.680932+0000","last_fullsized":"2024-09-11T23:59:21.680932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680758+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:59:21.680758+0000","last_peered":"2024-09-11T23:59:21.680758+0000","last_clean":"2024-09-11T23:59:21.680758+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:59:21.680758+0000","last_undegraded":"2024-09-11T23:59:21.680758+0000","last_fullsized":"2024-09-11T23:59:21.680758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645268+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:59:21.645268+0000","last_peered":"2024-09-11T23:59:21.645268+0000","last_clean":"2024-09-11T23:59:21.645268+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:59:21.645268+0000","last_undegraded":"2024-09-11T23:59:21.645268+0000","last_fullsized":"2024-09-11T23:59:21.645268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700973+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:59:21.700973+0000","last_peered":"2024-09-11T23:59:21.700973+0000","last_clean":"2024-09-11T23:59:21.700973+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:59:21.700973+0000","last_undegraded":"2024-09-11T23:59:21.700973+0000","last_fullsized":"2024-09-11T23:59:21.700973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475885+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:59:21.475885+0000","last_peered":"2024-09-11T23:59:21.475885+0000","last_clean":"2024-09-11T23:59:21.475885+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:59:21.475885+0000","last_undegraded":"2024-09-11T23:59:21.475885+0000","last_fullsized":"2024-09-11T23:59:21.475885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644131+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:59:21.644131+0000","last_peered":"2024-09-11T23:59:21.644131+0000","last_clean":"2024-09-11T23:59:21.644131+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:59:21.644131+0000","last_undegraded":"2024-09-11T23:59:21.644131+0000","last_fullsized":"2024-09-11T23:59:21.644131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466288+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:59:21.466288+0000","last_peered":"2024-09-11T23:59:21.466288+0000","last_clean":"2024-09-11T23:59:21.466288+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:59:21.466288+0000","last_undegraded":"2024-09-11T23:59:21.466288+0000","last_fullsized":"2024-09-11T23:59:21.466288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387087+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:59:21.387087+0000","last_peered":"2024-09-11T23:59:21.387087+0000","last_clean":"2024-09-11T23:59:21.387087+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:59:21.387087+0000","last_undegraded":"2024-09-11T23:59:21.387087+0000","last_fullsized":"2024-09-11T23:59:21.387087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476277+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:59:21.476277+0000","last_peered":"2024-09-11T23:59:21.476277+0000","last_clean":"2024-09-11T23:59:21.476277+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:59:21.476277+0000","last_undegraded":"2024-09-11T23:59:21.476277+0000","last_fullsized":"2024-09-11T23:59:21.476277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644423+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:59:21.644423+0000","last_peered":"2024-09-11T23:59:21.644423+0000","last_clean":"2024-09-11T23:59:21.644423+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:59:21.644423+0000","last_undegraded":"2024-09-11T23:59:21.644423+0000","last_fullsized":"2024-09-11T23:59:21.644423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385078+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:59:21.385078+0000","last_peered":"2024-09-11T23:59:21.385078+0000","last_clean":"2024-09-11T23:59:21.385078+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:59:21.385078+0000","last_undegraded":"2024-09-11T23:59:21.385078+0000","last_fullsized":"2024-09-11T23:59:21.385078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643697+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:59:21.643697+0000","last_peered":"2024-09-11T23:59:21.643697+0000","last_clean":"2024-09-11T23:59:21.643697+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:59:21.643697+0000","last_undegraded":"2024-09-11T23:59:21.643697+0000","last_fullsized":"2024-09-11T23:59:21.643697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680072+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:59:21.680072+0000","last_peered":"2024-09-11T23:59:21.680072+0000","last_clean":"2024-09-11T23:59:21.680072+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:59:21.680072+0000","last_undegraded":"2024-09-11T23:59:21.680072+0000","last_fullsized":"2024-09-11T23:59:21.680072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.679770+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:59:21.679770+0000","last_peered":"2024-09-11T23:59:21.679770+0000","last_clean":"2024-09-11T23:59:21.679770+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:59:21.679770+0000","last_undegraded":"2024-09-11T23:59:21.679770+0000","last_fullsized":"2024-09-11T23:59:21.679770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386692+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:59:21.386692+0000","last_peered":"2024-09-11T23:59:21.386692+0000","last_clean":"2024-09-11T23:59:21.386692+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:59:21.386692+0000","last_undegraded":"2024-09-11T23:59:21.386692+0000","last_fullsized":"2024-09-11T23:59:21.386692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466577+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:59:21.466577+0000","last_peered":"2024-09-11T23:59:21.466577+0000","last_clean":"2024-09-11T23:59:21.466577+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:59:21.466577+0000","last_undegraded":"2024-09-11T23:59:21.466577+0000","last_fullsized":"2024-09-11T23:59:21.466577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385256+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:59:21.385256+0000","last_peered":"2024-09-11T23:59:21.385256+0000","last_clean":"2024-09-11T23:59:21.385256+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:59:21.385256+0000","last_undegraded":"2024-09-11T23:59:21.385256+0000","last_fullsized":"2024-09-11T23:59:21.385256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387348+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:59:21.387348+0000","last_peered":"2024-09-11T23:59:21.387348+0000","last_clean":"2024-09-11T23:59:21.387348+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:59:21.387348+0000","last_undegraded":"2024-09-11T23:59:21.387348+0000","last_fullsized":"2024-09-11T23:59:21.387348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466261+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:59:21.466261+0000","last_peered":"2024-09-11T23:59:21.466261+0000","last_clean":"2024-09-11T23:59:21.466261+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:59:21.466261+0000","last_undegraded":"2024-09-11T23:59:21.466261+0000","last_fullsized":"2024-09-11T23:59:21.466261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643856+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:59:21.643856+0000","last_peered":"2024-09-11T23:59:21.643856+0000","last_clean":"2024-09-11T23:59:21.643856+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:59:21.643856+0000","last_undegraded":"2024-09-11T23:59:21.643856+0000","last_fullsized":"2024-09-11T23:59:21.643856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386866+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:59:21.386866+0000","last_peered":"2024-09-11T23:59:21.386866+0000","last_clean":"2024-09-11T23:59:21.386866+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:59:21.386866+0000","last_undegraded":"2024-09-11T23:59:21.386866+0000","last_fullsized":"2024-09-11T23:59:21.386866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466381+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:59:21.466381+0000","last_peered":"2024-09-11T23:59:21.466381+0000","last_clean":"2024-09-11T23:59:21.466381+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:59:21.466381+0000","last_undegraded":"2024-09-11T23:59:21.466381+0000","last_fullsized":"2024-09-11T23:59:21.466381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472730+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:59:21.472730+0000","last_peered":"2024-09-11T23:59:21.472730+0000","last_clean":"2024-09-11T23:59:21.472730+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:59:21.472730+0000","last_undegraded":"2024-09-11T23:59:21.472730+0000","last_fullsized":"2024-09-11T23:59:21.472730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466751+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:59:21.466751+0000","last_peered":"2024-09-11T23:59:21.466751+0000","last_clean":"2024-09-11T23:59:21.466751+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:59:21.466751+0000","last_undegraded":"2024-09-11T23:59:21.466751+0000","last_fullsized":"2024-09-11T23:59:21.466751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387391+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:59:21.387391+0000","last_peered":"2024-09-11T23:59:21.387391+0000","last_clean":"2024-09-11T23:59:21.387391+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:59:21.387391+0000","last_undegraded":"2024-09-11T23:59:21.387391+0000","last_fullsized":"2024-09-11T23:59:21.387391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466340+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:59:21.466340+0000","last_peered":"2024-09-11T23:59:21.466340+0000","last_clean":"2024-09-11T23:59:21.466340+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:59:21.466340+0000","last_undegraded":"2024-09-11T23:59:21.466340+0000","last_fullsized":"2024-09-11T23:59:21.466340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643440+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:59:21.643440+0000","last_peered":"2024-09-11T23:59:21.643440+0000","last_clean":"2024-09-11T23:59:21.643440+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:59:21.643440+0000","last_undegraded":"2024-09-11T23:59:21.643440+0000","last_fullsized":"2024-09-11T23:59:21.643440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:59:21.680410+0000","last_peered":"2024-09-11T23:59:21.680410+0000","last_clean":"2024-09-11T23:59:21.680410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:59:21.680410+0000","last_undegraded":"2024-09-11T23:59:21.680410+0000","last_fullsized":"2024-09-11T23:59:21.680410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387093+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:59:21.387093+0000","last_peered":"2024-09-11T23:59:21.387093+0000","last_clean":"2024-09-11T23:59:21.387093+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:59:21.387093+0000","last_undegraded":"2024-09-11T23:59:21.387093+0000","last_fullsized":"2024-09-11T23:59:21.387093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387125+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:59:21.387125+0000","last_peered":"2024-09-11T23:59:21.387125+0000","last_clean":"2024-09-11T23:59:21.387125+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:59:21.387125+0000","last_undegraded":"2024-09-11T23:59:21.387125+0000","last_fullsized":"2024-09-11T23:59:21.387125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700936+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:59:21.700936+0000","last_peered":"2024-09-11T23:59:21.700936+0000","last_clean":"2024-09-11T23:59:21.700936+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:59:21.700936+0000","last_undegraded":"2024-09-11T23:59:21.700936+0000","last_fullsized":"2024-09-11T23:59:21.700936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'9","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.678140+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:59:21.678140+0000","last_peered":"2024-09-11T23:59:21.678140+0000","last_clean":"2024-09-11T23:59:21.678140+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:59:21.678140+0000","last_undegraded":"2024-09-11T23:59:21.678140+0000","last_fullsized":"2024-09-11T23:59:21.678140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472907+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:59:21.472907+0000","last_peered":"2024-09-11T23:59:21.472907+0000","last_clean":"2024-09-11T23:59:21.472907+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:59:21.472907+0000","last_undegraded":"2024-09-11T23:59:21.472907+0000","last_fullsized":"2024-09-11T23:59:21.472907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475951+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:59:21.475951+0000","last_peered":"2024-09-11T23:59:21.475951+0000","last_clean":"2024-09-11T23:59:21.475951+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:59:21.475951+0000","last_undegraded":"2024-09-11T23:59:21.475951+0000","last_fullsized":"2024-09-11T23:59:21.475951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642891+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:59:21.642891+0000","last_peered":"2024-09-11T23:59:21.642891+0000","last_clean":"2024-09-11T23:59:21.642891+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:59:21.642891+0000","last_undegraded":"2024-09-11T23:59:21.642891+0000","last_fullsized":"2024-09-11T23:59:21.642891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466333+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:59:21.466333+0000","last_peered":"2024-09-11T23:59:21.466333+0000","last_clean":"2024-09-11T23:59:21.466333+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:59:21.466333+0000","last_undegraded":"2024-09-11T23:59:21.466333+0000","last_fullsized":"2024-09-11T23:59:21.466333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472936+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:59:21.472936+0000","last_peered":"2024-09-11T23:59:21.472936+0000","last_clean":"2024-09-11T23:59:21.472936+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:59:21.472936+0000","last_undegraded":"2024-09-11T23:59:21.472936+0000","last_fullsized":"2024-09-11T23:59:21.472936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385069+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:59:21.385069+0000","last_peered":"2024-09-11T23:59:21.385069+0000","last_clean":"2024-09-11T23:59:21.385069+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:59:21.385069+0000","last_undegraded":"2024-09-11T23:59:21.385069+0000","last_fullsized":"2024-09-11T23:59:21.385069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.641589+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:59:21.641589+0000","last_peered":"2024-09-11T23:59:21.641589+0000","last_clean":"2024-09-11T23:59:21.641589+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:59:21.641589+0000","last_undegraded":"2024-09-11T23:59:21.641589+0000","last_fullsized":"2024-09-11T23:59:21.641589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387218+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:59:21.387218+0000","last_peered":"2024-09-11T23:59:21.387218+0000","last_clean":"2024-09-11T23:59:21.387218+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:59:21.387218+0000","last_undegraded":"2024-09-11T23:59:21.387218+0000","last_fullsized":"2024-09-11T23:59:21.387218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644343+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:59:21.644343+0000","last_peered":"2024-09-11T23:59:21.644343+0000","last_clean":"2024-09-11T23:59:21.644343+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:59:21.644343+0000","last_undegraded":"2024-09-11T23:59:21.644343+0000","last_fullsized":"2024-09-11T23:59:21.644343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681237+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:59:21.681237+0000","last_peered":"2024-09-11T23:59:21.681237+0000","last_clean":"2024-09-11T23:59:21.681237+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:59:21.681237+0000","last_undegraded":"2024-09-11T23:59:21.681237+0000","last_fullsized":"2024-09-11T23:59:21.681237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473215+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:59:21.473215+0000","last_peered":"2024-09-11T23:59:21.473215+0000","last_clean":"2024-09-11T23:59:21.473215+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:59:21.473215+0000","last_undegraded":"2024-09-11T23:59:21.473215+0000","last_fullsized":"2024-09-11T23:59:21.473215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386888+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:59:21.386888+0000","last_peered":"2024-09-11T23:59:21.386888+0000","last_clean":"2024-09-11T23:59:21.386888+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:59:21.386888+0000","last_undegraded":"2024-09-11T23:59:21.386888+0000","last_fullsized":"2024-09-11T23:59:21.386888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":272,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.684619+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:59:21.684619+0000","last_peered":"2024-09-11T23:59:21.684619+0000","last_clean":"2024-09-11T23:59:21.684619+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:59:21.684619+0000","last_undegraded":"2024-09-11T23:59:21.684619+0000","last_fullsized":"2024-09-11T23:59:21.684619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":165,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701163+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:59:21.701163+0000","last_peered":"2024-09-11T23:59:21.701163+0000","last_clean":"2024-09-11T23:59:21.701163+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:59:21.701163+0000","last_undegraded":"2024-09-11T23:59:21.701163+0000","last_fullsized":"2024-09-11T23:59:21.701163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387205+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:59:21.387205+0000","last_peered":"2024-09-11T23:59:21.387205+0000","last_clean":"2024-09-11T23:59:21.387205+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:59:21.387205+0000","last_undegraded":"2024-09-11T23:59:21.387205+0000","last_fullsized":"2024-09-11T23:59:21.387205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643090+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:59:21.643090+0000","last_peered":"2024-09-11T23:59:21.643090+0000","last_clean":"2024-09-11T23:59:21.643090+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:59:21.643090+0000","last_undegraded":"2024-09-11T23:59:21.643090+0000","last_fullsized":"2024-09-11T23:59:21.643090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472835+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:59:21.472835+0000","last_peered":"2024-09-11T23:59:21.472835+0000","last_clean":"2024-09-11T23:59:21.472835+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:59:21.472835+0000","last_undegraded":"2024-09-11T23:59:21.472835+0000","last_fullsized":"2024-09-11T23:59:21.472835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644370+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:59:21.644370+0000","last_peered":"2024-09-11T23:59:21.644370+0000","last_clean":"2024-09-11T23:59:21.644370+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:59:21.644370+0000","last_undegraded":"2024-09-11T23:59:21.644370+0000","last_fullsized":"2024-09-11T23:59:21.644370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645135+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:59:21.645135+0000","last_peered":"2024-09-11T23:59:21.645135+0000","last_clean":"2024-09-11T23:59:21.645135+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:59:21.645135+0000","last_undegraded":"2024-09-11T23:59:21.645135+0000","last_fullsized":"2024-09-11T23:59:21.645135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644127+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:59:21.644127+0000","last_peered":"2024-09-11T23:59:21.644127+0000","last_clean":"2024-09-11T23:59:21.644127+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:59:21.644127+0000","last_undegraded":"2024-09-11T23:59:21.644127+0000","last_fullsized":"2024-09-11T23:59:21.644127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472738+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:59:21.472738+0000","last_peered":"2024-09-11T23:59:21.472738+0000","last_clean":"2024-09-11T23:59:21.472738+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:59:21.472738+0000","last_undegraded":"2024-09-11T23:59:21.472738+0000","last_fullsized":"2024-09-11T23:59:21.472738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701229+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:59:21.701229+0000","last_peered":"2024-09-11T23:59:21.701229+0000","last_clean":"2024-09-11T23:59:21.701229+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:59:21.701229+0000","last_undegraded":"2024-09-11T23:59:21.701229+0000","last_fullsized":"2024-09-11T23:59:21.701229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466415+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:59:21.466415+0000","last_peered":"2024-09-11T23:59:21.466415+0000","last_clean":"2024-09-11T23:59:21.466415+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:59:21.466415+0000","last_undegraded":"2024-09-11T23:59:21.466415+0000","last_fullsized":"2024-09-11T23:59:21.466415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643857+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:59:21.643857+0000","last_peered":"2024-09-11T23:59:21.643857+0000","last_clean":"2024-09-11T23:59:21.643857+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:59:21.643857+0000","last_undegraded":"2024-09-11T23:59:21.643857+0000","last_fullsized":"2024-09-11T23:59:21.643857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644471+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:59:21.644471+0000","last_peered":"2024-09-11T23:59:21.644471+0000","last_clean":"2024-09-11T23:59:21.644471+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:59:21.644471+0000","last_undegraded":"2024-09-11T23:59:21.644471+0000","last_fullsized":"2024-09-11T23:59:21.644471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.600003+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:59:21.600003+0000","last_peered":"2024-09-11T23:59:21.600003+0000","last_clean":"2024-09-11T23:59:21.600003+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:59:21.600003+0000","last_undegraded":"2024-09-11T23:59:21.600003+0000","last_fullsized":"2024-09-11T23:59:21.600003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644309+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:59:21.644309+0000","last_peered":"2024-09-11T23:59:21.644309+0000","last_clean":"2024-09-11T23:59:21.644309+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:59:21.644309+0000","last_undegraded":"2024-09-11T23:59:21.644309+0000","last_fullsized":"2024-09-11T23:59:21.644309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.641944+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:59:21.641944+0000","last_peered":"2024-09-11T23:59:21.641944+0000","last_clean":"2024-09-11T23:59:21.641944+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:59:21.641944+0000","last_undegraded":"2024-09-11T23:59:21.641944+0000","last_fullsized":"2024-09-11T23:59:21.641944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644569+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:59:21.644569+0000","last_peered":"2024-09-11T23:59:21.644569+0000","last_clean":"2024-09-11T23:59:21.644569+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:59:21.644569+0000","last_undegraded":"2024-09-11T23:59:21.644569+0000","last_fullsized":"2024-09-11T23:59:21.644569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644261+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:59:21.644261+0000","last_peered":"2024-09-11T23:59:21.644261+0000","last_clean":"2024-09-11T23:59:21.644261+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:59:21.644261+0000","last_undegraded":"2024-09-11T23:59:21.644261+0000","last_fullsized":"2024-09-11T23:59:21.644261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645112+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:59:21.645112+0000","last_peered":"2024-09-11T23:59:21.645112+0000","last_clean":"2024-09-11T23:59:21.645112+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:59:21.645112+0000","last_undegraded":"2024-09-11T23:59:21.645112+0000","last_fullsized":"2024-09-11T23:59:21.645112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466865+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:59:21.466865+0000","last_peered":"2024-09-11T23:59:21.466865+0000","last_clean":"2024-09-11T23:59:21.466865+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:59:21.466865+0000","last_undegraded":"2024-09-11T23:59:21.466865+0000","last_fullsized":"2024-09-11T23:59:21.466865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466169+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:59:21.466169+0000","last_peered":"2024-09-11T23:59:21.466169+0000","last_clean":"2024-09-11T23:59:21.466169+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:59:21.466169+0000","last_undegraded":"2024-09-11T23:59:21.466169+0000","last_fullsized":"2024-09-11T23:59:21.466169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642758+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:59:21.642758+0000","last_peered":"2024-09-11T23:59:21.642758+0000","last_clean":"2024-09-11T23:59:21.642758+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:59:21.642758+0000","last_undegraded":"2024-09-11T23:59:21.642758+0000","last_fullsized":"2024-09-11T23:59:21.642758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642998+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:59:21.642998+0000","last_peered":"2024-09-11T23:59:21.642998+0000","last_clean":"2024-09-11T23:59:21.642998+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:59:21.642998+0000","last_undegraded":"2024-09-11T23:59:21.642998+0000","last_fullsized":"2024-09-11T23:59:21.642998+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473034+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:59:21.473034+0000","last_peered":"2024-09-11T23:59:21.473034+0000","last_clean":"2024-09-11T23:59:21.473034+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:59:21.473034+0000","last_undegraded":"2024-09-11T23:59:21.473034+0000","last_fullsized":"2024-09-11T23:59:21.473034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'8","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644465+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:59:21.644465+0000","last_peered":"2024-09-11T23:59:21.644465+0000","last_clean":"2024-09-11T23:59:21.644465+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:59:21.644465+0000","last_undegraded":"2024-09-11T23:59:21.644465+0000","last_fullsized":"2024-09-11T23:59:21.644465+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475979+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:59:21.475979+0000","last_peered":"2024-09-11T23:59:21.475979+0000","last_clean":"2024-09-11T23:59:21.475979+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:59:21.475979+0000","last_undegraded":"2024-09-11T23:59:21.475979+0000","last_fullsized":"2024-09-11T23:59:21.475979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385258+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:59:21.385258+0000","last_peered":"2024-09-11T23:59:21.385258+0000","last_clean":"2024-09-11T23:59:21.385258+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:59:21.385258+0000","last_undegraded":"2024-09-11T23:59:21.385258+0000","last_fullsized":"2024-09-11T23:59:21.385258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476051+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:59:21.476051+0000","last_peered":"2024-09-11T23:59:21.476051+0000","last_clean":"2024-09-11T23:59:21.476051+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:59:21.476051+0000","last_undegraded":"2024-09-11T23:59:21.476051+0000","last_fullsized":"2024-09-11T23:59:21.476051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701325+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:59:21.701325+0000","last_peered":"2024-09-11T23:59:21.701325+0000","last_clean":"2024-09-11T23:59:21.701325+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:59:21.701325+0000","last_undegraded":"2024-09-11T23:59:21.701325+0000","last_fullsized":"2024-09-11T23:59:21.701325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643556+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:59:21.643556+0000","last_peered":"2024-09-11T23:59:21.643556+0000","last_clean":"2024-09-11T23:59:21.643556+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:59:21.643556+0000","last_undegraded":"2024-09-11T23:59:21.643556+0000","last_fullsized":"2024-09-11T23:59:21.643556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'50","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.603339+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:59:21.603339+0000","last_peered":"2024-09-11T23:59:21.603339+0000","last_clean":"2024-09-11T23:59:21.603339+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:59:21.603339+0000","last_undegraded":"2024-09-11T23:59:21.603339+0000","last_fullsized":"2024-09-11T23:59:21.603339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466838+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:59:21.466838+0000","last_peered":"2024-09-11T23:59:21.466838+0000","last_clean":"2024-09-11T23:59:21.466838+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:59:21.466838+0000","last_undegraded":"2024-09-11T23:59:21.466838+0000","last_fullsized":"2024-09-11T23:59:21.466838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645248+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:59:21.645248+0000","last_peered":"2024-09-11T23:59:21.645248+0000","last_clean":"2024-09-11T23:59:21.645248+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:59:21.645248+0000","last_undegraded":"2024-09-11T23:59:21.645248+0000","last_fullsized":"2024-09-11T23:59:21.645248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680966+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:59:21.680966+0000","last_peered":"2024-09-11T23:59:21.680966+0000","last_clean":"2024-09-11T23:59:21.680966+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:59:21.680966+0000","last_undegraded":"2024-09-11T23:59:21.680966+0000","last_fullsized":"2024-09-11T23:59:21.680966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386783+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:59:21.386783+0000","last_peered":"2024-09-11T23:59:21.386783+0000","last_clean":"2024-09-11T23:59:21.386783+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:59:21.386783+0000","last_undegraded":"2024-09-11T23:59:21.386783+0000","last_fullsized":"2024-09-11T23:59:21.386783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466548+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:59:21.466548+0000","last_peered":"2024-09-11T23:59:21.466548+0000","last_clean":"2024-09-11T23:59:21.466548+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:59:21.466548+0000","last_undegraded":"2024-09-11T23:59:21.466548+0000","last_fullsized":"2024-09-11T23:59:21.466548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387161+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:59:21.387161+0000","last_peered":"2024-09-11T23:59:21.387161+0000","last_clean":"2024-09-11T23:59:21.387161+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:59:21.387161+0000","last_undegraded":"2024-09-11T23:59:21.387161+0000","last_fullsized":"2024-09-11T23:59:21.387161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466575+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:59:21.466575+0000","last_peered":"2024-09-11T23:59:21.466575+0000","last_clean":"2024-09-11T23:59:21.466575+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:59:21.466575+0000","last_undegraded":"2024-09-11T23:59:21.466575+0000","last_fullsized":"2024-09-11T23:59:21.466575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701133+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:59:21.701133+0000","last_peered":"2024-09-11T23:59:21.701133+0000","last_clean":"2024-09-11T23:59:21.701133+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:59:21.701133+0000","last_undegraded":"2024-09-11T23:59:21.701133+0000","last_fullsized":"2024-09-11T23:59:21.701133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644300+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:59:21.644300+0000","last_peered":"2024-09-11T23:59:21.644300+0000","last_clean":"2024-09-11T23:59:21.644300+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:59:21.644300+0000","last_undegraded":"2024-09-11T23:59:21.644300+0000","last_fullsized":"2024-09-11T23:59:21.644300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473153+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:59:21.473153+0000","last_peered":"2024-09-11T23:59:21.473153+0000","last_clean":"2024-09-11T23:59:21.473153+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:59:21.473153+0000","last_undegraded":"2024-09-11T23:59:21.473153+0000","last_fullsized":"2024-09-11T23:59:21.473153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701254+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:59:21.701254+0000","last_peered":"2024-09-11T23:59:21.701254+0000","last_clean":"2024-09-11T23:59:21.701254+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:59:21.701254+0000","last_undegraded":"2024-09-11T23:59:21.701254+0000","last_fullsized":"2024-09-11T23:59:21.701254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386855+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:59:21.386855+0000","last_peered":"2024-09-11T23:59:21.386855+0000","last_clean":"2024-09-11T23:59:21.386855+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:59:21.386855+0000","last_undegraded":"2024-09-11T23:59:21.386855+0000","last_fullsized":"2024-09-11T23:59:21.386855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701190+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:59:21.701190+0000","last_peered":"2024-09-11T23:59:21.701190+0000","last_clean":"2024-09-11T23:59:21.701190+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:59:21.701190+0000","last_undegraded":"2024-09-11T23:59:21.701190+0000","last_fullsized":"2024-09-11T23:59:21.701190+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681315+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:59:21.681315+0000","last_peered":"2024-09-11T23:59:21.681315+0000","last_clean":"2024-09-11T23:59:21.681315+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:59:21.681315+0000","last_undegraded":"2024-09-11T23:59:21.681315+0000","last_fullsized":"2024-09-11T23:59:21.681315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466943+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:59:21.466943+0000","last_peered":"2024-09-11T23:59:21.466943+0000","last_clean":"2024-09-11T23:59:21.466943+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:59:21.466943+0000","last_undegraded":"2024-09-11T23:59:21.466943+0000","last_fullsized":"2024-09-11T23:59:21.466943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466791+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:59:21.466791+0000","last_peered":"2024-09-11T23:59:21.466791+0000","last_clean":"2024-09-11T23:59:21.466791+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:59:21.466791+0000","last_undegraded":"2024-09-11T23:59:21.466791+0000","last_fullsized":"2024-09-11T23:59:21.466791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385382+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:59:21.385382+0000","last_peered":"2024-09-11T23:59:21.385382+0000","last_clean":"2024-09-11T23:59:21.385382+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:59:21.385382+0000","last_undegraded":"2024-09-11T23:59:21.385382+0000","last_fullsized":"2024-09-11T23:59:21.385382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600807,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1149,"num_read_kb":685,"num_write":372,"num_write_kb":1463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1802421,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":836685,"data_compressed":22043,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":1232719,"data_compressed":45324,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":836222,"data_compressed":22043,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201329,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":434486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1038207,"data_compressed":39168,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593789,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":434667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822721,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1168109,"data_compressed":45324,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445060,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":967364,"data_compressed":28199,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":510107,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":987136,"data_stored":510958,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":444455,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135740,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":200350,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":394801,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:59:24.800 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-11T23:59:24.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:59:24.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.942+0000 7ff83107b640 1 -- 172.21.15.60:0/3606067872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 msgr2=0x7ff82c1072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.942+0000 7ff83107b640 1 --2- 172.21.15.60:0/3606067872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 0x7ff82c1072b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff814009900 tx=0x7ff81402a410 comp rx=0 tx=0).stop 2024-09-11T23:59:24.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.942+0000 7ff83107b640 1 -- 172.21.15.60:0/3606067872 shutdown_connections 2024-09-11T23:59:24.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.942+0000 7ff83107b640 1 --2- 172.21.15.60:0/3606067872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff82c1077f0 0x7ff82c109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.942+0000 7ff83107b640 1 --2- 172.21.15.60:0/3606067872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 0x7ff82c1072b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.942+0000 7ff83107b640 1 --2- 172.21.15.60:0/3606067872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff82c102590 0x7ff82c104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.942+0000 7ff83107b640 1 -- 172.21.15.60:0/3606067872 >> 172.21.15.60:0/3606067872 conn(0x7ff82c0fc170 msgr2=0x7ff82c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:24.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.943+0000 7ff83107b640 1 -- 172.21.15.60:0/3606067872 shutdown_connections 2024-09-11T23:59:24.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.943+0000 7ff83107b640 1 -- 172.21.15.60:0/3606067872 wait complete. 2024-09-11T23:59:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.943+0000 7ff83107b640 1 Processor -- start 2024-09-11T23:59:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.943+0000 7ff83107b640 1 -- start start 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff83107b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff82c102590 0x7ff82c19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff83107b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 0x7ff82c19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff83107b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff82c1077f0 0x7ff82c1a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff83107b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c10d900 con 0x7ff82c104ec0 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff83107b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c10d780 con 0x7ff82c102590 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff83107b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c10da80 con 0x7ff82c1077f0 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 0x7ff82c19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 0x7ff82c19a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53588/0 (socket says 172.21.15.60:53588) 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 -- 172.21.15.60:0/2651874443 learned_addr learned my addr 172.21.15.60:0/2651874443 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82ad9d640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff82c102590 0x7ff82c19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 -- 172.21.15.60:0/2651874443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff82c1077f0 msgr2=0x7ff82c1a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff82c1077f0 0x7ff82c1a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 -- 172.21.15.60:0/2651874443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff82c102590 msgr2=0x7ff82c19a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff82c102590 0x7ff82c19a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 -- 172.21.15.60:0/2651874443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c1a1dd0 con 0x7ff82c104ec0 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.944+0000 7ff82a59c640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 0x7ff82c19a760 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff814005ab0 tx=0x7ff8140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.945+0000 7ff823fff640 1 -- 172.21.15.60:0/2651874443 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81403f030 con 0x7ff82c104ec0 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.945+0000 7ff823fff640 1 -- 172.21.15.60:0/2651874443 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff814003d00 con 0x7ff82c104ec0 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.945+0000 7ff823fff640 1 -- 172.21.15.60:0/2651874443 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814035070 con 0x7ff82c104ec0 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.945+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82c1a2060 con 0x7ff82c104ec0 2024-09-11T23:59:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.945+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82c1a25a0 con 0x7ff82c104ec0 2024-09-11T23:59:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.946+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff82c109360 con 0x7ff82c104ec0 2024-09-11T23:59:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.947+0000 7ff823fff640 1 -- 172.21.15.60:0/2651874443 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7ff814042030 con 0x7ff82c104ec0 2024-09-11T23:59:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.947+0000 7ff823fff640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8180a2d80 0x7ff8180a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.948+0000 7ff823fff640 1 -- 172.21.15.60:0/2651874443 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff8140efa00 con 0x7ff82c104ec0 2024-09-11T23:59:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.948+0000 7ff82ad9d640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8180a2d80 0x7ff8180a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.948+0000 7ff82ad9d640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8180a2d80 0x7ff8180a5240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff81c005fd0 tx=0x7ff81c009680 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:24.952+0000 7ff823fff640 1 -- 172.21.15.60:0/2651874443 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8140bc610 con 0x7ff82c104ec0 2024-09-11T23:59:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.135+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff82c062630 con 0x7ff8180a2d80 2024-09-11T23:59:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.141+0000 7ff823fff640 1 -- 172.21.15.60:0/2651874443 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258025 (secure 0 0 0) 0x7ff82c062630 con 0x7ff8180a2d80 2024-09-11T23:59:25.144 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:25.145 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.144+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8180a2d80 msgr2=0x7ff8180a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.144+0000 7ff83107b640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8180a2d80 0x7ff8180a5240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff81c005fd0 tx=0x7ff81c009680 comp rx=0 tx=0).stop 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.144+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 msgr2=0x7ff82c19a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.144+0000 7ff83107b640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 0x7ff82c19a760 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff814005ab0 tx=0x7ff8140042f0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.145+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 shutdown_connections 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.145+0000 7ff83107b640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8180a2d80 0x7ff8180a5240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.145+0000 7ff83107b640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff82c1077f0 0x7ff82c1a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.145+0000 7ff83107b640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82c104ec0 0x7ff82c19a760 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.145+0000 7ff83107b640 1 --2- 172.21.15.60:0/2651874443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff82c102590 0x7ff82c19a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:25.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.145+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 >> 172.21.15.60:0/2651874443 conn(0x7ff82c0fc170 msgr2=0x7ff82c101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:25.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.145+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 shutdown_connections 2024-09-11T23:59:25.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:25.145+0000 7ff83107b640 1 -- 172.21.15.60:0/2651874443 wait complete. 2024-09-11T23:59:25.155 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-11T23:59:23.398697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191409,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1285,"num_read_kb":804,"num_write":555,"num_write_kb":4403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":939,"ondisk_log_size":939,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368960,"kb_used_data":11364,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572864,"statfs":{"total":1151940427776,"available":1151562612736,"internally_reserved":0,"allocated":11636736,"data_stored":8859039,"data_compressed":213689,"data_compressed_allocated":274432,"data_compressed_original":3399680,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.941944"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466469+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:59:21.466469+0000","last_peered":"2024-09-11T23:59:21.466469+0000","last_clean":"2024-09-11T23:59:21.466469+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:59:21.466469+0000","last_undegraded":"2024-09-11T23:59:21.466469+0000","last_fullsized":"2024-09-11T23:59:21.466469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680932+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:59:21.680932+0000","last_peered":"2024-09-11T23:59:21.680932+0000","last_clean":"2024-09-11T23:59:21.680932+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:59:21.680932+0000","last_undegraded":"2024-09-11T23:59:21.680932+0000","last_fullsized":"2024-09-11T23:59:21.680932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680758+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:59:21.680758+0000","last_peered":"2024-09-11T23:59:21.680758+0000","last_clean":"2024-09-11T23:59:21.680758+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:59:21.680758+0000","last_undegraded":"2024-09-11T23:59:21.680758+0000","last_fullsized":"2024-09-11T23:59:21.680758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645268+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:59:21.645268+0000","last_peered":"2024-09-11T23:59:21.645268+0000","last_clean":"2024-09-11T23:59:21.645268+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:59:21.645268+0000","last_undegraded":"2024-09-11T23:59:21.645268+0000","last_fullsized":"2024-09-11T23:59:21.645268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700973+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:59:21.700973+0000","last_peered":"2024-09-11T23:59:21.700973+0000","last_clean":"2024-09-11T23:59:21.700973+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:59:21.700973+0000","last_undegraded":"2024-09-11T23:59:21.700973+0000","last_fullsized":"2024-09-11T23:59:21.700973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475885+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:59:21.475885+0000","last_peered":"2024-09-11T23:59:21.475885+0000","last_clean":"2024-09-11T23:59:21.475885+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:59:21.475885+0000","last_undegraded":"2024-09-11T23:59:21.475885+0000","last_fullsized":"2024-09-11T23:59:21.475885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644131+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:59:21.644131+0000","last_peered":"2024-09-11T23:59:21.644131+0000","last_clean":"2024-09-11T23:59:21.644131+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:59:21.644131+0000","last_undegraded":"2024-09-11T23:59:21.644131+0000","last_fullsized":"2024-09-11T23:59:21.644131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466288+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:59:21.466288+0000","last_peered":"2024-09-11T23:59:21.466288+0000","last_clean":"2024-09-11T23:59:21.466288+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:59:21.466288+0000","last_undegraded":"2024-09-11T23:59:21.466288+0000","last_fullsized":"2024-09-11T23:59:21.466288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387087+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:59:21.387087+0000","last_peered":"2024-09-11T23:59:21.387087+0000","last_clean":"2024-09-11T23:59:21.387087+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:59:21.387087+0000","last_undegraded":"2024-09-11T23:59:21.387087+0000","last_fullsized":"2024-09-11T23:59:21.387087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476277+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:59:21.476277+0000","last_peered":"2024-09-11T23:59:21.476277+0000","last_clean":"2024-09-11T23:59:21.476277+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:59:21.476277+0000","last_undegraded":"2024-09-11T23:59:21.476277+0000","last_fullsized":"2024-09-11T23:59:21.476277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644423+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:59:21.644423+0000","last_peered":"2024-09-11T23:59:21.644423+0000","last_clean":"2024-09-11T23:59:21.644423+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:59:21.644423+0000","last_undegraded":"2024-09-11T23:59:21.644423+0000","last_fullsized":"2024-09-11T23:59:21.644423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385078+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:59:21.385078+0000","last_peered":"2024-09-11T23:59:21.385078+0000","last_clean":"2024-09-11T23:59:21.385078+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:59:21.385078+0000","last_undegraded":"2024-09-11T23:59:21.385078+0000","last_fullsized":"2024-09-11T23:59:21.385078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643697+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:59:21.643697+0000","last_peered":"2024-09-11T23:59:21.643697+0000","last_clean":"2024-09-11T23:59:21.643697+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:59:21.643697+0000","last_undegraded":"2024-09-11T23:59:21.643697+0000","last_fullsized":"2024-09-11T23:59:21.643697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680072+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:59:21.680072+0000","last_peered":"2024-09-11T23:59:21.680072+0000","last_clean":"2024-09-11T23:59:21.680072+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:59:21.680072+0000","last_undegraded":"2024-09-11T23:59:21.680072+0000","last_fullsized":"2024-09-11T23:59:21.680072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.679770+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:59:21.679770+0000","last_peered":"2024-09-11T23:59:21.679770+0000","last_clean":"2024-09-11T23:59:21.679770+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:59:21.679770+0000","last_undegraded":"2024-09-11T23:59:21.679770+0000","last_fullsized":"2024-09-11T23:59:21.679770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386692+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:59:21.386692+0000","last_peered":"2024-09-11T23:59:21.386692+0000","last_clean":"2024-09-11T23:59:21.386692+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:59:21.386692+0000","last_undegraded":"2024-09-11T23:59:21.386692+0000","last_fullsized":"2024-09-11T23:59:21.386692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466577+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:59:21.466577+0000","last_peered":"2024-09-11T23:59:21.466577+0000","last_clean":"2024-09-11T23:59:21.466577+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:59:21.466577+0000","last_undegraded":"2024-09-11T23:59:21.466577+0000","last_fullsized":"2024-09-11T23:59:21.466577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385256+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:59:21.385256+0000","last_peered":"2024-09-11T23:59:21.385256+0000","last_clean":"2024-09-11T23:59:21.385256+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:59:21.385256+0000","last_undegraded":"2024-09-11T23:59:21.385256+0000","last_fullsized":"2024-09-11T23:59:21.385256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387348+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:59:21.387348+0000","last_peered":"2024-09-11T23:59:21.387348+0000","last_clean":"2024-09-11T23:59:21.387348+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:59:21.387348+0000","last_undegraded":"2024-09-11T23:59:21.387348+0000","last_fullsized":"2024-09-11T23:59:21.387348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466261+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:59:21.466261+0000","last_peered":"2024-09-11T23:59:21.466261+0000","last_clean":"2024-09-11T23:59:21.466261+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:59:21.466261+0000","last_undegraded":"2024-09-11T23:59:21.466261+0000","last_fullsized":"2024-09-11T23:59:21.466261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643856+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:59:21.643856+0000","last_peered":"2024-09-11T23:59:21.643856+0000","last_clean":"2024-09-11T23:59:21.643856+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:59:21.643856+0000","last_undegraded":"2024-09-11T23:59:21.643856+0000","last_fullsized":"2024-09-11T23:59:21.643856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386866+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:59:21.386866+0000","last_peered":"2024-09-11T23:59:21.386866+0000","last_clean":"2024-09-11T23:59:21.386866+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:59:21.386866+0000","last_undegraded":"2024-09-11T23:59:21.386866+0000","last_fullsized":"2024-09-11T23:59:21.386866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466381+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:59:21.466381+0000","last_peered":"2024-09-11T23:59:21.466381+0000","last_clean":"2024-09-11T23:59:21.466381+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:59:21.466381+0000","last_undegraded":"2024-09-11T23:59:21.466381+0000","last_fullsized":"2024-09-11T23:59:21.466381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472730+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:59:21.472730+0000","last_peered":"2024-09-11T23:59:21.472730+0000","last_clean":"2024-09-11T23:59:21.472730+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:59:21.472730+0000","last_undegraded":"2024-09-11T23:59:21.472730+0000","last_fullsized":"2024-09-11T23:59:21.472730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466751+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:59:21.466751+0000","last_peered":"2024-09-11T23:59:21.466751+0000","last_clean":"2024-09-11T23:59:21.466751+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:59:21.466751+0000","last_undegraded":"2024-09-11T23:59:21.466751+0000","last_fullsized":"2024-09-11T23:59:21.466751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387391+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:59:21.387391+0000","last_peered":"2024-09-11T23:59:21.387391+0000","last_clean":"2024-09-11T23:59:21.387391+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:59:21.387391+0000","last_undegraded":"2024-09-11T23:59:21.387391+0000","last_fullsized":"2024-09-11T23:59:21.387391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466340+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:59:21.466340+0000","last_peered":"2024-09-11T23:59:21.466340+0000","last_clean":"2024-09-11T23:59:21.466340+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:59:21.466340+0000","last_undegraded":"2024-09-11T23:59:21.466340+0000","last_fullsized":"2024-09-11T23:59:21.466340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643440+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:59:21.643440+0000","last_peered":"2024-09-11T23:59:21.643440+0000","last_clean":"2024-09-11T23:59:21.643440+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:59:21.643440+0000","last_undegraded":"2024-09-11T23:59:21.643440+0000","last_fullsized":"2024-09-11T23:59:21.643440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:59:21.680410+0000","last_peered":"2024-09-11T23:59:21.680410+0000","last_clean":"2024-09-11T23:59:21.680410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:59:21.680410+0000","last_undegraded":"2024-09-11T23:59:21.680410+0000","last_fullsized":"2024-09-11T23:59:21.680410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387093+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:59:21.387093+0000","last_peered":"2024-09-11T23:59:21.387093+0000","last_clean":"2024-09-11T23:59:21.387093+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:59:21.387093+0000","last_undegraded":"2024-09-11T23:59:21.387093+0000","last_fullsized":"2024-09-11T23:59:21.387093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387125+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:59:21.387125+0000","last_peered":"2024-09-11T23:59:21.387125+0000","last_clean":"2024-09-11T23:59:21.387125+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:59:21.387125+0000","last_undegraded":"2024-09-11T23:59:21.387125+0000","last_fullsized":"2024-09-11T23:59:21.387125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700936+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:59:21.700936+0000","last_peered":"2024-09-11T23:59:21.700936+0000","last_clean":"2024-09-11T23:59:21.700936+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:59:21.700936+0000","last_undegraded":"2024-09-11T23:59:21.700936+0000","last_fullsized":"2024-09-11T23:59:21.700936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'9","reported_seq":150,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.678140+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:59:21.678140+0000","last_peered":"2024-09-11T23:59:21.678140+0000","last_clean":"2024-09-11T23:59:21.678140+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:59:21.678140+0000","last_undegraded":"2024-09-11T23:59:21.678140+0000","last_fullsized":"2024-09-11T23:59:21.678140+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472907+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:59:21.472907+0000","last_peered":"2024-09-11T23:59:21.472907+0000","last_clean":"2024-09-11T23:59:21.472907+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:59:21.472907+0000","last_undegraded":"2024-09-11T23:59:21.472907+0000","last_fullsized":"2024-09-11T23:59:21.472907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475951+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:59:21.475951+0000","last_peered":"2024-09-11T23:59:21.475951+0000","last_clean":"2024-09-11T23:59:21.475951+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:59:21.475951+0000","last_undegraded":"2024-09-11T23:59:21.475951+0000","last_fullsized":"2024-09-11T23:59:21.475951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642891+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:59:21.642891+0000","last_peered":"2024-09-11T23:59:21.642891+0000","last_clean":"2024-09-11T23:59:21.642891+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:59:21.642891+0000","last_undegraded":"2024-09-11T23:59:21.642891+0000","last_fullsized":"2024-09-11T23:59:21.642891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466333+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:59:21.466333+0000","last_peered":"2024-09-11T23:59:21.466333+0000","last_clean":"2024-09-11T23:59:21.466333+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:59:21.466333+0000","last_undegraded":"2024-09-11T23:59:21.466333+0000","last_fullsized":"2024-09-11T23:59:21.466333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472936+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:59:21.472936+0000","last_peered":"2024-09-11T23:59:21.472936+0000","last_clean":"2024-09-11T23:59:21.472936+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:59:21.472936+0000","last_undegraded":"2024-09-11T23:59:21.472936+0000","last_fullsized":"2024-09-11T23:59:21.472936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385069+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:59:21.385069+0000","last_peered":"2024-09-11T23:59:21.385069+0000","last_clean":"2024-09-11T23:59:21.385069+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:59:21.385069+0000","last_undegraded":"2024-09-11T23:59:21.385069+0000","last_fullsized":"2024-09-11T23:59:21.385069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.641589+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:59:21.641589+0000","last_peered":"2024-09-11T23:59:21.641589+0000","last_clean":"2024-09-11T23:59:21.641589+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:59:21.641589+0000","last_undegraded":"2024-09-11T23:59:21.641589+0000","last_fullsized":"2024-09-11T23:59:21.641589+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387218+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:59:21.387218+0000","last_peered":"2024-09-11T23:59:21.387218+0000","last_clean":"2024-09-11T23:59:21.387218+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:59:21.387218+0000","last_undegraded":"2024-09-11T23:59:21.387218+0000","last_fullsized":"2024-09-11T23:59:21.387218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644343+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:59:21.644343+0000","last_peered":"2024-09-11T23:59:21.644343+0000","last_clean":"2024-09-11T23:59:21.644343+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:59:21.644343+0000","last_undegraded":"2024-09-11T23:59:21.644343+0000","last_fullsized":"2024-09-11T23:59:21.644343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681237+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:59:21.681237+0000","last_peered":"2024-09-11T23:59:21.681237+0000","last_clean":"2024-09-11T23:59:21.681237+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:59:21.681237+0000","last_undegraded":"2024-09-11T23:59:21.681237+0000","last_fullsized":"2024-09-11T23:59:21.681237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473215+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:59:21.473215+0000","last_peered":"2024-09-11T23:59:21.473215+0000","last_clean":"2024-09-11T23:59:21.473215+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:59:21.473215+0000","last_undegraded":"2024-09-11T23:59:21.473215+0000","last_fullsized":"2024-09-11T23:59:21.473215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386888+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:59:21.386888+0000","last_peered":"2024-09-11T23:59:21.386888+0000","last_clean":"2024-09-11T23:59:21.386888+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:59:21.386888+0000","last_undegraded":"2024-09-11T23:59:21.386888+0000","last_fullsized":"2024-09-11T23:59:21.386888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":272,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.684619+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:59:21.684619+0000","last_peered":"2024-09-11T23:59:21.684619+0000","last_clean":"2024-09-11T23:59:21.684619+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:59:21.684619+0000","last_undegraded":"2024-09-11T23:59:21.684619+0000","last_fullsized":"2024-09-11T23:59:21.684619+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":165,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701163+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:59:21.701163+0000","last_peered":"2024-09-11T23:59:21.701163+0000","last_clean":"2024-09-11T23:59:21.701163+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:59:21.701163+0000","last_undegraded":"2024-09-11T23:59:21.701163+0000","last_fullsized":"2024-09-11T23:59:21.701163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387205+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:59:21.387205+0000","last_peered":"2024-09-11T23:59:21.387205+0000","last_clean":"2024-09-11T23:59:21.387205+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:59:21.387205+0000","last_undegraded":"2024-09-11T23:59:21.387205+0000","last_fullsized":"2024-09-11T23:59:21.387205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643090+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:59:21.643090+0000","last_peered":"2024-09-11T23:59:21.643090+0000","last_clean":"2024-09-11T23:59:21.643090+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:59:21.643090+0000","last_undegraded":"2024-09-11T23:59:21.643090+0000","last_fullsized":"2024-09-11T23:59:21.643090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472835+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:59:21.472835+0000","last_peered":"2024-09-11T23:59:21.472835+0000","last_clean":"2024-09-11T23:59:21.472835+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:59:21.472835+0000","last_undegraded":"2024-09-11T23:59:21.472835+0000","last_fullsized":"2024-09-11T23:59:21.472835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644370+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:59:21.644370+0000","last_peered":"2024-09-11T23:59:21.644370+0000","last_clean":"2024-09-11T23:59:21.644370+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:59:21.644370+0000","last_undegraded":"2024-09-11T23:59:21.644370+0000","last_fullsized":"2024-09-11T23:59:21.644370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":136,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645135+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:59:21.645135+0000","last_peered":"2024-09-11T23:59:21.645135+0000","last_clean":"2024-09-11T23:59:21.645135+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:59:21.645135+0000","last_undegraded":"2024-09-11T23:59:21.645135+0000","last_fullsized":"2024-09-11T23:59:21.645135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644127+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:59:21.644127+0000","last_peered":"2024-09-11T23:59:21.644127+0000","last_clean":"2024-09-11T23:59:21.644127+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:59:21.644127+0000","last_undegraded":"2024-09-11T23:59:21.644127+0000","last_fullsized":"2024-09-11T23:59:21.644127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472738+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:59:21.472738+0000","last_peered":"2024-09-11T23:59:21.472738+0000","last_clean":"2024-09-11T23:59:21.472738+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:59:21.472738+0000","last_undegraded":"2024-09-11T23:59:21.472738+0000","last_fullsized":"2024-09-11T23:59:21.472738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701229+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:59:21.701229+0000","last_peered":"2024-09-11T23:59:21.701229+0000","last_clean":"2024-09-11T23:59:21.701229+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:59:21.701229+0000","last_undegraded":"2024-09-11T23:59:21.701229+0000","last_fullsized":"2024-09-11T23:59:21.701229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466415+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:59:21.466415+0000","last_peered":"2024-09-11T23:59:21.466415+0000","last_clean":"2024-09-11T23:59:21.466415+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:59:21.466415+0000","last_undegraded":"2024-09-11T23:59:21.466415+0000","last_fullsized":"2024-09-11T23:59:21.466415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643857+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:59:21.643857+0000","last_peered":"2024-09-11T23:59:21.643857+0000","last_clean":"2024-09-11T23:59:21.643857+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:59:21.643857+0000","last_undegraded":"2024-09-11T23:59:21.643857+0000","last_fullsized":"2024-09-11T23:59:21.643857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644471+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:59:21.644471+0000","last_peered":"2024-09-11T23:59:21.644471+0000","last_clean":"2024-09-11T23:59:21.644471+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:59:21.644471+0000","last_undegraded":"2024-09-11T23:59:21.644471+0000","last_fullsized":"2024-09-11T23:59:21.644471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.600003+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:59:21.600003+0000","last_peered":"2024-09-11T23:59:21.600003+0000","last_clean":"2024-09-11T23:59:21.600003+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:59:21.600003+0000","last_undegraded":"2024-09-11T23:59:21.600003+0000","last_fullsized":"2024-09-11T23:59:21.600003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644309+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:59:21.644309+0000","last_peered":"2024-09-11T23:59:21.644309+0000","last_clean":"2024-09-11T23:59:21.644309+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:59:21.644309+0000","last_undegraded":"2024-09-11T23:59:21.644309+0000","last_fullsized":"2024-09-11T23:59:21.644309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":133,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.641944+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:59:21.641944+0000","last_peered":"2024-09-11T23:59:21.641944+0000","last_clean":"2024-09-11T23:59:21.641944+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:59:21.641944+0000","last_undegraded":"2024-09-11T23:59:21.641944+0000","last_fullsized":"2024-09-11T23:59:21.641944+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644569+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:59:21.644569+0000","last_peered":"2024-09-11T23:59:21.644569+0000","last_clean":"2024-09-11T23:59:21.644569+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:59:21.644569+0000","last_undegraded":"2024-09-11T23:59:21.644569+0000","last_fullsized":"2024-09-11T23:59:21.644569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":348,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644261+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:59:21.644261+0000","last_peered":"2024-09-11T23:59:21.644261+0000","last_clean":"2024-09-11T23:59:21.644261+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:59:21.644261+0000","last_undegraded":"2024-09-11T23:59:21.644261+0000","last_fullsized":"2024-09-11T23:59:21.644261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645112+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:59:21.645112+0000","last_peered":"2024-09-11T23:59:21.645112+0000","last_clean":"2024-09-11T23:59:21.645112+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:59:21.645112+0000","last_undegraded":"2024-09-11T23:59:21.645112+0000","last_fullsized":"2024-09-11T23:59:21.645112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466865+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:59:21.466865+0000","last_peered":"2024-09-11T23:59:21.466865+0000","last_clean":"2024-09-11T23:59:21.466865+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:59:21.466865+0000","last_undegraded":"2024-09-11T23:59:21.466865+0000","last_fullsized":"2024-09-11T23:59:21.466865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466169+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:59:21.466169+0000","last_peered":"2024-09-11T23:59:21.466169+0000","last_clean":"2024-09-11T23:59:21.466169+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:59:21.466169+0000","last_undegraded":"2024-09-11T23:59:21.466169+0000","last_fullsized":"2024-09-11T23:59:21.466169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642758+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:59:21.642758+0000","last_peered":"2024-09-11T23:59:21.642758+0000","last_clean":"2024-09-11T23:59:21.642758+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:59:21.642758+0000","last_undegraded":"2024-09-11T23:59:21.642758+0000","last_fullsized":"2024-09-11T23:59:21.642758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642998+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:59:21.642998+0000","last_peered":"2024-09-11T23:59:21.642998+0000","last_clean":"2024-09-11T23:59:21.642998+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:59:21.642998+0000","last_undegraded":"2024-09-11T23:59:21.642998+0000","last_fullsized":"2024-09-11T23:59:21.642998+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473034+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:59:21.473034+0000","last_peered":"2024-09-11T23:59:21.473034+0000","last_clean":"2024-09-11T23:59:21.473034+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:59:21.473034+0000","last_undegraded":"2024-09-11T23:59:21.473034+0000","last_fullsized":"2024-09-11T23:59:21.473034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'8","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644465+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:59:21.644465+0000","last_peered":"2024-09-11T23:59:21.644465+0000","last_clean":"2024-09-11T23:59:21.644465+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:59:21.644465+0000","last_undegraded":"2024-09-11T23:59:21.644465+0000","last_fullsized":"2024-09-11T23:59:21.644465+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475979+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:59:21.475979+0000","last_peered":"2024-09-11T23:59:21.475979+0000","last_clean":"2024-09-11T23:59:21.475979+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:59:21.475979+0000","last_undegraded":"2024-09-11T23:59:21.475979+0000","last_fullsized":"2024-09-11T23:59:21.475979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385258+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:59:21.385258+0000","last_peered":"2024-09-11T23:59:21.385258+0000","last_clean":"2024-09-11T23:59:21.385258+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:59:21.385258+0000","last_undegraded":"2024-09-11T23:59:21.385258+0000","last_fullsized":"2024-09-11T23:59:21.385258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476051+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:59:21.476051+0000","last_peered":"2024-09-11T23:59:21.476051+0000","last_clean":"2024-09-11T23:59:21.476051+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:59:21.476051+0000","last_undegraded":"2024-09-11T23:59:21.476051+0000","last_fullsized":"2024-09-11T23:59:21.476051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701325+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:59:21.701325+0000","last_peered":"2024-09-11T23:59:21.701325+0000","last_clean":"2024-09-11T23:59:21.701325+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:59:21.701325+0000","last_undegraded":"2024-09-11T23:59:21.701325+0000","last_fullsized":"2024-09-11T23:59:21.701325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643556+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:59:21.643556+0000","last_peered":"2024-09-11T23:59:21.643556+0000","last_clean":"2024-09-11T23:59:21.643556+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:59:21.643556+0000","last_undegraded":"2024-09-11T23:59:21.643556+0000","last_fullsized":"2024-09-11T23:59:21.643556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'50","reported_seq":113,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.603339+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:59:21.603339+0000","last_peered":"2024-09-11T23:59:21.603339+0000","last_clean":"2024-09-11T23:59:21.603339+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:59:21.603339+0000","last_undegraded":"2024-09-11T23:59:21.603339+0000","last_fullsized":"2024-09-11T23:59:21.603339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466838+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:59:21.466838+0000","last_peered":"2024-09-11T23:59:21.466838+0000","last_clean":"2024-09-11T23:59:21.466838+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:59:21.466838+0000","last_undegraded":"2024-09-11T23:59:21.466838+0000","last_fullsized":"2024-09-11T23:59:21.466838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645248+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:59:21.645248+0000","last_peered":"2024-09-11T23:59:21.645248+0000","last_clean":"2024-09-11T23:59:21.645248+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:59:21.645248+0000","last_undegraded":"2024-09-11T23:59:21.645248+0000","last_fullsized":"2024-09-11T23:59:21.645248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680966+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:59:21.680966+0000","last_peered":"2024-09-11T23:59:21.680966+0000","last_clean":"2024-09-11T23:59:21.680966+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:59:21.680966+0000","last_undegraded":"2024-09-11T23:59:21.680966+0000","last_fullsized":"2024-09-11T23:59:21.680966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386783+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:59:21.386783+0000","last_peered":"2024-09-11T23:59:21.386783+0000","last_clean":"2024-09-11T23:59:21.386783+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:59:21.386783+0000","last_undegraded":"2024-09-11T23:59:21.386783+0000","last_fullsized":"2024-09-11T23:59:21.386783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466548+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:59:21.466548+0000","last_peered":"2024-09-11T23:59:21.466548+0000","last_clean":"2024-09-11T23:59:21.466548+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:59:21.466548+0000","last_undegraded":"2024-09-11T23:59:21.466548+0000","last_fullsized":"2024-09-11T23:59:21.466548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387161+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:59:21.387161+0000","last_peered":"2024-09-11T23:59:21.387161+0000","last_clean":"2024-09-11T23:59:21.387161+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:59:21.387161+0000","last_undegraded":"2024-09-11T23:59:21.387161+0000","last_fullsized":"2024-09-11T23:59:21.387161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466575+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:59:21.466575+0000","last_peered":"2024-09-11T23:59:21.466575+0000","last_clean":"2024-09-11T23:59:21.466575+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:59:21.466575+0000","last_undegraded":"2024-09-11T23:59:21.466575+0000","last_fullsized":"2024-09-11T23:59:21.466575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701133+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:59:21.701133+0000","last_peered":"2024-09-11T23:59:21.701133+0000","last_clean":"2024-09-11T23:59:21.701133+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:59:21.701133+0000","last_undegraded":"2024-09-11T23:59:21.701133+0000","last_fullsized":"2024-09-11T23:59:21.701133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644300+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:59:21.644300+0000","last_peered":"2024-09-11T23:59:21.644300+0000","last_clean":"2024-09-11T23:59:21.644300+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:59:21.644300+0000","last_undegraded":"2024-09-11T23:59:21.644300+0000","last_fullsized":"2024-09-11T23:59:21.644300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473153+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:59:21.473153+0000","last_peered":"2024-09-11T23:59:21.473153+0000","last_clean":"2024-09-11T23:59:21.473153+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:59:21.473153+0000","last_undegraded":"2024-09-11T23:59:21.473153+0000","last_fullsized":"2024-09-11T23:59:21.473153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701254+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:59:21.701254+0000","last_peered":"2024-09-11T23:59:21.701254+0000","last_clean":"2024-09-11T23:59:21.701254+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:59:21.701254+0000","last_undegraded":"2024-09-11T23:59:21.701254+0000","last_fullsized":"2024-09-11T23:59:21.701254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386855+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:59:21.386855+0000","last_peered":"2024-09-11T23:59:21.386855+0000","last_clean":"2024-09-11T23:59:21.386855+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:59:21.386855+0000","last_undegraded":"2024-09-11T23:59:21.386855+0000","last_fullsized":"2024-09-11T23:59:21.386855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701190+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:59:21.701190+0000","last_peered":"2024-09-11T23:59:21.701190+0000","last_clean":"2024-09-11T23:59:21.701190+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:59:21.701190+0000","last_undegraded":"2024-09-11T23:59:21.701190+0000","last_fullsized":"2024-09-11T23:59:21.701190+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681315+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:59:21.681315+0000","last_peered":"2024-09-11T23:59:21.681315+0000","last_clean":"2024-09-11T23:59:21.681315+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:59:21.681315+0000","last_undegraded":"2024-09-11T23:59:21.681315+0000","last_fullsized":"2024-09-11T23:59:21.681315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466943+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:59:21.466943+0000","last_peered":"2024-09-11T23:59:21.466943+0000","last_clean":"2024-09-11T23:59:21.466943+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:59:21.466943+0000","last_undegraded":"2024-09-11T23:59:21.466943+0000","last_fullsized":"2024-09-11T23:59:21.466943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466791+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:59:21.466791+0000","last_peered":"2024-09-11T23:59:21.466791+0000","last_clean":"2024-09-11T23:59:21.466791+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:59:21.466791+0000","last_undegraded":"2024-09-11T23:59:21.466791+0000","last_fullsized":"2024-09-11T23:59:21.466791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":140,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385382+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:59:21.385382+0000","last_peered":"2024-09-11T23:59:21.385382+0000","last_clean":"2024-09-11T23:59:21.385382+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:59:21.385382+0000","last_undegraded":"2024-09-11T23:59:21.385382+0000","last_fullsized":"2024-09-11T23:59:21.385382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600807,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1149,"num_read_kb":685,"num_write":372,"num_write_kb":1463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1802421,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579939,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":836685,"data_compressed":22043,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":1232719,"data_compressed":45324,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972397,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":836222,"data_compressed":22043,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201329,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":434486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1038207,"data_compressed":39168,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593789,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":434667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822721,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1168109,"data_compressed":45324,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445060,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":967364,"data_compressed":28199,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":510107,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":987136,"data_stored":510958,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":444455,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135740,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":200350,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":394801,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:59:25.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:25.936 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:25.937 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:25.938 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:25.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:25.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:25.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:25.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:25.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:25.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:25.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:25.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:25.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:25.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:25.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:25.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:25.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:26.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:26.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-11T23:59:26.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:26.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 -- 172.21.15.60:0/2164637243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3201036e0 msgr2=0x7fb320107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 --2- 172.21.15.60:0/2164637243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3201036e0 0x7fb320107b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb314009930 tx=0x7fb31402a420 comp rx=0 tx=0).stop 2024-09-11T23:59:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 -- 172.21.15.60:0/2164637243 shutdown_connections 2024-09-11T23:59:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 --2- 172.21.15.60:0/2164637243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3201082a0 0x7fb32010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 --2- 172.21.15.60:0/2164637243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3201036e0 0x7fb320107b90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 --2- 172.21.15.60:0/2164637243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb320102d30 0x7fb320103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 -- 172.21.15.60:0/2164637243 >> 172.21.15.60:0/2164637243 conn(0x7fb3200fc7d0 msgr2=0x7fb3200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 -- 172.21.15.60:0/2164637243 shutdown_connections 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.027+0000 7fb324a71640 1 -- 172.21.15.60:0/2164637243 wait complete. 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.028+0000 7fb324a71640 1 Processor -- start 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.028+0000 7fb324a71640 1 -- start start 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.028+0000 7fb324a71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb320102d30 0x7fb320100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.028+0000 7fb324a71640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3201036e0 0x7fb320100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.028+0000 7fb324a71640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3201082a0 0x7fb320101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.028+0000 7fb324a71640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3201121c0 con 0x7fb320102d30 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.028+0000 7fb324a71640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb320112040 con 0x7fb3201036e0 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.028+0000 7fb324a71640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb320112340 con 0x7fb3201082a0 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb320102d30 0x7fb320100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb320102d30 0x7fb320100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53598/0 (socket says 172.21.15.60:53598) 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 -- 172.21.15.60:0/4077537799 learned_addr learned my addr 172.21.15.60:0/4077537799 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31dd9b640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3201036e0 0x7fb320100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31ed9d640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3201082a0 0x7fb320101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 -- 172.21.15.60:0/4077537799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3201082a0 msgr2=0x7fb320101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3201082a0 0x7fb320101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 -- 172.21.15.60:0/4077537799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3201036e0 msgr2=0x7fb320100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3201036e0 0x7fb320100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 -- 172.21.15.60:0/4077537799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3201a6b40 con 0x7fb320102d30 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31ed9d640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3201082a0 0x7fb320101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb31e59c640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb320102d30 0x7fb320100990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb31000e9f0 tx=0x7fb31000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb30f7fe640 1 -- 172.21.15.60:0/4077537799 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31000cd80 con 0x7fb320102d30 2024-09-11T23:59:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb30f7fe640 1 -- 172.21.15.60:0/4077537799 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb310005520 con 0x7fb320102d30 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.029+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3201a6e30 con 0x7fb320102d30 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.030+0000 7fb30f7fe640 1 -- 172.21.15.60:0/4077537799 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310010690 con 0x7fb320102d30 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.030+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3201a7290 con 0x7fb320102d30 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.031+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb320103110 con 0x7fb320102d30 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.032+0000 7fb30f7fe640 1 -- 172.21.15.60:0/4077537799 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7fb3100046c0 con 0x7fb320102d30 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.033+0000 7fb30f7fe640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3080a2d70 0x7fb3080a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.033+0000 7fb31dd9b640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3080a2d70 0x7fb3080a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.033+0000 7fb30f7fe640 1 -- 172.21.15.60:0/4077537799 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb3100cf830 con 0x7fb320102d30 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.033+0000 7fb31dd9b640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3080a2d70 0x7fb3080a5230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb314005940 tx=0x7fb3140058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.037+0000 7fb30f7fe640 1 -- 172.21.15.60:0/4077537799 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb31009c440 con 0x7fb320102d30 2024-09-11T23:59:26.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.262+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb32010a2b0 con 0x7fb320102d30 2024-09-11T23:59:26.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.263+0000 7fb30f7fe640 1 -- 172.21.15.60:0/4077537799 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7fb31009bd40 con 0x7fb320102d30 2024-09-11T23:59:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:26.263 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-11T23:59:26.263 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-11T23:59:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3080a2d70 msgr2=0x7fb3080a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:26.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3080a2d70 0x7fb3080a5230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb314005940 tx=0x7fb3140058d0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb320102d30 msgr2=0x7fb320100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb320102d30 0x7fb320100990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb31000e9f0 tx=0x7fb31000edf0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 shutdown_connections 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3080a2d70 0x7fb3080a5230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3201082a0 0x7fb320101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3201036e0 0x7fb320100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 --2- 172.21.15.60:0/4077537799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb320102d30 0x7fb320100990 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 >> 172.21.15.60:0/4077537799 conn(0x7fb3200fc7d0 msgr2=0x7fb320106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.266+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 shutdown_connections 2024-09-11T23:59:26.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:26.267+0000 7fb324a71640 1 -- 172.21.15.60:0/4077537799 wait complete. 2024-09-11T23:59:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-11T23:59:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T23:59:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-11T23:59:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-11T23:59:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:59:26.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:26.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:26.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:26.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:26.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:26.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:26.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:26.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:26.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:26.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:26.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4077537799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:26.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-11T23:59:26.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.982 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:26.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:26.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:26.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:26.983 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-11T23:59:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T23:59:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-11T23:59:27.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4077537799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:27.035 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:27.036 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-11T23:59:27.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi105:/etc/ceph/ceph.conf 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi105:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:27.090 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: Updating smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4077537799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:27.091 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:27.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:59:27.377 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:27.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 -- 172.21.15.60:0/85704948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4106a80 msgr2=0x7f44a4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:27.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/85704948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4106a80 0x7f44a4106e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4494009930 tx=0x7f449402a420 comp rx=0 tx=0).stop 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 -- 172.21.15.60:0/85704948 shutdown_connections 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/85704948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a4101420 0x7f44a410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/85704948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44a4100a80 0x7f44a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/85704948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4106a80 0x7f44a4106e60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 -- 172.21.15.60:0/85704948 >> 172.21.15.60:0/85704948 conn(0x7f44a40fc7a0 msgr2=0x7f44a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 -- 172.21.15.60:0/85704948 shutdown_connections 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 -- 172.21.15.60:0/85704948 wait complete. 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.870+0000 7f44aa1f2640 1 Processor -- start 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44aa1f2640 1 -- start start 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44aa1f2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4100a80 0x7f44a41985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44aa1f2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44a4101420 0x7f44a4198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44aa1f2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a4106a80 0x7f44a419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44aa1f2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4110fe0 con 0x7f44a4100a80 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44aa1f2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4110e60 con 0x7f44a4101420 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44aa1f2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4111160 con 0x7f44a4106a80 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4100a80 0x7f44a41985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4100a80 0x7f44a41985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53606/0 (socket says 172.21.15.60:53606) 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 -- 172.21.15.60:0/52354322 learned_addr learned my addr 172.21.15.60:0/52354322 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a2ffd640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44a4101420 0x7f44a4198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a3fff640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a4106a80 0x7f44a419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 -- 172.21.15.60:0/52354322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a4106a80 msgr2=0x7f44a419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a4106a80 0x7f44a419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 -- 172.21.15.60:0/52354322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44a4101420 msgr2=0x7f44a4198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44a4101420 0x7f44a4198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 -- 172.21.15.60:0/52354322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a419d5a0 con 0x7f44a4100a80 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a3fff640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a4106a80 0x7f44a419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.871+0000 7f44a37fe640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4100a80 0x7f44a41985f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4494009230 tx=0x7f4494004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.872+0000 7f44a0ff9640 1 -- 172.21.15.60:0/52354322 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449403f030 con 0x7f44a4100a80 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.872+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a419d830 con 0x7f44a4100a80 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.872+0000 7f44a0ff9640 1 -- 172.21.15.60:0/52354322 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4494003af0 con 0x7f44a4100a80 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.872+0000 7f44a0ff9640 1 -- 172.21.15.60:0/52354322 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494035070 con 0x7f44a4100a80 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.872+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a41a5170 con 0x7f44a4100a80 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.873+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a41021c0 con 0x7f44a4100a80 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.874+0000 7f44a0ff9640 1 -- 172.21.15.60:0/52354322 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f4494042030 con 0x7f44a4100a80 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.874+0000 7f44a0ff9640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f448c0a2d80 0x7f448c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:27.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.875+0000 7f44a2ffd640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f448c0a2d80 0x7f448c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.875+0000 7f44a0ff9640 1 -- 172.21.15.60:0/52354322 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f44940efe40 con 0x7f44a4100a80 2024-09-11T23:59:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.875+0000 7f44a2ffd640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f448c0a2d80 0x7f448c0a5240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44a40fea80 tx=0x7f449800b390 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:27.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:27.879+0000 7f44a0ff9640 1 -- 172.21.15.60:0/52354322 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44940bca00 con 0x7f44a4100a80 2024-09-11T23:59:28.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.054+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44a41a5340 con 0x7f44a4100a80 2024-09-11T23:59:28.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.056+0000 7f44a0ff9640 1 -- 172.21.15.60:0/52354322 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23021 (secure 0 0 0) 0x7f44940bc300 con 0x7f44a4100a80 2024-09-11T23:59:28.055 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:28.057 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":83,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:59:21.380083+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/75586277":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3663020999":"2024-09-12T23:59:21.380056+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6801/1180183286":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2524722535":"2024-09-12T23:59:21.380056+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/1180183286":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3141588653":"2024-09-12T23:59:21.380056+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:59:28.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f448c0a2d80 msgr2=0x7f448c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:28.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f448c0a2d80 0x7f448c0a5240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f44a40fea80 tx=0x7f449800b390 comp rx=0 tx=0).stop 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4100a80 msgr2=0x7f44a41985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4100a80 0x7f44a41985f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4494009230 tx=0x7f4494004270 comp rx=0 tx=0).stop 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 shutdown_connections 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f448c0a2d80 0x7f448c0a5240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a4106a80 0x7f44a419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44a4101420 0x7f44a4198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 --2- 172.21.15.60:0/52354322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44a4100a80 0x7f44a41985f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 >> 172.21.15.60:0/52354322 conn(0x7f44a40fc7a0 msgr2=0x7f44a406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 shutdown_connections 2024-09-11T23:59:28.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:28.058+0000 7f44aa1f2640 1 -- 172.21.15.60:0/52354322 wait complete. 2024-09-11T23:59:28.830 DEBUG:tasks.fwd_scrub:Yielding 2024-09-11T23:59:28.830 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T23:59:29.132 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T23:59:29.132 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-11T23:59:29.132 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-11T23:59:29.133 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-11T23:59:29.133 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-11T23:59:29.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-11T23:59:29.134 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:28 smithi192 ceph-mon[35487]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:29.135 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:28 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/52354322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:29.135 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:28 smithi105 ceph-mon[34805]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:29.135 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:28 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/52354322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:29.135 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:28 smithi060 ceph-mon[30953]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T23:59:29.135 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:28 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/52354322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:29.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 -- 172.21.15.60:0/1599825522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 msgr2=0x7fed98103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/1599825522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 0x7fed98103060 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fed88009900 tx=0x7fed8802a480 comp rx=0 tx=0).stop 2024-09-11T23:59:29.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 -- 172.21.15.60:0/1599825522 shutdown_connections 2024-09-11T23:59:29.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/1599825522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed9810c0d0 0x7fed9810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/1599825522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed981035a0 0x7fed9810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/1599825522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 0x7fed98103060 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 -- 172.21.15.60:0/1599825522 >> 172.21.15.60:0/1599825522 conn(0x7fed98077990 msgr2=0x7fed980fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 -- 172.21.15.60:0/1599825522 shutdown_connections 2024-09-11T23:59:29.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.257+0000 7fed9cb9f640 1 -- 172.21.15.60:0/1599825522 wait complete. 2024-09-11T23:59:29.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9cb9f640 1 Processor -- start 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9cb9f640 1 -- start start 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9cb9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 0x7fed981008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9cb9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed981035a0 0x7fed98100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9cb9f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9810c0d0 0x7fed98101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9cb9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fed98111fd0 con 0x7fed98102c80 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9cb9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed98111e50 con 0x7fed981035a0 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9cb9f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fed98112150 con 0x7fed9810c0d0 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 0x7fed981008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 0x7fed981008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53624/0 (socket says 172.21.15.60:53624) 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed9659c640 1 -- 172.21.15.60:0/3591811121 learned_addr learned my addr 172.21.15.60:0/3591811121 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:29.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed96d9d640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9810c0d0 0x7fed98101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.258+0000 7fed95d9b640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed981035a0 0x7fed98100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed9659c640 1 -- 172.21.15.60:0/3591811121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9810c0d0 msgr2=0x7fed98101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed9659c640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9810c0d0 0x7fed98101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed9659c640 1 -- 172.21.15.60:0/3591811121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed981035a0 msgr2=0x7fed98100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed9659c640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed981035a0 0x7fed98100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed9659c640 1 -- 172.21.15.60:0/3591811121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed981a6920 con 0x7fed98102c80 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed9659c640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 0x7fed981008d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fed88006010 tx=0x7fed880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed877fe640 1 -- 172.21.15.60:0/3591811121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8803f030 con 0x7fed98102c80 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed981a6bb0 con 0x7fed98102c80 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed877fe640 1 -- 172.21.15.60:0/3591811121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed88003d00 con 0x7fed98102c80 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed877fe640 1 -- 172.21.15.60:0/3591811121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88035070 con 0x7fed98102c80 2024-09-11T23:59:29.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.259+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed981a70f0 con 0x7fed98102c80 2024-09-11T23:59:29.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.260+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed98103060 con 0x7fed98102c80 2024-09-11T23:59:29.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.262+0000 7fed877fe640 1 -- 172.21.15.60:0/3591811121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fed88042030 con 0x7fed98102c80 2024-09-11T23:59:29.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.262+0000 7fed877fe640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fed800a2e40 0x7fed800a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.263+0000 7fed95d9b640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fed800a2e40 0x7fed800a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.263+0000 7fed877fe640 1 -- 172.21.15.60:0/3591811121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fed880efd40 con 0x7fed98102c80 2024-09-11T23:59:29.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.263+0000 7fed95d9b640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fed800a2e40 0x7fed800a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed98102360 tx=0x7fed8c00b360 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.266+0000 7fed877fe640 1 -- 172.21.15.60:0/3591811121 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed880bc2b0 con 0x7fed98102c80 2024-09-11T23:59:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:29.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.451+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fed981a73a0 con 0x7fed98102c80 2024-09-11T23:59:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.455+0000 7fed877fe640 1 -- 172.21.15.60:0/3591811121 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v27)=0 v27) ==== 129+0+0 (secure 0 0 0) 0x7fed880b6e20 con 0x7fed98102c80 2024-09-11T23:59:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fed800a2e40 msgr2=0x7fed800a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fed800a2e40 0x7fed800a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fed98102360 tx=0x7fed8c00b360 comp rx=0 tx=0).stop 2024-09-11T23:59:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 msgr2=0x7fed981008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 0x7fed981008d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fed88006010 tx=0x7fed880042f0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 shutdown_connections 2024-09-11T23:59:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fed800a2e40 0x7fed800a5300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed9810c0d0 0x7fed98101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed981035a0 0x7fed98100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 --2- 172.21.15.60:0/3591811121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed98102c80 0x7fed981008d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 >> 172.21.15.60:0/3591811121 conn(0x7fed98077990 msgr2=0x7fed980fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 shutdown_connections 2024-09-11T23:59:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.457+0000 7fed9cb9f640 1 -- 172.21.15.60:0/3591811121 wait complete. 2024-09-11T23:59:29.469 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-11T23:59:29.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 -- 172.21.15.60:0/3167847939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e0101390 msgr2=0x7f95e010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 --2- 172.21.15.60:0/3167847939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e0101390 0x7f95e010d8c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009cd0 tx=0x7f95d802a8e0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 -- 172.21.15.60:0/3167847939 shutdown_connections 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 --2- 172.21.15.60:0/3167847939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e0101390 0x7f95e010d8c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 --2- 172.21.15.60:0/3167847939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e01009f0 0x7f95e0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 --2- 172.21.15.60:0/3167847939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e0106a00 0x7f95e0106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 -- 172.21.15.60:0/3167847939 >> 172.21.15.60:0/3167847939 conn(0x7f95e00fc6b0 msgr2=0x7f95e00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 -- 172.21.15.60:0/3167847939 shutdown_connections 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.576+0000 7f95e876d640 1 -- 172.21.15.60:0/3167847939 wait complete. 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e876d640 1 Processor -- start 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e876d640 1 -- start start 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e876d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e01009f0 0x7f95e0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e876d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e0101390 0x7f95e0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e876d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e0106a00 0x7f95e019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e876d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0110f60 con 0x7f95e01009f0 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e876d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0110de0 con 0x7f95e0101390 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e876d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01110e0 con 0x7f95e0106a00 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e6509640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e01009f0 0x7f95e0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e6509640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e01009f0 0x7f95e0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53642/0 (socket says 172.21.15.60:53642) 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e6509640 1 -- 172.21.15.60:0/305853963 learned_addr learned my addr 172.21.15.60:0/305853963 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e6d0a640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e0106a00 0x7f95e019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e5d08640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e0101390 0x7f95e0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e6509640 1 -- 172.21.15.60:0/305853963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e0106a00 msgr2=0x7f95e019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e6509640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e0106a00 0x7f95e019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e6509640 1 -- 172.21.15.60:0/305853963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e0101390 msgr2=0x7f95e0198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.577+0000 7f95e6509640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e0101390 0x7f95e0198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.578+0000 7f95e6509640 1 -- 172.21.15.60:0/305853963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e019d3f0 con 0x7f95e01009f0 2024-09-11T23:59:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.578+0000 7f95e6509640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e01009f0 0x7f95e0198400 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00e9f0 tx=0x7f95dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.578+0000 7f95d77fe640 1 -- 172.21.15.60:0/305853963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc00cd80 con 0x7f95e01009f0 2024-09-11T23:59:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.578+0000 7f95d77fe640 1 -- 172.21.15.60:0/305853963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95dc010930 con 0x7f95e01009f0 2024-09-11T23:59:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.578+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e019d6e0 con 0x7f95e01009f0 2024-09-11T23:59:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.578+0000 7f95d77fe640 1 -- 172.21.15.60:0/305853963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc018b00 con 0x7f95e01009f0 2024-09-11T23:59:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.578+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e01a4f70 con 0x7f95e01009f0 2024-09-11T23:59:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.579+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e0100e50 con 0x7f95e01009f0 2024-09-11T23:59:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.580+0000 7f95d77fe640 1 -- 172.21.15.60:0/305853963 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f95dc018ca0 con 0x7f95e01009f0 2024-09-11T23:59:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.581+0000 7f95d77fe640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95cc0a2e40 0x7f95cc0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.581+0000 7f95d77fe640 1 -- 172.21.15.60:0/305853963 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f95dc0cfc70 con 0x7f95e01009f0 2024-09-11T23:59:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.581+0000 7f95e5d08640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95cc0a2e40 0x7f95cc0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.581+0000 7f95e5d08640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95cc0a2e40 0x7f95cc0a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f95e006b3e0 tx=0x7f95d0005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.584+0000 7f95d77fe640 1 -- 172.21.15.60:0/305853963 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95dc09c770 con 0x7f95e01009f0 2024-09-11T23:59:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.770+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f95e01a51e0 con 0x7f95e01009f0 2024-09-11T23:59:29.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.774+0000 7f95d77fe640 1 -- 172.21.15.60:0/305853963 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f95dc09c070 con 0x7f95e01009f0 2024-09-11T23:59:29.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95cc0a2e40 msgr2=0x7f95cc0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95cc0a2e40 0x7f95cc0a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f95e006b3e0 tx=0x7f95d0005f90 comp rx=0 tx=0).stop 2024-09-11T23:59:29.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e01009f0 msgr2=0x7f95e0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e01009f0 0x7f95e0198400 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00e9f0 tx=0x7f95dc00eeb0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 shutdown_connections 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95cc0a2e40 0x7f95cc0a5300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e0106a00 0x7f95e019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e0101390 0x7f95e0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 --2- 172.21.15.60:0/305853963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e01009f0 0x7f95e0198400 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 >> 172.21.15.60:0/305853963 conn(0x7f95e00fc6b0 msgr2=0x7f95e0104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 shutdown_connections 2024-09-11T23:59:29.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.776+0000 7f95e876d640 1 -- 172.21.15.60:0/305853963 wait complete. 2024-09-11T23:59:29.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-11T23:59:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 -- 172.21.15.60:0/3765451925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc101ac0 msgr2=0x7fcfbc101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/3765451925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc101ac0 0x7fcfbc101f20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009890 tx=0x7fcfa402a380 comp rx=0 tx=0).stop 2024-09-11T23:59:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 -- 172.21.15.60:0/3765451925 shutdown_connections 2024-09-11T23:59:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/3765451925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfbc102460 0x7fcfbc10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/3765451925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc101ac0 0x7fcfbc101f20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/3765451925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfbc107ad0 0x7fcfbc107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 -- 172.21.15.60:0/3765451925 >> 172.21.15.60:0/3765451925 conn(0x7fcfbc0fd820 msgr2=0x7fcfbc0ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 -- 172.21.15.60:0/3765451925 shutdown_connections 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 -- 172.21.15.60:0/3765451925 wait complete. 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.898+0000 7fcfc09b7640 1 Processor -- start 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfc09b7640 1 -- start start 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfc09b7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfbc101ac0 0x7fcfbc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfc09b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfbc102460 0x7fcfbc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfc09b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc107ad0 0x7fcfbc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfc09b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc112030 con 0x7fcfbc107ad0 2024-09-11T23:59:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfc09b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc111eb0 con 0x7fcfbc102460 2024-09-11T23:59:29.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfc09b7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc1121b0 con 0x7fcfbc101ac0 2024-09-11T23:59:29.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc107ad0 0x7fcfbc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc107ad0 0x7fcfbc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53658/0 (socket says 172.21.15.60:53658) 2024-09-11T23:59:29.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 -- 172.21.15.60:0/2098331618 learned_addr learned my addr 172.21.15.60:0/2098331618 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:29.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfba59c640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfbc101ac0 0x7fcfbc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfb3fff640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfbc102460 0x7fcfbc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 -- 172.21.15.60:0/2098331618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfbc101ac0 msgr2=0x7fcfbc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfbc101ac0 0x7fcfbc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 -- 172.21.15.60:0/2098331618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfbc102460 msgr2=0x7fcfbc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfbc102460 0x7fcfbc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 -- 172.21.15.60:0/2098331618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc1a6900 con 0x7fcfbc107ad0 2024-09-11T23:59:29.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.899+0000 7fcfbad9d640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc107ad0 0x7fcfbc074f70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009fd0 tx=0x7fcfb400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.900+0000 7fcfb37fe640 1 -- 172.21.15.60:0/2098331618 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4004b20 con 0x7fcfbc107ad0 2024-09-11T23:59:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.900+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc1a6bf0 con 0x7fcfbc107ad0 2024-09-11T23:59:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.900+0000 7fcfb37fe640 1 -- 172.21.15.60:0/2098331618 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcfb4004cc0 con 0x7fcfbc107ad0 2024-09-11T23:59:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.900+0000 7fcfb37fe640 1 -- 172.21.15.60:0/2098331618 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb400b630 con 0x7fcfbc107ad0 2024-09-11T23:59:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.900+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc1a70c0 con 0x7fcfbc107ad0 2024-09-11T23:59:29.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.901+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc101f20 con 0x7fcfbc107ad0 2024-09-11T23:59:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.903+0000 7fcfb37fe640 1 -- 172.21.15.60:0/2098331618 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fcfb401d020 con 0x7fcfbc107ad0 2024-09-11T23:59:29.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.904+0000 7fcfb37fe640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcfa80a2e40 0x7fcfa80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.904+0000 7fcfb37fe640 1 -- 172.21.15.60:0/2098331618 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fcfb40cff10 con 0x7fcfbc107ad0 2024-09-11T23:59:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.904+0000 7fcfba59c640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcfa80a2e40 0x7fcfa80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.904+0000 7fcfba59c640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcfa80a2e40 0x7fcfa80a5300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009b50 tx=0x7fcfac005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.906+0000 7fcfb37fe640 1 -- 172.21.15.60:0/2098331618 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcfb4024030 con 0x7fcfbc107ad0 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 -- 172.21.15.60:0/1224339625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4106f20 msgr2=0x7f8de410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 --2- 172.21.15.60:0/1224339625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4106f20 0x7f8de410eaa0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009ca0 tx=0x7f8ddc02a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 -- 172.21.15.60:0/1224339625 shutdown_connections 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 --2- 172.21.15.60:0/1224339625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4106f20 0x7f8de410eaa0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 --2- 172.21.15.60:0/1224339625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8de41027a0 0x7f8de41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 --2- 172.21.15.60:0/1224339625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8de4101df0 0x7f8de41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 -- 172.21.15.60:0/1224339625 >> 172.21.15.60:0/1224339625 conn(0x7f8de40fd8b0 msgr2=0x7f8de40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 -- 172.21.15.60:0/1224339625 shutdown_connections 2024-09-11T23:59:29.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.927+0000 7f8debcfd640 1 -- 172.21.15.60:0/1224339625 wait complete. 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8debcfd640 1 Processor -- start 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8debcfd640 1 -- start start 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8debcfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4101df0 0x7f8de40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8debcfd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8de41027a0 0x7f8de4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8debcfd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8de4106f20 0x7f8de4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8debcfd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41120a0 con 0x7f8de4101df0 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8debcfd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4111f20 con 0x7f8de41027a0 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8debcfd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4112220 con 0x7f8de4106f20 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8de9a99640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4101df0 0x7f8de40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8de9a99640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4101df0 0x7f8de40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53676/0 (socket says 172.21.15.60:53676) 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8de9a99640 1 -- 172.21.15.60:0/3575670 learned_addr learned my addr 172.21.15.60:0/3575670 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:29.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8dea29a640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8de4106f20 0x7f8de4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8de9298640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8de41027a0 0x7f8de4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8de9a99640 1 -- 172.21.15.60:0/3575670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8de4106f20 msgr2=0x7f8de4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.928+0000 7f8de9a99640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8de4106f20 0x7f8de4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8de9a99640 1 -- 172.21.15.60:0/3575670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8de41027a0 msgr2=0x7f8de4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8de9a99640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8de41027a0 0x7f8de4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8de9a99640 1 -- 172.21.15.60:0/3575670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de41a6900 con 0x7f8de4101df0 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8de9298640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8de41027a0 0x7f8de4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8de9a99640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4101df0 0x7f8de40744f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8de000d950 tx=0x7f8de000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8dd6ffd640 1 -- 172.21.15.60:0/3575670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0017070 con 0x7f8de4101df0 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8dd6ffd640 1 -- 172.21.15.60:0/3575670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8de0009c30 con 0x7f8de4101df0 2024-09-11T23:59:29.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8dd6ffd640 1 -- 172.21.15.60:0/3575670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de000f740 con 0x7f8de4101df0 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8debcfd640 1 -- 172.21.15.60:0/3575670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de41a6bf0 con 0x7f8de4101df0 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.929+0000 7f8debcfd640 1 -- 172.21.15.60:0/3575670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de41a7130 con 0x7f8de4101df0 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.931+0000 7f8dd6ffd640 1 -- 172.21.15.60:0/3575670 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f8de0010a80 con 0x7f8de4101df0 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dee0d6740 1 Processor -- start 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dee0d6740 1 -- start start 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf7b60 0x562794cf7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf8480 0x562794d02800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d05130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562794c5d280 con 0x562794d02d40 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562794c04b10 con 0x562794cf7b60 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562794c59240 con 0x562794cf8480 2024-09-11T23:59:29.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dd6ffd640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8dd00a2d80 0x7f8dd00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8de9298640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d05130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8de9298640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d05130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53682/0 (socket says 172.21.15.60:53682) 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8de9298640 1 -- 172.21.15.60:0/2436023614 learned_addr learned my addr 172.21.15.60:0/2436023614 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8de9a99640 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf8480 0x562794d02800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.932+0000 7f8dea29a640 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf7b60 0x562794cf7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8dea29a640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8dd00a2d80 0x7f8dd00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8de9298640 1 -- 172.21.15.60:0/2436023614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf8480 msgr2=0x562794d02800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8de9298640 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf8480 0x562794d02800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8de9298640 1 -- 172.21.15.60:0/2436023614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf7b60 msgr2=0x562794cf7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8de9298640 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf7b60 0x562794cf7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8de9298640 1 -- 172.21.15.60:0/2436023614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562794c111f0 con 0x562794d02d40 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8dd6ffd640 1 -- 172.21.15.60:0/3575670 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8de00cf340 con 0x7f8de4101df0 2024-09-11T23:59:29.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8de9298640 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d05130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800bcb0 tx=0x7f8dd800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7ff28ae21c4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8dea29a640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8dd00a2d80 0x7f8dd00a5240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc004af0 tx=0x7f8ddc009360 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8dcffff640 1 -- 172.21.15.60:0/2436023614 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8015070 con 0x562794d02d40 2024-09-11T23:59:29.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8dcffff640 1 -- 172.21.15.60:0/2436023614 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8dd8011940 con 0x562794d02d40 2024-09-11T23:59:29.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.933+0000 7f8dcffff640 1 -- 172.21.15.60:0/2436023614 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8010ad0 con 0x562794d02d40 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.934+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2436023614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 msgr2=0x562794d05130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.934+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d05130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800bcb0 tx=0x7f8dd800f730 comp rx=0 tx=0).stop 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.934+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2436023614 shutdown_connections 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.934+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d05130 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.934+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf8480 0x562794d02800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.934+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2436023614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf7b60 0x562794cf7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.934+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2436023614 >> 172.21.15.60:0/2436023614 conn(0x562794cf40f0 msgr2=0x562794cf44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.935+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2436023614 shutdown_connections 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.935+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2436023614 wait complete. 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.935+0000 7f8dee0d6740 1 -- start start 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.935+0000 7f8dee0d6740 1 Processor -- start 2024-09-11T23:59:29.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf7b60 0x562794cffce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf8480 0x562794d00220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794d02d40 0x562794d00760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562794d05910 con 0x562794cf7b60 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562794c17f10 con 0x562794cf8480 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562794d05a90 con 0x562794d02d40 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9a99640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf7b60 0x562794cffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dee0d6740 10 client.0 _ll_register_callbacks cb 0x562794be0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9a99640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf7b60 0x562794cffce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53688/0 (socket says 172.21.15.60:53688) 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9a99640 1 -- 172.21.15.60:0/3096546879 learned_addr learned my addr 172.21.15.60:0/3096546879 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9298640 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf8480 0x562794d00220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dea29a640 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794d02d40 0x562794d00760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9a99640 1 -- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794d02d40 msgr2=0x562794d00760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:29.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9a99640 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794d02d40 0x562794d00760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9a99640 1 -- 172.21.15.60:0/3096546879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf8480 msgr2=0x562794d00220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9a99640 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf8480 0x562794d00220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8de9a99640 1 -- 172.21.15.60:0/3096546879 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627949ce6a0 con 0x562794cf7b60 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.936+0000 7f8dea29a640 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794d02d40 0x562794d00760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8de9a99640 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf7b60 0x562794cffce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8de0010fd0 tx=0x7f8de009b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0af19678ca0006e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/3096546879 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0020070 con 0x562794cf7b60 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/3096546879 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8de0097d50 con 0x562794cf7b60 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 1 -- 172.21.15.60:0/3096546879 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd8011940 con 0x562794cf7b60 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/3096546879 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8de009b6e0 con 0x562794cf7b60 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 10 client.15366 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:29.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 1 -- 172.21.15.60:0/3096546879 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562794d11630 con 0x562794cf7b60 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/3096546879 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8dd8011940 con 0x562794cf7b60 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/3096546879 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8de0092030 con 0x562794cf7b60 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 10 client.15366 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 10 client.15366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 20 client.15366 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562794d12b40 0x562794d14f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 4 client.15366 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.937+0000 7f8dee0d6740 1 -- 172.21.15.60:0/3096546879 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562794c6a7f0 con 0x562794d12b40 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.938+0000 7f8de9298640 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562794d12b40 0x562794d14f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.938+0000 7f8dcd7fa640 10 client.15366 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.938+0000 7f8de9298640 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562794d12b40 0x562794d14f70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8eed1a00a5032b9 server_cookie=60604c57a2e882e5 in_seq=0 out_seq=0 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/3096546879 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562794c6a7f0 con 0x562794d12b40 2024-09-11T23:59:29.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dcd7fa640 10 client.15366 handle_command_reply: tid=0 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 client.15366 shutdown 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 -- 172.21.15.60:0/3096546879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf7b60 msgr2=0x562794cffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf7b60 0x562794cffce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8de0010fd0 tx=0x7f8de009b040 comp rx=0 tx=0).stop 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 -- 172.21.15.60:0/3096546879 shutdown_connections 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562794d12b40 0x562794d14f70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794d02d40 0x562794d00760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794cf8480 0x562794d00220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/3096546879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf7b60 0x562794cffce0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 -- 172.21.15.60:0/3096546879 >> 172.21.15.60:0/3096546879 conn(0x562794cf40f0 msgr2=0x562794cf3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dcd7fa640 0 client.15366 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 -- 172.21.15.60:0/3096546879 shutdown_connections 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 1 -- 172.21.15.60:0/3096546879 wait complete. 2024-09-11T23:59:29.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.939+0000 7f8dee0d6740 20 client.15366 trim_cache size 0 max 16384 2024-09-11T23:59:29.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dee0d6740 1 Processor -- start 2024-09-11T23:59:29.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dee0d6740 1 -- start start 2024-09-11T23:59:29.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 0x562794cfa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf8480 0x562794d1a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d02d40 0x562794d1ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41afa30 con 0x562794cf8480 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b1570 con 0x562794d02d40 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dee0d6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b0100 con 0x562794cf7b60 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9298640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf8480 0x562794d1a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9298640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf8480 0x562794d1a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53692/0 (socket says 172.21.15.60:53692) 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9298640 1 -- 172.21.15.60:0/2685634627 learned_addr learned my addr 172.21.15.60:0/2685634627 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9a99640 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 0x562794cfa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8dea29a640 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d02d40 0x562794d1ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9298640 1 -- 172.21.15.60:0/2685634627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 msgr2=0x562794cfa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:29.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9298640 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 0x562794cfa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9298640 1 -- 172.21.15.60:0/2685634627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d02d40 msgr2=0x562794d1ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:29.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9298640 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d02d40 0x562794d1ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.957+0000 7f8de9298640 1 -- 172.21.15.60:0/2685634627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562794cef830 con 0x562794cf8480 2024-09-11T23:59:29.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.958+0000 7f8de9298640 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf8480 0x562794d1a840 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800bcb0 tx=0x7f8dd800b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72121ce1be05bc95 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.958+0000 7f8dcf7fe640 1 -- 172.21.15.60:0/2685634627 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8015050 con 0x562794cf8480 2024-09-11T23:59:29.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.958+0000 7f8dcf7fe640 1 -- 172.21.15.60:0/2685634627 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8dd8005040 con 0x562794cf8480 2024-09-11T23:59:29.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.958+0000 7f8dcf7fe640 1 -- 172.21.15.60:0/2685634627 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8010980 con 0x562794cf8480 2024-09-11T23:59:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2685634627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf8480 msgr2=0x562794d1a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf8480 0x562794d1a840 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800bcb0 tx=0x7f8dd800b5a0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2685634627 shutdown_connections 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d02d40 0x562794d1ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794cf8480 0x562794d1a840 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2685634627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 0x562794cfa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2685634627 >> 172.21.15.60:0/2685634627 conn(0x562794cf40f0 msgr2=0x562794d01c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2685634627 shutdown_connections 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2685634627 wait complete. 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 -- start start 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.959+0000 7f8dee0d6740 1 Processor -- start 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 0x562794d06dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8dee0d6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d07310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9298640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d07310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9298640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d07310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53696/0 (socket says 172.21.15.60:53696) 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9298640 1 -- 172.21.15.60:0/2359742983 learned_addr learned my addr 172.21.15.60:0/2359742983 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d07a00 0x562794d7c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b0ea0 con 0x562794d02d40 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b07d0 con 0x562794d07a00 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41ada10 con 0x562794cf7b60 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9a99640 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 0x562794d06dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8dee0d6740 10 client.0 _ll_register_callbacks cb 0x7f8de00cc850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9298640 1 -- 172.21.15.60:0/2359742983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 msgr2=0x562794d06dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9298640 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 0x562794d06dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9298640 1 -- 172.21.15.60:0/2359742983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d07a00 msgr2=0x562794d7c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9298640 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d07a00 0x562794d7c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.960+0000 7f8de9298640 1 -- 172.21.15.60:0/2359742983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562794d7d020 con 0x562794d02d40 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8de9298640 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d07310 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800f770 tx=0x7f8dd800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc67449a4df8b933 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/2359742983 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8035020 con 0x562794d02d40 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/2359742983 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8dd8004230 con 0x562794d02d40 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd8005040 con 0x562794d02d40 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/2359742983 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dd8015020 con 0x562794d02d40 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dee0d6740 10 client.15372 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562794d7e340 con 0x562794d02d40 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/2359742983 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8dd8004680 con 0x562794d02d40 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/2359742983 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8dd80035f0 con 0x562794d02d40 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.961+0000 7f8dee0d6740 10 client.15372 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:29.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.962+0000 7f8dee0d6740 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T23:59:29.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.962+0000 7f8dee0d6740 20 client.15372 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:29.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.962+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562794d7e8b0 0x562794d80ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:29.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.962+0000 7f8dee0d6740 4 client.15372 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.962+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f8dd8005040 con 0x562794d7e8b0 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.962+0000 7f8de9a99640 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562794d7e8b0 0x562794d80ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.962+0000 7f8dcd7fa640 10 client.15372 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.962+0000 7f8de9a99640 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562794d7e8b0 0x562794d80ca0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a89f02b21c5a979b server_cookie=215b55fb6168fe5 in_seq=0 out_seq=0 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.963+0000 7f8dcd7fa640 1 -- 172.21.15.60:0/2359742983 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f8dd8005040 con 0x562794d7e8b0 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dcd7fa640 10 client.15372 handle_command_reply: tid=0 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 client.15372 shutdown 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 msgr2=0x562794d07310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d07310 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800f770 tx=0x7f8dd800be20 comp rx=0 tx=0).stop 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 shutdown_connections 2024-09-11T23:59:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562794d7e8b0 0x562794d80ca0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562794d07a00 0x562794d7c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562794d02d40 0x562794d07310 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 --2- 172.21.15.60:0/2359742983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562794cf7b60 0x562794d06dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 >> 172.21.15.60:0/2359742983 conn(0x562794cf40f0 msgr2=0x562794d01150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dcd7fa640 0 client.15372 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 shutdown_connections 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 1 -- 172.21.15.60:0/2359742983 wait complete. 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.964+0000 7f8dee0d6740 20 client.15372 trim_cache size 0 max 16384 2024-09-11T23:59:29.970 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-11T23:59:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "d4cf1b60-16e6-4585-83af-4fafb42348e2", 2024-09-11T23:59:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-11T23:59:29.971 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 -- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8dd00a2d80 msgr2=0x7f8dd00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8dd00a2d80 0x7f8dd00a5240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc004af0 tx=0x7f8ddc009360 comp rx=0 tx=0).stop 2024-09-11T23:59:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 -- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4101df0 msgr2=0x7f8de40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4101df0 0x7f8de40744f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8de000d950 tx=0x7f8de000de10 comp rx=0 tx=0).stop 2024-09-11T23:59:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 -- 172.21.15.60:0/3575670 shutdown_connections 2024-09-11T23:59:29.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8dd00a2d80 0x7f8dd00a5240 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8de4106f20 0x7f8de4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8de41027a0 0x7f8de4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 --2- 172.21.15.60:0/3575670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8de4101df0 0x7f8de40744f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:29.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 -- 172.21.15.60:0/3575670 >> 172.21.15.60:0/3575670 conn(0x7f8de40fd8b0 msgr2=0x7f8de40febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:29.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 -- 172.21.15.60:0/3575670 shutdown_connections 2024-09-11T23:59:29.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:29.965+0000 7f8debcfd640 1 -- 172.21.15.60:0/3575670 wait complete. 2024-09-11T23:59:30.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.094+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fcfbc1a73f0 con 0x7fcfbc107ad0 2024-09-11T23:59:30.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.098+0000 7fcfb37fe640 1 -- 172.21.15.60:0/2098331618 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7fcfb4096e20 con 0x7fcfbc107ad0 2024-09-11T23:59:30.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcfa80a2e40 msgr2=0x7fcfa80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcfa80a2e40 0x7fcfa80a5300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009b50 tx=0x7fcfac005f90 comp rx=0 tx=0).stop 2024-09-11T23:59:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc107ad0 msgr2=0x7fcfbc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc107ad0 0x7fcfbc074f70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009fd0 tx=0x7fcfb400c800 comp rx=0 tx=0).stop 2024-09-11T23:59:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 shutdown_connections 2024-09-11T23:59:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcfa80a2e40 0x7fcfa80a5300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfbc107ad0 0x7fcfbc074f70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfbc102460 0x7fcfbc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 --2- 172.21.15.60:0/2098331618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfbc101ac0 0x7fcfbc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 >> 172.21.15.60:0/2098331618 conn(0x7fcfbc0fd820 msgr2=0x7fcfbc0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 shutdown_connections 2024-09-11T23:59:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.100+0000 7fcfc09b7640 1 -- 172.21.15.60:0/2098331618 wait complete. 2024-09-11T23:59:30.112 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-11T23:59:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 -- 172.21.15.60:0/1601118161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 msgr2=0x7fddd4107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/1601118161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 0x7fddd4107eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009cd0 tx=0x7fddd002a8e0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 -- 172.21.15.60:0/1601118161 shutdown_connections 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/1601118161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddd4102460 0x7fddd410e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/1601118161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd4101ac0 0x7fddd4101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/1601118161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 0x7fddd4107eb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 -- 172.21.15.60:0/1601118161 >> 172.21.15.60:0/1601118161 conn(0x7fddd40fd820 msgr2=0x7fddd40ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 -- 172.21.15.60:0/1601118161 shutdown_connections 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 -- 172.21.15.60:0/1601118161 wait complete. 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.232+0000 7fdddbb9f640 1 Processor -- start 2024-09-11T23:59:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fdddbb9f640 1 -- start start 2024-09-11T23:59:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fdddbb9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd4101ac0 0x7fddd40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:30.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fdddbb9f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddd4102460 0x7fddd4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fdddbb9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 0x7fddd4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fdddbb9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4112030 con 0x7fddd4107ad0 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fdddbb9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4111eb0 con 0x7fddd4101ac0 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fdddbb9f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41121b0 con 0x7fddd4102460 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 0x7fddd4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 0x7fddd4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53714/0 (socket says 172.21.15.60:53714) 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 -- 172.21.15.60:0/3442557040 learned_addr learned my addr 172.21.15.60:0/3442557040 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddd913a640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddd4102460 0x7fddd4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddd993b640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd4101ac0 0x7fddd40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 -- 172.21.15.60:0/3442557040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddd4102460 msgr2=0x7fddd4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddd4102460 0x7fddd4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 -- 172.21.15.60:0/3442557040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd4101ac0 msgr2=0x7fddd40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd4101ac0 0x7fddd40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 -- 172.21.15.60:0/3442557040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd41a6960 con 0x7fddd4107ad0 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddd993b640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd4101ac0 0x7fddd40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.233+0000 7fddda13c640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 0x7fddd4074f70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e970 tx=0x7fddcc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.234+0000 7fddcaffd640 1 -- 172.21.15.60:0/3442557040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00ccc0 con 0x7fddd4107ad0 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.234+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd41a6c50 con 0x7fddd4107ad0 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.234+0000 7fddcaffd640 1 -- 172.21.15.60:0/3442557040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fddcc00ce60 con 0x7fddd4107ad0 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.234+0000 7fddcaffd640 1 -- 172.21.15.60:0/3442557040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc010690 con 0x7fddd4107ad0 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.234+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd41a71f0 con 0x7fddd4107ad0 2024-09-11T23:59:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.235+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd4101f20 con 0x7fddd4107ad0 2024-09-11T23:59:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.236+0000 7fddcaffd640 1 -- 172.21.15.60:0/3442557040 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fddcc0046c0 con 0x7fddd4107ad0 2024-09-11T23:59:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.237+0000 7fddcaffd640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fddc00a2e40 0x7fddc00a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.237+0000 7fddd993b640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fddc00a2e40 0x7fddc00a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.237+0000 7fddcaffd640 1 -- 172.21.15.60:0/3442557040 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fddcc0cf9b0 con 0x7fddd4107ad0 2024-09-11T23:59:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.237+0000 7fddd993b640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fddc00a2e40 0x7fddc00a5300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fddd0004af0 tx=0x7fddd0000f40 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.241+0000 7fddcaffd640 1 -- 172.21.15.60:0/3442557040 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddcc09c4b0 con 0x7fddd4107ad0 2024-09-11T23:59:30.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.439+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fddd40fe5d0 con 0x7fddc00a2e40 2024-09-11T23:59:30.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.502+0000 7fddcaffd640 1 -- 172.21.15.60:0/3442557040 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fddd40fe5d0 con 0x7fddc00a2e40 2024-09-11T23:59:30.501 INFO:teuthology.orchestra.run.smithi060.stdout:Schedule set for path / 2024-09-11T23:59:30.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fddc00a2e40 msgr2=0x7fddc00a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fddc00a2e40 0x7fddc00a5300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fddd0004af0 tx=0x7fddd0000f40 comp rx=0 tx=0).stop 2024-09-11T23:59:30.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 msgr2=0x7fddd4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 0x7fddd4074f70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e970 tx=0x7fddcc00ed70 comp rx=0 tx=0).stop 2024-09-11T23:59:30.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 shutdown_connections 2024-09-11T23:59:30.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fddc00a2e40 0x7fddc00a5300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddd4107ad0 0x7fddd4074f70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddd4102460 0x7fddd4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 --2- 172.21.15.60:0/3442557040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddd4101ac0 0x7fddd40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 >> 172.21.15.60:0/3442557040 conn(0x7fddd40fd820 msgr2=0x7fddd40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:30.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 shutdown_connections 2024-09-11T23:59:30.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.504+0000 7fdddbb9f640 1 -- 172.21.15.60:0/3442557040 wait complete. 2024-09-11T23:59:30.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-11T23:59:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.620+0000 7fecebfb7640 1 -- 172.21.15.60:0/2722495491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4100890 msgr2=0x7fece4100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.620+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2722495491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4100890 0x7fece4100c70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fece0009900 tx=0x7fece002a410 comp rx=0 tx=0).stop 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 -- 172.21.15.60:0/2722495491 shutdown_connections 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2722495491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fece410e440 0x7fece4110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2722495491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece4101240 0x7fece410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2722495491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4100890 0x7fece4100c70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 -- 172.21.15.60:0/2722495491 >> 172.21.15.60:0/2722495491 conn(0x7fece4077990 msgr2=0x7fece40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 -- 172.21.15.60:0/2722495491 shutdown_connections 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 -- 172.21.15.60:0/2722495491 wait complete. 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 Processor -- start 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 -- start start 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece4100890 0x7fece419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4101240 0x7fece419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fece410e440 0x7fece419ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fece41141e0 con 0x7fece4101240 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fece4114060 con 0x7fece4100890 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.621+0000 7fecebfb7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fece4114360 con 0x7fece410e440 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4101240 0x7fece419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4101240 0x7fece419abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53732/0 (socket says 172.21.15.60:53732) 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 -- 172.21.15.60:0/2448924952 learned_addr learned my addr 172.21.15.60:0/2448924952 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9d53640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece4100890 0x7fece419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 -- 172.21.15.60:0/2448924952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fece410e440 msgr2=0x7fece419ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fece410e440 0x7fece419ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 -- 172.21.15.60:0/2448924952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece4100890 msgr2=0x7fece419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece4100890 0x7fece419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 -- 172.21.15.60:0/2448924952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece419f660 con 0x7fece4101240 2024-09-11T23:59:30.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fece9552640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4101240 0x7fece419abb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c920 tx=0x7fecd400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:30.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fecdaffd640 1 -- 172.21.15.60:0/2448924952 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4007c70 con 0x7fece4101240 2024-09-11T23:59:30.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fecdaffd640 1 -- 172.21.15.60:0/2448924952 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecd4007e10 con 0x7fece4101240 2024-09-11T23:59:30.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece419f950 con 0x7fece4101240 2024-09-11T23:59:30.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fecdaffd640 1 -- 172.21.15.60:0/2448924952 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4018940 con 0x7fece4101240 2024-09-11T23:59:30.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.622+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece41a71e0 con 0x7fece4101240 2024-09-11T23:59:30.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.623+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece4100c70 con 0x7fece4101240 2024-09-11T23:59:30.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.625+0000 7fecdaffd640 1 -- 172.21.15.60:0/2448924952 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fecd4018b20 con 0x7fece4101240 2024-09-11T23:59:30.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.625+0000 7fecdaffd640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fecd00a2ec0 0x7fecd00a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:30.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.625+0000 7fece9d53640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fecd00a2ec0 0x7fecd00a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:30.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.625+0000 7fecdaffd640 1 -- 172.21.15.60:0/2448924952 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fecd40cf770 con 0x7fece4101240 2024-09-11T23:59:30.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.626+0000 7fece9d53640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fecd00a2ec0 0x7fecd00a5380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fece0000c00 tx=0x7fece00095f0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:30.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.629+0000 7fecdaffd640 1 -- 172.21.15.60:0/2448924952 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fecd4014030 con 0x7fece4101240 2024-09-11T23:59:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 294 B/s wr, 25 op/s 2024-09-11T23:59:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3591811121' entity='client.admin' 2024-09-11T23:59:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/305853963' entity='client.admin' 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-11T23:59:30.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2098331618' entity='client.admin' 2024-09-11T23:59:30.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 294 B/s wr, 25 op/s 2024-09-11T23:59:30.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3591811121' entity='client.admin' 2024-09-11T23:59:30.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/305853963' entity='client.admin' 2024-09-11T23:59:30.748 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2098331618' entity='client.admin' 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.749 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-11T23:59:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 294 B/s wr, 25 op/s 2024-09-11T23:59:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3591811121' entity='client.admin' 2024-09-11T23:59:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/305853963' entity='client.admin' 2024-09-11T23:59:30.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2098331618' entity='client.admin' 2024-09-11T23:59:30.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-11T23:59:30.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-11T23:59:30.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-11T23:59:30.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-11T23:59:30.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.845+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fece40ffc50 con 0x7fecd00a2ec0 2024-09-11T23:59:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.907+0000 7fecdaffd640 1 -- 172.21.15.60:0/2448924952 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fece40ffc50 con 0x7fecd00a2ec0 2024-09-11T23:59:30.906 INFO:teuthology.orchestra.run.smithi060.stdout:Retention added to path / 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.910+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fecd00a2ec0 msgr2=0x7fecd00a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.910+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fecd00a2ec0 0x7fecd00a5380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fece0000c00 tx=0x7fece00095f0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.910+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4101240 msgr2=0x7fece419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.910+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4101240 0x7fece419abb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c920 tx=0x7fecd400cde0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.911+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 shutdown_connections 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.911+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fecd00a2ec0 0x7fecd00a5380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.911+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fece410e440 0x7fece419ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.911+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fece4101240 0x7fece419abb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.911+0000 7fecebfb7640 1 --2- 172.21.15.60:0/2448924952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fece4100890 0x7fece419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.911+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 >> 172.21.15.60:0/2448924952 conn(0x7fece4077990 msgr2=0x7fece40ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:30.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.911+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 shutdown_connections 2024-09-11T23:59:30.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:30.911+0000 7fecebfb7640 1 -- 172.21.15.60:0/2448924952 wait complete. 2024-09-11T23:59:30.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-11T23:59:31.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 -- 172.21.15.60:0/189714755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b201009b0 msgr2=0x7f5b20100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 --2- 172.21.15.60:0/189714755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b201009b0 0x7f5b20100e10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009930 tx=0x7f5b1402a420 comp rx=0 tx=0).stop 2024-09-11T23:59:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 -- 172.21.15.60:0/189714755 shutdown_connections 2024-09-11T23:59:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 --2- 172.21.15.60:0/189714755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b20101350 0x7f5b2010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 --2- 172.21.15.60:0/189714755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b201009b0 0x7f5b20100e10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 --2- 172.21.15.60:0/189714755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b201069c0 0x7f5b20106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 -- 172.21.15.60:0/189714755 >> 172.21.15.60:0/189714755 conn(0x7f5b20077990 msgr2=0x7f5b200fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 -- 172.21.15.60:0/189714755 shutdown_connections 2024-09-11T23:59:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.039+0000 7f5b28206640 1 -- 172.21.15.60:0/189714755 wait complete. 2024-09-11T23:59:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b28206640 1 Processor -- start 2024-09-11T23:59:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b28206640 1 -- start start 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b28206640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b201009b0 0x7f5b20198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b28206640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b20101350 0x7f5b20198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b28206640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b201069c0 0x7f5b2019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b28206640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20110f70 con 0x7f5b20101350 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b28206640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20110df0 con 0x7f5b201009b0 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b28206640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201110f0 con 0x7f5b201069c0 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b257a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b20101350 0x7f5b20198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b257a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b20101350 0x7f5b20198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53756/0 (socket says 172.21.15.60:53756) 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.040+0000 7f5b257a1640 1 -- 172.21.15.60:0/3977444760 learned_addr learned my addr 172.21.15.60:0/3977444760 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b25fa2640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b201009b0 0x7f5b20198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b267a3640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b201069c0 0x7f5b2019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b257a1640 1 -- 172.21.15.60:0/3977444760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b201069c0 msgr2=0x7f5b2019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b257a1640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b201069c0 0x7f5b2019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b257a1640 1 -- 172.21.15.60:0/3977444760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b201009b0 msgr2=0x7f5b20198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b257a1640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b201009b0 0x7f5b20198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b257a1640 1 -- 172.21.15.60:0/3977444760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2019d430 con 0x7f5b20101350 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b25fa2640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b201009b0 0x7f5b20198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b257a1640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b20101350 0x7f5b20198980 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5b1402a940 tx=0x7f5b140329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b1effd640 1 -- 172.21.15.60:0/3977444760 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1403f030 con 0x7f5b20101350 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2019d6c0 con 0x7f5b20101350 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b1effd640 1 -- 172.21.15.60:0/3977444760 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5b14032df0 con 0x7f5b20101350 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b1effd640 1 -- 172.21.15.60:0/3977444760 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14035070 con 0x7f5b20101350 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.041+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b201a4fb0 con 0x7f5b20101350 2024-09-11T23:59:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.042+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b20100e10 con 0x7f5b20101350 2024-09-11T23:59:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.044+0000 7f5b1effd640 1 -- 172.21.15.60:0/3977444760 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f5b14042030 con 0x7f5b20101350 2024-09-11T23:59:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.044+0000 7f5b1effd640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5b080a2e40 0x7f5b080a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.045+0000 7f5b1effd640 1 -- 172.21.15.60:0/3977444760 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5b140efc60 con 0x7f5b20101350 2024-09-11T23:59:31.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.045+0000 7f5b25fa2640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5b080a2e40 0x7f5b080a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.045+0000 7f5b25fa2640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5b080a2e40 0x7f5b080a5300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b10005fd0 tx=0x7f5b10009500 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.048+0000 7f5b1effd640 1 -- 172.21.15.60:0/3977444760 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b140bc110 con 0x7f5b20101350 2024-09-11T23:59:31.061 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:31.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.263+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f5b20109f60 con 0x7f5b080a2e40 2024-09-11T23:59:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.270+0000 7f5b1effd640 1 -- 172.21.15.60:0/3977444760 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f5b20109f60 con 0x7f5b080a2e40 2024-09-11T23:59:31.269 INFO:teuthology.orchestra.run.smithi060.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T23:59:30", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-11T23:59:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5b080a2e40 msgr2=0x7f5b080a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5b080a2e40 0x7f5b080a5300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b10005fd0 tx=0x7f5b10009500 comp rx=0 tx=0).stop 2024-09-11T23:59:31.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b20101350 msgr2=0x7f5b20198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b20101350 0x7f5b20198980 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5b1402a940 tx=0x7f5b140329c0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 shutdown_connections 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5b080a2e40 0x7f5b080a5300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b201069c0 0x7f5b2019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b20101350 0x7f5b20198980 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 --2- 172.21.15.60:0/3977444760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b201009b0 0x7f5b20198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 >> 172.21.15.60:0/3977444760 conn(0x7f5b20077990 msgr2=0x7f5b20069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 shutdown_connections 2024-09-11T23:59:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.272+0000 7f5b28206640 1 -- 172.21.15.60:0/3977444760 wait complete. 2024-09-11T23:59:31.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-11T23:59:31.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 -- 172.21.15.60:0/3535842582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10881069c0 msgr2=0x7f1088106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 --2- 172.21.15.60:0/3535842582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10881069c0 0x7f1088106da0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1078009930 tx=0x7f107802a420 comp rx=0 tx=0).stop 2024-09-11T23:59:31.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 -- 172.21.15.60:0/3535842582 shutdown_connections 2024-09-11T23:59:31.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 --2- 172.21.15.60:0/3535842582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1088101350 0x7f108810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 --2- 172.21.15.60:0/3535842582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10881009b0 0x7f1088100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 --2- 172.21.15.60:0/3535842582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10881069c0 0x7f1088106da0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 -- 172.21.15.60:0/3535842582 >> 172.21.15.60:0/3535842582 conn(0x7f1088077990 msgr2=0x7f10880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 -- 172.21.15.60:0/3535842582 shutdown_connections 2024-09-11T23:59:31.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.406+0000 7f108d778640 1 -- 172.21.15.60:0/3535842582 wait complete. 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f108d778640 1 Processor -- start 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f108d778640 1 -- start start 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f108d778640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10881009b0 0x7f1088197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f108d778640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1088101350 0x7f1088197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f108d778640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10881069c0 0x7f108819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f108d778640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1088110f20 con 0x7f1088101350 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f108d778640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1088110da0 con 0x7f10881069c0 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f108d778640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10881110a0 con 0x7f10881009b0 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10867fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1088101350 0x7f1088197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10867fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1088101350 0x7f1088197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53778/0 (socket says 172.21.15.60:53778) 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10867fc640 1 -- 172.21.15.60:0/2295549130 learned_addr learned my addr 172.21.15.60:0/2295549130 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10877fe640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10881069c0 0x7f108819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10867fc640 1 -- 172.21.15.60:0/2295549130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10881009b0 msgr2=0x7f1088197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10867fc640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10881009b0 0x7f1088197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10867fc640 1 -- 172.21.15.60:0/2295549130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10881069c0 msgr2=0x7f108819bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10867fc640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10881069c0 0x7f108819bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.407+0000 7f10867fc640 1 -- 172.21.15.60:0/2295549130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108819c340 con 0x7f1088101350 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.408+0000 7f10867fc640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1088101350 0x7f1088197890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f107000d950 tx=0x7f107000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.408+0000 7f107ffff640 1 -- 172.21.15.60:0/2295549130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070017030 con 0x7f1088101350 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.408+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108819c630 con 0x7f1088101350 2024-09-11T23:59:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.408+0000 7f107ffff640 1 -- 172.21.15.60:0/2295549130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1070004020 con 0x7f1088101350 2024-09-11T23:59:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.408+0000 7f107ffff640 1 -- 172.21.15.60:0/2295549130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070004a00 con 0x7f1088101350 2024-09-11T23:59:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.408+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10881a3ec0 con 0x7f1088101350 2024-09-11T23:59:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.409+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1088100e10 con 0x7f1088101350 2024-09-11T23:59:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.410+0000 7f107ffff640 1 -- 172.21.15.60:0/2295549130 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f10700041d0 con 0x7f1088101350 2024-09-11T23:59:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.411+0000 7f107ffff640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10740a2e40 0x7f10740a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.411+0000 7f1086ffd640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10740a2e40 0x7f10740a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.411+0000 7f107ffff640 1 -- 172.21.15.60:0/2295549130 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f10700cefa0 con 0x7f1088101350 2024-09-11T23:59:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.411+0000 7f1086ffd640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10740a2e40 0x7f10740a5300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10780096c0 tx=0x7f1078000bc0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.415+0000 7f107ffff640 1 -- 172.21.15.60:0/2295549130 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f107009baa0 con 0x7f1088101350 2024-09-11T23:59:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.571+0000 7f6797096640 1 -- 172.21.15.60:0/2112859436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901036e0 msgr2=0x7f6790107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.571+0000 7f6797096640 1 --2- 172.21.15.60:0/2112859436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901036e0 0x7f6790107b90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6780009930 tx=0x7f678002a420 comp rx=0 tx=0).stop 2024-09-11T23:59:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.571+0000 7f6797096640 1 -- 172.21.15.60:0/2112859436 shutdown_connections 2024-09-11T23:59:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.571+0000 7f6797096640 1 --2- 172.21.15.60:0/2112859436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67901082a0 0x7f679010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.571+0000 7f6797096640 1 --2- 172.21.15.60:0/2112859436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901036e0 0x7f6790107b90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.571+0000 7f6797096640 1 --2- 172.21.15.60:0/2112859436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6790102d30 0x7f6790103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.571+0000 7f6797096640 1 -- 172.21.15.60:0/2112859436 >> 172.21.15.60:0/2112859436 conn(0x7f67900fc7d0 msgr2=0x7f67900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.571+0000 7f6797096640 1 -- 172.21.15.60:0/2112859436 shutdown_connections 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 -- 172.21.15.60:0/2112859436 wait complete. 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 Processor -- start 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 -- start start 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6790102d30 0x7f6790100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67901036e0 0x7f6790100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901082a0 0x7f6790101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67901121c0 con 0x7f67901082a0 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6790112040 con 0x7f67901036e0 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6797096640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6790112340 con 0x7f6790102d30 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.572+0000 7f6795633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901082a0 0x7f6790101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6794e32640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6790102d30 0x7f6790100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f678ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67901036e0 0x7f6790100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6795633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901082a0 0x7f6790101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34430/0 (socket says 172.21.15.60:34430) 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6795633640 1 -- 172.21.15.60:0/1553329518 learned_addr learned my addr 172.21.15.60:0/1553329518 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6794e32640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6790102d30 0x7f6790100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:42628/0 (socket says 172.21.15.60:42628) 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6794e32640 1 -- 172.21.15.60:0/1553329518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67901036e0 msgr2=0x7f6790100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6794e32640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67901036e0 0x7f6790100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6794e32640 1 -- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901082a0 msgr2=0x7f6790101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6794e32640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901082a0 0x7f6790101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6794e32640 1 -- 172.21.15.60:0/1553329518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67901a6c10 con 0x7f6790102d30 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6795633640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901082a0 0x7f6790101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6794e32640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6790102d30 0x7f6790100990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f677800e9f0 tx=0x7f677800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f678dffb640 1 -- 172.21.15.60:0/1553329518 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677800ccc0 con 0x7f6790102d30 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f6797096640 1 -- 172.21.15.60:0/1553329518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67901a6f00 con 0x7f6790102d30 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f678dffb640 1 -- 172.21.15.60:0/1553329518 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6778010930 con 0x7f6790102d30 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.573+0000 7f678dffb640 1 -- 172.21.15.60:0/1553329518 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67780189f0 con 0x7f6790102d30 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.574+0000 7f6797096640 1 -- 172.21.15.60:0/1553329518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67901a73b0 con 0x7f6790102d30 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f678dffb640 1 -- 172.21.15.60:0/1553329518 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f6778010ae0 con 0x7f6790102d30 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f679946f740 1 Processor -- start 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f679946f740 1 -- start start 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f679946f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b844a0 0x5592b5b84880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f679946f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b84dc0 0x5592b5b8f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f679946f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b8f680 0x5592b5b91a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f679946f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5592b5aea2e0 con 0x5592b5b844a0 2024-09-11T23:59:31.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f679946f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5592b5a91ce0 con 0x5592b5b84dc0 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.576+0000 7f679946f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5592b5ae62a0 con 0x5592b5b8f680 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b844a0 0x5592b5b84880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b844a0 0x5592b5b84880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34446/0 (socket says 172.21.15.60:34446) 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 -- 172.21.15.60:0/2847194049 learned_addr learned my addr 172.21.15.60:0/2847194049 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f678ffff640 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b8f680 0x5592b5b91a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6794e32640 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b84dc0 0x5592b5b8f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 -- 172.21.15.60:0/2847194049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b8f680 msgr2=0x5592b5b91a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b8f680 0x5592b5b91a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 -- 172.21.15.60:0/2847194049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b84dc0 msgr2=0x5592b5b8f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b84dc0 0x5592b5b8f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 -- 172.21.15.60:0/2847194049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b5a76440 con 0x5592b5b844a0 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6794e32640 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b84dc0 0x5592b5b8f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:31.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f678dffb640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f677c0a2d80 0x7f677c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6794e32640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f677c0a2d80 0x7f677c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f6795633640 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b844a0 0x5592b5b84880 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6788011850 tx=0x7f6788011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174ba6daf240a5da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.577+0000 7f678dffb640 1 -- 172.21.15.60:0/1553329518 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f67780cf810 con 0x7f6790102d30 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f6786ffd640 1 -- 172.21.15.60:0/2847194049 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788011330 con 0x5592b5b844a0 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f6786ffd640 1 -- 172.21.15.60:0/2847194049 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6788010430 con 0x5592b5b844a0 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f6786ffd640 1 -- 172.21.15.60:0/2847194049 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678800fea0 con 0x5592b5b844a0 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f6794e32640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f677c0a2d80 0x7f677c0a5240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67780ccf50 tx=0x7f677800cf70 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f679946f740 1 -- 172.21.15.60:0/2847194049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b844a0 msgr2=0x5592b5b84880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f679946f740 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b844a0 0x5592b5b84880 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6788011850 tx=0x7f6788011d10 comp rx=0 tx=0).stop 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f679946f740 1 -- 172.21.15.60:0/2847194049 shutdown_connections 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f679946f740 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b8f680 0x5592b5b91a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f679946f740 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b84dc0 0x5592b5b8f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f679946f740 1 --2- 172.21.15.60:0/2847194049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b844a0 0x5592b5b84880 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f679946f740 1 -- 172.21.15.60:0/2847194049 >> 172.21.15.60:0/2847194049 conn(0x5592b5b80a30 msgr2=0x5592b5b80e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.578+0000 7f679946f740 1 -- 172.21.15.60:0/2847194049 shutdown_connections 2024-09-11T23:59:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.579+0000 7f679946f740 1 -- 172.21.15.60:0/2847194049 wait complete. 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.579+0000 7f679946f740 1 -- start start 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.579+0000 7f679946f740 1 Processor -- start 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f679946f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b8eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f679946f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b8c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f679946f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b8c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f679946f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5592b5b92250 con 0x5592b5b84dc0 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b8c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f679946f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5592b5aa5050 con 0x5592b5b8f680 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f679946f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5592b5b923d0 con 0x5592b5b844a0 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b8c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34456/0 (socket says 172.21.15.60:34456) 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 -- 172.21.15.60:0/3702272409 learned_addr learned my addr 172.21.15.60:0/3702272409 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:31.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f679946f740 10 client.0 _ll_register_callbacks cb 0x5592b5ae5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f6795633640 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b8c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f6795633640 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b8eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 -- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 msgr2=0x5592b5b8eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b8eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 -- 172.21.15.60:0/3702272409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 msgr2=0x5592b5b8c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b8c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 -- 172.21.15.60:0/3702272409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b585b3c0 con 0x5592b5b84dc0 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f6795633640 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b8eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.580+0000 7f678ffff640 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b8c1a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f67900697d0 tx=0x7f6780032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96cff0d60097463 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f676ffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f676ffff640 1 -- 172.21.15.60:0/3702272409 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780035040 con 0x5592b5b84dc0 2024-09-11T23:59:31.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f676ffff640 1 -- 172.21.15.60:0/3702272409 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6780031840 con 0x5592b5b84dc0 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 1 -- 172.21.15.60:0/3702272409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6788010430 con 0x5592b5b84dc0 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f676ffff640 1 -- 172.21.15.60:0/3702272409 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6780031a40 con 0x5592b5b84dc0 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 10 client.15408 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 1 -- 172.21.15.60:0/3702272409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592b5b9db00 con 0x5592b5b84dc0 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f676ffff640 1 -- 172.21.15.60:0/3702272409 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6788010430 con 0x5592b5b84dc0 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f676ffff640 1 -- 172.21.15.60:0/3702272409 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6780004800 con 0x5592b5b84dc0 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 10 client.15408 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 10 client.15408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 20 client.15408 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5592b5b9ef10 0x5592b5ba1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 4 client.15408 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.581+0000 7f679946f740 1 -- 172.21.15.60:0/3702272409 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592b5af7850 con 0x5592b5b9ef10 2024-09-11T23:59:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.582+0000 7f6795633640 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5592b5b9ef10 0x5592b5ba1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.582+0000 7f676ffff640 10 client.15408 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.582+0000 7f6795633640 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5592b5b9ef10 0x5592b5ba1330 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf7012524fc8e89e server_cookie=3768441a5f004a3 in_seq=0 out_seq=0 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f676ffff640 1 -- 172.21.15.60:0/3702272409 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5592b5af7850 con 0x5592b5b9ef10 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f676ffff640 10 client.15408 handle_command_reply: tid=0 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 client.15408 shutdown 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 -- 172.21.15.60:0/3702272409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 msgr2=0x5592b5b8c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b8c1a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f67900697d0 tx=0x7f6780032c80 comp rx=0 tx=0).stop 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 -- 172.21.15.60:0/3702272409 shutdown_connections 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5592b5b9ef10 0x5592b5ba1330 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b8c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b8c1a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 --2- 172.21.15.60:0/3702272409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b8eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f676ffff640 0 client.15408 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:31.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 -- 172.21.15.60:0/3702272409 >> 172.21.15.60:0/3702272409 conn(0x5592b5b80a30 msgr2=0x5592b5b7fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 -- 172.21.15.60:0/3702272409 shutdown_connections 2024-09-11T23:59:31.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.583+0000 7f679946f740 1 -- 172.21.15.60:0/3702272409 wait complete. 2024-09-11T23:59:31.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.584+0000 7f679946f740 20 client.15408 trim_cache size 0 max 16384 2024-09-11T23:59:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f679946f740 1 Processor -- start 2024-09-11T23:59:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f679946f740 1 -- start start 2024-09-11T23:59:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f679946f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b844a0 0x5592b5ba6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f679946f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b84dc0 0x5592b5ba7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f679946f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b8f680 0x5592b5b89400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f679946f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67901afad0 con 0x5592b5b8f680 2024-09-11T23:59:31.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f679946f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67901b1610 con 0x5592b5b844a0 2024-09-11T23:59:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f679946f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67901b01a0 con 0x5592b5b84dc0 2024-09-11T23:59:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f6795633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b8f680 0x5592b5b89400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f6795633640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b8f680 0x5592b5b89400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34468/0 (socket says 172.21.15.60:34468) 2024-09-11T23:59:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f6795633640 1 -- 172.21.15.60:0/3030924625 learned_addr learned my addr 172.21.15.60:0/3030924625 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f6795633640 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b844a0 0x5592b5ba6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f678ffff640 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b84dc0 0x5592b5ba7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f6795633640 1 -- 172.21.15.60:0/3030924625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b84dc0 msgr2=0x5592b5ba7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.601+0000 7f6795633640 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b84dc0 0x5592b5ba7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.602+0000 7f6795633640 1 -- 172.21.15.60:0/3030924625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b844a0 msgr2=0x5592b5ba6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.602+0000 7f6795633640 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b844a0 0x5592b5ba6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.602+0000 7f6795633640 1 -- 172.21.15.60:0/3030924625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b5b84bf0 con 0x5592b5b8f680 2024-09-11T23:59:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.602+0000 7f678ffff640 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b84dc0 0x5592b5ba7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.602+0000 7f6795633640 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b8f680 0x5592b5b89400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6788011850 tx=0x7f6788005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8aac50f4436af98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.602+0000 7f67867fc640 1 -- 172.21.15.60:0/3030924625 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678800fcf0 con 0x5592b5b8f680 2024-09-11T23:59:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.602+0000 7f67867fc640 1 -- 172.21.15.60:0/3030924625 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f678800fe90 con 0x5592b5b8f680 2024-09-11T23:59:31.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.602+0000 7f67867fc640 1 -- 172.21.15.60:0/3030924625 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788005810 con 0x5592b5b8f680 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 -- 172.21.15.60:0/3030924625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b8f680 msgr2=0x5592b5b89400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b8f680 0x5592b5b89400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6788011850 tx=0x7f6788005b00 comp rx=0 tx=0).stop 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 -- 172.21.15.60:0/3030924625 shutdown_connections 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b8f680 0x5592b5b89400 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b84dc0 0x5592b5ba7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 --2- 172.21.15.60:0/3030924625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b844a0 0x5592b5ba6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 -- 172.21.15.60:0/3030924625 >> 172.21.15.60:0/3030924625 conn(0x5592b5b80a30 msgr2=0x5592b5b8e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 -- 172.21.15.60:0/3030924625 shutdown_connections 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 -- 172.21.15.60:0/3030924625 wait complete. 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 -- start start 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.603+0000 7f679946f740 1 Processor -- start 2024-09-11T23:59:31.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f679946f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b90780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f679946f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b90cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f679946f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b91200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f679946f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67901b0f40 con 0x5592b5b84dc0 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f679946f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67901b0870 con 0x5592b5b8f680 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f679946f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67901adad0 con 0x5592b5b844a0 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f679946f740 10 client.0 _ll_register_callbacks cb 0x7f6780009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f6795633640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b91200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b90cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f6795633640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b91200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56780/0 (socket says 172.21.15.60:56780) 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b90cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34470/0 (socket says 172.21.15.60:34470) 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f6795633640 1 -- 172.21.15.60:0/3195252582 learned_addr learned my addr 172.21.15.60:0/3195252582 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:31.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f6795633640 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b90780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f678ffff640 1 -- 172.21.15.60:0/3195252582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 msgr2=0x5592b5b90780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f678ffff640 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b90780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f678ffff640 1 -- 172.21.15.60:0/3195252582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 msgr2=0x5592b5b91200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f678ffff640 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b91200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f678ffff640 1 -- 172.21.15.60:0/3195252582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b5b95b10 con 0x5592b5b84dc0 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f6795633640 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b91200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f678ffff640 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b90cc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6780004d20 tx=0x7f6780004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866f4bb0cfe987f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.604+0000 7f676ffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f676ffff640 1 -- 172.21.15.60:0/3195252582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780035070 con 0x5592b5b84dc0 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f676ffff640 1 -- 172.21.15.60:0/3195252582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f67800051b0 con 0x5592b5b84dc0 2024-09-11T23:59:31.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 1 -- 172.21.15.60:0/3195252582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f678800fe90 con 0x5592b5b84dc0 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f676ffff640 1 -- 172.21.15.60:0/3195252582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f678005e050 con 0x5592b5b84dc0 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 10 client.15414 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 1 -- 172.21.15.60:0/3195252582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592b5c09ed0 con 0x5592b5b84dc0 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f676ffff640 1 -- 172.21.15.60:0/3195252582 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f678800fe90 con 0x5592b5b84dc0 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f676ffff640 1 -- 172.21.15.60:0/3195252582 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f67800053d0 con 0x5592b5b84dc0 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 10 client.15414 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 20 client.15414 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5592b5c0a6a0 0x5592b5c0cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:31.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 4 client.15414 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.605+0000 7f679946f740 1 -- 172.21.15.60:0/3195252582 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5592b5af1d60 con 0x5592b5c0a6a0 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f6795633640 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5592b5c0a6a0 0x5592b5c0cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f6795633640 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5592b5c0a6a0 0x5592b5c0cac0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a20d0f8586dfaf9 server_cookie=1e1e4f40b7518c56 in_seq=0 out_seq=0 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f676ffff640 10 client.15414 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f676ffff640 1 -- 172.21.15.60:0/3195252582 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5592b5af1d60 con 0x5592b5c0a6a0 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f676ffff640 10 client.15414 handle_command_reply: tid=0 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f679946f740 1 client.15414 shutdown 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f679946f740 1 -- 172.21.15.60:0/3195252582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 msgr2=0x5592b5b90cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f679946f740 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b90cc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6780004d20 tx=0x7f6780004980 comp rx=0 tx=0).stop 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f679946f740 1 -- 172.21.15.60:0/3195252582 shutdown_connections 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f679946f740 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5592b5c0a6a0 0x5592b5c0cac0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f676ffff640 0 client.15414 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:31.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f679946f740 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5592b5b8f680 0x5592b5b91200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.606+0000 7f679946f740 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5592b5b84dc0 0x5592b5b90cc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f679946f740 1 --2- 172.21.15.60:0/3195252582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5592b5b844a0 0x5592b5b90780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f679946f740 1 -- 172.21.15.60:0/3195252582 >> 172.21.15.60:0/3195252582 conn(0x5592b5b80a30 msgr2=0x5592b5b8da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f679946f740 1 -- 172.21.15.60:0/3195252582 shutdown_connections 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f679946f740 1 -- 172.21.15.60:0/3195252582 wait complete. 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f679946f740 20 client.15414 trim_cache size 0 max 16384 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-11T23:59:31.612 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-11T23:59:31.613 INFO:teuthology.orchestra.run.smithi060.stdout: "d4cf1b60-16e6-4585-83af-4fafb42348e2": { 2024-09-11T23:59:31.613 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-11T23:59:31.613 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "d4cf1b60-16e6-4585-83af-4fafb42348e2", 2024-09-11T23:59:31.613 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-11T23:59:31.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-11T23:59:31.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-11T23:59:31.613 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 -- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f677c0a2d80 msgr2=0x7f677c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f677c0a2d80 0x7f677c0a5240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67780ccf50 tx=0x7f677800cf70 comp rx=0 tx=0).stop 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 -- 172.21.15.60:0/1553329518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6790102d30 msgr2=0x7f6790100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6790102d30 0x7f6790100990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f677800e9f0 tx=0x7f677800eeb0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 -- 172.21.15.60:0/1553329518 shutdown_connections 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f677c0a2d80 0x7f677c0a5240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67901082a0 0x7f6790101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67901036e0 0x7f6790100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 --2- 172.21.15.60:0/1553329518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6790102d30 0x7f6790100990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.607+0000 7f6797096640 1 -- 172.21.15.60:0/1553329518 >> 172.21.15.60:0/1553329518 conn(0x7f67900fc7d0 msgr2=0x7f6790106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.608+0000 7f6797096640 1 -- 172.21.15.60:0/1553329518 shutdown_connections 2024-09-11T23:59:31.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.608+0000 7f6797096640 1 -- 172.21.15.60:0/1553329518 wait complete. 2024-09-11T23:59:31.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.623+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f1088103ed0 con 0x7f10740a2e40 2024-09-11T23:59:31.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.631+0000 7f107ffff640 1 -- 172.21.15.60:0/2295549130 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f1088103ed0 con 0x7f10740a2e40 2024-09-11T23:59:31.630 INFO:teuthology.orchestra.run.smithi060.stdout:/ 1m 6m3h 2024-09-11T23:59:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10740a2e40 msgr2=0x7f10740a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10740a2e40 0x7f10740a5300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10780096c0 tx=0x7f1078000bc0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1088101350 msgr2=0x7f1088197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1088101350 0x7f1088197890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f107000d950 tx=0x7f107000de10 comp rx=0 tx=0).stop 2024-09-11T23:59:31.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 shutdown_connections 2024-09-11T23:59:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10740a2e40 0x7f10740a5300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10881069c0 0x7f108819bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1088101350 0x7f1088197890 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 --2- 172.21.15.60:0/2295549130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10881009b0 0x7f1088197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 >> 172.21.15.60:0/2295549130 conn(0x7f1088077990 msgr2=0x7f10881037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 shutdown_connections 2024-09-11T23:59:31.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:31.633+0000 7f108d778640 1 -- 172.21.15.60:0/2295549130 wait complete. 2024-09-11T23:59:31.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-11T23:59:31.674 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-11T23:59:31.685 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-11T23:59:31.712 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T23:59:31.712 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:59:31.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:31 smithi105 ceph-mon[34805]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:31.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:31 smithi105 ceph-mon[34805]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:31.736 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:31 smithi060 ceph-mon[30953]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:31.737 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:31 smithi060 ceph-mon[30953]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:31.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:31 smithi192 ceph-mon[35487]: from='client.15378 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:31.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:31 smithi192 ceph-mon[35487]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:32.383 INFO:tasks.cephfs.filesystem:scrub status for tag:d4cf1b60-16e6-4585-83af-4fafb42348e2 - {'path': '/', 'tag': 'd4cf1b60-16e6-4585-83af-4fafb42348e2', 'options': 'recursive,force'} 2024-09-11T23:59:32.507 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:32.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:32 smithi060 ceph-mon[30953]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:32.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:32 smithi060 ceph-mon[30953]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 228 B/s wr, 19 op/s 2024-09-11T23:59:32.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:32 smithi060 ceph-mon[30953]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:32.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:32 smithi105 ceph-mon[34805]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:32.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:32 smithi105 ceph-mon[34805]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 228 B/s wr, 19 op/s 2024-09-11T23:59:32.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:32 smithi105 ceph-mon[34805]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:32.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:32 smithi192 ceph-mon[35487]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:32.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:32 smithi192 ceph-mon[35487]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 228 B/s wr, 19 op/s 2024-09-11T23:59:32.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:32 smithi192 ceph-mon[35487]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T23:59:32.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 -- 172.21.15.60:0/4273390721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 msgr2=0x7fbc74106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:32.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 --2- 172.21.15.60:0/4273390721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 0x7fbc74106e60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009930 tx=0x7fbc6402a420 comp rx=0 tx=0).stop 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 -- 172.21.15.60:0/4273390721 shutdown_connections 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 --2- 172.21.15.60:0/4273390721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc74101420 0x7fbc7410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 --2- 172.21.15.60:0/4273390721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc74100a80 0x7fbc74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 --2- 172.21.15.60:0/4273390721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 0x7fbc74106e60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 -- 172.21.15.60:0/4273390721 >> 172.21.15.60:0/4273390721 conn(0x7fbc740fc7a0 msgr2=0x7fbc740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 -- 172.21.15.60:0/4273390721 shutdown_connections 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.980+0000 7fbc78f96640 1 -- 172.21.15.60:0/4273390721 wait complete. 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc78f96640 1 Processor -- start 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc78f96640 1 -- start start 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc78f96640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc74100a80 0x7fbc741a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc78f96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc74101420 0x7fbc741a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc78f96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 0x7fbc7419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc78f96640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74110fe0 con 0x7fbc74106a80 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc78f96640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74110e60 con 0x7fbc74101420 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc78f96640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbc74111160 con 0x7fbc74100a80 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc72d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 0x7fbc7419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc72d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 0x7fbc7419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34482/0 (socket says 172.21.15.60:34482) 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc72d9d640 1 -- 172.21.15.60:0/1157937107 learned_addr learned my addr 172.21.15.60:0/1157937107 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc6bfff640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc74101420 0x7fbc741a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc7259c640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc74100a80 0x7fbc741a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc72d9d640 1 -- 172.21.15.60:0/1157937107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc74100a80 msgr2=0x7fbc741a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.981+0000 7fbc72d9d640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc74100a80 0x7fbc741a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc72d9d640 1 -- 172.21.15.60:0/1157937107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc74101420 msgr2=0x7fbc741a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc72d9d640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc74101420 0x7fbc741a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc72d9d640 1 -- 172.21.15.60:0/1157937107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7419ad10 con 0x7fbc74106a80 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc72d9d640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 0x7fbc7419a5e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009fd0 tx=0x7fbc6c00def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc6b7fe640 1 -- 172.21.15.60:0/1157937107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c017070 con 0x7fbc74106a80 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7419b000 con 0x7fbc74106a80 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc6b7fe640 1 -- 172.21.15.60:0/1157937107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc6c00bdd0 con 0x7fbc74106a80 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc6b7fe640 1 -- 172.21.15.60:0/1157937107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0106c0 con 0x7fbc74106a80 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.982+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc741a72f0 con 0x7fbc74106a80 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.983+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc74100ee0 con 0x7fbc74106a80 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.984+0000 7fbc6b7fe640 1 -- 172.21.15.60:0/1157937107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fbc6c003970 con 0x7fbc74106a80 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.985+0000 7fbc6b7fe640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc600a2d80 0x7fbc600a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.985+0000 7fbc7259c640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc600a2d80 0x7fbc600a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:33.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.985+0000 7fbc6b7fe640 1 -- 172.21.15.60:0/1157937107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbc6c0cf2c0 con 0x7fbc74106a80 2024-09-11T23:59:33.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.985+0000 7fbc7259c640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc600a2d80 0x7fbc600a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc64000c00 tx=0x7fbc64005a20 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:33.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:32.989+0000 7fbc6b7fe640 1 -- 172.21.15.60:0/1157937107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc6c09bdc0 con 0x7fbc74106a80 2024-09-11T23:59:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.161+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc7406aea0 con 0x7fbc600a2d80 2024-09-11T23:59:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.167+0000 7fbc6b7fe640 1 -- 172.21.15.60:0/1157937107 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258049 (secure 0 0 0) 0x7fbc7406aea0 con 0x7fbc600a2d80 2024-09-11T23:59:33.169 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:33.170 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:59:33.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.170+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc600a2d80 msgr2=0x7fbc600a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:33.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc600a2d80 0x7fbc600a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc64000c00 tx=0x7fbc64005a20 comp rx=0 tx=0).stop 2024-09-11T23:59:33.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 msgr2=0x7fbc7419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 0x7fbc7419a5e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009fd0 tx=0x7fbc6c00def0 comp rx=0 tx=0).stop 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 shutdown_connections 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc600a2d80 0x7fbc600a5240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc74106a80 0x7fbc7419a5e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc74101420 0x7fbc741a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 --2- 172.21.15.60:0/1157937107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc74100a80 0x7fbc741a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 >> 172.21.15.60:0/1157937107 conn(0x7fbc740fc7a0 msgr2=0x7fbc7406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 shutdown_connections 2024-09-11T23:59:33.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:33.171+0000 7fbc78f96640 1 -- 172.21.15.60:0/1157937107 wait complete. 2024-09-11T23:59:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:33 smithi105 ceph-mon[34805]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:33 smithi192 ceph-mon[35487]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:33.803 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:33 smithi060 ceph-mon[30953]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:33.832 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-11T23:59:31.400155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191409,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1439,"num_read_kb":1049,"num_write":579,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":952,"ondisk_log_size":952,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368992,"kb_used_data":11388,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572832,"statfs":{"total":1151940427776,"available":1151562579968,"internally_reserved":0,"allocated":11661312,"data_stored":8876835,"data_compressed":219483,"data_compressed_allocated":282624,"data_compressed_original":3416064,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":245,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.943402"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466469+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:59:21.466469+0000","last_peered":"2024-09-11T23:59:21.466469+0000","last_clean":"2024-09-11T23:59:21.466469+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:59:21.466469+0000","last_undegraded":"2024-09-11T23:59:21.466469+0000","last_fullsized":"2024-09-11T23:59:21.466469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680932+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:59:21.680932+0000","last_peered":"2024-09-11T23:59:21.680932+0000","last_clean":"2024-09-11T23:59:21.680932+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:59:21.680932+0000","last_undegraded":"2024-09-11T23:59:21.680932+0000","last_fullsized":"2024-09-11T23:59:21.680932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680758+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:59:21.680758+0000","last_peered":"2024-09-11T23:59:21.680758+0000","last_clean":"2024-09-11T23:59:21.680758+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:59:21.680758+0000","last_undegraded":"2024-09-11T23:59:21.680758+0000","last_fullsized":"2024-09-11T23:59:21.680758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645268+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:59:21.645268+0000","last_peered":"2024-09-11T23:59:21.645268+0000","last_clean":"2024-09-11T23:59:21.645268+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:59:21.645268+0000","last_undegraded":"2024-09-11T23:59:21.645268+0000","last_fullsized":"2024-09-11T23:59:21.645268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700973+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:59:21.700973+0000","last_peered":"2024-09-11T23:59:21.700973+0000","last_clean":"2024-09-11T23:59:21.700973+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:59:21.700973+0000","last_undegraded":"2024-09-11T23:59:21.700973+0000","last_fullsized":"2024-09-11T23:59:21.700973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475885+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:59:21.475885+0000","last_peered":"2024-09-11T23:59:21.475885+0000","last_clean":"2024-09-11T23:59:21.475885+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:59:21.475885+0000","last_undegraded":"2024-09-11T23:59:21.475885+0000","last_fullsized":"2024-09-11T23:59:21.475885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644131+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:59:21.644131+0000","last_peered":"2024-09-11T23:59:21.644131+0000","last_clean":"2024-09-11T23:59:21.644131+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:59:21.644131+0000","last_undegraded":"2024-09-11T23:59:21.644131+0000","last_fullsized":"2024-09-11T23:59:21.644131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466288+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:59:21.466288+0000","last_peered":"2024-09-11T23:59:21.466288+0000","last_clean":"2024-09-11T23:59:21.466288+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:59:21.466288+0000","last_undegraded":"2024-09-11T23:59:21.466288+0000","last_fullsized":"2024-09-11T23:59:21.466288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387087+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:59:21.387087+0000","last_peered":"2024-09-11T23:59:21.387087+0000","last_clean":"2024-09-11T23:59:21.387087+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:59:21.387087+0000","last_undegraded":"2024-09-11T23:59:21.387087+0000","last_fullsized":"2024-09-11T23:59:21.387087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476277+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:59:21.476277+0000","last_peered":"2024-09-11T23:59:21.476277+0000","last_clean":"2024-09-11T23:59:21.476277+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:59:21.476277+0000","last_undegraded":"2024-09-11T23:59:21.476277+0000","last_fullsized":"2024-09-11T23:59:21.476277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644423+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:59:21.644423+0000","last_peered":"2024-09-11T23:59:21.644423+0000","last_clean":"2024-09-11T23:59:21.644423+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:59:21.644423+0000","last_undegraded":"2024-09-11T23:59:21.644423+0000","last_fullsized":"2024-09-11T23:59:21.644423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385078+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:59:21.385078+0000","last_peered":"2024-09-11T23:59:21.385078+0000","last_clean":"2024-09-11T23:59:21.385078+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:59:21.385078+0000","last_undegraded":"2024-09-11T23:59:21.385078+0000","last_fullsized":"2024-09-11T23:59:21.385078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643697+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:59:21.643697+0000","last_peered":"2024-09-11T23:59:21.643697+0000","last_clean":"2024-09-11T23:59:21.643697+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:59:21.643697+0000","last_undegraded":"2024-09-11T23:59:21.643697+0000","last_fullsized":"2024-09-11T23:59:21.643697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680072+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:59:21.680072+0000","last_peered":"2024-09-11T23:59:21.680072+0000","last_clean":"2024-09-11T23:59:21.680072+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:59:21.680072+0000","last_undegraded":"2024-09-11T23:59:21.680072+0000","last_fullsized":"2024-09-11T23:59:21.680072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.679770+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:59:21.679770+0000","last_peered":"2024-09-11T23:59:21.679770+0000","last_clean":"2024-09-11T23:59:21.679770+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:59:21.679770+0000","last_undegraded":"2024-09-11T23:59:21.679770+0000","last_fullsized":"2024-09-11T23:59:21.679770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386692+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:59:21.386692+0000","last_peered":"2024-09-11T23:59:21.386692+0000","last_clean":"2024-09-11T23:59:21.386692+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:59:21.386692+0000","last_undegraded":"2024-09-11T23:59:21.386692+0000","last_fullsized":"2024-09-11T23:59:21.386692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466577+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:59:21.466577+0000","last_peered":"2024-09-11T23:59:21.466577+0000","last_clean":"2024-09-11T23:59:21.466577+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:59:21.466577+0000","last_undegraded":"2024-09-11T23:59:21.466577+0000","last_fullsized":"2024-09-11T23:59:21.466577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385256+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:59:21.385256+0000","last_peered":"2024-09-11T23:59:21.385256+0000","last_clean":"2024-09-11T23:59:21.385256+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:59:21.385256+0000","last_undegraded":"2024-09-11T23:59:21.385256+0000","last_fullsized":"2024-09-11T23:59:21.385256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387348+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:59:21.387348+0000","last_peered":"2024-09-11T23:59:21.387348+0000","last_clean":"2024-09-11T23:59:21.387348+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:59:21.387348+0000","last_undegraded":"2024-09-11T23:59:21.387348+0000","last_fullsized":"2024-09-11T23:59:21.387348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466261+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:59:21.466261+0000","last_peered":"2024-09-11T23:59:21.466261+0000","last_clean":"2024-09-11T23:59:21.466261+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:59:21.466261+0000","last_undegraded":"2024-09-11T23:59:21.466261+0000","last_fullsized":"2024-09-11T23:59:21.466261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643856+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:59:21.643856+0000","last_peered":"2024-09-11T23:59:21.643856+0000","last_clean":"2024-09-11T23:59:21.643856+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:59:21.643856+0000","last_undegraded":"2024-09-11T23:59:21.643856+0000","last_fullsized":"2024-09-11T23:59:21.643856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386866+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:59:21.386866+0000","last_peered":"2024-09-11T23:59:21.386866+0000","last_clean":"2024-09-11T23:59:21.386866+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:59:21.386866+0000","last_undegraded":"2024-09-11T23:59:21.386866+0000","last_fullsized":"2024-09-11T23:59:21.386866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466381+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:59:21.466381+0000","last_peered":"2024-09-11T23:59:21.466381+0000","last_clean":"2024-09-11T23:59:21.466381+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:59:21.466381+0000","last_undegraded":"2024-09-11T23:59:21.466381+0000","last_fullsized":"2024-09-11T23:59:21.466381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472730+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:59:21.472730+0000","last_peered":"2024-09-11T23:59:21.472730+0000","last_clean":"2024-09-11T23:59:21.472730+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:59:21.472730+0000","last_undegraded":"2024-09-11T23:59:21.472730+0000","last_fullsized":"2024-09-11T23:59:21.472730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466751+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:59:21.466751+0000","last_peered":"2024-09-11T23:59:21.466751+0000","last_clean":"2024-09-11T23:59:21.466751+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:59:21.466751+0000","last_undegraded":"2024-09-11T23:59:21.466751+0000","last_fullsized":"2024-09-11T23:59:21.466751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387391+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:59:21.387391+0000","last_peered":"2024-09-11T23:59:21.387391+0000","last_clean":"2024-09-11T23:59:21.387391+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:59:21.387391+0000","last_undegraded":"2024-09-11T23:59:21.387391+0000","last_fullsized":"2024-09-11T23:59:21.387391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466340+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:59:21.466340+0000","last_peered":"2024-09-11T23:59:21.466340+0000","last_clean":"2024-09-11T23:59:21.466340+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:59:21.466340+0000","last_undegraded":"2024-09-11T23:59:21.466340+0000","last_fullsized":"2024-09-11T23:59:21.466340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643440+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:59:21.643440+0000","last_peered":"2024-09-11T23:59:21.643440+0000","last_clean":"2024-09-11T23:59:21.643440+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:59:21.643440+0000","last_undegraded":"2024-09-11T23:59:21.643440+0000","last_fullsized":"2024-09-11T23:59:21.643440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:59:21.680410+0000","last_peered":"2024-09-11T23:59:21.680410+0000","last_clean":"2024-09-11T23:59:21.680410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:59:21.680410+0000","last_undegraded":"2024-09-11T23:59:21.680410+0000","last_fullsized":"2024-09-11T23:59:21.680410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387093+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:59:21.387093+0000","last_peered":"2024-09-11T23:59:21.387093+0000","last_clean":"2024-09-11T23:59:21.387093+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:59:21.387093+0000","last_undegraded":"2024-09-11T23:59:21.387093+0000","last_fullsized":"2024-09-11T23:59:21.387093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387125+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:59:21.387125+0000","last_peered":"2024-09-11T23:59:21.387125+0000","last_clean":"2024-09-11T23:59:21.387125+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:59:21.387125+0000","last_undegraded":"2024-09-11T23:59:21.387125+0000","last_fullsized":"2024-09-11T23:59:21.387125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700936+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:59:21.700936+0000","last_peered":"2024-09-11T23:59:21.700936+0000","last_clean":"2024-09-11T23:59:21.700936+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:59:21.700936+0000","last_undegraded":"2024-09-11T23:59:21.700936+0000","last_fullsized":"2024-09-11T23:59:21.700936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'9","reported_seq":156,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:25.647722+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:59:25.647722+0000","last_peered":"2024-09-11T23:59:25.647722+0000","last_clean":"2024-09-11T23:59:25.647722+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:59:25.647722+0000","last_undegraded":"2024-09-11T23:59:25.647722+0000","last_fullsized":"2024-09-11T23:59:25.647722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472907+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:59:21.472907+0000","last_peered":"2024-09-11T23:59:21.472907+0000","last_clean":"2024-09-11T23:59:21.472907+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:59:21.472907+0000","last_undegraded":"2024-09-11T23:59:21.472907+0000","last_fullsized":"2024-09-11T23:59:21.472907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475951+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:59:21.475951+0000","last_peered":"2024-09-11T23:59:21.475951+0000","last_clean":"2024-09-11T23:59:21.475951+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:59:21.475951+0000","last_undegraded":"2024-09-11T23:59:21.475951+0000","last_fullsized":"2024-09-11T23:59:21.475951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642891+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:59:21.642891+0000","last_peered":"2024-09-11T23:59:21.642891+0000","last_clean":"2024-09-11T23:59:21.642891+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:59:21.642891+0000","last_undegraded":"2024-09-11T23:59:21.642891+0000","last_fullsized":"2024-09-11T23:59:21.642891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466333+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:59:21.466333+0000","last_peered":"2024-09-11T23:59:21.466333+0000","last_clean":"2024-09-11T23:59:21.466333+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:59:21.466333+0000","last_undegraded":"2024-09-11T23:59:21.466333+0000","last_fullsized":"2024-09-11T23:59:21.466333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472936+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:59:21.472936+0000","last_peered":"2024-09-11T23:59:21.472936+0000","last_clean":"2024-09-11T23:59:21.472936+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:59:21.472936+0000","last_undegraded":"2024-09-11T23:59:21.472936+0000","last_fullsized":"2024-09-11T23:59:21.472936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385069+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:59:21.385069+0000","last_peered":"2024-09-11T23:59:21.385069+0000","last_clean":"2024-09-11T23:59:21.385069+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:59:21.385069+0000","last_undegraded":"2024-09-11T23:59:21.385069+0000","last_fullsized":"2024-09-11T23:59:21.385069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":242,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:26.648226+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:59:26.648226+0000","last_peered":"2024-09-11T23:59:26.648226+0000","last_clean":"2024-09-11T23:59:26.648226+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:59:26.648226+0000","last_undegraded":"2024-09-11T23:59:26.648226+0000","last_fullsized":"2024-09-11T23:59:26.648226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387218+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:59:21.387218+0000","last_peered":"2024-09-11T23:59:21.387218+0000","last_clean":"2024-09-11T23:59:21.387218+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:59:21.387218+0000","last_undegraded":"2024-09-11T23:59:21.387218+0000","last_fullsized":"2024-09-11T23:59:21.387218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644343+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:59:21.644343+0000","last_peered":"2024-09-11T23:59:21.644343+0000","last_clean":"2024-09-11T23:59:21.644343+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:59:21.644343+0000","last_undegraded":"2024-09-11T23:59:21.644343+0000","last_fullsized":"2024-09-11T23:59:21.644343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681237+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:59:21.681237+0000","last_peered":"2024-09-11T23:59:21.681237+0000","last_clean":"2024-09-11T23:59:21.681237+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:59:21.681237+0000","last_undegraded":"2024-09-11T23:59:21.681237+0000","last_fullsized":"2024-09-11T23:59:21.681237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473215+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:59:21.473215+0000","last_peered":"2024-09-11T23:59:21.473215+0000","last_clean":"2024-09-11T23:59:21.473215+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:59:21.473215+0000","last_undegraded":"2024-09-11T23:59:21.473215+0000","last_fullsized":"2024-09-11T23:59:21.473215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386888+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:59:21.386888+0000","last_peered":"2024-09-11T23:59:21.386888+0000","last_clean":"2024-09-11T23:59:21.386888+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:59:21.386888+0000","last_undegraded":"2024-09-11T23:59:21.386888+0000","last_fullsized":"2024-09-11T23:59:21.386888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":283,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:26.647711+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:59:26.647711+0000","last_peered":"2024-09-11T23:59:26.647711+0000","last_clean":"2024-09-11T23:59:26.647711+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:59:26.647711+0000","last_undegraded":"2024-09-11T23:59:26.647711+0000","last_fullsized":"2024-09-11T23:59:26.647711+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":177,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701163+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:59:21.701163+0000","last_peered":"2024-09-11T23:59:21.701163+0000","last_clean":"2024-09-11T23:59:21.701163+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:59:21.701163+0000","last_undegraded":"2024-09-11T23:59:21.701163+0000","last_fullsized":"2024-09-11T23:59:21.701163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387205+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:59:21.387205+0000","last_peered":"2024-09-11T23:59:21.387205+0000","last_clean":"2024-09-11T23:59:21.387205+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:59:21.387205+0000","last_undegraded":"2024-09-11T23:59:21.387205+0000","last_fullsized":"2024-09-11T23:59:21.387205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643090+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:59:21.643090+0000","last_peered":"2024-09-11T23:59:21.643090+0000","last_clean":"2024-09-11T23:59:21.643090+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:59:21.643090+0000","last_undegraded":"2024-09-11T23:59:21.643090+0000","last_fullsized":"2024-09-11T23:59:21.643090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472835+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:59:21.472835+0000","last_peered":"2024-09-11T23:59:21.472835+0000","last_clean":"2024-09-11T23:59:21.472835+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:59:21.472835+0000","last_undegraded":"2024-09-11T23:59:21.472835+0000","last_fullsized":"2024-09-11T23:59:21.472835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644370+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:59:21.644370+0000","last_peered":"2024-09-11T23:59:21.644370+0000","last_clean":"2024-09-11T23:59:21.644370+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:59:21.644370+0000","last_undegraded":"2024-09-11T23:59:21.644370+0000","last_fullsized":"2024-09-11T23:59:21.644370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":141,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:25.649360+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:59:25.649360+0000","last_peered":"2024-09-11T23:59:25.649360+0000","last_clean":"2024-09-11T23:59:25.649360+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:59:25.649360+0000","last_undegraded":"2024-09-11T23:59:25.649360+0000","last_fullsized":"2024-09-11T23:59:25.649360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644127+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:59:21.644127+0000","last_peered":"2024-09-11T23:59:21.644127+0000","last_clean":"2024-09-11T23:59:21.644127+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:59:21.644127+0000","last_undegraded":"2024-09-11T23:59:21.644127+0000","last_fullsized":"2024-09-11T23:59:21.644127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472738+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:59:21.472738+0000","last_peered":"2024-09-11T23:59:21.472738+0000","last_clean":"2024-09-11T23:59:21.472738+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:59:21.472738+0000","last_undegraded":"2024-09-11T23:59:21.472738+0000","last_fullsized":"2024-09-11T23:59:21.472738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701229+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:59:21.701229+0000","last_peered":"2024-09-11T23:59:21.701229+0000","last_clean":"2024-09-11T23:59:21.701229+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:59:21.701229+0000","last_undegraded":"2024-09-11T23:59:21.701229+0000","last_fullsized":"2024-09-11T23:59:21.701229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466415+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:59:21.466415+0000","last_peered":"2024-09-11T23:59:21.466415+0000","last_clean":"2024-09-11T23:59:21.466415+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:59:21.466415+0000","last_undegraded":"2024-09-11T23:59:21.466415+0000","last_fullsized":"2024-09-11T23:59:21.466415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643857+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:59:21.643857+0000","last_peered":"2024-09-11T23:59:21.643857+0000","last_clean":"2024-09-11T23:59:21.643857+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:59:21.643857+0000","last_undegraded":"2024-09-11T23:59:21.643857+0000","last_fullsized":"2024-09-11T23:59:21.643857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644471+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:59:21.644471+0000","last_peered":"2024-09-11T23:59:21.644471+0000","last_clean":"2024-09-11T23:59:21.644471+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:59:21.644471+0000","last_undegraded":"2024-09-11T23:59:21.644471+0000","last_fullsized":"2024-09-11T23:59:21.644471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'41","reported_seq":73,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.600003+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:59:21.600003+0000","last_peered":"2024-09-11T23:59:21.600003+0000","last_clean":"2024-09-11T23:59:21.600003+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:59:21.600003+0000","last_undegraded":"2024-09-11T23:59:21.600003+0000","last_fullsized":"2024-09-11T23:59:21.600003+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644309+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:59:21.644309+0000","last_peered":"2024-09-11T23:59:21.644309+0000","last_clean":"2024-09-11T23:59:21.644309+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:59:21.644309+0000","last_undegraded":"2024-09-11T23:59:21.644309+0000","last_fullsized":"2024-09-11T23:59:21.644309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":139,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:25.647617+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:59:25.647617+0000","last_peered":"2024-09-11T23:59:25.647617+0000","last_clean":"2024-09-11T23:59:25.647617+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:59:25.647617+0000","last_undegraded":"2024-09-11T23:59:25.647617+0000","last_fullsized":"2024-09-11T23:59:25.647617+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644569+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:59:21.644569+0000","last_peered":"2024-09-11T23:59:21.644569+0000","last_clean":"2024-09-11T23:59:21.644569+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:59:21.644569+0000","last_undegraded":"2024-09-11T23:59:21.644569+0000","last_fullsized":"2024-09-11T23:59:21.644569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":392,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:23.481396+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:59:23.481396+0000","last_peered":"2024-09-11T23:59:23.481396+0000","last_clean":"2024-09-11T23:59:23.481396+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:59:23.481396+0000","last_undegraded":"2024-09-11T23:59:23.481396+0000","last_fullsized":"2024-09-11T23:59:23.481396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645112+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:59:21.645112+0000","last_peered":"2024-09-11T23:59:21.645112+0000","last_clean":"2024-09-11T23:59:21.645112+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:59:21.645112+0000","last_undegraded":"2024-09-11T23:59:21.645112+0000","last_fullsized":"2024-09-11T23:59:21.645112+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466865+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:59:21.466865+0000","last_peered":"2024-09-11T23:59:21.466865+0000","last_clean":"2024-09-11T23:59:21.466865+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:59:21.466865+0000","last_undegraded":"2024-09-11T23:59:21.466865+0000","last_fullsized":"2024-09-11T23:59:21.466865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466169+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:59:21.466169+0000","last_peered":"2024-09-11T23:59:21.466169+0000","last_clean":"2024-09-11T23:59:21.466169+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:59:21.466169+0000","last_undegraded":"2024-09-11T23:59:21.466169+0000","last_fullsized":"2024-09-11T23:59:21.466169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642758+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:59:21.642758+0000","last_peered":"2024-09-11T23:59:21.642758+0000","last_clean":"2024-09-11T23:59:21.642758+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:59:21.642758+0000","last_undegraded":"2024-09-11T23:59:21.642758+0000","last_fullsized":"2024-09-11T23:59:21.642758+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":137,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:25.648938+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:59:25.648938+0000","last_peered":"2024-09-11T23:59:25.648938+0000","last_clean":"2024-09-11T23:59:25.648938+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:59:25.648938+0000","last_undegraded":"2024-09-11T23:59:25.648938+0000","last_fullsized":"2024-09-11T23:59:25.648938+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473034+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:59:21.473034+0000","last_peered":"2024-09-11T23:59:21.473034+0000","last_clean":"2024-09-11T23:59:21.473034+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:59:21.473034+0000","last_undegraded":"2024-09-11T23:59:21.473034+0000","last_fullsized":"2024-09-11T23:59:21.473034+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'8","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:25.649186+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:59:25.649186+0000","last_peered":"2024-09-11T23:59:25.649186+0000","last_clean":"2024-09-11T23:59:25.649186+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:59:25.649186+0000","last_undegraded":"2024-09-11T23:59:25.649186+0000","last_fullsized":"2024-09-11T23:59:25.649186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475979+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:59:21.475979+0000","last_peered":"2024-09-11T23:59:21.475979+0000","last_clean":"2024-09-11T23:59:21.475979+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:59:21.475979+0000","last_undegraded":"2024-09-11T23:59:21.475979+0000","last_fullsized":"2024-09-11T23:59:21.475979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385258+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:59:21.385258+0000","last_peered":"2024-09-11T23:59:21.385258+0000","last_clean":"2024-09-11T23:59:21.385258+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:59:21.385258+0000","last_undegraded":"2024-09-11T23:59:21.385258+0000","last_fullsized":"2024-09-11T23:59:21.385258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476051+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:59:21.476051+0000","last_peered":"2024-09-11T23:59:21.476051+0000","last_clean":"2024-09-11T23:59:21.476051+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:59:21.476051+0000","last_undegraded":"2024-09-11T23:59:21.476051+0000","last_fullsized":"2024-09-11T23:59:21.476051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701325+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:59:21.701325+0000","last_peered":"2024-09-11T23:59:21.701325+0000","last_clean":"2024-09-11T23:59:21.701325+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:59:21.701325+0000","last_undegraded":"2024-09-11T23:59:21.701325+0000","last_fullsized":"2024-09-11T23:59:21.701325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643556+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:59:21.643556+0000","last_peered":"2024-09-11T23:59:21.643556+0000","last_clean":"2024-09-11T23:59:21.643556+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:59:21.643556+0000","last_undegraded":"2024-09-11T23:59:21.643556+0000","last_fullsized":"2024-09-11T23:59:21.643556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'51","reported_seq":114,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.606453+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:59:21.606453+0000","last_peered":"2024-09-11T23:59:21.606453+0000","last_clean":"2024-09-11T23:59:21.606453+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:59:21.606453+0000","last_undegraded":"2024-09-11T23:59:21.606453+0000","last_fullsized":"2024-09-11T23:59:21.606453+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466838+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:59:21.466838+0000","last_peered":"2024-09-11T23:59:21.466838+0000","last_clean":"2024-09-11T23:59:21.466838+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:59:21.466838+0000","last_undegraded":"2024-09-11T23:59:21.466838+0000","last_fullsized":"2024-09-11T23:59:21.466838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645248+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:59:21.645248+0000","last_peered":"2024-09-11T23:59:21.645248+0000","last_clean":"2024-09-11T23:59:21.645248+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:59:21.645248+0000","last_undegraded":"2024-09-11T23:59:21.645248+0000","last_fullsized":"2024-09-11T23:59:21.645248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680966+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:59:21.680966+0000","last_peered":"2024-09-11T23:59:21.680966+0000","last_clean":"2024-09-11T23:59:21.680966+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:59:21.680966+0000","last_undegraded":"2024-09-11T23:59:21.680966+0000","last_fullsized":"2024-09-11T23:59:21.680966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386783+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:59:21.386783+0000","last_peered":"2024-09-11T23:59:21.386783+0000","last_clean":"2024-09-11T23:59:21.386783+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:59:21.386783+0000","last_undegraded":"2024-09-11T23:59:21.386783+0000","last_fullsized":"2024-09-11T23:59:21.386783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466548+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:59:21.466548+0000","last_peered":"2024-09-11T23:59:21.466548+0000","last_clean":"2024-09-11T23:59:21.466548+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:59:21.466548+0000","last_undegraded":"2024-09-11T23:59:21.466548+0000","last_fullsized":"2024-09-11T23:59:21.466548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387214+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:59:21.387214+0000","last_peered":"2024-09-11T23:59:21.387214+0000","last_clean":"2024-09-11T23:59:21.387214+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:59:21.387214+0000","last_undegraded":"2024-09-11T23:59:21.387214+0000","last_fullsized":"2024-09-11T23:59:21.387214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466575+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:59:21.466575+0000","last_peered":"2024-09-11T23:59:21.466575+0000","last_clean":"2024-09-11T23:59:21.466575+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:59:21.466575+0000","last_undegraded":"2024-09-11T23:59:21.466575+0000","last_fullsized":"2024-09-11T23:59:21.466575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701133+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:59:21.701133+0000","last_peered":"2024-09-11T23:59:21.701133+0000","last_clean":"2024-09-11T23:59:21.701133+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:59:21.701133+0000","last_undegraded":"2024-09-11T23:59:21.701133+0000","last_fullsized":"2024-09-11T23:59:21.701133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644300+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:59:21.644300+0000","last_peered":"2024-09-11T23:59:21.644300+0000","last_clean":"2024-09-11T23:59:21.644300+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:59:21.644300+0000","last_undegraded":"2024-09-11T23:59:21.644300+0000","last_fullsized":"2024-09-11T23:59:21.644300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473153+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:59:21.473153+0000","last_peered":"2024-09-11T23:59:21.473153+0000","last_clean":"2024-09-11T23:59:21.473153+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:59:21.473153+0000","last_undegraded":"2024-09-11T23:59:21.473153+0000","last_fullsized":"2024-09-11T23:59:21.473153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701254+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:59:21.701254+0000","last_peered":"2024-09-11T23:59:21.701254+0000","last_clean":"2024-09-11T23:59:21.701254+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:59:21.701254+0000","last_undegraded":"2024-09-11T23:59:21.701254+0000","last_fullsized":"2024-09-11T23:59:21.701254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386855+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:59:21.386855+0000","last_peered":"2024-09-11T23:59:21.386855+0000","last_clean":"2024-09-11T23:59:21.386855+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:59:21.386855+0000","last_undegraded":"2024-09-11T23:59:21.386855+0000","last_fullsized":"2024-09-11T23:59:21.386855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701190+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:59:21.701190+0000","last_peered":"2024-09-11T23:59:21.701190+0000","last_clean":"2024-09-11T23:59:21.701190+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:59:21.701190+0000","last_undegraded":"2024-09-11T23:59:21.701190+0000","last_fullsized":"2024-09-11T23:59:21.701190+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681315+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:59:21.681315+0000","last_peered":"2024-09-11T23:59:21.681315+0000","last_clean":"2024-09-11T23:59:21.681315+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:59:21.681315+0000","last_undegraded":"2024-09-11T23:59:21.681315+0000","last_fullsized":"2024-09-11T23:59:21.681315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466943+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:59:21.466943+0000","last_peered":"2024-09-11T23:59:21.466943+0000","last_clean":"2024-09-11T23:59:21.466943+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:59:21.466943+0000","last_undegraded":"2024-09-11T23:59:21.466943+0000","last_fullsized":"2024-09-11T23:59:21.466943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466791+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:59:21.466791+0000","last_peered":"2024-09-11T23:59:21.466791+0000","last_clean":"2024-09-11T23:59:21.466791+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:59:21.466791+0000","last_undegraded":"2024-09-11T23:59:21.466791+0000","last_fullsized":"2024-09-11T23:59:21.466791+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":145,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:25.648750+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:59:25.648750+0000","last_peered":"2024-09-11T23:59:25.648750+0000","last_clean":"2024-09-11T23:59:25.648750+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:59:25.648750+0000","last_undegraded":"2024-09-11T23:59:25.648750+0000","last_fullsized":"2024-09-11T23:59:25.648750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600807,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1202,"num_read_kb":719,"num_write":376,"num_write_kb":1465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1802421,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579940,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":836685,"data_compressed":22043,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":1232719,"data_compressed":45324,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":958464,"data_stored":836222,"data_compressed":22043,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":443384,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430264,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1038207,"data_compressed":39168,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":443565,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1168109,"data_compressed":45324,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445060,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215181,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":967364,"data_compressed":28199,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":510107,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":987136,"data_stored":510958,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":444455,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135740,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":200350,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":394801,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:59:33.837 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:59:34.094 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:34.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 -- 172.21.15.60:0/1121504416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 msgr2=0x7fee8410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:34.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/1121504416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 0x7fee8410d950 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009cd0 tx=0x7fee7c02a8e0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 -- 172.21.15.60:0/1121504416 shutdown_connections 2024-09-11T23:59:34.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/1121504416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 0x7fee8410d950 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/1121504416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee84100a80 0x7fee84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/1121504416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee84106a80 0x7fee84106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 -- 172.21.15.60:0/1121504416 >> 172.21.15.60:0/1121504416 conn(0x7fee840fc7a0 msgr2=0x7fee840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 -- 172.21.15.60:0/1121504416 shutdown_connections 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.550+0000 7fee8c5e9640 1 -- 172.21.15.60:0/1121504416 wait complete. 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8c5e9640 1 Processor -- start 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8c5e9640 1 -- start start 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8c5e9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee84100a80 0x7fee841984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8c5e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 0x7fee84198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8c5e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee84106a80 0x7fee8419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8c5e9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee841120a0 con 0x7fee84101420 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8c5e9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee84111f20 con 0x7fee84106a80 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8c5e9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee84112220 con 0x7fee84100a80 2024-09-11T23:59:34.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 0x7fee84198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 0x7fee84198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34500/0 (socket says 172.21.15.60:34500) 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 -- 172.21.15.60:0/656260959 learned_addr learned my addr 172.21.15.60:0/656260959 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8a385640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee84100a80 0x7fee841984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8ab86640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee84106a80 0x7fee8419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 -- 172.21.15.60:0/656260959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee84100a80 msgr2=0x7fee841984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee84100a80 0x7fee841984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 -- 172.21.15.60:0/656260959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee84106a80 msgr2=0x7fee8419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee84106a80 0x7fee8419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 -- 172.21.15.60:0/656260959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8419d470 con 0x7fee84101420 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee8ab86640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee84106a80 0x7fee8419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.551+0000 7fee89b84640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 0x7fee84198a00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fee7400d950 tx=0x7fee7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:34.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.552+0000 7fee7b7fe640 1 -- 172.21.15.60:0/656260959 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74017030 con 0x7fee84101420 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.552+0000 7fee7b7fe640 1 -- 172.21.15.60:0/656260959 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee74004020 con 0x7fee84101420 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.552+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8419d760 con 0x7fee84101420 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.552+0000 7fee7b7fe640 1 -- 172.21.15.60:0/656260959 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74004a00 con 0x7fee84101420 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.552+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee841a5040 con 0x7fee84101420 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.553+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee84100ee0 con 0x7fee84101420 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.554+0000 7fee7b7fe640 1 -- 172.21.15.60:0/656260959 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fee740041d0 con 0x7fee84101420 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.555+0000 7fee7b7fe640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee700a2d80 0x7fee700a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.555+0000 7fee8a385640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee700a2d80 0x7fee700a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.555+0000 7fee7b7fe640 1 -- 172.21.15.60:0/656260959 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fee740cf6d0 con 0x7fee84101420 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.555+0000 7fee8a385640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee700a2d80 0x7fee700a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee80005fd0 tx=0x7fee80005850 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.558+0000 7fee7b7fe640 1 -- 172.21.15.60:0/656260959 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee7409c1d0 con 0x7fee84101420 2024-09-11T23:59:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:34 smithi105 ceph-mon[34805]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-11T23:59:34.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.731+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee840fd4d0 con 0x7fee700a2d80 2024-09-11T23:59:34.730 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:34 smithi060 ceph-mon[30953]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-11T23:59:34.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.737+0000 7fee7b7fe640 1 -- 172.21.15.60:0/656260959 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258077 (secure 0 0 0) 0x7fee840fd4d0 con 0x7fee700a2d80 2024-09-11T23:59:34.739 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:34.740 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:59:34.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee700a2d80 msgr2=0x7fee700a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:34.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee700a2d80 0x7fee700a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee80005fd0 tx=0x7fee80005850 comp rx=0 tx=0).stop 2024-09-11T23:59:34.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 msgr2=0x7fee84198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 0x7fee84198a00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fee7400d950 tx=0x7fee7400de10 comp rx=0 tx=0).stop 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 shutdown_connections 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee700a2d80 0x7fee700a5240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee84106a80 0x7fee8419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee84101420 0x7fee84198a00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 --2- 172.21.15.60:0/656260959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee84100a80 0x7fee841984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 >> 172.21.15.60:0/656260959 conn(0x7fee840fc7a0 msgr2=0x7fee840fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 shutdown_connections 2024-09-11T23:59:34.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:34.740+0000 7fee8c5e9640 1 -- 172.21.15.60:0/656260959 wait complete. 2024-09-11T23:59:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:34 smithi192 ceph-mon[35487]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-11T23:59:35.386 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-11T23:59:33.400500+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1388041,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1744,"num_read_kb":1306,"num_write":705,"num_write_kb":5319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1031,"ondisk_log_size":1031,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369080,"kb_used_data":11460,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572744,"statfs":{"total":1151940427776,"available":1151562489856,"internally_reserved":0,"allocated":11735040,"data_stored":9466731,"data_compressed":247050,"data_compressed_allocated":319488,"data_compressed_original":3969024,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":502,"num_write":150,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.943747"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466469+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:59:21.466469+0000","last_peered":"2024-09-11T23:59:21.466469+0000","last_clean":"2024-09-11T23:59:21.466469+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:59:21.466469+0000","last_undegraded":"2024-09-11T23:59:21.466469+0000","last_fullsized":"2024-09-11T23:59:21.466469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680982+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:59:21.680982+0000","last_peered":"2024-09-11T23:59:21.680982+0000","last_clean":"2024-09-11T23:59:21.680982+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:59:21.680982+0000","last_undegraded":"2024-09-11T23:59:21.680982+0000","last_fullsized":"2024-09-11T23:59:21.680982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680810+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:59:21.680810+0000","last_peered":"2024-09-11T23:59:21.680810+0000","last_clean":"2024-09-11T23:59:21.680810+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:59:21.680810+0000","last_undegraded":"2024-09-11T23:59:21.680810+0000","last_fullsized":"2024-09-11T23:59:21.680810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645319+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:59:21.645319+0000","last_peered":"2024-09-11T23:59:21.645319+0000","last_clean":"2024-09-11T23:59:21.645319+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:59:21.645319+0000","last_undegraded":"2024-09-11T23:59:21.645319+0000","last_fullsized":"2024-09-11T23:59:21.645319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700973+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:59:21.700973+0000","last_peered":"2024-09-11T23:59:21.700973+0000","last_clean":"2024-09-11T23:59:21.700973+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:59:21.700973+0000","last_undegraded":"2024-09-11T23:59:21.700973+0000","last_fullsized":"2024-09-11T23:59:21.700973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475885+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:59:21.475885+0000","last_peered":"2024-09-11T23:59:21.475885+0000","last_clean":"2024-09-11T23:59:21.475885+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:59:21.475885+0000","last_undegraded":"2024-09-11T23:59:21.475885+0000","last_fullsized":"2024-09-11T23:59:21.475885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644131+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:59:21.644131+0000","last_peered":"2024-09-11T23:59:21.644131+0000","last_clean":"2024-09-11T23:59:21.644131+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:59:21.644131+0000","last_undegraded":"2024-09-11T23:59:21.644131+0000","last_fullsized":"2024-09-11T23:59:21.644131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466288+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:59:21.466288+0000","last_peered":"2024-09-11T23:59:21.466288+0000","last_clean":"2024-09-11T23:59:21.466288+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:59:21.466288+0000","last_undegraded":"2024-09-11T23:59:21.466288+0000","last_fullsized":"2024-09-11T23:59:21.466288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387087+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:59:21.387087+0000","last_peered":"2024-09-11T23:59:21.387087+0000","last_clean":"2024-09-11T23:59:21.387087+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:59:21.387087+0000","last_undegraded":"2024-09-11T23:59:21.387087+0000","last_fullsized":"2024-09-11T23:59:21.387087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476277+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:59:21.476277+0000","last_peered":"2024-09-11T23:59:21.476277+0000","last_clean":"2024-09-11T23:59:21.476277+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:59:21.476277+0000","last_undegraded":"2024-09-11T23:59:21.476277+0000","last_fullsized":"2024-09-11T23:59:21.476277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644423+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:59:21.644423+0000","last_peered":"2024-09-11T23:59:21.644423+0000","last_clean":"2024-09-11T23:59:21.644423+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:59:21.644423+0000","last_undegraded":"2024-09-11T23:59:21.644423+0000","last_fullsized":"2024-09-11T23:59:21.644423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385078+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:59:21.385078+0000","last_peered":"2024-09-11T23:59:21.385078+0000","last_clean":"2024-09-11T23:59:21.385078+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:59:21.385078+0000","last_undegraded":"2024-09-11T23:59:21.385078+0000","last_fullsized":"2024-09-11T23:59:21.385078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643697+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:59:21.643697+0000","last_peered":"2024-09-11T23:59:21.643697+0000","last_clean":"2024-09-11T23:59:21.643697+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:59:21.643697+0000","last_undegraded":"2024-09-11T23:59:21.643697+0000","last_fullsized":"2024-09-11T23:59:21.643697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680072+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:59:21.680072+0000","last_peered":"2024-09-11T23:59:21.680072+0000","last_clean":"2024-09-11T23:59:21.680072+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:59:21.680072+0000","last_undegraded":"2024-09-11T23:59:21.680072+0000","last_fullsized":"2024-09-11T23:59:21.680072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.679770+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:59:21.679770+0000","last_peered":"2024-09-11T23:59:21.679770+0000","last_clean":"2024-09-11T23:59:21.679770+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:59:21.679770+0000","last_undegraded":"2024-09-11T23:59:21.679770+0000","last_fullsized":"2024-09-11T23:59:21.679770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386692+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:59:21.386692+0000","last_peered":"2024-09-11T23:59:21.386692+0000","last_clean":"2024-09-11T23:59:21.386692+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:59:21.386692+0000","last_undegraded":"2024-09-11T23:59:21.386692+0000","last_fullsized":"2024-09-11T23:59:21.386692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466577+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:59:21.466577+0000","last_peered":"2024-09-11T23:59:21.466577+0000","last_clean":"2024-09-11T23:59:21.466577+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:59:21.466577+0000","last_undegraded":"2024-09-11T23:59:21.466577+0000","last_fullsized":"2024-09-11T23:59:21.466577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385256+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:59:21.385256+0000","last_peered":"2024-09-11T23:59:21.385256+0000","last_clean":"2024-09-11T23:59:21.385256+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:59:21.385256+0000","last_undegraded":"2024-09-11T23:59:21.385256+0000","last_fullsized":"2024-09-11T23:59:21.385256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387348+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:59:21.387348+0000","last_peered":"2024-09-11T23:59:21.387348+0000","last_clean":"2024-09-11T23:59:21.387348+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:59:21.387348+0000","last_undegraded":"2024-09-11T23:59:21.387348+0000","last_fullsized":"2024-09-11T23:59:21.387348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466261+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:59:21.466261+0000","last_peered":"2024-09-11T23:59:21.466261+0000","last_clean":"2024-09-11T23:59:21.466261+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:59:21.466261+0000","last_undegraded":"2024-09-11T23:59:21.466261+0000","last_fullsized":"2024-09-11T23:59:21.466261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643856+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:59:21.643856+0000","last_peered":"2024-09-11T23:59:21.643856+0000","last_clean":"2024-09-11T23:59:21.643856+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:59:21.643856+0000","last_undegraded":"2024-09-11T23:59:21.643856+0000","last_fullsized":"2024-09-11T23:59:21.643856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386866+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:59:21.386866+0000","last_peered":"2024-09-11T23:59:21.386866+0000","last_clean":"2024-09-11T23:59:21.386866+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:59:21.386866+0000","last_undegraded":"2024-09-11T23:59:21.386866+0000","last_fullsized":"2024-09-11T23:59:21.386866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466381+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:59:21.466381+0000","last_peered":"2024-09-11T23:59:21.466381+0000","last_clean":"2024-09-11T23:59:21.466381+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:59:21.466381+0000","last_undegraded":"2024-09-11T23:59:21.466381+0000","last_fullsized":"2024-09-11T23:59:21.466381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472730+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:59:21.472730+0000","last_peered":"2024-09-11T23:59:21.472730+0000","last_clean":"2024-09-11T23:59:21.472730+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:59:21.472730+0000","last_undegraded":"2024-09-11T23:59:21.472730+0000","last_fullsized":"2024-09-11T23:59:21.472730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466751+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:59:21.466751+0000","last_peered":"2024-09-11T23:59:21.466751+0000","last_clean":"2024-09-11T23:59:21.466751+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:59:21.466751+0000","last_undegraded":"2024-09-11T23:59:21.466751+0000","last_fullsized":"2024-09-11T23:59:21.466751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387391+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:59:21.387391+0000","last_peered":"2024-09-11T23:59:21.387391+0000","last_clean":"2024-09-11T23:59:21.387391+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:59:21.387391+0000","last_undegraded":"2024-09-11T23:59:21.387391+0000","last_fullsized":"2024-09-11T23:59:21.387391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466340+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:59:21.466340+0000","last_peered":"2024-09-11T23:59:21.466340+0000","last_clean":"2024-09-11T23:59:21.466340+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:59:21.466340+0000","last_undegraded":"2024-09-11T23:59:21.466340+0000","last_fullsized":"2024-09-11T23:59:21.466340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643440+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:59:21.643440+0000","last_peered":"2024-09-11T23:59:21.643440+0000","last_clean":"2024-09-11T23:59:21.643440+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:59:21.643440+0000","last_undegraded":"2024-09-11T23:59:21.643440+0000","last_fullsized":"2024-09-11T23:59:21.643440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:59:21.680410+0000","last_peered":"2024-09-11T23:59:21.680410+0000","last_clean":"2024-09-11T23:59:21.680410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:59:21.680410+0000","last_undegraded":"2024-09-11T23:59:21.680410+0000","last_fullsized":"2024-09-11T23:59:21.680410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387149+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:59:21.387149+0000","last_peered":"2024-09-11T23:59:21.387149+0000","last_clean":"2024-09-11T23:59:21.387149+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:59:21.387149+0000","last_undegraded":"2024-09-11T23:59:21.387149+0000","last_fullsized":"2024-09-11T23:59:21.387149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387182+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:59:21.387182+0000","last_peered":"2024-09-11T23:59:21.387182+0000","last_clean":"2024-09-11T23:59:21.387182+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:59:21.387182+0000","last_undegraded":"2024-09-11T23:59:21.387182+0000","last_fullsized":"2024-09-11T23:59:21.387182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466594+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:59:21.466594+0000","last_peered":"2024-09-11T23:59:21.466594+0000","last_clean":"2024-09-11T23:59:21.466594+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:59:21.466594+0000","last_undegraded":"2024-09-11T23:59:21.466594+0000","last_fullsized":"2024-09-11T23:59:21.466594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700936+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:59:21.700936+0000","last_peered":"2024-09-11T23:59:21.700936+0000","last_clean":"2024-09-11T23:59:21.700936+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:59:21.700936+0000","last_undegraded":"2024-09-11T23:59:21.700936+0000","last_fullsized":"2024-09-11T23:59:21.700936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'9","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:30.654332+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:59:30.654332+0000","last_peered":"2024-09-11T23:59:30.654332+0000","last_clean":"2024-09-11T23:59:30.654332+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:59:30.654332+0000","last_undegraded":"2024-09-11T23:59:30.654332+0000","last_fullsized":"2024-09-11T23:59:30.654332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472907+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:59:21.472907+0000","last_peered":"2024-09-11T23:59:21.472907+0000","last_clean":"2024-09-11T23:59:21.472907+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:59:21.472907+0000","last_undegraded":"2024-09-11T23:59:21.472907+0000","last_fullsized":"2024-09-11T23:59:21.472907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475951+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:59:21.475951+0000","last_peered":"2024-09-11T23:59:21.475951+0000","last_clean":"2024-09-11T23:59:21.475951+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:59:21.475951+0000","last_undegraded":"2024-09-11T23:59:21.475951+0000","last_fullsized":"2024-09-11T23:59:21.475951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642891+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:59:21.642891+0000","last_peered":"2024-09-11T23:59:21.642891+0000","last_clean":"2024-09-11T23:59:21.642891+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:59:21.642891+0000","last_undegraded":"2024-09-11T23:59:21.642891+0000","last_fullsized":"2024-09-11T23:59:21.642891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466333+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:59:21.466333+0000","last_peered":"2024-09-11T23:59:21.466333+0000","last_clean":"2024-09-11T23:59:21.466333+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:59:21.466333+0000","last_undegraded":"2024-09-11T23:59:21.466333+0000","last_fullsized":"2024-09-11T23:59:21.466333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472936+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:59:21.472936+0000","last_peered":"2024-09-11T23:59:21.472936+0000","last_clean":"2024-09-11T23:59:21.472936+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:59:21.472936+0000","last_undegraded":"2024-09-11T23:59:21.472936+0000","last_fullsized":"2024-09-11T23:59:21.472936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385069+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:59:21.385069+0000","last_peered":"2024-09-11T23:59:21.385069+0000","last_clean":"2024-09-11T23:59:21.385069+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:59:21.385069+0000","last_undegraded":"2024-09-11T23:59:21.385069+0000","last_fullsized":"2024-09-11T23:59:21.385069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":252,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.654783+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:59:31.654783+0000","last_peered":"2024-09-11T23:59:31.654783+0000","last_clean":"2024-09-11T23:59:31.654783+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:59:31.654783+0000","last_undegraded":"2024-09-11T23:59:31.654783+0000","last_fullsized":"2024-09-11T23:59:31.654783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387218+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:59:21.387218+0000","last_peered":"2024-09-11T23:59:21.387218+0000","last_clean":"2024-09-11T23:59:21.387218+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:59:21.387218+0000","last_undegraded":"2024-09-11T23:59:21.387218+0000","last_fullsized":"2024-09-11T23:59:21.387218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644343+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:59:21.644343+0000","last_peered":"2024-09-11T23:59:21.644343+0000","last_clean":"2024-09-11T23:59:21.644343+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:59:21.644343+0000","last_undegraded":"2024-09-11T23:59:21.644343+0000","last_fullsized":"2024-09-11T23:59:21.644343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681237+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:59:21.681237+0000","last_peered":"2024-09-11T23:59:21.681237+0000","last_clean":"2024-09-11T23:59:21.681237+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:59:21.681237+0000","last_undegraded":"2024-09-11T23:59:21.681237+0000","last_fullsized":"2024-09-11T23:59:21.681237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473215+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:59:21.473215+0000","last_peered":"2024-09-11T23:59:21.473215+0000","last_clean":"2024-09-11T23:59:21.473215+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:59:21.473215+0000","last_undegraded":"2024-09-11T23:59:21.473215+0000","last_fullsized":"2024-09-11T23:59:21.473215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386888+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:59:21.386888+0000","last_peered":"2024-09-11T23:59:21.386888+0000","last_clean":"2024-09-11T23:59:21.386888+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:59:21.386888+0000","last_undegraded":"2024-09-11T23:59:21.386888+0000","last_fullsized":"2024-09-11T23:59:21.386888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":294,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.654098+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:59:31.654098+0000","last_peered":"2024-09-11T23:59:31.654098+0000","last_clean":"2024-09-11T23:59:31.654098+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:59:31.654098+0000","last_undegraded":"2024-09-11T23:59:31.654098+0000","last_fullsized":"2024-09-11T23:59:31.654098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":234,"num_read_kb":183,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701163+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:59:21.701163+0000","last_peered":"2024-09-11T23:59:21.701163+0000","last_clean":"2024-09-11T23:59:21.701163+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:59:21.701163+0000","last_undegraded":"2024-09-11T23:59:21.701163+0000","last_fullsized":"2024-09-11T23:59:21.701163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387205+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:59:21.387205+0000","last_peered":"2024-09-11T23:59:21.387205+0000","last_clean":"2024-09-11T23:59:21.387205+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:59:21.387205+0000","last_undegraded":"2024-09-11T23:59:21.387205+0000","last_fullsized":"2024-09-11T23:59:21.387205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643090+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:59:21.643090+0000","last_peered":"2024-09-11T23:59:21.643090+0000","last_clean":"2024-09-11T23:59:21.643090+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:59:21.643090+0000","last_undegraded":"2024-09-11T23:59:21.643090+0000","last_fullsized":"2024-09-11T23:59:21.643090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472835+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:59:21.472835+0000","last_peered":"2024-09-11T23:59:21.472835+0000","last_clean":"2024-09-11T23:59:21.472835+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:59:21.472835+0000","last_undegraded":"2024-09-11T23:59:21.472835+0000","last_fullsized":"2024-09-11T23:59:21.472835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644370+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:59:21.644370+0000","last_peered":"2024-09-11T23:59:21.644370+0000","last_clean":"2024-09-11T23:59:21.644370+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:59:21.644370+0000","last_undegraded":"2024-09-11T23:59:21.644370+0000","last_fullsized":"2024-09-11T23:59:21.644370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:30.654572+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:59:30.654572+0000","last_peered":"2024-09-11T23:59:30.654572+0000","last_clean":"2024-09-11T23:59:30.654572+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:59:30.654572+0000","last_undegraded":"2024-09-11T23:59:30.654572+0000","last_fullsized":"2024-09-11T23:59:30.654572+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644127+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:59:21.644127+0000","last_peered":"2024-09-11T23:59:21.644127+0000","last_clean":"2024-09-11T23:59:21.644127+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:59:21.644127+0000","last_undegraded":"2024-09-11T23:59:21.644127+0000","last_fullsized":"2024-09-11T23:59:21.644127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472738+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:59:21.472738+0000","last_peered":"2024-09-11T23:59:21.472738+0000","last_clean":"2024-09-11T23:59:21.472738+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:59:21.472738+0000","last_undegraded":"2024-09-11T23:59:21.472738+0000","last_fullsized":"2024-09-11T23:59:21.472738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701229+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:59:21.701229+0000","last_peered":"2024-09-11T23:59:21.701229+0000","last_clean":"2024-09-11T23:59:21.701229+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:59:21.701229+0000","last_undegraded":"2024-09-11T23:59:21.701229+0000","last_fullsized":"2024-09-11T23:59:21.701229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466415+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:59:21.466415+0000","last_peered":"2024-09-11T23:59:21.466415+0000","last_clean":"2024-09-11T23:59:21.466415+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:59:21.466415+0000","last_undegraded":"2024-09-11T23:59:21.466415+0000","last_fullsized":"2024-09-11T23:59:21.466415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643857+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:59:21.643857+0000","last_peered":"2024-09-11T23:59:21.643857+0000","last_clean":"2024-09-11T23:59:21.643857+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:59:21.643857+0000","last_undegraded":"2024-09-11T23:59:21.643857+0000","last_fullsized":"2024-09-11T23:59:21.643857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644471+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:59:21.644471+0000","last_peered":"2024-09-11T23:59:21.644471+0000","last_clean":"2024-09-11T23:59:21.644471+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:59:21.644471+0000","last_undegraded":"2024-09-11T23:59:21.644471+0000","last_fullsized":"2024-09-11T23:59:21.644471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'67","reported_seq":122,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.268214+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:59:31.268214+0000","last_peered":"2024-09-11T23:59:31.268214+0000","last_clean":"2024-09-11T23:59:31.268214+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:59:31.268214+0000","last_undegraded":"2024-09-11T23:59:31.268214+0000","last_fullsized":"2024-09-11T23:59:31.268214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644309+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:59:21.644309+0000","last_peered":"2024-09-11T23:59:21.644309+0000","last_clean":"2024-09-11T23:59:21.644309+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:59:21.644309+0000","last_undegraded":"2024-09-11T23:59:21.644309+0000","last_fullsized":"2024-09-11T23:59:21.644309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:30.654135+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:59:30.654135+0000","last_peered":"2024-09-11T23:59:30.654135+0000","last_clean":"2024-09-11T23:59:30.654135+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:59:30.654135+0000","last_undegraded":"2024-09-11T23:59:30.654135+0000","last_fullsized":"2024-09-11T23:59:30.654135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644569+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:59:21.644569+0000","last_peered":"2024-09-11T23:59:21.644569+0000","last_clean":"2024-09-11T23:59:21.644569+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:59:21.644569+0000","last_undegraded":"2024-09-11T23:59:21.644569+0000","last_fullsized":"2024-09-11T23:59:21.644569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":392,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:23.481396+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:59:23.481396+0000","last_peered":"2024-09-11T23:59:23.481396+0000","last_clean":"2024-09-11T23:59:23.481396+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:59:23.481396+0000","last_undegraded":"2024-09-11T23:59:23.481396+0000","last_fullsized":"2024-09-11T23:59:23.481396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645165+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:59:21.645165+0000","last_peered":"2024-09-11T23:59:21.645165+0000","last_clean":"2024-09-11T23:59:21.645165+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:59:21.645165+0000","last_undegraded":"2024-09-11T23:59:21.645165+0000","last_fullsized":"2024-09-11T23:59:21.645165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466911+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:59:21.466911+0000","last_peered":"2024-09-11T23:59:21.466911+0000","last_clean":"2024-09-11T23:59:21.466911+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:59:21.466911+0000","last_undegraded":"2024-09-11T23:59:21.466911+0000","last_fullsized":"2024-09-11T23:59:21.466911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466169+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:59:21.466169+0000","last_peered":"2024-09-11T23:59:21.466169+0000","last_clean":"2024-09-11T23:59:21.466169+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:59:21.466169+0000","last_undegraded":"2024-09-11T23:59:21.466169+0000","last_fullsized":"2024-09-11T23:59:21.466169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642811+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:59:21.642811+0000","last_peered":"2024-09-11T23:59:21.642811+0000","last_clean":"2024-09-11T23:59:21.642811+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:59:21.642811+0000","last_undegraded":"2024-09-11T23:59:21.642811+0000","last_fullsized":"2024-09-11T23:59:21.642811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.655124+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:59:31.655124+0000","last_peered":"2024-09-11T23:59:31.655124+0000","last_clean":"2024-09-11T23:59:31.655124+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:59:31.655124+0000","last_undegraded":"2024-09-11T23:59:31.655124+0000","last_fullsized":"2024-09-11T23:59:31.655124+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473078+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:59:21.473078+0000","last_peered":"2024-09-11T23:59:21.473078+0000","last_clean":"2024-09-11T23:59:21.473078+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:59:21.473078+0000","last_undegraded":"2024-09-11T23:59:21.473078+0000","last_fullsized":"2024-09-11T23:59:21.473078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'8","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.655197+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:59:31.655197+0000","last_peered":"2024-09-11T23:59:31.655197+0000","last_clean":"2024-09-11T23:59:31.655197+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:59:31.655197+0000","last_undegraded":"2024-09-11T23:59:31.655197+0000","last_fullsized":"2024-09-11T23:59:31.655197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476029+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:59:21.476029+0000","last_peered":"2024-09-11T23:59:21.476029+0000","last_clean":"2024-09-11T23:59:21.476029+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:59:21.476029+0000","last_undegraded":"2024-09-11T23:59:21.476029+0000","last_fullsized":"2024-09-11T23:59:21.476029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385258+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:59:21.385258+0000","last_peered":"2024-09-11T23:59:21.385258+0000","last_clean":"2024-09-11T23:59:21.385258+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:59:21.385258+0000","last_undegraded":"2024-09-11T23:59:21.385258+0000","last_fullsized":"2024-09-11T23:59:21.385258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476051+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:59:21.476051+0000","last_peered":"2024-09-11T23:59:21.476051+0000","last_clean":"2024-09-11T23:59:21.476051+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:59:21.476051+0000","last_undegraded":"2024-09-11T23:59:21.476051+0000","last_fullsized":"2024-09-11T23:59:21.476051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701325+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:59:21.701325+0000","last_peered":"2024-09-11T23:59:21.701325+0000","last_clean":"2024-09-11T23:59:21.701325+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:59:21.701325+0000","last_undegraded":"2024-09-11T23:59:21.701325+0000","last_fullsized":"2024-09-11T23:59:21.701325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643556+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:59:21.643556+0000","last_peered":"2024-09-11T23:59:21.643556+0000","last_clean":"2024-09-11T23:59:21.643556+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:59:21.643556+0000","last_undegraded":"2024-09-11T23:59:21.643556+0000","last_fullsized":"2024-09-11T23:59:21.643556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'104","reported_seq":236,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.629716+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:59:31.629716+0000","last_peered":"2024-09-11T23:59:31.629716+0000","last_clean":"2024-09-11T23:59:31.629716+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:59:31.629716+0000","last_undegraded":"2024-09-11T23:59:31.629716+0000","last_fullsized":"2024-09-11T23:59:31.629716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":190,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466838+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:59:21.466838+0000","last_peered":"2024-09-11T23:59:21.466838+0000","last_clean":"2024-09-11T23:59:21.466838+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:59:21.466838+0000","last_undegraded":"2024-09-11T23:59:21.466838+0000","last_fullsized":"2024-09-11T23:59:21.466838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645248+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:59:21.645248+0000","last_peered":"2024-09-11T23:59:21.645248+0000","last_clean":"2024-09-11T23:59:21.645248+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:59:21.645248+0000","last_undegraded":"2024-09-11T23:59:21.645248+0000","last_fullsized":"2024-09-11T23:59:21.645248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680966+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:59:21.680966+0000","last_peered":"2024-09-11T23:59:21.680966+0000","last_clean":"2024-09-11T23:59:21.680966+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:59:21.680966+0000","last_undegraded":"2024-09-11T23:59:21.680966+0000","last_fullsized":"2024-09-11T23:59:21.680966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386783+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:59:21.386783+0000","last_peered":"2024-09-11T23:59:21.386783+0000","last_clean":"2024-09-11T23:59:21.386783+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:59:21.386783+0000","last_undegraded":"2024-09-11T23:59:21.386783+0000","last_fullsized":"2024-09-11T23:59:21.386783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466548+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:59:21.466548+0000","last_peered":"2024-09-11T23:59:21.466548+0000","last_clean":"2024-09-11T23:59:21.466548+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:59:21.466548+0000","last_undegraded":"2024-09-11T23:59:21.466548+0000","last_fullsized":"2024-09-11T23:59:21.466548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387214+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:59:21.387214+0000","last_peered":"2024-09-11T23:59:21.387214+0000","last_clean":"2024-09-11T23:59:21.387214+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:59:21.387214+0000","last_undegraded":"2024-09-11T23:59:21.387214+0000","last_fullsized":"2024-09-11T23:59:21.387214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466575+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:59:21.466575+0000","last_peered":"2024-09-11T23:59:21.466575+0000","last_clean":"2024-09-11T23:59:21.466575+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:59:21.466575+0000","last_undegraded":"2024-09-11T23:59:21.466575+0000","last_fullsized":"2024-09-11T23:59:21.466575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701133+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:59:21.701133+0000","last_peered":"2024-09-11T23:59:21.701133+0000","last_clean":"2024-09-11T23:59:21.701133+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:59:21.701133+0000","last_undegraded":"2024-09-11T23:59:21.701133+0000","last_fullsized":"2024-09-11T23:59:21.701133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644300+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:59:21.644300+0000","last_peered":"2024-09-11T23:59:21.644300+0000","last_clean":"2024-09-11T23:59:21.644300+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:59:21.644300+0000","last_undegraded":"2024-09-11T23:59:21.644300+0000","last_fullsized":"2024-09-11T23:59:21.644300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473153+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:59:21.473153+0000","last_peered":"2024-09-11T23:59:21.473153+0000","last_clean":"2024-09-11T23:59:21.473153+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:59:21.473153+0000","last_undegraded":"2024-09-11T23:59:21.473153+0000","last_fullsized":"2024-09-11T23:59:21.473153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701254+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:59:21.701254+0000","last_peered":"2024-09-11T23:59:21.701254+0000","last_clean":"2024-09-11T23:59:21.701254+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:59:21.701254+0000","last_undegraded":"2024-09-11T23:59:21.701254+0000","last_fullsized":"2024-09-11T23:59:21.701254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386855+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:59:21.386855+0000","last_peered":"2024-09-11T23:59:21.386855+0000","last_clean":"2024-09-11T23:59:21.386855+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:59:21.386855+0000","last_undegraded":"2024-09-11T23:59:21.386855+0000","last_fullsized":"2024-09-11T23:59:21.386855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701190+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:59:21.701190+0000","last_peered":"2024-09-11T23:59:21.701190+0000","last_clean":"2024-09-11T23:59:21.701190+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:59:21.701190+0000","last_undegraded":"2024-09-11T23:59:21.701190+0000","last_fullsized":"2024-09-11T23:59:21.701190+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681365+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:59:21.681365+0000","last_peered":"2024-09-11T23:59:21.681365+0000","last_clean":"2024-09-11T23:59:21.681365+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:59:21.681365+0000","last_undegraded":"2024-09-11T23:59:21.681365+0000","last_fullsized":"2024-09-11T23:59:21.681365+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466994+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:59:21.466994+0000","last_peered":"2024-09-11T23:59:21.466994+0000","last_clean":"2024-09-11T23:59:21.466994+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:59:21.466994+0000","last_undegraded":"2024-09-11T23:59:21.466994+0000","last_fullsized":"2024-09-11T23:59:21.466994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466847+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:59:21.466847+0000","last_peered":"2024-09-11T23:59:21.466847+0000","last_clean":"2024-09-11T23:59:21.466847+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:59:21.466847+0000","last_undegraded":"2024-09-11T23:59:21.466847+0000","last_fullsized":"2024-09-11T23:59:21.466847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.654766+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:59:31.654766+0000","last_peered":"2024-09-11T23:59:31.654766+0000","last_clean":"2024-09-11T23:59:31.654766+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:59:31.654766+0000","last_undegraded":"2024-09-11T23:59:31.654766+0000","last_fullsized":"2024-09-11T23:59:31.654766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797439,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1507,"num_read_kb":976,"num_write":502,"num_write_kb":2379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":2392317,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":381,"ondisk_log_size":381,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":836685,"data_compressed":22186,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1118208,"data_stored":1429351,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":836222,"data_compressed":22186,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201331,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":443384,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1038207,"data_compressed":39168,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":443565,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1364741,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986249,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445060,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":1163996,"data_compressed":37388,"data_compressed_allocated":49152,"data_compressed_original":708608,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":510107,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":987136,"data_stored":510958,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":444455,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":721878,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":332372,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":396982,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":394801,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:59:35.393 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T23:59:35.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T23:59:35.652 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:35.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:35 smithi105 ceph-mon[34805]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:35.774 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:35 smithi060 ceph-mon[30953]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:35.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:35 smithi192 ceph-mon[35487]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:36.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 -- 172.21.15.60:0/2448681535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4100a80 msgr2=0x7f52b4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:36.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/2448681535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4100a80 0x7f52b4100ee0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f529c009930 tx=0x7f529c02a420 comp rx=0 tx=0).stop 2024-09-11T23:59:36.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 -- 172.21.15.60:0/2448681535 shutdown_connections 2024-09-11T23:59:36.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/2448681535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b4101420 0x7f52b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/2448681535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4100a80 0x7f52b4100ee0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/2448681535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52b4106a80 0x7f52b4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 -- 172.21.15.60:0/2448681535 >> 172.21.15.60:0/2448681535 conn(0x7f52b40fc7a0 msgr2=0x7f52b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:36.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 -- 172.21.15.60:0/2448681535 shutdown_connections 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.117+0000 7f52b8ae7640 1 -- 172.21.15.60:0/2448681535 wait complete. 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b8ae7640 1 Processor -- start 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b8ae7640 1 -- start start 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b8ae7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52b4100a80 0x7f52b41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b8ae7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4101420 0x7f52b4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b8ae7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b4106a80 0x7f52b419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b8ae7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4110fa0 con 0x7f52b4101420 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b8ae7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4110e20 con 0x7f52b4100a80 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b8ae7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4111120 con 0x7f52b4106a80 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4101420 0x7f52b4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:36.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4101420 0x7f52b4198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34526/0 (socket says 172.21.15.60:34526) 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b1d9b640 1 -- 172.21.15.60:0/4069578138 learned_addr learned my addr 172.21.15.60:0/4069578138 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.118+0000 7f52b2d9d640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b4106a80 0x7f52b419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b259c640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52b4100a80 0x7f52b41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b1d9b640 1 -- 172.21.15.60:0/4069578138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b4106a80 msgr2=0x7f52b419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b1d9b640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b4106a80 0x7f52b419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b1d9b640 1 -- 172.21.15.60:0/4069578138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52b4100a80 msgr2=0x7f52b41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b1d9b640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52b4100a80 0x7f52b41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b1d9b640 1 -- 172.21.15.60:0/4069578138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b419d480 con 0x7f52b4101420 2024-09-11T23:59:36.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b1d9b640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4101420 0x7f52b4198a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f529c009a50 tx=0x7f529c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52ab7fe640 1 -- 172.21.15.60:0/4069578138 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c03f030 con 0x7f52b4101420 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52ab7fe640 1 -- 172.21.15.60:0/4069578138 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f529c003af0 con 0x7f52b4101420 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52ab7fe640 1 -- 172.21.15.60:0/4069578138 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c035070 con 0x7f52b4101420 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b419d710 con 0x7f52b4101420 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.119+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b41a5050 con 0x7f52b4101420 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.120+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b41021c0 con 0x7f52b4101420 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.121+0000 7f52ab7fe640 1 -- 172.21.15.60:0/4069578138 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f529c042030 con 0x7f52b4101420 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.122+0000 7f52ab7fe640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f52a00a2d80 0x7f52a00a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.122+0000 7f52b259c640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f52a00a2d80 0x7f52a00a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.122+0000 7f52ab7fe640 1 -- 172.21.15.60:0/4069578138 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f529c0efdf0 con 0x7f52b4101420 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.123+0000 7f52b259c640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f52a00a2d80 0x7f52a00a5240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f52a400ab60 tx=0x7f52a400a2d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:36.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.126+0000 7f52ab7fe640 1 -- 172.21.15.60:0/4069578138 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f529c0bc890 con 0x7f52b4101420 2024-09-11T23:59:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.300+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52b4062630 con 0x7f52a00a2d80 2024-09-11T23:59:36.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.307+0000 7f52ab7fe640 1 -- 172.21.15.60:0/4069578138 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258078 (secure 0 0 0) 0x7f52b4062630 con 0x7f52a00a2d80 2024-09-11T23:59:36.311 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:36.312 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-11T23:59:36.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.310+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f52a00a2d80 msgr2=0x7f52a00a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:36.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.310+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f52a00a2d80 0x7f52a00a5240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f52a400ab60 tx=0x7f52a400a2d0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.310+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4101420 msgr2=0x7f52b4198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:36.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.310+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4101420 0x7f52b4198a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f529c009a50 tx=0x7f529c004270 comp rx=0 tx=0).stop 2024-09-11T23:59:36.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.310+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 shutdown_connections 2024-09-11T23:59:36.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.310+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f52a00a2d80 0x7f52a00a5240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.310+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b4106a80 0x7f52b419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.311+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52b4101420 0x7f52b4198a10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.311+0000 7f52b8ae7640 1 --2- 172.21.15.60:0/4069578138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52b4100a80 0x7f52b41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:36.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.311+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 >> 172.21.15.60:0/4069578138 conn(0x7f52b40fc7a0 msgr2=0x7f52b406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:36.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.311+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 shutdown_connections 2024-09-11T23:59:36.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:36.311+0000 7f52b8ae7640 1 -- 172.21.15.60:0/4069578138 wait complete. 2024-09-11T23:59:36.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:36 smithi060 ceph-mon[30953]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-11T23:59:36.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:36 smithi105 ceph-mon[34805]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-11T23:59:36.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:36 smithi192 ceph-mon[35487]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-11T23:59:36.962 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-11T23:59:35.401050+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1388041,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1744,"num_read_kb":1306,"num_write":705,"num_write_kb":5319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181358,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1031,"ondisk_log_size":1031,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369080,"kb_used_data":11460,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572744,"statfs":{"total":1151940427776,"available":1151562489856,"internally_reserved":0,"allocated":11735040,"data_stored":9466731,"data_compressed":247050,"data_compressed_allocated":319488,"data_compressed_original":3969024,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":459,"num_read_kb":502,"num_write":150,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002352"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466469+0000","last_change":"2024-09-11T23:57:28.428066+0000","last_active":"2024-09-11T23:59:21.466469+0000","last_peered":"2024-09-11T23:59:21.466469+0000","last_clean":"2024-09-11T23:59:21.466469+0000","last_became_active":"2024-09-11T23:57:28.427720+0000","last_became_peered":"2024-09-11T23:57:28.427720+0000","last_unstale":"2024-09-11T23:59:21.466469+0000","last_undegraded":"2024-09-11T23:59:21.466469+0000","last_fullsized":"2024-09-11T23:59:21.466469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:55.040698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680982+0000","last_change":"2024-09-11T23:57:28.424041+0000","last_active":"2024-09-11T23:59:21.680982+0000","last_peered":"2024-09-11T23:59:21.680982+0000","last_clean":"2024-09-11T23:59:21.680982+0000","last_became_active":"2024-09-11T23:57:28.423271+0000","last_became_peered":"2024-09-11T23:57:28.423271+0000","last_unstale":"2024-09-11T23:59:21.680982+0000","last_undegraded":"2024-09-11T23:59:21.680982+0000","last_fullsized":"2024-09-11T23:59:21.680982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:48.884983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680810+0000","last_change":"2024-09-11T23:57:28.422947+0000","last_active":"2024-09-11T23:59:21.680810+0000","last_peered":"2024-09-11T23:59:21.680810+0000","last_clean":"2024-09-11T23:59:21.680810+0000","last_became_active":"2024-09-11T23:57:28.422599+0000","last_became_peered":"2024-09-11T23:57:28.422599+0000","last_unstale":"2024-09-11T23:59:21.680810+0000","last_undegraded":"2024-09-11T23:59:21.680810+0000","last_fullsized":"2024-09-11T23:59:21.680810+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:04.521316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645319+0000","last_change":"2024-09-11T23:57:28.427294+0000","last_active":"2024-09-11T23:59:21.645319+0000","last_peered":"2024-09-11T23:59:21.645319+0000","last_clean":"2024-09-11T23:59:21.645319+0000","last_became_active":"2024-09-11T23:57:28.426361+0000","last_became_peered":"2024-09-11T23:57:28.426361+0000","last_unstale":"2024-09-11T23:59:21.645319+0000","last_undegraded":"2024-09-11T23:59:21.645319+0000","last_fullsized":"2024-09-11T23:59:21.645319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:48.075783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700973+0000","last_change":"2024-09-11T23:57:28.418231+0000","last_active":"2024-09-11T23:59:21.700973+0000","last_peered":"2024-09-11T23:59:21.700973+0000","last_clean":"2024-09-11T23:59:21.700973+0000","last_became_active":"2024-09-11T23:57:28.417893+0000","last_became_peered":"2024-09-11T23:57:28.417893+0000","last_unstale":"2024-09-11T23:59:21.700973+0000","last_undegraded":"2024-09-11T23:59:21.700973+0000","last_fullsized":"2024-09-11T23:59:21.700973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:22.411853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475885+0000","last_change":"2024-09-11T23:57:28.432736+0000","last_active":"2024-09-11T23:59:21.475885+0000","last_peered":"2024-09-11T23:59:21.475885+0000","last_clean":"2024-09-11T23:59:21.475885+0000","last_became_active":"2024-09-11T23:57:28.431571+0000","last_became_peered":"2024-09-11T23:57:28.431571+0000","last_unstale":"2024-09-11T23:59:21.475885+0000","last_undegraded":"2024-09-11T23:59:21.475885+0000","last_fullsized":"2024-09-11T23:59:21.475885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:19.009436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644131+0000","last_change":"2024-09-11T23:57:28.430574+0000","last_active":"2024-09-11T23:59:21.644131+0000","last_peered":"2024-09-11T23:59:21.644131+0000","last_clean":"2024-09-11T23:59:21.644131+0000","last_became_active":"2024-09-11T23:57:28.430217+0000","last_became_peered":"2024-09-11T23:57:28.430217+0000","last_unstale":"2024-09-11T23:59:21.644131+0000","last_undegraded":"2024-09-11T23:59:21.644131+0000","last_fullsized":"2024-09-11T23:59:21.644131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:30.236771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466288+0000","last_change":"2024-09-11T23:57:28.429711+0000","last_active":"2024-09-11T23:59:21.466288+0000","last_peered":"2024-09-11T23:59:21.466288+0000","last_clean":"2024-09-11T23:59:21.466288+0000","last_became_active":"2024-09-11T23:57:28.429326+0000","last_became_peered":"2024-09-11T23:57:28.429326+0000","last_unstale":"2024-09-11T23:59:21.466288+0000","last_undegraded":"2024-09-11T23:59:21.466288+0000","last_fullsized":"2024-09-11T23:59:21.466288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.178318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387087+0000","last_change":"2024-09-11T23:57:28.432738+0000","last_active":"2024-09-11T23:59:21.387087+0000","last_peered":"2024-09-11T23:59:21.387087+0000","last_clean":"2024-09-11T23:59:21.387087+0000","last_became_active":"2024-09-11T23:57:28.432438+0000","last_became_peered":"2024-09-11T23:57:28.432438+0000","last_unstale":"2024-09-11T23:59:21.387087+0000","last_undegraded":"2024-09-11T23:59:21.387087+0000","last_fullsized":"2024-09-11T23:59:21.387087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:24.490542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476277+0000","last_change":"2024-09-11T23:57:28.432462+0000","last_active":"2024-09-11T23:59:21.476277+0000","last_peered":"2024-09-11T23:59:21.476277+0000","last_clean":"2024-09-11T23:59:21.476277+0000","last_became_active":"2024-09-11T23:57:28.432147+0000","last_became_peered":"2024-09-11T23:57:28.432147+0000","last_unstale":"2024-09-11T23:59:21.476277+0000","last_undegraded":"2024-09-11T23:59:21.476277+0000","last_fullsized":"2024-09-11T23:59:21.476277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.388788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644423+0000","last_change":"2024-09-11T23:57:28.427274+0000","last_active":"2024-09-11T23:59:21.644423+0000","last_peered":"2024-09-11T23:59:21.644423+0000","last_clean":"2024-09-11T23:59:21.644423+0000","last_became_active":"2024-09-11T23:57:28.426952+0000","last_became_peered":"2024-09-11T23:57:28.426952+0000","last_unstale":"2024-09-11T23:59:21.644423+0000","last_undegraded":"2024-09-11T23:59:21.644423+0000","last_fullsized":"2024-09-11T23:59:21.644423+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:12.238958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385078+0000","last_change":"2024-09-11T23:57:40.800804+0000","last_active":"2024-09-11T23:59:21.385078+0000","last_peered":"2024-09-11T23:59:21.385078+0000","last_clean":"2024-09-11T23:59:21.385078+0000","last_became_active":"2024-09-11T23:57:40.800442+0000","last_became_peered":"2024-09-11T23:57:40.800442+0000","last_unstale":"2024-09-11T23:59:21.385078+0000","last_undegraded":"2024-09-11T23:59:21.385078+0000","last_fullsized":"2024-09-11T23:59:21.385078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:30.218133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643697+0000","last_change":"2024-09-11T23:57:28.429778+0000","last_active":"2024-09-11T23:59:21.643697+0000","last_peered":"2024-09-11T23:59:21.643697+0000","last_clean":"2024-09-11T23:59:21.643697+0000","last_became_active":"2024-09-11T23:57:28.429460+0000","last_became_peered":"2024-09-11T23:57:28.429460+0000","last_unstale":"2024-09-11T23:59:21.643697+0000","last_undegraded":"2024-09-11T23:59:21.643697+0000","last_fullsized":"2024-09-11T23:59:21.643697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.484576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680072+0000","last_change":"2024-09-11T23:57:28.423740+0000","last_active":"2024-09-11T23:59:21.680072+0000","last_peered":"2024-09-11T23:59:21.680072+0000","last_clean":"2024-09-11T23:59:21.680072+0000","last_became_active":"2024-09-11T23:57:28.423312+0000","last_became_peered":"2024-09-11T23:57:28.423312+0000","last_unstale":"2024-09-11T23:59:21.680072+0000","last_undegraded":"2024-09-11T23:59:21.680072+0000","last_fullsized":"2024-09-11T23:59:21.680072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:17.062672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.679770+0000","last_change":"2024-09-11T23:57:28.424333+0000","last_active":"2024-09-11T23:59:21.679770+0000","last_peered":"2024-09-11T23:59:21.679770+0000","last_clean":"2024-09-11T23:59:21.679770+0000","last_became_active":"2024-09-11T23:57:28.423772+0000","last_became_peered":"2024-09-11T23:57:28.423772+0000","last_unstale":"2024-09-11T23:59:21.679770+0000","last_undegraded":"2024-09-11T23:59:21.679770+0000","last_fullsized":"2024-09-11T23:59:21.679770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.881832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386692+0000","last_change":"2024-09-11T23:57:28.420663+0000","last_active":"2024-09-11T23:59:21.386692+0000","last_peered":"2024-09-11T23:59:21.386692+0000","last_clean":"2024-09-11T23:59:21.386692+0000","last_became_active":"2024-09-11T23:57:28.420341+0000","last_became_peered":"2024-09-11T23:57:28.420341+0000","last_unstale":"2024-09-11T23:59:21.386692+0000","last_undegraded":"2024-09-11T23:59:21.386692+0000","last_fullsized":"2024-09-11T23:59:21.386692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:59.522569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466577+0000","last_change":"2024-09-11T23:57:28.429821+0000","last_active":"2024-09-11T23:59:21.466577+0000","last_peered":"2024-09-11T23:59:21.466577+0000","last_clean":"2024-09-11T23:59:21.466577+0000","last_became_active":"2024-09-11T23:57:28.429472+0000","last_became_peered":"2024-09-11T23:57:28.429472+0000","last_unstale":"2024-09-11T23:59:21.466577+0000","last_undegraded":"2024-09-11T23:59:21.466577+0000","last_fullsized":"2024-09-11T23:59:21.466577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385256+0000","last_change":"2024-09-11T23:57:28.425643+0000","last_active":"2024-09-11T23:59:21.385256+0000","last_peered":"2024-09-11T23:59:21.385256+0000","last_clean":"2024-09-11T23:59:21.385256+0000","last_became_active":"2024-09-11T23:57:28.425308+0000","last_became_peered":"2024-09-11T23:57:28.425308+0000","last_unstale":"2024-09-11T23:59:21.385256+0000","last_undegraded":"2024-09-11T23:59:21.385256+0000","last_fullsized":"2024-09-11T23:59:21.385256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:31.407497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387348+0000","last_change":"2024-09-11T23:57:28.428168+0000","last_active":"2024-09-11T23:59:21.387348+0000","last_peered":"2024-09-11T23:59:21.387348+0000","last_clean":"2024-09-11T23:59:21.387348+0000","last_became_active":"2024-09-11T23:57:28.427840+0000","last_became_peered":"2024-09-11T23:57:28.427840+0000","last_unstale":"2024-09-11T23:59:21.387348+0000","last_undegraded":"2024-09-11T23:59:21.387348+0000","last_fullsized":"2024-09-11T23:59:21.387348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:39.922069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466261+0000","last_change":"2024-09-11T23:57:28.432038+0000","last_active":"2024-09-11T23:59:21.466261+0000","last_peered":"2024-09-11T23:59:21.466261+0000","last_clean":"2024-09-11T23:59:21.466261+0000","last_became_active":"2024-09-11T23:57:28.431717+0000","last_became_peered":"2024-09-11T23:57:28.431717+0000","last_unstale":"2024-09-11T23:59:21.466261+0000","last_undegraded":"2024-09-11T23:59:21.466261+0000","last_fullsized":"2024-09-11T23:59:21.466261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:16.983502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643856+0000","last_change":"2024-09-11T23:57:28.420706+0000","last_active":"2024-09-11T23:59:21.643856+0000","last_peered":"2024-09-11T23:59:21.643856+0000","last_clean":"2024-09-11T23:59:21.643856+0000","last_became_active":"2024-09-11T23:57:28.420387+0000","last_became_peered":"2024-09-11T23:57:28.420387+0000","last_unstale":"2024-09-11T23:59:21.643856+0000","last_undegraded":"2024-09-11T23:59:21.643856+0000","last_fullsized":"2024-09-11T23:59:21.643856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:13.856755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386866+0000","last_change":"2024-09-11T23:57:28.420609+0000","last_active":"2024-09-11T23:59:21.386866+0000","last_peered":"2024-09-11T23:59:21.386866+0000","last_clean":"2024-09-11T23:59:21.386866+0000","last_became_active":"2024-09-11T23:57:28.420278+0000","last_became_peered":"2024-09-11T23:57:28.420278+0000","last_unstale":"2024-09-11T23:59:21.386866+0000","last_undegraded":"2024-09-11T23:59:21.386866+0000","last_fullsized":"2024-09-11T23:59:21.386866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:39.562454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466381+0000","last_change":"2024-09-11T23:57:28.422701+0000","last_active":"2024-09-11T23:59:21.466381+0000","last_peered":"2024-09-11T23:59:21.466381+0000","last_clean":"2024-09-11T23:59:21.466381+0000","last_became_active":"2024-09-11T23:57:28.422054+0000","last_became_peered":"2024-09-11T23:57:28.422054+0000","last_unstale":"2024-09-11T23:59:21.466381+0000","last_undegraded":"2024-09-11T23:59:21.466381+0000","last_fullsized":"2024-09-11T23:59:21.466381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:51.994048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472730+0000","last_change":"2024-09-11T23:57:28.432839+0000","last_active":"2024-09-11T23:59:21.472730+0000","last_peered":"2024-09-11T23:59:21.472730+0000","last_clean":"2024-09-11T23:59:21.472730+0000","last_became_active":"2024-09-11T23:57:28.432463+0000","last_became_peered":"2024-09-11T23:57:28.432463+0000","last_unstale":"2024-09-11T23:59:21.472730+0000","last_undegraded":"2024-09-11T23:59:21.472730+0000","last_fullsized":"2024-09-11T23:59:21.472730+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:36.263046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466751+0000","last_change":"2024-09-11T23:57:28.421943+0000","last_active":"2024-09-11T23:59:21.466751+0000","last_peered":"2024-09-11T23:59:21.466751+0000","last_clean":"2024-09-11T23:59:21.466751+0000","last_became_active":"2024-09-11T23:57:28.421604+0000","last_became_peered":"2024-09-11T23:57:28.421604+0000","last_unstale":"2024-09-11T23:59:21.466751+0000","last_undegraded":"2024-09-11T23:59:21.466751+0000","last_fullsized":"2024-09-11T23:59:21.466751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:42.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387391+0000","last_change":"2024-09-11T23:57:28.429472+0000","last_active":"2024-09-11T23:59:21.387391+0000","last_peered":"2024-09-11T23:59:21.387391+0000","last_clean":"2024-09-11T23:59:21.387391+0000","last_became_active":"2024-09-11T23:57:28.429112+0000","last_became_peered":"2024-09-11T23:57:28.429112+0000","last_unstale":"2024-09-11T23:59:21.387391+0000","last_undegraded":"2024-09-11T23:59:21.387391+0000","last_fullsized":"2024-09-11T23:59:21.387391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:30.660777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466340+0000","last_change":"2024-09-11T23:57:28.433457+0000","last_active":"2024-09-11T23:59:21.466340+0000","last_peered":"2024-09-11T23:59:21.466340+0000","last_clean":"2024-09-11T23:59:21.466340+0000","last_became_active":"2024-09-11T23:57:28.433113+0000","last_became_peered":"2024-09-11T23:57:28.433113+0000","last_unstale":"2024-09-11T23:59:21.466340+0000","last_undegraded":"2024-09-11T23:59:21.466340+0000","last_fullsized":"2024-09-11T23:59:21.466340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:30.164244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643440+0000","last_change":"2024-09-11T23:57:28.418847+0000","last_active":"2024-09-11T23:59:21.643440+0000","last_peered":"2024-09-11T23:59:21.643440+0000","last_clean":"2024-09-11T23:59:21.643440+0000","last_became_active":"2024-09-11T23:57:28.418554+0000","last_became_peered":"2024-09-11T23:57:28.418554+0000","last_unstale":"2024-09-11T23:59:21.643440+0000","last_undegraded":"2024-09-11T23:59:21.643440+0000","last_fullsized":"2024-09-11T23:59:21.643440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:00.377723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680410+0000","last_change":"2024-09-11T23:57:28.418437+0000","last_active":"2024-09-11T23:59:21.680410+0000","last_peered":"2024-09-11T23:59:21.680410+0000","last_clean":"2024-09-11T23:59:21.680410+0000","last_became_active":"2024-09-11T23:57:28.418152+0000","last_became_peered":"2024-09-11T23:57:28.418152+0000","last_unstale":"2024-09-11T23:59:21.680410+0000","last_undegraded":"2024-09-11T23:59:21.680410+0000","last_fullsized":"2024-09-11T23:59:21.680410+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.869362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387149+0000","last_change":"2024-09-11T23:57:28.432310+0000","last_active":"2024-09-11T23:59:21.387149+0000","last_peered":"2024-09-11T23:59:21.387149+0000","last_clean":"2024-09-11T23:59:21.387149+0000","last_became_active":"2024-09-11T23:57:28.431914+0000","last_became_peered":"2024-09-11T23:57:28.431914+0000","last_unstale":"2024-09-11T23:59:21.387149+0000","last_undegraded":"2024-09-11T23:59:21.387149+0000","last_fullsized":"2024-09-11T23:59:21.387149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:24.522524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387182+0000","last_change":"2024-09-11T23:57:40.493188+0000","last_active":"2024-09-11T23:59:21.387182+0000","last_peered":"2024-09-11T23:59:21.387182+0000","last_clean":"2024-09-11T23:59:21.387182+0000","last_became_active":"2024-09-11T23:57:40.492739+0000","last_became_peered":"2024-09-11T23:57:40.492739+0000","last_unstale":"2024-09-11T23:59:21.387182+0000","last_undegraded":"2024-09-11T23:59:21.387182+0000","last_fullsized":"2024-09-11T23:59:21.387182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:23.449059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466594+0000","last_change":"2024-09-11T23:57:28.435871+0000","last_active":"2024-09-11T23:59:21.466594+0000","last_peered":"2024-09-11T23:59:21.466594+0000","last_clean":"2024-09-11T23:59:21.466594+0000","last_became_active":"2024-09-11T23:57:28.435543+0000","last_became_peered":"2024-09-11T23:57:28.435543+0000","last_unstale":"2024-09-11T23:59:21.466594+0000","last_undegraded":"2024-09-11T23:59:21.466594+0000","last_fullsized":"2024-09-11T23:59:21.466594+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:29.738103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700936+0000","last_change":"2024-09-11T23:57:28.423215+0000","last_active":"2024-09-11T23:59:21.700936+0000","last_peered":"2024-09-11T23:59:21.700936+0000","last_clean":"2024-09-11T23:59:21.700936+0000","last_became_active":"2024-09-11T23:57:28.422456+0000","last_became_peered":"2024-09-11T23:57:28.422456+0000","last_unstale":"2024-09-11T23:59:21.700936+0000","last_undegraded":"2024-09-11T23:59:21.700936+0000","last_fullsized":"2024-09-11T23:59:21.700936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:01.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'9","reported_seq":161,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:30.654332+0000","last_change":"2024-09-11T23:57:40.499214+0000","last_active":"2024-09-11T23:59:30.654332+0000","last_peered":"2024-09-11T23:59:30.654332+0000","last_clean":"2024-09-11T23:59:30.654332+0000","last_became_active":"2024-09-11T23:57:40.494062+0000","last_became_peered":"2024-09-11T23:57:40.494062+0000","last_unstale":"2024-09-11T23:59:30.654332+0000","last_undegraded":"2024-09-11T23:59:30.654332+0000","last_fullsized":"2024-09-11T23:59:30.654332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:47.142363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472907+0000","last_change":"2024-09-11T23:57:28.433542+0000","last_active":"2024-09-11T23:59:21.472907+0000","last_peered":"2024-09-11T23:59:21.472907+0000","last_clean":"2024-09-11T23:59:21.472907+0000","last_became_active":"2024-09-11T23:57:28.433221+0000","last_became_peered":"2024-09-11T23:57:28.433221+0000","last_unstale":"2024-09-11T23:59:21.472907+0000","last_undegraded":"2024-09-11T23:59:21.472907+0000","last_fullsized":"2024-09-11T23:59:21.472907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:44.262381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.475951+0000","last_change":"2024-09-11T23:57:26.265578+0000","last_active":"2024-09-11T23:59:21.475951+0000","last_peered":"2024-09-11T23:59:21.475951+0000","last_clean":"2024-09-11T23:59:21.475951+0000","last_became_active":"2024-09-11T23:57:26.263603+0000","last_became_peered":"2024-09-11T23:57:26.263603+0000","last_unstale":"2024-09-11T23:59:21.475951+0000","last_undegraded":"2024-09-11T23:59:21.475951+0000","last_fullsized":"2024-09-11T23:59:21.475951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:51.766009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642891+0000","last_change":"2024-09-11T23:57:26.260062+0000","last_active":"2024-09-11T23:59:21.642891+0000","last_peered":"2024-09-11T23:59:21.642891+0000","last_clean":"2024-09-11T23:59:21.642891+0000","last_became_active":"2024-09-11T23:57:26.259657+0000","last_became_peered":"2024-09-11T23:57:26.259657+0000","last_unstale":"2024-09-11T23:59:21.642891+0000","last_undegraded":"2024-09-11T23:59:21.642891+0000","last_fullsized":"2024-09-11T23:59:21.642891+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:29.107066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466333+0000","last_change":"2024-09-11T23:57:28.425676+0000","last_active":"2024-09-11T23:59:21.466333+0000","last_peered":"2024-09-11T23:59:21.466333+0000","last_clean":"2024-09-11T23:59:21.466333+0000","last_became_active":"2024-09-11T23:57:28.425359+0000","last_became_peered":"2024-09-11T23:57:28.425359+0000","last_unstale":"2024-09-11T23:59:21.466333+0000","last_undegraded":"2024-09-11T23:59:21.466333+0000","last_fullsized":"2024-09-11T23:59:21.466333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:26.069386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472936+0000","last_change":"2024-09-11T23:57:26.265234+0000","last_active":"2024-09-11T23:59:21.472936+0000","last_peered":"2024-09-11T23:59:21.472936+0000","last_clean":"2024-09-11T23:59:21.472936+0000","last_became_active":"2024-09-11T23:57:26.264852+0000","last_became_peered":"2024-09-11T23:57:26.264852+0000","last_unstale":"2024-09-11T23:59:21.472936+0000","last_undegraded":"2024-09-11T23:59:21.472936+0000","last_fullsized":"2024-09-11T23:59:21.472936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:35.867141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385069+0000","last_change":"2024-09-11T23:57:28.425159+0000","last_active":"2024-09-11T23:59:21.385069+0000","last_peered":"2024-09-11T23:59:21.385069+0000","last_clean":"2024-09-11T23:59:21.385069+0000","last_became_active":"2024-09-11T23:57:28.424806+0000","last_became_peered":"2024-09-11T23:57:28.424806+0000","last_unstale":"2024-09-11T23:59:21.385069+0000","last_undegraded":"2024-09-11T23:59:21.385069+0000","last_fullsized":"2024-09-11T23:59:21.385069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:16.028241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'6","reported_seq":252,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.654783+0000","last_change":"2024-09-11T23:57:26.266562+0000","last_active":"2024-09-11T23:59:31.654783+0000","last_peered":"2024-09-11T23:59:31.654783+0000","last_clean":"2024-09-11T23:59:31.654783+0000","last_became_active":"2024-09-11T23:57:26.265912+0000","last_became_peered":"2024-09-11T23:57:26.265912+0000","last_unstale":"2024-09-11T23:59:31.654783+0000","last_undegraded":"2024-09-11T23:59:31.654783+0000","last_fullsized":"2024-09-11T23:59:31.654783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:07.858992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387218+0000","last_change":"2024-09-11T23:57:28.425602+0000","last_active":"2024-09-11T23:59:21.387218+0000","last_peered":"2024-09-11T23:59:21.387218+0000","last_clean":"2024-09-11T23:59:21.387218+0000","last_became_active":"2024-09-11T23:57:28.425291+0000","last_became_peered":"2024-09-11T23:57:28.425291+0000","last_unstale":"2024-09-11T23:59:21.387218+0000","last_undegraded":"2024-09-11T23:59:21.387218+0000","last_fullsized":"2024-09-11T23:59:21.387218+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:28.832266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644343+0000","last_change":"2024-09-11T23:57:26.263540+0000","last_active":"2024-09-11T23:59:21.644343+0000","last_peered":"2024-09-11T23:59:21.644343+0000","last_clean":"2024-09-11T23:59:21.644343+0000","last_became_active":"2024-09-11T23:57:26.263195+0000","last_became_peered":"2024-09-11T23:57:26.263195+0000","last_unstale":"2024-09-11T23:59:21.644343+0000","last_undegraded":"2024-09-11T23:59:21.644343+0000","last_fullsized":"2024-09-11T23:59:21.644343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:26.236276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681237+0000","last_change":"2024-09-11T23:57:28.428735+0000","last_active":"2024-09-11T23:59:21.681237+0000","last_peered":"2024-09-11T23:59:21.681237+0000","last_clean":"2024-09-11T23:59:21.681237+0000","last_became_active":"2024-09-11T23:57:28.427596+0000","last_became_peered":"2024-09-11T23:57:28.427596+0000","last_unstale":"2024-09-11T23:59:21.681237+0000","last_undegraded":"2024-09-11T23:59:21.681237+0000","last_fullsized":"2024-09-11T23:59:21.681237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:41.196230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473215+0000","last_change":"2024-09-11T23:57:26.579958+0000","last_active":"2024-09-11T23:59:21.473215+0000","last_peered":"2024-09-11T23:59:21.473215+0000","last_clean":"2024-09-11T23:59:21.473215+0000","last_became_active":"2024-09-11T23:57:26.579493+0000","last_became_peered":"2024-09-11T23:57:26.579493+0000","last_unstale":"2024-09-11T23:59:21.473215+0000","last_undegraded":"2024-09-11T23:59:21.473215+0000","last_fullsized":"2024-09-11T23:59:21.473215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:07.474143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386888+0000","last_change":"2024-09-11T23:57:28.418860+0000","last_active":"2024-09-11T23:59:21.386888+0000","last_peered":"2024-09-11T23:59:21.386888+0000","last_clean":"2024-09-11T23:59:21.386888+0000","last_became_active":"2024-09-11T23:57:28.418415+0000","last_became_peered":"2024-09-11T23:57:28.418415+0000","last_unstale":"2024-09-11T23:59:21.386888+0000","last_undegraded":"2024-09-11T23:59:21.386888+0000","last_fullsized":"2024-09-11T23:59:21.386888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:52.707416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'36","reported_seq":294,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.654098+0000","last_change":"2024-09-11T23:57:26.264422+0000","last_active":"2024-09-11T23:59:31.654098+0000","last_peered":"2024-09-11T23:59:31.654098+0000","last_clean":"2024-09-11T23:59:31.654098+0000","last_became_active":"2024-09-11T23:57:26.264008+0000","last_became_peered":"2024-09-11T23:57:26.264008+0000","last_unstale":"2024-09-11T23:59:31.654098+0000","last_undegraded":"2024-09-11T23:59:31.654098+0000","last_fullsized":"2024-09-11T23:59:31.654098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.359881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":234,"num_read_kb":183,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701163+0000","last_change":"2024-09-11T23:57:28.422074+0000","last_active":"2024-09-11T23:59:21.701163+0000","last_peered":"2024-09-11T23:59:21.701163+0000","last_clean":"2024-09-11T23:59:21.701163+0000","last_became_active":"2024-09-11T23:57:28.421657+0000","last_became_peered":"2024-09-11T23:57:28.421657+0000","last_unstale":"2024-09-11T23:59:21.701163+0000","last_undegraded":"2024-09-11T23:59:21.701163+0000","last_fullsized":"2024-09-11T23:59:21.701163+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:07.126037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387205+0000","last_change":"2024-09-11T23:57:26.261407+0000","last_active":"2024-09-11T23:59:21.387205+0000","last_peered":"2024-09-11T23:59:21.387205+0000","last_clean":"2024-09-11T23:59:21.387205+0000","last_became_active":"2024-09-11T23:57:26.261080+0000","last_became_peered":"2024-09-11T23:57:26.261080+0000","last_unstale":"2024-09-11T23:59:21.387205+0000","last_undegraded":"2024-09-11T23:59:21.387205+0000","last_fullsized":"2024-09-11T23:59:21.387205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:39.247677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643090+0000","last_change":"2024-09-11T23:57:28.421327+0000","last_active":"2024-09-11T23:59:21.643090+0000","last_peered":"2024-09-11T23:59:21.643090+0000","last_clean":"2024-09-11T23:59:21.643090+0000","last_became_active":"2024-09-11T23:57:28.420496+0000","last_became_peered":"2024-09-11T23:57:28.420496+0000","last_unstale":"2024-09-11T23:59:21.643090+0000","last_undegraded":"2024-09-11T23:59:21.643090+0000","last_fullsized":"2024-09-11T23:59:21.643090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:15.500659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472835+0000","last_change":"2024-09-11T23:57:26.264941+0000","last_active":"2024-09-11T23:59:21.472835+0000","last_peered":"2024-09-11T23:59:21.472835+0000","last_clean":"2024-09-11T23:59:21.472835+0000","last_became_active":"2024-09-11T23:57:26.264545+0000","last_became_peered":"2024-09-11T23:57:26.264545+0000","last_unstale":"2024-09-11T23:59:21.472835+0000","last_undegraded":"2024-09-11T23:59:21.472835+0000","last_fullsized":"2024-09-11T23:59:21.472835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:42.874668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644370+0000","last_change":"2024-09-11T23:57:40.491962+0000","last_active":"2024-09-11T23:59:21.644370+0000","last_peered":"2024-09-11T23:59:21.644370+0000","last_clean":"2024-09-11T23:59:21.644370+0000","last_became_active":"2024-09-11T23:57:40.491704+0000","last_became_peered":"2024-09-11T23:57:40.491704+0000","last_unstale":"2024-09-11T23:59:21.644370+0000","last_undegraded":"2024-09-11T23:59:21.644370+0000","last_fullsized":"2024-09-11T23:59:21.644370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:22.918334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:30.654572+0000","last_change":"2024-09-11T23:57:26.266711+0000","last_active":"2024-09-11T23:59:30.654572+0000","last_peered":"2024-09-11T23:59:30.654572+0000","last_clean":"2024-09-11T23:59:30.654572+0000","last_became_active":"2024-09-11T23:57:26.266363+0000","last_became_peered":"2024-09-11T23:57:26.266363+0000","last_unstale":"2024-09-11T23:59:30.654572+0000","last_undegraded":"2024-09-11T23:59:30.654572+0000","last_fullsized":"2024-09-11T23:59:30.654572+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:28.139434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644127+0000","last_change":"2024-09-11T23:57:28.429754+0000","last_active":"2024-09-11T23:59:21.644127+0000","last_peered":"2024-09-11T23:59:21.644127+0000","last_clean":"2024-09-11T23:59:21.644127+0000","last_became_active":"2024-09-11T23:57:28.429448+0000","last_became_peered":"2024-09-11T23:57:28.429448+0000","last_unstale":"2024-09-11T23:59:21.644127+0000","last_undegraded":"2024-09-11T23:59:21.644127+0000","last_fullsized":"2024-09-11T23:59:21.644127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:44.186715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:26.580188+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:26.579662+0000","last_became_peered":"2024-09-11T23:57:26.579662+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:27.399908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.472738+0000","last_change":"2024-09-11T23:57:28.436791+0000","last_active":"2024-09-11T23:59:21.472738+0000","last_peered":"2024-09-11T23:59:21.472738+0000","last_clean":"2024-09-11T23:59:21.472738+0000","last_became_active":"2024-09-11T23:57:28.436324+0000","last_became_peered":"2024-09-11T23:57:28.436324+0000","last_unstale":"2024-09-11T23:59:21.472738+0000","last_undegraded":"2024-09-11T23:59:21.472738+0000","last_fullsized":"2024-09-11T23:59:21.472738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:49.547171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701229+0000","last_change":"2024-09-11T23:57:26.261927+0000","last_active":"2024-09-11T23:59:21.701229+0000","last_peered":"2024-09-11T23:59:21.701229+0000","last_clean":"2024-09-11T23:59:21.701229+0000","last_became_active":"2024-09-11T23:57:26.261496+0000","last_became_peered":"2024-09-11T23:57:26.261496+0000","last_unstale":"2024-09-11T23:59:21.701229+0000","last_undegraded":"2024-09-11T23:59:21.701229+0000","last_fullsized":"2024-09-11T23:59:21.701229+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:44.829374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466415+0000","last_change":"2024-09-11T23:57:28.434494+0000","last_active":"2024-09-11T23:59:21.466415+0000","last_peered":"2024-09-11T23:59:21.466415+0000","last_clean":"2024-09-11T23:59:21.466415+0000","last_became_active":"2024-09-11T23:57:28.434167+0000","last_became_peered":"2024-09-11T23:57:28.434167+0000","last_unstale":"2024-09-11T23:59:21.466415+0000","last_undegraded":"2024-09-11T23:59:21.466415+0000","last_fullsized":"2024-09-11T23:59:21.466415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:55.956423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643857+0000","last_change":"2024-09-11T23:57:40.805290+0000","last_active":"2024-09-11T23:59:21.643857+0000","last_peered":"2024-09-11T23:59:21.643857+0000","last_clean":"2024-09-11T23:59:21.643857+0000","last_became_active":"2024-09-11T23:57:40.801390+0000","last_became_peered":"2024-09-11T23:57:40.801390+0000","last_unstale":"2024-09-11T23:59:21.643857+0000","last_undegraded":"2024-09-11T23:59:21.643857+0000","last_fullsized":"2024-09-11T23:59:21.643857+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:21.404085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644471+0000","last_change":"2024-09-11T23:57:28.424478+0000","last_active":"2024-09-11T23:59:21.644471+0000","last_peered":"2024-09-11T23:59:21.644471+0000","last_clean":"2024-09-11T23:59:21.644471+0000","last_became_active":"2024-09-11T23:57:28.424133+0000","last_became_peered":"2024-09-11T23:57:28.424133+0000","last_unstale":"2024-09-11T23:59:21.644471+0000","last_undegraded":"2024-09-11T23:59:21.644471+0000","last_fullsized":"2024-09-11T23:59:21.644471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:11.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'67","reported_seq":122,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.268214+0000","last_change":"2024-09-11T23:57:26.266666+0000","last_active":"2024-09-11T23:59:31.268214+0000","last_peered":"2024-09-11T23:59:31.268214+0000","last_clean":"2024-09-11T23:59:31.268214+0000","last_became_active":"2024-09-11T23:57:26.266328+0000","last_became_peered":"2024-09-11T23:57:26.266328+0000","last_unstale":"2024-09-11T23:59:31.268214+0000","last_undegraded":"2024-09-11T23:59:31.268214+0000","last_fullsized":"2024-09-11T23:59:31.268214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:08.184365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644309+0000","last_change":"2024-09-11T23:57:28.431707+0000","last_active":"2024-09-11T23:59:21.644309+0000","last_peered":"2024-09-11T23:59:21.644309+0000","last_clean":"2024-09-11T23:59:21.644309+0000","last_became_active":"2024-09-11T23:57:28.431341+0000","last_became_peered":"2024-09-11T23:57:28.431341+0000","last_unstale":"2024-09-11T23:59:21.644309+0000","last_undegraded":"2024-09-11T23:59:21.644309+0000","last_fullsized":"2024-09-11T23:59:21.644309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:26.845678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:30.654135+0000","last_change":"2024-09-11T23:57:26.581270+0000","last_active":"2024-09-11T23:59:30.654135+0000","last_peered":"2024-09-11T23:59:30.654135+0000","last_clean":"2024-09-11T23:59:30.654135+0000","last_became_active":"2024-09-11T23:57:26.580525+0000","last_became_peered":"2024-09-11T23:57:26.580525+0000","last_unstale":"2024-09-11T23:59:30.654135+0000","last_undegraded":"2024-09-11T23:59:30.654135+0000","last_fullsized":"2024-09-11T23:59:30.654135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:31.585647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644569+0000","last_change":"2024-09-11T23:57:28.427242+0000","last_active":"2024-09-11T23:59:21.644569+0000","last_peered":"2024-09-11T23:59:21.644569+0000","last_clean":"2024-09-11T23:59:21.644569+0000","last_became_active":"2024-09-11T23:57:28.426936+0000","last_became_peered":"2024-09-11T23:57:28.426936+0000","last_unstale":"2024-09-11T23:59:21.644569+0000","last_undegraded":"2024-09-11T23:59:21.644569+0000","last_fullsized":"2024-09-11T23:59:21.644569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:40.775465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"83'148","reported_seq":392,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:23.481396+0000","last_change":"2024-09-11T23:56:16.805638+0000","last_active":"2024-09-11T23:59:23.481396+0000","last_peered":"2024-09-11T23:59:23.481396+0000","last_clean":"2024-09-11T23:59:23.481396+0000","last_became_active":"2024-09-11T23:56:16.805227+0000","last_became_peered":"2024-09-11T23:56:16.805227+0000","last_unstale":"2024-09-11T23:59:23.481396+0000","last_undegraded":"2024-09-11T23:59:23.481396+0000","last_fullsized":"2024-09-11T23:59:23.481396+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:52:53.812322+0000","last_clean_scrub_stamp":"2024-09-11T23:52:53.812322+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:36.543698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645165+0000","last_change":"2024-09-11T23:57:26.263601+0000","last_active":"2024-09-11T23:59:21.645165+0000","last_peered":"2024-09-11T23:59:21.645165+0000","last_clean":"2024-09-11T23:59:21.645165+0000","last_became_active":"2024-09-11T23:57:26.262218+0000","last_became_peered":"2024-09-11T23:57:26.262218+0000","last_unstale":"2024-09-11T23:59:21.645165+0000","last_undegraded":"2024-09-11T23:59:21.645165+0000","last_fullsized":"2024-09-11T23:59:21.645165+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:35.911223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466911+0000","last_change":"2024-09-11T23:57:28.429647+0000","last_active":"2024-09-11T23:59:21.466911+0000","last_peered":"2024-09-11T23:59:21.466911+0000","last_clean":"2024-09-11T23:59:21.466911+0000","last_became_active":"2024-09-11T23:57:28.429315+0000","last_became_peered":"2024-09-11T23:57:28.429315+0000","last_unstale":"2024-09-11T23:59:21.466911+0000","last_undegraded":"2024-09-11T23:59:21.466911+0000","last_fullsized":"2024-09-11T23:59:21.466911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.114461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466169+0000","last_change":"2024-09-11T23:57:40.498988+0000","last_active":"2024-09-11T23:59:21.466169+0000","last_peered":"2024-09-11T23:59:21.466169+0000","last_clean":"2024-09-11T23:59:21.466169+0000","last_became_active":"2024-09-11T23:57:40.493868+0000","last_became_peered":"2024-09-11T23:57:40.493868+0000","last_unstale":"2024-09-11T23:59:21.466169+0000","last_undegraded":"2024-09-11T23:59:21.466169+0000","last_fullsized":"2024-09-11T23:59:21.466169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:33.449386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.642811+0000","last_change":"2024-09-11T23:57:28.423365+0000","last_active":"2024-09-11T23:59:21.642811+0000","last_peered":"2024-09-11T23:59:21.642811+0000","last_clean":"2024-09-11T23:59:21.642811+0000","last_became_active":"2024-09-11T23:57:28.420660+0000","last_became_peered":"2024-09-11T23:57:28.420660+0000","last_unstale":"2024-09-11T23:59:21.642811+0000","last_undegraded":"2024-09-11T23:59:21.642811+0000","last_fullsized":"2024-09-11T23:59:21.642811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:54.240280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.655124+0000","last_change":"2024-09-11T23:57:26.579715+0000","last_active":"2024-09-11T23:59:31.655124+0000","last_peered":"2024-09-11T23:59:31.655124+0000","last_clean":"2024-09-11T23:59:31.655124+0000","last_became_active":"2024-09-11T23:57:26.579377+0000","last_became_peered":"2024-09-11T23:57:26.579377+0000","last_unstale":"2024-09-11T23:59:31.655124+0000","last_undegraded":"2024-09-11T23:59:31.655124+0000","last_fullsized":"2024-09-11T23:59:31.655124+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:44.709103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473078+0000","last_change":"2024-09-11T23:57:28.430914+0000","last_active":"2024-09-11T23:59:21.473078+0000","last_peered":"2024-09-11T23:59:21.473078+0000","last_clean":"2024-09-11T23:59:21.473078+0000","last_became_active":"2024-09-11T23:57:28.430556+0000","last_became_peered":"2024-09-11T23:57:28.430556+0000","last_unstale":"2024-09-11T23:59:21.473078+0000","last_undegraded":"2024-09-11T23:59:21.473078+0000","last_fullsized":"2024-09-11T23:59:21.473078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:40.293088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'8","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.655197+0000","last_change":"2024-09-11T23:57:26.263552+0000","last_active":"2024-09-11T23:59:31.655197+0000","last_peered":"2024-09-11T23:59:31.655197+0000","last_clean":"2024-09-11T23:59:31.655197+0000","last_became_active":"2024-09-11T23:57:26.263212+0000","last_became_peered":"2024-09-11T23:57:26.263212+0000","last_unstale":"2024-09-11T23:59:31.655197+0000","last_undegraded":"2024-09-11T23:59:31.655197+0000","last_fullsized":"2024-09-11T23:59:31.655197+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:45.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476029+0000","last_change":"2024-09-11T23:57:28.429380+0000","last_active":"2024-09-11T23:59:21.476029+0000","last_peered":"2024-09-11T23:59:21.476029+0000","last_clean":"2024-09-11T23:59:21.476029+0000","last_became_active":"2024-09-11T23:57:28.429059+0000","last_became_peered":"2024-09-11T23:57:28.429059+0000","last_unstale":"2024-09-11T23:59:21.476029+0000","last_undegraded":"2024-09-11T23:59:21.476029+0000","last_fullsized":"2024-09-11T23:59:21.476029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:33.254457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.385258+0000","last_change":"2024-09-11T23:57:26.580576+0000","last_active":"2024-09-11T23:59:21.385258+0000","last_peered":"2024-09-11T23:59:21.385258+0000","last_clean":"2024-09-11T23:59:21.385258+0000","last_became_active":"2024-09-11T23:57:26.580281+0000","last_became_peered":"2024-09-11T23:57:26.580281+0000","last_unstale":"2024-09-11T23:59:21.385258+0000","last_undegraded":"2024-09-11T23:59:21.385258+0000","last_fullsized":"2024-09-11T23:59:21.385258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:51.443680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.476051+0000","last_change":"2024-09-11T23:57:28.425374+0000","last_active":"2024-09-11T23:59:21.476051+0000","last_peered":"2024-09-11T23:59:21.476051+0000","last_clean":"2024-09-11T23:59:21.476051+0000","last_became_active":"2024-09-11T23:57:28.424983+0000","last_became_peered":"2024-09-11T23:57:28.424983+0000","last_unstale":"2024-09-11T23:59:21.476051+0000","last_undegraded":"2024-09-11T23:59:21.476051+0000","last_fullsized":"2024-09-11T23:59:21.476051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:46.664666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701325+0000","last_change":"2024-09-11T23:57:26.580526+0000","last_active":"2024-09-11T23:59:21.701325+0000","last_peered":"2024-09-11T23:59:21.701325+0000","last_clean":"2024-09-11T23:59:21.701325+0000","last_became_active":"2024-09-11T23:57:26.579773+0000","last_became_peered":"2024-09-11T23:57:26.579773+0000","last_unstale":"2024-09-11T23:59:21.701325+0000","last_undegraded":"2024-09-11T23:59:21.701325+0000","last_fullsized":"2024-09-11T23:59:21.701325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:44.825431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.643556+0000","last_change":"2024-09-11T23:57:28.422811+0000","last_active":"2024-09-11T23:59:21.643556+0000","last_peered":"2024-09-11T23:59:21.643556+0000","last_clean":"2024-09-11T23:59:21.643556+0000","last_became_active":"2024-09-11T23:57:28.422421+0000","last_became_peered":"2024-09-11T23:57:28.422421+0000","last_unstale":"2024-09-11T23:59:21.643556+0000","last_undegraded":"2024-09-11T23:59:21.643556+0000","last_fullsized":"2024-09-11T23:59:21.643556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:38.119970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'104","reported_seq":236,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.629716+0000","last_change":"2024-09-11T23:57:40.502324+0000","last_active":"2024-09-11T23:59:31.629716+0000","last_peered":"2024-09-11T23:59:31.629716+0000","last_clean":"2024-09-11T23:59:31.629716+0000","last_became_active":"2024-09-11T23:57:40.493948+0000","last_became_peered":"2024-09-11T23:57:40.493948+0000","last_unstale":"2024-09-11T23:59:31.629716+0000","last_undegraded":"2024-09-11T23:59:31.629716+0000","last_fullsized":"2024-09-11T23:59:31.629716+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:01.145165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":190,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466838+0000","last_change":"2024-09-11T23:57:28.421028+0000","last_active":"2024-09-11T23:59:21.466838+0000","last_peered":"2024-09-11T23:59:21.466838+0000","last_clean":"2024-09-11T23:59:21.466838+0000","last_became_active":"2024-09-11T23:57:28.420708+0000","last_became_peered":"2024-09-11T23:57:28.420708+0000","last_unstale":"2024-09-11T23:59:21.466838+0000","last_undegraded":"2024-09-11T23:59:21.466838+0000","last_fullsized":"2024-09-11T23:59:21.466838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:35.328471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.645248+0000","last_change":"2024-09-11T23:57:26.270591+0000","last_active":"2024-09-11T23:59:21.645248+0000","last_peered":"2024-09-11T23:59:21.645248+0000","last_clean":"2024-09-11T23:59:21.645248+0000","last_became_active":"2024-09-11T23:57:26.270345+0000","last_became_peered":"2024-09-11T23:57:26.270345+0000","last_unstale":"2024-09-11T23:59:21.645248+0000","last_undegraded":"2024-09-11T23:59:21.645248+0000","last_fullsized":"2024-09-11T23:59:21.645248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:38.688081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.680966+0000","last_change":"2024-09-11T23:57:28.418300+0000","last_active":"2024-09-11T23:59:21.680966+0000","last_peered":"2024-09-11T23:59:21.680966+0000","last_clean":"2024-09-11T23:59:21.680966+0000","last_became_active":"2024-09-11T23:57:28.418004+0000","last_became_peered":"2024-09-11T23:57:28.418004+0000","last_unstale":"2024-09-11T23:59:21.680966+0000","last_undegraded":"2024-09-11T23:59:21.680966+0000","last_fullsized":"2024-09-11T23:59:21.680966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.503823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386783+0000","last_change":"2024-09-11T23:57:26.580097+0000","last_active":"2024-09-11T23:59:21.386783+0000","last_peered":"2024-09-11T23:59:21.386783+0000","last_clean":"2024-09-11T23:59:21.386783+0000","last_became_active":"2024-09-11T23:57:26.579651+0000","last_became_peered":"2024-09-11T23:57:26.579651+0000","last_unstale":"2024-09-11T23:59:21.386783+0000","last_undegraded":"2024-09-11T23:59:21.386783+0000","last_fullsized":"2024-09-11T23:59:21.386783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:30.212087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.700914+0000","last_change":"2024-09-11T23:57:28.424838+0000","last_active":"2024-09-11T23:59:21.700914+0000","last_peered":"2024-09-11T23:59:21.700914+0000","last_clean":"2024-09-11T23:59:21.700914+0000","last_became_active":"2024-09-11T23:57:28.424545+0000","last_became_peered":"2024-09-11T23:57:28.424545+0000","last_unstale":"2024-09-11T23:59:21.700914+0000","last_undegraded":"2024-09-11T23:59:21.700914+0000","last_fullsized":"2024-09-11T23:59:21.700914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.223629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466548+0000","last_change":"2024-09-11T23:57:26.260772+0000","last_active":"2024-09-11T23:59:21.466548+0000","last_peered":"2024-09-11T23:59:21.466548+0000","last_clean":"2024-09-11T23:59:21.466548+0000","last_became_active":"2024-09-11T23:57:26.260436+0000","last_became_peered":"2024-09-11T23:57:26.260436+0000","last_unstale":"2024-09-11T23:59:21.466548+0000","last_undegraded":"2024-09-11T23:59:21.466548+0000","last_fullsized":"2024-09-11T23:59:21.466548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:39.616197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466388+0000","last_change":"2024-09-11T23:57:28.429694+0000","last_active":"2024-09-11T23:59:21.466388+0000","last_peered":"2024-09-11T23:59:21.466388+0000","last_clean":"2024-09-11T23:59:21.466388+0000","last_became_active":"2024-09-11T23:57:28.429355+0000","last_became_peered":"2024-09-11T23:57:28.429355+0000","last_unstale":"2024-09-11T23:59:21.466388+0000","last_undegraded":"2024-09-11T23:59:21.466388+0000","last_fullsized":"2024-09-11T23:59:21.466388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:27.772248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'4","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.387214+0000","last_change":"2024-09-11T23:57:26.263478+0000","last_active":"2024-09-11T23:59:21.387214+0000","last_peered":"2024-09-11T23:59:21.387214+0000","last_clean":"2024-09-11T23:59:21.387214+0000","last_became_active":"2024-09-11T23:57:26.263109+0000","last_became_peered":"2024-09-11T23:57:26.263109+0000","last_unstale":"2024-09-11T23:59:21.387214+0000","last_undegraded":"2024-09-11T23:59:21.387214+0000","last_fullsized":"2024-09-11T23:59:21.387214+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:34.029761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466575+0000","last_change":"2024-09-11T23:57:28.425262+0000","last_active":"2024-09-11T23:59:21.466575+0000","last_peered":"2024-09-11T23:59:21.466575+0000","last_clean":"2024-09-11T23:59:21.466575+0000","last_became_active":"2024-09-11T23:57:28.424958+0000","last_became_peered":"2024-09-11T23:57:28.424958+0000","last_unstale":"2024-09-11T23:59:21.466575+0000","last_undegraded":"2024-09-11T23:59:21.466575+0000","last_fullsized":"2024-09-11T23:59:21.466575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.060417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701133+0000","last_change":"2024-09-11T23:57:26.266189+0000","last_active":"2024-09-11T23:59:21.701133+0000","last_peered":"2024-09-11T23:59:21.701133+0000","last_clean":"2024-09-11T23:59:21.701133+0000","last_became_active":"2024-09-11T23:57:26.265835+0000","last_became_peered":"2024-09-11T23:57:26.265835+0000","last_unstale":"2024-09-11T23:59:21.701133+0000","last_undegraded":"2024-09-11T23:59:21.701133+0000","last_fullsized":"2024-09-11T23:59:21.701133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:57.316785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.644300+0000","last_change":"2024-09-11T23:57:28.420934+0000","last_active":"2024-09-11T23:59:21.644300+0000","last_peered":"2024-09-11T23:59:21.644300+0000","last_clean":"2024-09-11T23:59:21.644300+0000","last_became_active":"2024-09-11T23:57:28.420560+0000","last_became_peered":"2024-09-11T23:57:28.420560+0000","last_unstale":"2024-09-11T23:59:21.644300+0000","last_undegraded":"2024-09-11T23:59:21.644300+0000","last_fullsized":"2024-09-11T23:59:21.644300+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:29.124518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.473153+0000","last_change":"2024-09-11T23:57:28.435863+0000","last_active":"2024-09-11T23:59:21.473153+0000","last_peered":"2024-09-11T23:59:21.473153+0000","last_clean":"2024-09-11T23:59:21.473153+0000","last_became_active":"2024-09-11T23:57:28.435558+0000","last_became_peered":"2024-09-11T23:57:28.435558+0000","last_unstale":"2024-09-11T23:59:21.473153+0000","last_undegraded":"2024-09-11T23:59:21.473153+0000","last_fullsized":"2024-09-11T23:59:21.473153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:31.357498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701254+0000","last_change":"2024-09-11T23:57:26.261467+0000","last_active":"2024-09-11T23:59:21.701254+0000","last_peered":"2024-09-11T23:59:21.701254+0000","last_clean":"2024-09-11T23:59:21.701254+0000","last_became_active":"2024-09-11T23:57:26.260746+0000","last_became_peered":"2024-09-11T23:57:26.260746+0000","last_unstale":"2024-09-11T23:59:21.701254+0000","last_undegraded":"2024-09-11T23:59:21.701254+0000","last_fullsized":"2024-09-11T23:59:21.701254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:53.704943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.386855+0000","last_change":"2024-09-11T23:57:28.423920+0000","last_active":"2024-09-11T23:59:21.386855+0000","last_peered":"2024-09-11T23:59:21.386855+0000","last_clean":"2024-09-11T23:59:21.386855+0000","last_became_active":"2024-09-11T23:57:28.423595+0000","last_became_peered":"2024-09-11T23:57:28.423595+0000","last_unstale":"2024-09-11T23:59:21.386855+0000","last_undegraded":"2024-09-11T23:59:21.386855+0000","last_fullsized":"2024-09-11T23:59:21.386855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:18.087432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.701190+0000","last_change":"2024-09-11T23:57:26.263579+0000","last_active":"2024-09-11T23:59:21.701190+0000","last_peered":"2024-09-11T23:59:21.701190+0000","last_clean":"2024-09-11T23:59:21.701190+0000","last_became_active":"2024-09-11T23:57:26.263240+0000","last_became_peered":"2024-09-11T23:57:26.263240+0000","last_unstale":"2024-09-11T23:59:21.701190+0000","last_undegraded":"2024-09-11T23:59:21.701190+0000","last_fullsized":"2024-09-11T23:59:21.701190+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:00.591344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.681365+0000","last_change":"2024-09-11T23:57:28.430232+0000","last_active":"2024-09-11T23:59:21.681365+0000","last_peered":"2024-09-11T23:59:21.681365+0000","last_clean":"2024-09-11T23:59:21.681365+0000","last_became_active":"2024-09-11T23:57:28.429843+0000","last_became_peered":"2024-09-11T23:57:28.429843+0000","last_unstale":"2024-09-11T23:59:21.681365+0000","last_undegraded":"2024-09-11T23:59:21.681365+0000","last_fullsized":"2024-09-11T23:59:21.681365+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:04.126939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466994+0000","last_change":"2024-09-11T23:57:26.579592+0000","last_active":"2024-09-11T23:59:21.466994+0000","last_peered":"2024-09-11T23:59:21.466994+0000","last_clean":"2024-09-11T23:59:21.466994+0000","last_became_active":"2024-09-11T23:57:26.579311+0000","last_became_peered":"2024-09-11T23:57:26.579311+0000","last_unstale":"2024-09-11T23:59:21.466994+0000","last_undegraded":"2024-09-11T23:59:21.466994+0000","last_fullsized":"2024-09-11T23:59:21.466994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:13.192812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:21.466847+0000","last_change":"2024-09-11T23:57:28.430688+0000","last_active":"2024-09-11T23:59:21.466847+0000","last_peered":"2024-09-11T23:59:21.466847+0000","last_clean":"2024-09-11T23:59:21.466847+0000","last_became_active":"2024-09-11T23:57:28.430303+0000","last_became_peered":"2024-09-11T23:57:28.430303+0000","last_unstale":"2024-09-11T23:59:21.466847+0000","last_undegraded":"2024-09-11T23:59:21.466847+0000","last_fullsized":"2024-09-11T23:59:21.466847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:27.402358+0000","last_clean_scrub_stamp":"2024-09-11T23:57:27.402358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.206702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":152,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:59:31.654766+0000","last_change":"2024-09-11T23:57:26.261645+0000","last_active":"2024-09-11T23:59:31.654766+0000","last_peered":"2024-09-11T23:59:31.654766+0000","last_clean":"2024-09-11T23:59:31.654766+0000","last_became_active":"2024-09-11T23:57:26.261366+0000","last_became_peered":"2024-09-11T23:57:26.261366+0000","last_unstale":"2024-09-11T23:59:31.654766+0000","last_undegraded":"2024-09-11T23:59:31.654766+0000","last_fullsized":"2024-09-11T23:59:31.654766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:57:25.244470+0000","last_clean_scrub_stamp":"2024-09-11T23:57:25.244470+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:57.624679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":797439,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1507,"num_read_kb":976,"num_write":502,"num_write_kb":2379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":2392317,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":381,"ondisk_log_size":381,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108813,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":836685,"data_compressed":22186,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1118208,"data_stored":1429351,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":836222,"data_compressed":22186,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201331,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":443384,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":1038207,"data_compressed":39168,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":443565,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1364741,"data_compressed":54370,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986249,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":445060,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":1163996,"data_compressed":37388,"data_compressed_allocated":49152,"data_compressed_original":708608,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":510107,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":987136,"data_stored":510958,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":937984,"data_stored":444455,"data_compressed":2897,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36271,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":721878,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":332372,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":396982,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":394801,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:59:36.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:37.223 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:37.652 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:37 smithi060 ceph-mon[30953]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:37.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:37 smithi105 ceph-mon[34805]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 -- 172.21.15.60:0/3904499090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830101de0 msgr2=0x7f08301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 --2- 172.21.15.60:0/3904499090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830101de0 0x7f08301021c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f082c009900 tx=0x7f082c02a410 comp rx=0 tx=0).stop 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 -- 172.21.15.60:0/3904499090 shutdown_connections 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 --2- 172.21.15.60:0/3904499090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830106f10 0x7f083010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 --2- 172.21.15.60:0/3904499090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0830102790 0x7f08301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 --2- 172.21.15.60:0/3904499090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830101de0 0x7f08301021c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 -- 172.21.15.60:0/3904499090 >> 172.21.15.60:0/3904499090 conn(0x7f08300fd8c0 msgr2=0x7f08300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 -- 172.21.15.60:0/3904499090 shutdown_connections 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.735+0000 7f083700b640 1 -- 172.21.15.60:0/3904499090 wait complete. 2024-09-11T23:59:37.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f083700b640 1 Processor -- start 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f083700b640 1 -- start start 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f083700b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0830101de0 0x7f08300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f083700b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830102790 0x7f0830074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f083700b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830106f10 0x7f0830074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f083700b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08301120d0 con 0x7f0830106f10 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f083700b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0830111f50 con 0x7f0830101de0 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f083700b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0830112250 con 0x7f0830102790 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f08355a8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830106f10 0x7f0830074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f08355a8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830106f10 0x7f0830074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34542/0 (socket says 172.21.15.60:34542) 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f08355a8640 1 -- 172.21.15.60:0/4052822948 learned_addr learned my addr 172.21.15.60:0/4052822948 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f0834da7640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0830101de0 0x7f08300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f0827fff640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830102790 0x7f0830074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:37.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f08355a8640 1 -- 172.21.15.60:0/4052822948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830102790 msgr2=0x7f0830074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f08355a8640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830102790 0x7f0830074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f08355a8640 1 -- 172.21.15.60:0/4052822948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0830101de0 msgr2=0x7f08300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f08355a8640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0830101de0 0x7f08300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.736+0000 7f08355a8640 1 -- 172.21.15.60:0/4052822948 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08301a69d0 con 0x7f0830106f10 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.737+0000 7f08355a8640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830106f10 0x7f0830074f70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f082800b970 tx=0x7f082800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.737+0000 7f0825ffb640 1 -- 172.21.15.60:0/4052822948 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828019070 con 0x7f0830106f10 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.737+0000 7f0825ffb640 1 -- 172.21.15.60:0/4052822948 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f082800cb40 con 0x7f0830106f10 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.737+0000 7f0825ffb640 1 -- 172.21.15.60:0/4052822948 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828007700 con 0x7f0830106f10 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.737+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08301a6cc0 con 0x7f0830106f10 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.737+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08301a71b0 con 0x7f0830106f10 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.738+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08301021c0 con 0x7f0830106f10 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.739+0000 7f0825ffb640 1 -- 172.21.15.60:0/4052822948 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f082801c070 con 0x7f0830106f10 2024-09-11T23:59:37.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.740+0000 7f0825ffb640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f08180a2d80 0x7f08180a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:37.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.740+0000 7f0834da7640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f08180a2d80 0x7f08180a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:37.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.740+0000 7f0825ffb640 1 -- 172.21.15.60:0/4052822948 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f08280cea00 con 0x7f0830106f10 2024-09-11T23:59:37.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.741+0000 7f0834da7640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f08180a2d80 0x7f08180a5240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f082c009230 tx=0x7f082c0058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:37.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.744+0000 7f0825ffb640 1 -- 172.21.15.60:0/4052822948 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f082809afc0 con 0x7f0830106f10 2024-09-11T23:59:37.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:37 smithi192 ceph-mon[35487]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T23:59:37.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.957+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f083010a0f0 con 0x7f0830106f10 2024-09-11T23:59:37.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.958+0000 7f0825ffb640 1 -- 172.21.15.60:0/4052822948 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7f082809f2c0 con 0x7f0830106f10 2024-09-11T23:59:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:37.958 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-11T23:59:37.958 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-11T23:59:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f08180a2d80 msgr2=0x7f08180a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f08180a2d80 0x7f08180a5240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f082c009230 tx=0x7f082c0058d0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830106f10 msgr2=0x7f0830074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830106f10 0x7f0830074f70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f082800b970 tx=0x7f082800be30 comp rx=0 tx=0).stop 2024-09-11T23:59:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 shutdown_connections 2024-09-11T23:59:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f08180a2d80 0x7f08180a5240 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0830106f10 0x7f0830074f70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830102790 0x7f0830074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 --2- 172.21.15.60:0/4052822948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0830101de0 0x7f08300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.960+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 >> 172.21.15.60:0/4052822948 conn(0x7f08300fd8c0 msgr2=0x7f08300fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.961+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 shutdown_connections 2024-09-11T23:59:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:37.961+0000 7f083700b640 1 -- 172.21.15.60:0/4052822948 wait complete. 2024-09-11T23:59:38.566 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:38 smithi060 ceph-mon[30953]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-11T23:59:38.567 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:38 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4052822948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:38.597 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:38.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:38 smithi105 ceph-mon[34805]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-11T23:59:38.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:38 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4052822948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:38 smithi192 ceph-mon[35487]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 50 op/s 2024-09-11T23:59:38.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:38 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4052822948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:38.861 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 -- 172.21.15.60:0/4005856270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 msgr2=0x7fa4a0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 --2- 172.21.15.60:0/4005856270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 0x7fa4a0103110 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa490009930 tx=0x7fa49002a420 comp rx=0 tx=0).stop 2024-09-11T23:59:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 -- 172.21.15.60:0/4005856270 shutdown_connections 2024-09-11T23:59:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 --2- 172.21.15.60:0/4005856270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4a01082a0 0x7fa4a010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 --2- 172.21.15.60:0/4005856270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a01036e0 0x7fa4a0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 --2- 172.21.15.60:0/4005856270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 0x7fa4a0103110 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 -- 172.21.15.60:0/4005856270 >> 172.21.15.60:0/4005856270 conn(0x7fa4a00fc7d0 msgr2=0x7fa4a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:39.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 -- 172.21.15.60:0/4005856270 shutdown_connections 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 -- 172.21.15.60:0/4005856270 wait complete. 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 Processor -- start 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.374+0000 7fa4a632b640 1 -- start start 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa4a632b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 0x7fa4a0198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa4a632b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a01036e0 0x7fa4a0198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa4a632b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4a01082a0 0x7fa4a019cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa4a632b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a01121c0 con 0x7fa4a0102d30 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa4a632b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a0112040 con 0x7fa4a01082a0 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa4a632b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a0112340 con 0x7fa4a01036e0 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 0x7fa4a0198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 0x7fa4a0198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34554/0 (socket says 172.21.15.60:34554) 2024-09-11T23:59:39.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 -- 172.21.15.60:0/1010732221 learned_addr learned my addr 172.21.15.60:0/1010732221 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa4a48c8640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4a01082a0 0x7fa4a019cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49f7fe640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a01036e0 0x7fa4a0198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 -- 172.21.15.60:0/1010732221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a01036e0 msgr2=0x7fa4a0198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a01036e0 0x7fa4a0198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 -- 172.21.15.60:0/1010732221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4a01082a0 msgr2=0x7fa4a019cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4a01082a0 0x7fa4a019cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 -- 172.21.15.60:0/1010732221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a019d640 con 0x7fa4a0102d30 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.375+0000 7fa49ffff640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 0x7fa4a0198690 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa490009230 tx=0x7fa490004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.376+0000 7fa49d7fa640 1 -- 172.21.15.60:0/1010732221 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49003f030 con 0x7fa4a0102d30 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.376+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a019d8d0 con 0x7fa4a0102d30 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.376+0000 7fa49d7fa640 1 -- 172.21.15.60:0/1010732221 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa490003af0 con 0x7fa4a0102d30 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.376+0000 7fa49d7fa640 1 -- 172.21.15.60:0/1010732221 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490035070 con 0x7fa4a0102d30 2024-09-11T23:59:39.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.376+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a01a5210 con 0x7fa4a0102d30 2024-09-11T23:59:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.377+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a0103110 con 0x7fa4a0102d30 2024-09-11T23:59:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.378+0000 7fa49d7fa640 1 -- 172.21.15.60:0/1010732221 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fa490042030 con 0x7fa4a0102d30 2024-09-11T23:59:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.379+0000 7fa49d7fa640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4880a2d80 0x7fa4880a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.379+0000 7fa49f7fe640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4880a2d80 0x7fa4880a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.379+0000 7fa49d7fa640 1 -- 172.21.15.60:0/1010732221 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa4900efb90 con 0x7fa4a0102d30 2024-09-11T23:59:39.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.379+0000 7fa49f7fe640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4880a2d80 0x7fa4880a5240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa494005fd0 tx=0x7fa494005850 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:39.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.387+0000 7fa49d7fa640 1 -- 172.21.15.60:0/1010732221 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4900bc690 con 0x7fa4a0102d30 2024-09-11T23:59:39.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.600+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4a010a2b0 con 0x7fa4a0102d30 2024-09-11T23:59:39.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.600+0000 7fa49d7fa640 1 -- 172.21.15.60:0/1010732221 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7fa4900bbf90 con 0x7fa4a0102d30 2024-09-11T23:59:39.600 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:39.600 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-11T23:59:39.600 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-11T23:59:39.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4880a2d80 msgr2=0x7fa4880a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4880a2d80 0x7fa4880a5240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa494005fd0 tx=0x7fa494005850 comp rx=0 tx=0).stop 2024-09-11T23:59:39.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 msgr2=0x7fa4a0198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:39.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 0x7fa4a0198690 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa490009230 tx=0x7fa490004270 comp rx=0 tx=0).stop 2024-09-11T23:59:39.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 shutdown_connections 2024-09-11T23:59:39.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4880a2d80 0x7fa4880a5240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4a01082a0 0x7fa4a019cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a01036e0 0x7fa4a0198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 --2- 172.21.15.60:0/1010732221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4a0102d30 0x7fa4a0198690 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:39.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 >> 172.21.15.60:0/1010732221 conn(0x7fa4a00fc7d0 msgr2=0x7fa4a0105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:39.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 shutdown_connections 2024-09-11T23:59:39.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:39.603+0000 7fa4a632b640 1 -- 172.21.15.60:0/1010732221 wait complete. 2024-09-11T23:59:40.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T23:59:40.678 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:40 smithi192 ceph-mon[35487]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 KiB/s wr, 54 op/s 2024-09-11T23:59:40.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:40 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1010732221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:40.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:40 smithi060 ceph-mon[30953]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 KiB/s wr, 54 op/s 2024-09-11T23:59:40.800 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:40 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1010732221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:40.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:40 smithi105 ceph-mon[34805]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 KiB/s wr, 54 op/s 2024-09-11T23:59:40.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:40 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1010732221' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1742952962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8106f10 msgr2=0x7f4fa810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1742952962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8106f10 0x7f4fa810ea90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009ca0 tx=0x7f4fa002a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1742952962 shutdown_connections 2024-09-11T23:59:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1742952962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8106f10 0x7f4fa810ea90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1742952962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa8102790 0x7f4fa81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1742952962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa8101de0 0x7f4fa81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1742952962 >> 172.21.15.60:0/1742952962 conn(0x7f4fa80fd8c0 msgr2=0x7f4fa80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1742952962 shutdown_connections 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.163+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1742952962 wait complete. 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fae6fb640 1 Processor -- start 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fae6fb640 1 -- start start 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fae6fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fae6fb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa8102790 0x7f4fa8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fae6fb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa8106f10 0x7f4fa819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fae6fb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8112090 con 0x7f4fa8101de0 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fae6fb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8111f10 con 0x7f4fa8106f10 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fae6fb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8112210 con 0x7f4fa8102790 2024-09-11T23:59:41.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fa7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fa7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34580/0 (socket says 172.21.15.60:34580) 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.164+0000 7f4fa7fff640 1 -- 172.21.15.60:0/1957617883 learned_addr learned my addr 172.21.15.60:0/1957617883 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4facc98640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa8106f10 0x7f4fa819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa77fe640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa8102790 0x7f4fa8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa7fff640 1 -- 172.21.15.60:0/1957617883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa8102790 msgr2=0x7f4fa8198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa7fff640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa8102790 0x7f4fa8198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa7fff640 1 -- 172.21.15.60:0/1957617883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa8106f10 msgr2=0x7f4fa819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa7fff640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa8106f10 0x7f4fa819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa7fff640 1 -- 172.21.15.60:0/1957617883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa819d3d0 con 0x7f4fa8101de0 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4facc98640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa8106f10 0x7f4fa819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa7fff640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198420 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800d770 tx=0x7f4f9800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:41.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa57fa640 1 -- 172.21.15.60:0/1957617883 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98017070 con 0x7f4fa8101de0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa57fa640 1 -- 172.21.15.60:0/1957617883 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4f98005520 con 0x7f4fa8101de0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa819d6c0 con 0x7f4fa8101de0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fa57fa640 1 -- 172.21.15.60:0/1957617883 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98010460 con 0x7f4fa8101de0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.165+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa81a4fa0 con 0x7f4fa8101de0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.166+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa81021c0 con 0x7f4fa8101de0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.167+0000 7f4fa57fa640 1 -- 172.21.15.60:0/1957617883 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f4f98004ea0 con 0x7f4fa8101de0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.168+0000 7f4fa57fa640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4f900a2d80 0x7f4f900a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.169+0000 7f4fa77fe640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4f900a2d80 0x7f4f900a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.169+0000 7f4fa57fa640 1 -- 172.21.15.60:0/1957617883 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f4f980cf5f0 con 0x7f4fa8101de0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.169+0000 7f4fa77fe640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4f900a2d80 0x7f4f900a5240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8108880 tx=0x7f4f9c00c4a0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.172+0000 7f4fa57fa640 1 -- 172.21.15.60:0/1957617883 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4f9809c090 con 0x7f4fa8101de0 2024-09-11T23:59:41.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.349+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fa81a5170 con 0x7f4fa8101de0 2024-09-11T23:59:41.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.350+0000 7f4fa57fa640 1 -- 172.21.15.60:0/1957617883 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+23021 (secure 0 0 0) 0x7f4f9809b990 con 0x7f4fa8101de0 2024-09-11T23:59:41.349 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:41.350 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":83,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-11T23:59:21.380083+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/75586277":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3663020999":"2024-09-12T23:59:21.380056+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6801/1180183286":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2524722535":"2024-09-12T23:59:21.380056+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/1180183286":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3141588653":"2024-09-12T23:59:21.380056+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:59:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4f900a2d80 msgr2=0x7f4f900a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4f900a2d80 0x7f4f900a5240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8108880 tx=0x7f4f9c00c4a0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8101de0 msgr2=0x7f4fa8198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198420 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800d770 tx=0x7f4f9800dc30 comp rx=0 tx=0).stop 2024-09-11T23:59:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 shutdown_connections 2024-09-11T23:59:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4f900a2d80 0x7f4f900a5240 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fa8106f10 0x7f4fa819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa8102790 0x7f4fa8198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 --2- 172.21.15.60:0/1957617883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fa8101de0 0x7f4fa8198420 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:41.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 >> 172.21.15.60:0/1957617883 conn(0x7f4fa80fd8c0 msgr2=0x7f4fa80ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:41.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 shutdown_connections 2024-09-11T23:59:41.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:41.353+0000 7f4fae6fb640 1 -- 172.21.15.60:0/1957617883 wait complete. 2024-09-11T23:59:41.668 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:41 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1957617883' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:41.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:41 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1957617883' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:41.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:41 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1957617883' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-11T23:59:42.018 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-11T23:59:42.277 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:42.649 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:42 smithi060 ceph-mon[30953]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-11T23:59:42.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:42 smithi192 ceph-mon[35487]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-11T23:59:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:42 smithi105 ceph-mon[34805]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-11T23:59:43.420 INFO:teuthology.orchestra.run.smithi060.stdout:{"run_dir":"/var/run/ceph"} 2024-09-11T23:59:43.420 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-11T23:59:43.421 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-11T23:59:43.421 DEBUG:tasks.quiescer:Yielding 2024-09-11T23:59:43.421 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T23:59:43.440 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T23:59:43.440 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T23:59:43.440 INFO:tasks.workunit:timeout=3h 2024-09-11T23:59:43.440 INFO:tasks.workunit:cleanup=True 2024-09-11T23:59:43.441 DEBUG:teuthology.orchestra.run.smithi060:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:43.441 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-11 23:57:47.034820111 +0000 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-11 23:57:47.034820111 +0000 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-11 23:59:19.572249690 +0000 2024-09-11T23:59:43.459 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-11 23:57:47.034820111 +0000 2024-09-11T23:59:43.460 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T23:59:43.460 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T23:59:43.534 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T23:59:43.591 INFO:tasks.workunit.client.0.smithi060.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T23:59:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:44.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 -- 172.21.15.60:0/3177516457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441036e0 msgr2=0x7f4344107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 --2- 172.21.15.60:0/3177516457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441036e0 0x7f4344107b90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4330009930 tx=0x7f433002a420 comp rx=0 tx=0).stop 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 -- 172.21.15.60:0/3177516457 shutdown_connections 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 --2- 172.21.15.60:0/3177516457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43441082a0 0x7f434410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 --2- 172.21.15.60:0/3177516457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441036e0 0x7f4344107b90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 --2- 172.21.15.60:0/3177516457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4344102d30 0x7f4344103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 -- 172.21.15.60:0/3177516457 >> 172.21.15.60:0/3177516457 conn(0x7f43440fc7d0 msgr2=0x7f43440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 -- 172.21.15.60:0/3177516457 shutdown_connections 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.261+0000 7f434b211640 1 -- 172.21.15.60:0/3177516457 wait complete. 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f434b211640 1 Processor -- start 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f434b211640 1 -- start start 2024-09-11T23:59:44.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f434b211640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4344102d30 0x7f4344198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f434b211640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43441036e0 0x7f4344198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f434b211640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43441082a0 0x7f434419cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f434b211640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4344112200 con 0x7f4344102d30 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f434b211640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4344112080 con 0x7f43441036e0 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f434b211640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4344112380 con 0x7f43441082a0 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4348fad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4344102d30 0x7f4344198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4348fad640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4344102d30 0x7f4344198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43066/0 (socket says 172.21.15.60:43066) 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4348fad640 1 -- 172.21.15.60:0/1237281479 learned_addr learned my addr 172.21.15.60:0/1237281479 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4343fff640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43441036e0 0x7f4344198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f43497ae640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43441082a0 0x7f434419cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4348fad640 1 -- 172.21.15.60:0/1237281479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43441082a0 msgr2=0x7f434419cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:44.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4348fad640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43441082a0 0x7f434419cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4348fad640 1 -- 172.21.15.60:0/1237281479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43441036e0 msgr2=0x7f4344198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4348fad640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43441036e0 0x7f4344198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.262+0000 7f4348fad640 1 -- 172.21.15.60:0/1237281479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434419d6c0 con 0x7f4344102d30 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.263+0000 7f4343fff640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43441036e0 0x7f4344198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.263+0000 7f4348fad640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4344102d30 0x7f4344198710 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f433800b4a0 tx=0x7f433800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.263+0000 7f4341ffb640 1 -- 172.21.15.60:0/1237281479 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338014070 con 0x7f4344102d30 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.263+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434419d9b0 con 0x7f4344102d30 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.263+0000 7f4341ffb640 1 -- 172.21.15.60:0/1237281479 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4338010b10 con 0x7f4344102d30 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.263+0000 7f4341ffb640 1 -- 172.21.15.60:0/1237281479 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338017d60 con 0x7f4344102d30 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.263+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43441a5290 con 0x7f4344102d30 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.264+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f434406a850 con 0x7f4344102d30 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.265+0000 7f4341ffb640 1 -- 172.21.15.60:0/1237281479 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f4338017070 con 0x7f4344102d30 2024-09-11T23:59:44.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.266+0000 7f4341ffb640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f43340a2d80 0x7f43340a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:44.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.266+0000 7f4343fff640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f43340a2d80 0x7f43340a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:44.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.266+0000 7f4341ffb640 1 -- 172.21.15.60:0/1237281479 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f43380ce9d0 con 0x7f4344102d30 2024-09-11T23:59:44.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.267+0000 7f4343fff640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f43340a2d80 0x7f43340a5240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4330009900 tx=0x7f4330005a20 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:44.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.270+0000 7f4341ffb640 1 -- 172.21.15.60:0/1237281479 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f433809b580 con 0x7f4344102d30 2024-09-11T23:59:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.486+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f434410a2b0 con 0x7f4344102d30 2024-09-11T23:59:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.486+0000 7f4341ffb640 1 -- 172.21.15.60:0/1237281479 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7f433809ae80 con 0x7f4344102d30 2024-09-11T23:59:44.486 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-11T23:59:44.486 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-11T23:59:44.486 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-11T23:59:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f43340a2d80 msgr2=0x7f43340a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f43340a2d80 0x7f43340a5240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4330009900 tx=0x7f4330005a20 comp rx=0 tx=0).stop 2024-09-11T23:59:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4344102d30 msgr2=0x7f4344198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4344102d30 0x7f4344198710 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f433800b4a0 tx=0x7f433800b960 comp rx=0 tx=0).stop 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 shutdown_connections 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f43340a2d80 0x7f43340a5240 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43441082a0 0x7f434419cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43441036e0 0x7f4344198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 --2- 172.21.15.60:0/1237281479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4344102d30 0x7f4344198710 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 >> 172.21.15.60:0/1237281479 conn(0x7f43440fc7d0 msgr2=0x7f4344105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 shutdown_connections 2024-09-11T23:59:44.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:44.489+0000 7f434b211640 1 -- 172.21.15.60:0/1237281479 wait complete. 2024-09-11T23:59:45.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:44 smithi060 ceph-mon[30953]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-11T23:59:45.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:44 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-11T23:59:45.184 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:44 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1237281479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:45.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T23:57:29.107465+0000', 'modified': '2024-09-11T23:59:20.337602+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24496, 'mds_1': 24485, 'mds_2': 24484, 'mds_3': 24475, 'mds_4': 24467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14601': {'gid': 14601, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6839/4061424559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 4061424559}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 4061424559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6841/1402291177', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6840', 'nonce': 1402291177}, {'type': 'v1', 'addr': '172.21.15.60:6841', 'nonce': 1402291177}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6833/967941361', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 967941361}, {'type': 'v1', 'addr': '172.21.15.105:6833', 'nonce': 967941361}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6833/1968112880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 1968112880}, {'type': 'v1', 'addr': '172.21.15.192:6833', 'nonce': 1968112880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.105:6835/3186850870', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 3186850870}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 3186850870}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.105:6837/2264507638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6836', 'nonce': 2264507638}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 2264507638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6835/968968600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 968968600}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 968968600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6837/1338489089', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 1338489089}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 1338489089}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.105:6839/525386561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6838', 'nonce': 525386561}, {'type': 'v1', 'addr': '172.21.15.105:6839', 'nonce': 525386561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.192:6839/3310133932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 3310133932}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 3310133932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24496, 'qdb_cluster': [24467, 24475, 24484, 24485, 24496]} 2024-09-11T23:59:45.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-11T23:59:45.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T23:59:45.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:44 smithi105 ceph-mon[34805]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-11T23:59:45.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:44 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-11T23:59:45.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:44 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1237281479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:45.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:44 smithi192 ceph-mon[35487]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-11T23:59:45.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:44 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-11T23:59:45.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:44 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1237281479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-11T23:59:45.528 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 -- 172.21.15.60:0/76152848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c106f00 msgr2=0x7ff67c10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 --2- 172.21.15.60:0/76152848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c106f00 0x7ff67c10ea80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff674009ca0 tx=0x7ff67402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 -- 172.21.15.60:0/76152848 shutdown_connections 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 --2- 172.21.15.60:0/76152848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c106f00 0x7ff67c10ea80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 --2- 172.21.15.60:0/76152848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff67c102780 0x7ff67c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 --2- 172.21.15.60:0/76152848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67c101dd0 0x7ff67c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 -- 172.21.15.60:0/76152848 >> 172.21.15.60:0/76152848 conn(0x7ff67c0fd890 msgr2=0x7ff67c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 -- 172.21.15.60:0/76152848 shutdown_connections 2024-09-11T23:59:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.038+0000 7ff680b9e640 1 -- 172.21.15.60:0/76152848 wait complete. 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff680b9e640 1 Processor -- start 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff680b9e640 1 -- start start 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff680b9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c101dd0 0x7ff67c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff680b9e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67c102780 0x7ff67c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff680b9e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff67c106f00 0x7ff67c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff680b9e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c112080 con 0x7ff67c101dd0 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff680b9e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c111f00 con 0x7ff67c106f00 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff680b9e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c112200 con 0x7ff67c102780 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff67a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c101dd0 0x7ff67c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff67a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c101dd0 0x7ff67c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43074/0 (socket says 172.21.15.60:43074) 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff67a59c640 1 -- 172.21.15.60:0/963493228 learned_addr learned my addr 172.21.15.60:0/963493228 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff673fff640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67c102780 0x7ff67c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff67c106f00 0x7ff67c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff67a59c640 1 -- 172.21.15.60:0/963493228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67c102780 msgr2=0x7ff67c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff67a59c640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67c102780 0x7ff67c198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff67a59c640 1 -- 172.21.15.60:0/963493228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff67c106f00 msgr2=0x7ff67c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.039+0000 7ff67a59c640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff67c106f00 0x7ff67c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.040+0000 7ff67a59c640 1 -- 172.21.15.60:0/963493228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c19d490 con 0x7ff67c101dd0 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.040+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff67c106f00 0x7ff67c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.040+0000 7ff67a59c640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c101dd0 0x7ff67c1984e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00e9f0 tx=0x7ff66c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.040+0000 7ff6737fe640 1 -- 172.21.15.60:0/963493228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00cd80 con 0x7ff67c101dd0 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.040+0000 7ff680b9e640 1 -- 172.21.15.60:0/963493228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c19d780 con 0x7ff67c101dd0 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.040+0000 7ff6737fe640 1 -- 172.21.15.60:0/963493228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff66c005520 con 0x7ff67c101dd0 2024-09-11T23:59:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.040+0000 7ff6737fe640 1 -- 172.21.15.60:0/963493228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c010690 con 0x7ff67c101dd0 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.040+0000 7ff680b9e640 1 -- 172.21.15.60:0/963493228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c1a5060 con 0x7ff67c101dd0 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.042+0000 7ff6737fe640 1 -- 172.21.15.60:0/963493228 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7ff66c0046c0 con 0x7ff67c101dd0 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff682f77740 1 Processor -- start 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff682f77740 1 -- start start 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff682f77740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06de8d0 0x55b3d06decb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff682f77740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff682f77740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff682f77740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b3d0645090 con 0x55b3d06df1f0 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff682f77740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b3d05eca70 con 0x55b3d06de8d0 2024-09-11T23:59:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff682f77740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b3d0641050 con 0x55b3d06edfc0 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff67a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff67a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43080/0 (socket says 172.21.15.60:43080) 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff67a59c640 1 -- 172.21.15.60:0/3682761803 learned_addr learned my addr 172.21.15.60:0/3682761803 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06de8d0 0x55b3d06decb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff6737fe640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6680a2d80 0x7ff6680a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.043+0000 7ff673fff640 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6680a2d80 0x7ff6680a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff6737fe640 1 -- 172.21.15.60:0/963493228 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff66c0cfb00 con 0x7ff67c101dd0 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff67a59c640 1 -- 172.21.15.60:0/3682761803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 msgr2=0x55b3d06f03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff67a59c640 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06f03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff67a59c640 1 -- 172.21.15.60:0/3682761803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06de8d0 msgr2=0x55b3d06decb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff67a59c640 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06de8d0 0x55b3d06decb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff67a59c640 1 -- 172.21.15.60:0/3682761803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3d05f9130 con 0x55b3d06df1f0 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff673fff640 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff67a59c640 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eda80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff66c09bc00 tx=0x7ff66c004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4080056827c710d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff670ff9640 1 -- 172.21.15.60:0/3682761803 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c09ba40 con 0x55b3d06df1f0 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff670ff9640 1 -- 172.21.15.60:0/3682761803 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff66c09c600 con 0x55b3d06df1f0 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.044+0000 7ff670ff9640 1 -- 172.21.15.60:0/3682761803 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c09b860 con 0x55b3d06df1f0 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 -- 172.21.15.60:0/3682761803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 msgr2=0x55b3d06eda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eda80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff66c09bc00 tx=0x7ff66c004c10 comp rx=0 tx=0).stop 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6680a2d80 0x7ff6680a5240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff674009430 tx=0x7ff67402a8c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 -- 172.21.15.60:0/3682761803 shutdown_connections 2024-09-11T23:59:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eda80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 --2- 172.21.15.60:0/3682761803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06de8d0 0x55b3d06decb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 -- 172.21.15.60:0/3682761803 >> 172.21.15.60:0/3682761803 conn(0x55b3d06daf60 msgr2=0x55b3d06db340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 -- 172.21.15.60:0/3682761803 shutdown_connections 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 -- 172.21.15.60:0/3682761803 wait complete. 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 -- start start 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.045+0000 7ff682f77740 1 Processor -- start 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff682f77740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d06ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff682f77740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff682f77740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06edfc0 0x55b3d06eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff682f77740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b3d06f0b30 con 0x55b3d06df1f0 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff682f77740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b3d05fff20 con 0x55b3d06edfc0 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff682f77740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b3d06f0cb0 con 0x55b3d06de8d0 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff682f77740 10 client.0 _ll_register_callbacks cb 0x55b3d05c9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43092/0 (socket says 172.21.15.60:43092) 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 -- 172.21.15.60:0/2983491844 learned_addr learned my addr 172.21.15.60:0/2983491844 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06edfc0 0x55b3d06eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff67a59c640 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d06ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 -- 172.21.15.60:0/2983491844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 msgr2=0x55b3d06ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d06ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 -- 172.21.15.60:0/2983491844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06edfc0 msgr2=0x55b3d06eb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06edfc0 0x55b3d06eb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 -- 172.21.15.60:0/2983491844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3d03b62b0 con 0x55b3d06df1f0 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff67a59c640 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d06ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff673fff640 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eacf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff6640103a0 tx=0x7ff664010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c35a23299b0480 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.046+0000 7ff661ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff661ffb640 1 -- 172.21.15.60:0/2983491844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664012920 con 0x55b3d06df1f0 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff661ffb640 1 -- 172.21.15.60:0/2983491844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff664012ac0 con 0x55b3d06df1f0 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 1 -- 172.21.15.60:0/2983491844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff66c09c600 con 0x55b3d06df1f0 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff661ffb640 1 -- 172.21.15.60:0/2983491844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff664012cc0 con 0x55b3d06df1f0 2024-09-11T23:59:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 10 client.15468 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 1 -- 172.21.15.60:0/2983491844 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b3d06fc610 con 0x55b3d06df1f0 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff661ffb640 1 -- 172.21.15.60:0/2983491844 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff66c09c600 con 0x55b3d06df1f0 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff661ffb640 1 -- 172.21.15.60:0/2983491844 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff66400f040 con 0x55b3d06df1f0 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 10 client.15468 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 10 client.15468 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 20 client.15468 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b3d06fec10 0x55b3d0700080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 4 client.15468 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.047+0000 7ff682f77740 1 -- 172.21.15.60:0/2983491844 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3d0652600 con 0x55b3d06fec10 2024-09-11T23:59:46.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.048+0000 7ff67a59c640 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b3d06fec10 0x55b3d0700080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.048+0000 7ff67a59c640 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b3d06fec10 0x55b3d0700080 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ffaa610316e8ade6 server_cookie=e326144f256a06f8 in_seq=0 out_seq=0 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.048+0000 7ff661ffb640 10 client.15468 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff661ffb640 1 -- 172.21.15.60:0/2983491844 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3d0652600 con 0x55b3d06fec10 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff661ffb640 10 client.15468 handle_command_reply: tid=0 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 client.15468 shutdown 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 -- 172.21.15.60:0/2983491844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 msgr2=0x55b3d06eacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eacf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff6640103a0 tx=0x7ff664010860 comp rx=0 tx=0).stop 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 -- 172.21.15.60:0/2983491844 shutdown_connections 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b3d06fec10 0x55b3d0700080 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06edfc0 0x55b3d06eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06df1f0 0x55b3d06eacf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 --2- 172.21.15.60:0/2983491844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d06ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 -- 172.21.15.60:0/2983491844 >> 172.21.15.60:0/2983491844 conn(0x55b3d06daf60 msgr2=0x55b3d06e0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff661ffb640 0 client.15468 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-11T23:59:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 -- 172.21.15.60:0/2983491844 shutdown_connections 2024-09-11T23:59:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 1 -- 172.21.15.60:0/2983491844 wait complete. 2024-09-11T23:59:46.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.049+0000 7ff682f77740 20 client.15468 trim_cache size 0 max 16384 2024-09-11T23:59:46.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff682f77740 1 Processor -- start 2024-09-11T23:59:46.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff682f77740 1 -- start start 2024-09-11T23:59:46.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff682f77740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06de8d0 0x55b3d06fec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff682f77740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d06e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff682f77740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06e8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff682f77740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b3d06fe3c0 con 0x55b3d06de8d0 2024-09-11T23:59:46.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff682f77740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b3d06fea90 con 0x55b3d06df1f0 2024-09-11T23:59:46.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff682f77740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b3d06ff160 con 0x55b3d06edfc0 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff67a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06de8d0 0x55b3d06fec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff67a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06de8d0 0x55b3d06fec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43094/0 (socket says 172.21.15.60:43094) 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff67a59c640 1 -- 172.21.15.60:0/3308548957 learned_addr learned my addr 172.21.15.60:0/3308548957 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.067+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06e8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff673fff640 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d06e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff67a59c640 1 -- 172.21.15.60:0/3308548957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 msgr2=0x55b3d06e8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff67a59c640 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06e8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff67a59c640 1 -- 172.21.15.60:0/3308548957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 msgr2=0x55b3d06e7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff67a59c640 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d06e7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff67a59c640 1 -- 172.21.15.60:0/3308548957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3d06eb630 con 0x55b3d06de8d0 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:46.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff67a59c640 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06de8d0 0x55b3d06fec10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff66c09be90 tx=0x7ff66c0cfe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dee6f3809d82b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff663fff640 1 -- 172.21.15.60:0/3308548957 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0b4020 con 0x55b3d06de8d0 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff663fff640 1 -- 172.21.15.60:0/3308548957 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff66c0a4b70 con 0x55b3d06de8d0 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.068+0000 7ff663fff640 1 -- 172.21.15.60:0/3308548957 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0cd490 con 0x55b3d06de8d0 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- 172.21.15.60:0/3308548957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06de8d0 msgr2=0x55b3d06fec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06de8d0 0x55b3d06fec10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff66c09be90 tx=0x7ff66c0cfe00 comp rx=0 tx=0).stop 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- 172.21.15.60:0/3308548957 shutdown_connections 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06edfc0 0x55b3d06e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d06e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 --2- 172.21.15.60:0/3308548957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06de8d0 0x55b3d06fec10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- 172.21.15.60:0/3308548957 >> 172.21.15.60:0/3308548957 conn(0x55b3d06daf60 msgr2=0x55b3d06db340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- 172.21.15.60:0/3308548957 shutdown_connections 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- 172.21.15.60:0/3308548957 wait complete. 2024-09-11T23:59:46.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- start start 2024-09-11T23:59:46.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 Processor -- start 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d0701400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d0701940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06edfc0 0x55b3d0767310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b3d06fff00 con 0x55b3d06edfc0 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b3d06ff830 con 0x55b3d06df1f0 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b3d07005d0 con 0x55b3d06de8d0 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.069+0000 7ff682f77740 10 client.0 _ll_register_callbacks cb 0x7ff664005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06edfc0 0x55b3d0767310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06edfc0 0x55b3d0767310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43110/0 (socket says 172.21.15.60:43110) 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 -- 172.21.15.60:0/2449882617 learned_addr learned my addr 172.21.15.60:0/2449882617 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:46.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67a59c640 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d0701400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff673fff640 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d0701940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 -- 172.21.15.60:0/2449882617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 msgr2=0x55b3d0701400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d0701400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 -- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 msgr2=0x55b3d0701940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d0701940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 -- 172.21.15.60:0/2449882617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3d07021d0 con 0x55b3d06edfc0 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff673fff640 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d0701940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff67ad9d640 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06edfc0 0x55b3d0767310 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff674009ca0 tx=0x7ff6740095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc15628b4fbaa0a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff661ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff661ffb640 1 -- 172.21.15.60:0/2449882617 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674044070 con 0x55b3d06edfc0 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff661ffb640 1 -- 172.21.15.60:0/2449882617 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff674004250 con 0x55b3d06edfc0 2024-09-11T23:59:46.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff682f77740 1 -- 172.21.15.60:0/2449882617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b3d064cb10 con 0x55b3d06edfc0 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff661ffb640 1 -- 172.21.15.60:0/2449882617 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff674004b40 con 0x55b3d06edfc0 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff682f77740 10 client.15474 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.070+0000 7ff682f77740 1 -- 172.21.15.60:0/2449882617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b3d0768920 con 0x55b3d06edfc0 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff661ffb640 1 -- 172.21.15.60:0/2449882617 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55b3d064cb10 con 0x55b3d06edfc0 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff661ffb640 1 -- 172.21.15.60:0/2449882617 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff674047070 con 0x55b3d06edfc0 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff682f77740 10 client.15474 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff682f77740 10 client.15474 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff682f77740 20 client.15474 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff682f77740 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b3d076d5f0 0x55b3d076c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff682f77740 4 client.15474 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff682f77740 1 -- 172.21.15.60:0/2449882617 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "status"}) -- 0x55b3d05c90e0 con 0x55b3d076d5f0 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.071+0000 7ff67a59c640 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b3d076d5f0 0x55b3d076c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:46.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff67a59c640 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b3d076d5f0 0x55b3d076c300 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c09f4162ac81a40b server_cookie=84fa040a60589cd5 in_seq=0 out_seq=0 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff661ffb640 10 client.15474 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff661ffb640 1 -- 172.21.15.60:0/2449882617 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b3d05c90e0 con 0x55b3d076d5f0 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff661ffb640 10 client.15474 handle_command_reply: tid=0 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 client.15474 shutdown 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 -- 172.21.15.60:0/2449882617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06edfc0 msgr2=0x55b3d0767310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06edfc0 0x55b3d0767310 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff674009ca0 tx=0x7ff6740095c0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 -- 172.21.15.60:0/2449882617 shutdown_connections 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3d06edfc0 0x55b3d0767310 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b3d076d5f0 0x55b3d076c300 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3d06df1f0 0x55b3d0701940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 --2- 172.21.15.60:0/2449882617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3d06de8d0 0x55b3d0701400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff661ffb640 0 client.15474 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-11T23:59:46.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 -- 172.21.15.60:0/2449882617 >> 172.21.15.60:0/2449882617 conn(0x55b3d06daf60 msgr2=0x55b3d06ea5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 -- 172.21.15.60:0/2449882617 shutdown_connections 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 1 -- 172.21.15.60:0/2449882617 wait complete. 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.072+0000 7ff682f77740 20 client.15474 trim_cache size 0 max 16384 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 4, 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24467, 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:46.079 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:46.080 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:46.080 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 126.57708056200001, 2024-09-11T23:59:46.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 29, 2024-09-11T23:59:46.080 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 83, 2024-09-11T23:59:46.080 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:46.080 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 159.73667137699999 2024-09-11T23:59:46.080 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:46.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 -- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6680a2d80 msgr2=0x7ff6680a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6680a2d80 0x7ff6680a5240 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff674009430 tx=0x7ff67402a8c0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 -- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c101dd0 msgr2=0x7ff67c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c101dd0 0x7ff67c1984e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00e9f0 tx=0x7ff66c00edf0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 -- 172.21.15.60:0/963493228 shutdown_connections 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6680a2d80 0x7ff6680a5240 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff67c106f00 0x7ff67c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67c102780 0x7ff67c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 --2- 172.21.15.60:0/963493228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff67c101dd0 0x7ff67c1984e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 -- 172.21.15.60:0/963493228 >> 172.21.15.60:0/963493228 conn(0x7ff67c0fd890 msgr2=0x7ff67c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 -- 172.21.15.60:0/963493228 shutdown_connections 2024-09-11T23:59:46.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:46.073+0000 7ff680b9e640 1 -- 172.21.15.60:0/963493228 wait complete. 2024-09-11T23:59:46.791 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-11T23:59:47.053 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:47.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:46 smithi060 ceph-mon[30953]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:47.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:46 smithi105 ceph-mon[34805]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:47.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:46 smithi192 ceph-mon[35487]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:47.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 -- 172.21.15.60:0/2585696662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8102790 msgr2=0x7f71e81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 --2- 172.21.15.60:0/2585696662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8102790 0x7f71e81067e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009900 tx=0x7f71dc02a410 comp rx=0 tx=0).stop 2024-09-11T23:59:47.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 -- 172.21.15.60:0/2585696662 shutdown_connections 2024-09-11T23:59:47.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 --2- 172.21.15.60:0/2585696662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e8106f10 0x7f71e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 --2- 172.21.15.60:0/2585696662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8102790 0x7f71e81067e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 --2- 172.21.15.60:0/2585696662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71e8101de0 0x7f71e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 -- 172.21.15.60:0/2585696662 >> 172.21.15.60:0/2585696662 conn(0x7f71e80fd8c0 msgr2=0x7f71e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 -- 172.21.15.60:0/2585696662 shutdown_connections 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.514+0000 7f71ede12640 1 -- 172.21.15.60:0/2585696662 wait complete. 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.515+0000 7f71ede12640 1 Processor -- start 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.515+0000 7f71ede12640 1 -- start start 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.515+0000 7f71ede12640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e8101de0 0x7f71e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.515+0000 7f71ede12640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71e8102790 0x7f71e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.515+0000 7f71ede12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8106f10 0x7f71e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.515+0000 7f71ede12640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8112090 con 0x7f71e8106f10 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.515+0000 7f71ede12640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8111f10 con 0x7f71e8102790 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.515+0000 7f71ede12640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8112210 con 0x7f71e8101de0 2024-09-11T23:59:47.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8106f10 0x7f71e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8106f10 0x7f71e8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43126/0 (socket says 172.21.15.60:43126) 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 -- 172.21.15.60:0/1885321611 learned_addr learned my addr 172.21.15.60:0/1885321611 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71e8102790 0x7f71e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e77fe640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e8101de0 0x7f71e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 -- 172.21.15.60:0/1885321611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e8101de0 msgr2=0x7f71e80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e8101de0 0x7f71e80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 -- 172.21.15.60:0/1885321611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71e8102790 msgr2=0x7f71e8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71e8102790 0x7f71e8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 -- 172.21.15.60:0/1885321611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e81a69e0 con 0x7f71e8106f10 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71e8102790 0x7f71e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e7fff640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8106f10 0x7f71e8074f70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f71e000eb10 tx=0x7f71e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:47.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e4ff9640 1 -- 172.21.15.60:0/1885321611 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0004b20 con 0x7f71e8106f10 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e4ff9640 1 -- 172.21.15.60:0/1885321611 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f71e0004cc0 con 0x7f71e8106f10 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71ede12640 1 -- 172.21.15.60:0/1885321611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e81a6cd0 con 0x7f71e8106f10 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71e4ff9640 1 -- 172.21.15.60:0/1885321611 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e00107f0 con 0x7f71e8106f10 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.516+0000 7f71ede12640 1 -- 172.21.15.60:0/1885321611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e81a7260 con 0x7f71e8106f10 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.518+0000 7f71e4ff9640 1 -- 172.21.15.60:0/1885321611 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f71e0005020 con 0x7f71e8106f10 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71f01eb740 1 Processor -- start 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71f01eb740 1 -- start start 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71e4ff9640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f71d00a2e00 0x7f71d00a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9b9d0 0x558a20d9bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9c2f0 0x558a20da6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71f01eb740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558a20d02090 con 0x558a20d9c2f0 2024-09-11T23:59:47.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71f01eb740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a20ca9a70 con 0x558a20da6bb0 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71f01eb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a20cfe050 con 0x558a20d9b9d0 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71e6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9c2f0 0x558a20da6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71e6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9c2f0 0x558a20da6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43142/0 (socket says 172.21.15.60:43142) 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71e6ffd640 1 -- 172.21.15.60:0/1589938523 learned_addr learned my addr 172.21.15.60:0/1589938523 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71e4ff9640 1 -- 172.21.15.60:0/1885321611 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f71e00cfb20 con 0x7f71e8106f10 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71e77fe640 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9b9d0 0x558a20d9bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.519+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f71d00a2e00 0x7f71d00a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e7fff640 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e77fe640 1 -- 172.21.15.60:0/1589938523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 msgr2=0x558a20da8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e77fe640 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e77fe640 1 -- 172.21.15.60:0/1589938523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9c2f0 msgr2=0x558a20da6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:47.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e77fe640 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9c2f0 0x558a20da6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e77fe640 1 -- 172.21.15.60:0/1589938523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a20cb6130 con 0x558a20d9b9d0 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9c2f0 0x558a20da6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e7fff640 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f71d00a2e00 0x7f71d00a52c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x558a20d98dc0 tx=0x7f71dc02a410 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71e77fe640 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9b9d0 0x558a20d9bdb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f71d800bbe0 tx=0x7f71d800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36243507ad9b2726 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71cdffb640 1 -- 172.21.15.60:0/1589938523 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8015070 con 0x558a20d9b9d0 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71cdffb640 1 -- 172.21.15.60:0/1589938523 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f71d80035f0 con 0x558a20d9b9d0 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.520+0000 7f71cdffb640 1 -- 172.21.15.60:0/1589938523 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d80116a0 con 0x558a20d9b9d0 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 -- 172.21.15.60:0/1589938523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9b9d0 msgr2=0x558a20d9bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9b9d0 0x558a20d9bdb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f71d800bbe0 tx=0x7f71d800f730 comp rx=0 tx=0).stop 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 -- 172.21.15.60:0/1589938523 shutdown_connections 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9c2f0 0x558a20da6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 --2- 172.21.15.60:0/1589938523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9b9d0 0x558a20d9bdb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 -- 172.21.15.60:0/1589938523 >> 172.21.15.60:0/1589938523 conn(0x558a20d97f60 msgr2=0x558a20d98340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:47.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 -- 172.21.15.60:0/1589938523 shutdown_connections 2024-09-11T23:59:47.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 -- 172.21.15.60:0/1589938523 wait complete. 2024-09-11T23:59:47.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.521+0000 7f71f01eb740 1 -- start start 2024-09-11T23:59:47.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71f01eb740 1 Processor -- start 2024-09-11T23:59:47.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20da6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 0x558a20da3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71f01eb740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558a20da9780 con 0x558a20d9b9d0 2024-09-11T23:59:47.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71f01eb740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a20cbcf20 con 0x558a20da6bb0 2024-09-11T23:59:47.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71f01eb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a20da9900 con 0x558a20d9c2f0 2024-09-11T23:59:47.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71f01eb740 10 client.0 _ll_register_callbacks cb 0x558a20c86030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:47.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20da6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20da6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43158/0 (socket says 172.21.15.60:43158) 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71e77fe640 1 -- 172.21.15.60:0/3071974510 learned_addr learned my addr 172.21.15.60:0/3071974510 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71e7fff640 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.522+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 0x558a20da3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71e77fe640 1 -- 172.21.15.60:0/3071974510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 msgr2=0x558a20da3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71e77fe640 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 0x558a20da3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71e77fe640 1 -- 172.21.15.60:0/3071974510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 msgr2=0x558a20da3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71e77fe640 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71e77fe640 1 -- 172.21.15.60:0/3071974510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a20a732b0 con 0x558a20d9b9d0 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71e77fe640 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20da6420 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f71d8003de0 tx=0x7f71d800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2783eadd6d51e85c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:47.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3071974510 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8028060 con 0x558a20d9b9d0 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3071974510 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f71d8003af0 con 0x558a20d9b9d0 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71f01eb740 1 -- 172.21.15.60:0/3071974510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71d80035f0 con 0x558a20d9b9d0 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3071974510 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f71d8015070 con 0x558a20d9b9d0 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71f01eb740 10 client.15486 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71f01eb740 1 -- 172.21.15.60:0/3071974510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a20db5070 con 0x558a20d9b9d0 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.523+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3071974510 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f71d80035f0 con 0x558a20d9b9d0 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3071974510 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f71d8011bc0 con 0x558a20d9b9d0 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71f01eb740 10 client.15486 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:47.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71f01eb740 10 client.15486 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:59:47.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71f01eb740 20 client.15486 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:47.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558a20db7330 0x558a20db87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71f01eb740 4 client.15486 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:47.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71f01eb740 1 -- 172.21.15.60:0/3071974510 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a20d0f600 con 0x558a20db7330 2024-09-11T23:59:47.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558a20db7330 0x558a20db87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558a20db7330 0x558a20db87a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f75c07ac188b0b95 server_cookie=6fc496f5e8154000 in_seq=0 out_seq=0 2024-09-11T23:59:47.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.524+0000 7f71c6ffd640 10 client.15486 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-11T23:59:47.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3071974510 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a20d0f600 con 0x558a20db7330 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71c6ffd640 10 client.15486 handle_command_reply: tid=0 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 client.15486 shutdown 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 -- 172.21.15.60:0/3071974510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 msgr2=0x558a20da6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20da6420 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f71d8003de0 tx=0x7f71d800bf00 comp rx=0 tx=0).stop 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 -- 172.21.15.60:0/3071974510 shutdown_connections 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558a20db7330 0x558a20db87a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20da3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 0x558a20da3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3071974510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20da6420 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 -- 172.21.15.60:0/3071974510 >> 172.21.15.60:0/3071974510 conn(0x558a20d97f60 msgr2=0x558a20d9dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71c6ffd640 0 client.15486 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.525+0000 7f71f01eb740 1 -- 172.21.15.60:0/3071974510 shutdown_connections 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.526+0000 7f71f01eb740 1 -- 172.21.15.60:0/3071974510 wait complete. 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.526+0000 7f71f01eb740 20 client.15486 trim_cache size 0 max 16384 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.543+0000 7f71f01eb740 1 Processor -- start 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.543+0000 7f71f01eb740 1 -- start start 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.543+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20db7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.543+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20d9c2f0 0x558a20d96ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.543+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20da6bb0 0x558a20da09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.543+0000 7f71f01eb740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558a20db6ae0 con 0x558a20d9b9d0 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.543+0000 7f71f01eb740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a20db71b0 con 0x558a20d9c2f0 2024-09-11T23:59:47.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.543+0000 7f71f01eb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a20db7880 con 0x558a20da6bb0 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20db7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20db7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43168/0 (socket says 172.21.15.60:43168) 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 -- 172.21.15.60:0/1867983050 learned_addr learned my addr 172.21.15.60:0/1867983050 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 -- 172.21.15.60:0/1867983050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20da6bb0 msgr2=0x558a20da09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 --2- 172.21.15.60:0/1867983050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20da6bb0 0x558a20da09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 -- 172.21.15.60:0/1867983050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20d9c2f0 msgr2=0x558a20d96ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 --2- 172.21.15.60:0/1867983050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20d9c2f0 0x558a20d96ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 -- 172.21.15.60:0/1867983050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a20da6790 con 0x558a20d9b9d0 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71e77fe640 1 --2- 172.21.15.60:0/1867983050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20db7330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005780 tx=0x7f71d800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14eeefed51d83a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:47.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71cd7fa640 1 -- 172.21.15.60:0/1867983050 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d80035f0 con 0x558a20d9b9d0 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71cd7fa640 1 -- 172.21.15.60:0/1867983050 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f71d8003af0 con 0x558a20d9b9d0 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.544+0000 7f71cd7fa640 1 -- 172.21.15.60:0/1867983050 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d80043e0 con 0x558a20d9b9d0 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 -- 172.21.15.60:0/1867983050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 msgr2=0x558a20db7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 --2- 172.21.15.60:0/1867983050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20db7330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f71d8005780 tx=0x7f71d800b810 comp rx=0 tx=0).stop 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 -- 172.21.15.60:0/1867983050 shutdown_connections 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 --2- 172.21.15.60:0/1867983050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20da6bb0 0x558a20da09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 --2- 172.21.15.60:0/1867983050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20d9c2f0 0x558a20d96ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 --2- 172.21.15.60:0/1867983050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20db7330 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 -- 172.21.15.60:0/1867983050 >> 172.21.15.60:0/1867983050 conn(0x558a20d97f60 msgr2=0x558a20d967e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 -- 172.21.15.60:0/1867983050 shutdown_connections 2024-09-11T23:59:47.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 -- 172.21.15.60:0/1867983050 wait complete. 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 -- start start 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.545+0000 7f71f01eb740 1 Processor -- start 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20dc0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 0x558a20dc12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20dbc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558a20db8620 con 0x558a20d9b9d0 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a20db7f50 con 0x558a20da6bb0 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a20db8cf0 con 0x558a20d9c2f0 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 10 client.0 _ll_register_callbacks cb 0x7f71e00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20dc0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20dc0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43182/0 (socket says 172.21.15.60:43182) 2024-09-11T23:59:47.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 -- 172.21.15.60:0/3900858808 learned_addr learned my addr 172.21.15.60:0/3900858808 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 -- 172.21.15.60:0/3900858808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 msgr2=0x558a20dc12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e7fff640 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20dbc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 0x558a20dc12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 -- 172.21.15.60:0/3900858808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 msgr2=0x558a20dbc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20dbc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 -- 172.21.15.60:0/3900858808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a20dbc9a0 con 0x558a20d9b9d0 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71e77fe640 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20dc0d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c010 tx=0x7f71d800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf258161720f1bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3900858808 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d800b5e0 con 0x558a20d9b9d0 2024-09-11T23:59:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 1 -- 172.21.15.60:0/3900858808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71d8003af0 con 0x558a20d9b9d0 2024-09-11T23:59:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3900858808 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f71d8005250 con 0x558a20d9b9d0 2024-09-11T23:59:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3900858808 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f71d800b3a0 con 0x558a20d9b9d0 2024-09-11T23:59:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.546+0000 7f71f01eb740 10 client.15492 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71f01eb740 1 -- 172.21.15.60:0/3900858808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a20e21620 con 0x558a20d9b9d0 2024-09-11T23:59:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3900858808 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f71d8003af0 con 0x558a20d9b9d0 2024-09-11T23:59:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3900858808 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f71d8003ca0 con 0x558a20d9b9d0 2024-09-11T23:59:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71f01eb740 10 client.15492 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71f01eb740 10 client.15492 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71f01eb740 20 client.15492 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558a20e25ac0 0x558a20e247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71f01eb740 4 client.15492 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71f01eb740 1 -- 172.21.15.60:0/3900858808 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "status"}) -- 0x558a20d09b10 con 0x558a20e25ac0 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.547+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558a20e25ac0 0x558a20e247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71e6ffd640 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558a20e25ac0 0x558a20e247d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8cf840d1c8f04d33 server_cookie=32a41dc89eb2423 in_seq=0 out_seq=0 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71c6ffd640 10 client.15492 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71c6ffd640 1 -- 172.21.15.60:0/3900858808 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558a20d09b10 con 0x558a20e25ac0 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71c6ffd640 10 client.15492 handle_command_reply: tid=0 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 client.15492 shutdown 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 -- 172.21.15.60:0/3900858808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 msgr2=0x558a20dc0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20dc0d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c010 tx=0x7f71d800b880 comp rx=0 tx=0).stop 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 -- 172.21.15.60:0/3900858808 shutdown_connections 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558a20e25ac0 0x558a20e247d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71c6ffd640 0 client.15492 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a20da6bb0 0x558a20dbc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a20d9c2f0 0x558a20dc12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 --2- 172.21.15.60:0/3900858808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a20d9b9d0 0x558a20dc0d90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 -- 172.21.15.60:0/3900858808 >> 172.21.15.60:0/3900858808 conn(0x558a20d97f60 msgr2=0x558a20d97000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 -- 172.21.15.60:0/3900858808 shutdown_connections 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 1 -- 172.21.15.60:0/3900858808 wait complete. 2024-09-11T23:59:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.548+0000 7f71f01eb740 20 client.15492 trim_cache size 0 max 16384 2024-09-11T23:59:47.569 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:47.569 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:47.569 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 3, 2024-09-11T23:59:47.569 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24475, 2024-09-11T23:59:47.569 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:47.569 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:47.569 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:47.570 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 129.068420758, 2024-09-11T23:59:47.570 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 29, 2024-09-11T23:59:47.570 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 83, 2024-09-11T23:59:47.570 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:47.570 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 166.59271601200001 2024-09-11T23:59:47.570 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:47.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 -- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f71d00a2e00 msgr2=0x7f71d00a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f71d00a2e00 0x7f71d00a52c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x558a20d98dc0 tx=0x7f71dc02a410 comp rx=0 tx=0).stop 2024-09-11T23:59:47.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 -- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8106f10 msgr2=0x7f71e8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:47.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8106f10 0x7f71e8074f70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f71e000eb10 tx=0x7f71e000c2d0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 -- 172.21.15.60:0/1885321611 shutdown_connections 2024-09-11T23:59:47.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f71d00a2e00 0x7f71d00a52c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71e8106f10 0x7f71e8074f70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71e8102790 0x7f71e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 --2- 172.21.15.60:0/1885321611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e8101de0 0x7f71e80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:47.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 -- 172.21.15.60:0/1885321611 >> 172.21.15.60:0/1885321611 conn(0x7f71e80fd8c0 msgr2=0x7f71e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:47.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 -- 172.21.15.60:0/1885321611 shutdown_connections 2024-09-11T23:59:47.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:47.549+0000 7f71ede12640 1 -- 172.21.15.60:0/1885321611 wait complete. 2024-09-11T23:59:48.252 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-11T23:59:48.508 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:48.959 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:48 smithi060 ceph-mon[30953]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:48.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 -- 172.21.15.60:0/1323032193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0102780 msgr2=0x7f3ae01067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:48.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 --2- 172.21.15.60:0/1323032193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0102780 0x7f3ae01067d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009900 tx=0x7f3ad402a410 comp rx=0 tx=0).stop 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 -- 172.21.15.60:0/1323032193 shutdown_connections 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 --2- 172.21.15.60:0/1323032193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ae0106f00 0x7f3ae010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 --2- 172.21.15.60:0/1323032193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0102780 0x7f3ae01067d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 --2- 172.21.15.60:0/1323032193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ae0101dd0 0x7f3ae01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 -- 172.21.15.60:0/1323032193 >> 172.21.15.60:0/1323032193 conn(0x7f3ae00fd8b0 msgr2=0x7f3ae00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 -- 172.21.15.60:0/1323032193 shutdown_connections 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.958+0000 7f3ae7302640 1 -- 172.21.15.60:0/1323032193 wait complete. 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.959+0000 7f3ae7302640 1 Processor -- start 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.959+0000 7f3ae7302640 1 -- start start 2024-09-11T23:59:48.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.959+0000 7f3ae7302640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0101dd0 0x7f3ae0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.959+0000 7f3ae7302640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ae0102780 0x7f3ae0198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae7302640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ae0106f00 0x7f3ae019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae7302640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0112080 con 0x7f3ae0101dd0 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae7302640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0111f00 con 0x7f3ae0102780 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae7302640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0112200 con 0x7f3ae0106f00 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0101dd0 0x7f3ae0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0101dd0 0x7f3ae0198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43206/0 (socket says 172.21.15.60:43206) 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 -- 172.21.15.60:0/2575585411 learned_addr learned my addr 172.21.15.60:0/2575585411 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae589f640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ae0106f00 0x7f3ae019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae489d640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ae0102780 0x7f3ae0198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 -- 172.21.15.60:0/2575585411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ae0106f00 msgr2=0x7f3ae019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ae0106f00 0x7f3ae019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 -- 172.21.15.60:0/2575585411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ae0102780 msgr2=0x7f3ae0198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ae0102780 0x7f3ae0198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 -- 172.21.15.60:0/2575585411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae019d4f0 con 0x7f3ae0101dd0 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae509e640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0101dd0 0x7f3ae0198540 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00e9f0 tx=0x7f3adc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ad27fc640 1 -- 172.21.15.60:0/2575585411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc00cd80 con 0x7f3ae0101dd0 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae7302640 1 -- 172.21.15.60:0/2575585411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae019d7e0 con 0x7f3ae0101dd0 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ad27fc640 1 -- 172.21.15.60:0/2575585411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3adc005520 con 0x7f3ae0101dd0 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ad27fc640 1 -- 172.21.15.60:0/2575585411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc010690 con 0x7f3ae0101dd0 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.960+0000 7f3ae7302640 1 -- 172.21.15.60:0/2575585411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01a50c0 con 0x7f3ae0101dd0 2024-09-11T23:59:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ad27fc640 1 -- 172.21.15.60:0/2575585411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f3adc0046c0 con 0x7f3ae0101dd0 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ae96db740 1 Processor -- start 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ae96db740 1 -- start start 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb769d0 0x56252fb76db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb772f0 0x56252fb81670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 0x56252fb83fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ae96db740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56252fadd090 con 0x56252fb769d0 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ae96db740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56252fa84a70 con 0x56252fb81bb0 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.963+0000 7f3ae96db740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56252fad9050 con 0x56252fb772f0 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ad27fc640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3acc0a2d80 0x7f3acc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb769d0 0x56252fb76db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb769d0 0x56252fb76db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43210/0 (socket says 172.21.15.60:43210) 2024-09-11T23:59:48.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 -- 172.21.15.60:0/3989777750 learned_addr learned my addr 172.21.15.60:0/3989777750 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:48.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae509e640 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb772f0 0x56252fb81670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3acc0a2d80 0x7f3acc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae489d640 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 0x56252fb83fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ad27fc640 1 -- 172.21.15.60:0/2575585411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f3adc0cfb20 con 0x7f3ae0101dd0 2024-09-11T23:59:48.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 -- 172.21.15.60:0/3989777750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb772f0 msgr2=0x56252fb81670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:48.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb772f0 0x56252fb81670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 -- 172.21.15.60:0/3989777750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 msgr2=0x56252fb83fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:48.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 0x56252fb83fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 -- 172.21.15.60:0/3989777750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252fa91130 con 0x56252fb769d0 2024-09-11T23:59:48.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb769d0 0x56252fb76db0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8012c50 tx=0x7f3ad8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbd970053144d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:48.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3ae589f640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3acc0a2d80 0x7f3acc0a5240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8010c40 tx=0x7f3ad8017000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:48.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.964+0000 7f3acb7fe640 1 -- 172.21.15.60:0/3989777750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8012e00 con 0x56252fb769d0 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3acb7fe640 1 -- 172.21.15.60:0/3989777750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ad8009c00 con 0x56252fb769d0 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3acb7fe640 1 -- 172.21.15.60:0/3989777750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8005520 con 0x56252fb769d0 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 -- 172.21.15.60:0/3989777750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb769d0 msgr2=0x56252fb76db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb769d0 0x56252fb76db0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8012c50 tx=0x7f3ad8010740 comp rx=0 tx=0).stop 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 -- 172.21.15.60:0/3989777750 shutdown_connections 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 0x56252fb83fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb772f0 0x56252fb81670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 --2- 172.21.15.60:0/3989777750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb769d0 0x56252fb76db0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 -- 172.21.15.60:0/3989777750 >> 172.21.15.60:0/3989777750 conn(0x56252fb72f60 msgr2=0x56252fb73340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:48.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 -- 172.21.15.60:0/3989777750 shutdown_connections 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.965+0000 7f3ae96db740 1 -- 172.21.15.60:0/3989777750 wait complete. 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 1 -- start start 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 1 Processor -- start 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb7e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56252fb84780 con 0x56252fb81bb0 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56252fa97f20 con 0x56252fb772f0 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56252fb84900 con 0x56252fb769d0 2024-09-11T23:59:48.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae96db740 10 client.0 _ll_register_callbacks cb 0x56252fa61030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae589f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae509e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae589f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43220/0 (socket says 172.21.15.60:43220) 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.966+0000 7f3ae589f640 1 -- 172.21.15.60:0/2690589658 learned_addr learned my addr 172.21.15.60:0/2690589658 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae489d640 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb7e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae589f640 1 -- 172.21.15.60:0/2690589658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 msgr2=0x56252fb814c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae589f640 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb814c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae589f640 1 -- 172.21.15.60:0/2690589658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 msgr2=0x56252fb7e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae589f640 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb7e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae589f640 1 -- 172.21.15.60:0/2690589658 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252f84e2b0 con 0x56252fb81bb0 2024-09-11T23:59:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae489d640 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb7e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae509e640 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb814c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae589f640 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7ed50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80094e0 tx=0x7f3ad800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b138b5f33fa40a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ac8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/2690589658 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad802b030 con 0x56252fb81bb0 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/2690589658 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f3ad8005790 con 0x56252fb81bb0 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae96db740 1 -- 172.21.15.60:0/2690589658 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56252faea600 con 0x56252fb81bb0 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/2690589658 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ad8034020 con 0x56252fb81bb0 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae96db740 10 client.15504 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.967+0000 7f3ae96db740 1 -- 172.21.15.60:0/2690589658 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56252fb90100 con 0x56252fb81bb0 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.968+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/2690589658 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x56252faea600 con 0x56252fb81bb0 2024-09-11T23:59:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.968+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/2690589658 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3ad80324d0 con 0x56252fb81bb0 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ae96db740 10 client.15504 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ae96db740 10 client.15504 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ae96db740 20 client.15504 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ae96db740 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x56252fb923d0 0x56252fb93840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ae96db740 4 client.15504 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ae96db740 1 -- 172.21.15.60:0/2690589658 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56252fae4b10 con 0x56252fb923d0 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ae509e640 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x56252fb923d0 0x56252fb93840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ae509e640 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x56252fb923d0 0x56252fb93840 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19d5d15fe1f301e7 server_cookie=5b974a80e4dcf0d6 in_seq=0 out_seq=0 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.969+0000 7f3ac8ff9640 10 client.15504 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/2690589658 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56252fae4b10 con 0x56252fb923d0 2024-09-11T23:59:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ac8ff9640 10 client.15504 handle_command_reply: tid=0 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 client.15504 shutdown 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 -- 172.21.15.60:0/2690589658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 msgr2=0x56252fb7ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7ed50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80094e0 tx=0x7f3ad800cb40 comp rx=0 tx=0).stop 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 -- 172.21.15.60:0/2690589658 shutdown_connections 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x56252fb923d0 0x56252fb93840 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7ed50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb7e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 --2- 172.21.15.60:0/2690589658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb814c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ae96db740 1 -- 172.21.15.60:0/2690589658 >> 172.21.15.60:0/2690589658 conn(0x56252fb72f60 msgr2=0x56252fb78c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.970+0000 7f3ac8ff9640 0 client.15504 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-11T23:59:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.971+0000 7f3ae96db740 1 -- 172.21.15.60:0/2690589658 shutdown_connections 2024-09-11T23:59:48.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.971+0000 7f3ae96db740 1 -- 172.21.15.60:0/2690589658 wait complete. 2024-09-11T23:59:48.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.971+0000 7f3ae96db740 20 client.15504 trim_cache size 0 max 16384 2024-09-11T23:59:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae96db740 1 Processor -- start 2024-09-11T23:59:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae96db740 1 -- start start 2024-09-11T23:59:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb92aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb80670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae96db740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56252fb91b80 con 0x56252fb81bb0 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae96db740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56252fb92250 con 0x56252fb772f0 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae96db740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56252fb92920 con 0x56252fb769d0 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae589f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae589f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43224/0 (socket says 172.21.15.60:43224) 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae589f640 1 -- 172.21.15.60:0/1920027186 learned_addr learned my addr 172.21.15.60:0/1920027186 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae489d640 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb80670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae509e640 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb92aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae589f640 1 -- 172.21.15.60:0/1920027186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 msgr2=0x56252fb92aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae589f640 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb92aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae589f640 1 -- 172.21.15.60:0/1920027186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 msgr2=0x56252fb80670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:48.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae589f640 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb80670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.989+0000 7f3ae589f640 1 -- 172.21.15.60:0/1920027186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252fb81830 con 0x56252fb81bb0 2024-09-11T23:59:48.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.990+0000 7f3ae589f640 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7bab0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8032920 tx=0x7f3ad8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a6d7ec8ab92e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:48.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.990+0000 7f3acaffd640 1 -- 172.21.15.60:0/1920027186 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad802b030 con 0x56252fb81bb0 2024-09-11T23:59:48.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.990+0000 7f3acaffd640 1 -- 172.21.15.60:0/1920027186 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ad803e020 con 0x56252fb81bb0 2024-09-11T23:59:48.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.990+0000 7f3acaffd640 1 -- 172.21.15.60:0/1920027186 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad801b040 con 0x56252fb81bb0 2024-09-11T23:59:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.990+0000 7f3ae96db740 1 -- 172.21.15.60:0/1920027186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 msgr2=0x56252fb7bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.990+0000 7f3ae96db740 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7bab0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8032920 tx=0x7f3ad8010740 comp rx=0 tx=0).stop 2024-09-11T23:59:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 -- 172.21.15.60:0/1920027186 shutdown_connections 2024-09-11T23:59:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb81bb0 0x56252fb7bab0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb772f0 0x56252fb80670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 --2- 172.21.15.60:0/1920027186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb92aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 -- 172.21.15.60:0/1920027186 >> 172.21.15.60:0/1920027186 conn(0x56252fb72f60 msgr2=0x56252fb7ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 -- 172.21.15.60:0/1920027186 shutdown_connections 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 -- 172.21.15.60:0/1920027186 wait complete. 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 -- start start 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.991+0000 7f3ae96db740 1 Processor -- start 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb96af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb772f0 0x56252fb97030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae96db740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 0x56252fb97570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:48.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae96db740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56252fb936c0 con 0x56252fb772f0 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae96db740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56252fb92ff0 con 0x56252fb81bb0 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae96db740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56252fb93d90 con 0x56252fb769d0 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae96db740 10 client.0 _ll_register_callbacks cb 0x7f3adc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb772f0 0x56252fb97030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb772f0 0x56252fb97030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43230/0 (socket says 172.21.15.60:43230) 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 -- 172.21.15.60:0/4176210963 learned_addr learned my addr 172.21.15.60:0/4176210963 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae589f640 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 0x56252fb97570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae509e640 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb96af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 -- 172.21.15.60:0/4176210963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 msgr2=0x56252fb96af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb96af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 -- 172.21.15.60:0/4176210963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 msgr2=0x56252fb97570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 0x56252fb97570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 -- 172.21.15.60:0/4176210963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252fbfac00 con 0x56252fb772f0 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae489d640 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb772f0 0x56252fb97030 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009900 tx=0x7f3ad40318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1008ef8f3568852 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ac8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/4176210963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4035040 con 0x56252fb772f0 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.992+0000 7f3ae96db740 1 -- 172.21.15.60:0/4176210963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ad803e020 con 0x56252fb772f0 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/4176210963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f3ad4004040 con 0x56252fb772f0 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/4176210963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ad4004240 con 0x56252fb772f0 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae96db740 10 client.15510 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae96db740 1 -- 172.21.15.60:0/4176210963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56252fbfbf30 con 0x56252fb772f0 2024-09-11T23:59:48.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/4176210963 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ad803e020 con 0x56252fb772f0 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/4176210963 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3ad4004b00 con 0x56252fb772f0 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae96db740 10 client.15510 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae96db740 10 client.15510 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae96db740 20 client.15510 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae96db740 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x56252fc00ae0 0x56252fbff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae96db740 4 client.15510 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae96db740 1 -- 172.21.15.60:0/4176210963 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "status"}) -- 0x56252fa610e0 con 0x56252fc00ae0 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.993+0000 7f3ae509e640 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x56252fc00ae0 0x56252fbff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae509e640 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x56252fc00ae0 0x56252fbff7f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbf906f8e490d0b1 server_cookie=322812e78142a42a in_seq=0 out_seq=0 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ac8ff9640 10 client.15510 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-11T23:59:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ac8ff9640 1 -- 172.21.15.60:0/4176210963 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56252fa610e0 con 0x56252fc00ae0 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ac8ff9640 10 client.15510 handle_command_reply: tid=0 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 client.15510 shutdown 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 -- 172.21.15.60:0/4176210963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb772f0 msgr2=0x56252fb97030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb772f0 0x56252fb97030 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009900 tx=0x7f3ad40318e0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 -- 172.21.15.60:0/4176210963 shutdown_connections 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x56252fc00ae0 0x56252fbff7f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56252fb81bb0 0x56252fb97570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56252fb772f0 0x56252fb97030 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 --2- 172.21.15.60:0/4176210963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56252fb769d0 0x56252fb96af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 -- 172.21.15.60:0/4176210963 >> 172.21.15.60:0/4176210963 conn(0x56252fb72f60 msgr2=0x56252fb72000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ac8ff9640 0 client.15510 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 -- 172.21.15.60:0/4176210963 shutdown_connections 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 1 -- 172.21.15.60:0/4176210963 wait complete. 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.994+0000 7f3ae96db740 20 client.15510 trim_cache size 0 max 16384 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 2, 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24484, 2024-09-11T23:59:49.002 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 131.52453206999999, 2024-09-11T23:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 29, 2024-09-11T23:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 83, 2024-09-11T23:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 165.432383558 2024-09-11T23:59:49.003 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 -- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3acc0a2d80 msgr2=0x7f3acc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3acc0a2d80 0x7f3acc0a5240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8010c40 tx=0x7f3ad8017000 comp rx=0 tx=0).stop 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 -- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0101dd0 msgr2=0x7f3ae0198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0101dd0 0x7f3ae0198540 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00e9f0 tx=0x7f3adc00edf0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 -- 172.21.15.60:0/2575585411 shutdown_connections 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3acc0a2d80 0x7f3acc0a5240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ae0106f00 0x7f3ae019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ae0102780 0x7f3ae0198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 --2- 172.21.15.60:0/2575585411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ae0101dd0 0x7f3ae0198540 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:49.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 -- 172.21.15.60:0/2575585411 >> 172.21.15.60:0/2575585411 conn(0x7f3ae00fd8b0 msgr2=0x7f3ae00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:49.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 -- 172.21.15.60:0/2575585411 shutdown_connections 2024-09-11T23:59:49.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:48.995+0000 7f3ae7302640 1 -- 172.21.15.60:0/2575585411 wait complete. 2024-09-11T23:59:49.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:48 smithi105 ceph-mon[34805]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:49.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:48 smithi192 ceph-mon[35487]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-11T23:59:49.715 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T23:59:49.975 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:50.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3322888723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8102ef0 msgr2=0x7fb4a810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3322888723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8102ef0 0x7fb4a810da40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009900 tx=0x7fb4a002a480 comp rx=0 tx=0).stop 2024-09-11T23:59:50.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3322888723 shutdown_connections 2024-09-11T23:59:50.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3322888723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8102ef0 0x7fb4a810da40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3322888723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a8102570 0x7fb4a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3322888723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a8100e20 0x7fb4a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3322888723 >> 172.21.15.60:0/3322888723 conn(0x7fb4a80fc7d0 msgr2=0x7fb4a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3322888723 shutdown_connections 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.443+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3322888723 wait complete. 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.444+0000 7fb4ad12b640 1 Processor -- start 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.444+0000 7fb4ad12b640 1 -- start start 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4ad12b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8100e20 0x7fb4a8198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4ad12b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a8102570 0x7fb4a8198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4ad12b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a8102ef0 0x7fb4a819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4ad12b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a81110a0 con 0x7fb4a8100e20 2024-09-11T23:59:50.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4ad12b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a8110f20 con 0x7fb4a8102570 2024-09-11T23:59:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4ad12b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a8111220 con 0x7fb4a8102ef0 2024-09-11T23:59:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8100e20 0x7fb4a8198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8100e20 0x7fb4a8198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43246/0 (socket says 172.21.15.60:43246) 2024-09-11T23:59:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 -- 172.21.15.60:0/3922545714 learned_addr learned my addr 172.21.15.60:0/3922545714 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a659c640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a8102570 0x7fb4a8198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 -- 172.21.15.60:0/3922545714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a8102ef0 msgr2=0x7fb4a819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a8102ef0 0x7fb4a819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 -- 172.21.15.60:0/3922545714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a8102570 msgr2=0x7fb4a8198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a8102570 0x7fb4a8198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 -- 172.21.15.60:0/3922545714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a819d5b0 con 0x7fb4a8100e20 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8100e20 0x7fb4a8198600 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb49800cce0 tx=0x7fb49800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb48ffff640 1 -- 172.21.15.60:0/3922545714 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb498004b20 con 0x7fb4a8100e20 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3922545714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a819d8a0 con 0x7fb4a8100e20 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb48ffff640 1 -- 172.21.15.60:0/3922545714 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb498004cc0 con 0x7fb4a8100e20 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3922545714 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a81a5180 con 0x7fb4a8100e20 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.445+0000 7fb48ffff640 1 -- 172.21.15.60:0/3922545714 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49800f8c0 con 0x7fb4a8100e20 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb48ffff640 1 -- 172.21.15.60:0/3922545714 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fb4980056b0 con 0x7fb4a8100e20 2024-09-11T23:59:50.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4af504740 1 Processor -- start 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4af504740 1 -- start start 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb48ffff640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4900a2d80 0x7fb4900a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4af504740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b2de0 0x55b7813b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4af504740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b3700 0x55b7813bda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4af504740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4af504740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b781315090 con 0x55b7813b2de0 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4af504740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b7812bca70 con 0x55b7813bdfc0 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4af504740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b781311050 con 0x55b7813b3700 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb4a759e640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4900a2d80 0x7fb4900a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.448+0000 7fb48ffff640 1 -- 172.21.15.60:0/3922545714 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb4980cf760 con 0x7fb4a8100e20 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b2de0 0x55b7813b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b2de0 0x55b7813b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43260/0 (socket says 172.21.15.60:43260) 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 -- 172.21.15.60:0/2430282436 learned_addr learned my addr 172.21.15.60:0/2430282436 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a759e640 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a659c640 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b3700 0x55b7813bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 -- 172.21.15.60:0/2430282436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b3700 msgr2=0x55b7813bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b3700 0x55b7813bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 -- 172.21.15.60:0/2430282436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 msgr2=0x55b7813c03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813c03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 -- 172.21.15.60:0/2430282436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7812c9130 con 0x55b7813b2de0 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a659c640 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b3700 0x55b7813bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b2de0 0x55b7813b31c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb49800ab20 tx=0x7fb49809c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9383ecf528d4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb4a759e640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4900a2d80 0x7fb4900a5240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4a002a9a0 tx=0x7fb4a0032d90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb48d7fa640 1 -- 172.21.15.60:0/2430282436 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49801d030 con 0x55b7813b2de0 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb48d7fa640 1 -- 172.21.15.60:0/2430282436 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4980a4770 con 0x55b7813b2de0 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.449+0000 7fb48d7fa640 1 -- 172.21.15.60:0/2430282436 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4980cd2f0 con 0x55b7813b2de0 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 -- 172.21.15.60:0/2430282436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b2de0 msgr2=0x55b7813b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b2de0 0x55b7813b31c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb49800ab20 tx=0x7fb49809c200 comp rx=0 tx=0).stop 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 -- 172.21.15.60:0/2430282436 shutdown_connections 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813c03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b3700 0x55b7813bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 --2- 172.21.15.60:0/2430282436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b2de0 0x55b7813b31c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 -- 172.21.15.60:0/2430282436 >> 172.21.15.60:0/2430282436 conn(0x55b7813af370 msgr2=0x55b7813af750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 -- 172.21.15.60:0/2430282436 shutdown_connections 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 -- 172.21.15.60:0/2430282436 wait complete. 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 -- start start 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.450+0000 7fb4af504740 1 Processor -- start 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4af504740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 0x55b7813bd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4af504740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b3700 0x55b7813babc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4af504740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813bdfc0 0x55b7813bb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4af504740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b7813c0b90 con 0x55b7813bdfc0 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4af504740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b7812cff20 con 0x55b7813b3700 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4af504740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b7813c0d10 con 0x55b7813b2de0 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4af504740 10 client.0 _ll_register_callbacks cb 0x55b781299030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:50.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813bdfc0 0x55b7813bb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813bdfc0 0x55b7813bb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43268/0 (socket says 172.21.15.60:43268) 2024-09-11T23:59:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a759e640 1 -- 172.21.15.60:0/4210646865 learned_addr learned my addr 172.21.15.60:0/4210646865 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 0x55b7813bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a659c640 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b3700 0x55b7813babc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a759e640 1 -- 172.21.15.60:0/4210646865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 msgr2=0x55b7813bd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a759e640 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 0x55b7813bd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a759e640 1 -- 172.21.15.60:0/4210646865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b3700 msgr2=0x55b7813babc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:50.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a759e640 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b3700 0x55b7813babc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.451+0000 7fb4a759e640 1 -- 172.21.15.60:0/4210646865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7810862b0 con 0x55b7813bdfc0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb4a759e640 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813bdfc0 0x55b7813bb100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0004270 tx=0x7fb4a0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f22f7ac6511680 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb48aff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb48aff5640 1 -- 172.21.15.60:0/4210646865 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0045070 con 0x55b7813bdfc0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb4af504740 1 -- 172.21.15.60:0/4210646865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4980a4770 con 0x55b7813bdfc0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb48aff5640 1 -- 172.21.15.60:0/4210646865 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb4a00037f0 con 0x55b7813bdfc0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb48aff5640 1 -- 172.21.15.60:0/4210646865 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb4a0059050 con 0x55b7813bdfc0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb4af504740 10 client.15522 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb4af504740 1 -- 172.21.15.60:0/4210646865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7813cc470 con 0x55b7813bdfc0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb48aff5640 1 -- 172.21.15.60:0/4210646865 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb4980a4770 con 0x55b7813bdfc0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb48aff5640 1 -- 172.21.15.60:0/4210646865 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb4a003db10 con 0x55b7813bdfc0 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb4af504740 10 client.15522 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:50.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.452+0000 7fb4af504740 10 client.15522 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:59:50.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.453+0000 7fb4af504740 20 client.15522 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:50.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.453+0000 7fb4af504740 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b7813ceb20 0x55b7813cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.453+0000 7fb4af504740 4 client.15522 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:50.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.453+0000 7fb4af504740 1 -- 172.21.15.60:0/4210646865 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b781322600 con 0x55b7813ceb20 2024-09-11T23:59:50.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.453+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b7813ceb20 0x55b7813cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.453+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b7813ceb20 0x55b7813cff90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f14d7a8de61fe0b3 server_cookie=7075be044246f667 in_seq=0 out_seq=0 2024-09-11T23:59:50.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.453+0000 7fb48aff5640 10 client.15522 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-11T23:59:50.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.454+0000 7fb48aff5640 1 -- 172.21.15.60:0/4210646865 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b781322600 con 0x55b7813ceb20 2024-09-11T23:59:50.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.454+0000 7fb48aff5640 10 client.15522 handle_command_reply: tid=0 2024-09-11T23:59:50.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.454+0000 7fb4af504740 1 client.15522 shutdown 2024-09-11T23:59:50.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.454+0000 7fb4af504740 1 -- 172.21.15.60:0/4210646865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813bdfc0 msgr2=0x55b7813bb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.454+0000 7fb4af504740 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813bdfc0 0x55b7813bb100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0004270 tx=0x7fb4a0005fd0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.454+0000 7fb4af504740 1 -- 172.21.15.60:0/4210646865 shutdown_connections 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.454+0000 7fb4af504740 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b7813ceb20 0x55b7813cff90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.454+0000 7fb4af504740 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813bdfc0 0x55b7813bb100 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.455+0000 7fb4af504740 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b3700 0x55b7813babc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.455+0000 7fb4af504740 1 --2- 172.21.15.60:0/4210646865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 0x55b7813bd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.455+0000 7fb4af504740 1 -- 172.21.15.60:0/4210646865 >> 172.21.15.60:0/4210646865 conn(0x55b7813af370 msgr2=0x55b7813b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.455+0000 7fb48aff5640 0 client.15522 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.455+0000 7fb4af504740 1 -- 172.21.15.60:0/4210646865 shutdown_connections 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.455+0000 7fb4af504740 1 -- 172.21.15.60:0/4210646865 wait complete. 2024-09-11T23:59:50.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.455+0000 7fb4af504740 20 client.15522 trim_cache size 0 max 16384 2024-09-11T23:59:50.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.472+0000 7fb4af504740 1 Processor -- start 2024-09-11T23:59:50.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.472+0000 7fb4af504740 1 -- start start 2024-09-11T23:59:50.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4af504740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 0x55b7813ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4af504740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4af504740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4af504740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b7813ce2d0 con 0x55b7813b3700 2024-09-11T23:59:50.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4af504740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b7813ce9a0 con 0x55b7813bdfc0 2024-09-11T23:59:50.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4af504740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b7813cf070 con 0x55b7813b2de0 2024-09-11T23:59:50.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43270/0 (socket says 172.21.15.60:43270) 2024-09-11T23:59:50.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 -- 172.21.15.60:0/3840977060 learned_addr learned my addr 172.21.15.60:0/3840977060 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:50.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 0x55b7813ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a759e640 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 -- 172.21.15.60:0/3840977060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 msgr2=0x55b7813ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:50.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 0x55b7813ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 -- 172.21.15.60:0/3840977060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 msgr2=0x55b7813ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:50.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 -- 172.21.15.60:0/3840977060 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7813b3530 con 0x55b7813b3700 2024-09-11T23:59:50.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a759e640 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:50.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb4a659c640 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813cff90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00b710 tx=0x7fb49c00bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7caff136142f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:50.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb48cff9640 1 -- 172.21.15.60:0/3840977060 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c003a70 con 0x55b7813b3700 2024-09-11T23:59:50.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb48cff9640 1 -- 172.21.15.60:0/3840977060 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb49c005520 con 0x55b7813b3700 2024-09-11T23:59:50.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.473+0000 7fb48cff9640 1 -- 172.21.15.60:0/3840977060 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c004d10 con 0x55b7813b3700 2024-09-11T23:59:50.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 -- 172.21.15.60:0/3840977060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 msgr2=0x55b7813cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813cff90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00b710 tx=0x7fb49c00bbd0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 -- 172.21.15.60:0/3840977060 shutdown_connections 2024-09-11T23:59:50.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813bdfc0 0x55b7813ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813cff90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 --2- 172.21.15.60:0/3840977060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813b2de0 0x55b7813ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 -- 172.21.15.60:0/3840977060 >> 172.21.15.60:0/3840977060 conn(0x55b7813af370 msgr2=0x55b7813a5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:50.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 -- 172.21.15.60:0/3840977060 shutdown_connections 2024-09-11T23:59:50.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 -- 172.21.15.60:0/3840977060 wait complete. 2024-09-11T23:59:50.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.474+0000 7fb4af504740 1 -- start start 2024-09-11T23:59:50.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4af504740 1 Processor -- start 2024-09-11T23:59:50.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4af504740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b2de0 0x55b7813d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4af504740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4af504740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813bdfc0 0x55b781437220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4af504740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b7813cfe10 con 0x55b7813b3700 2024-09-11T23:59:50.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4af504740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b7813cf740 con 0x55b7813b2de0 2024-09-11T23:59:50.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4af504740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b7813d04e0 con 0x55b7813bdfc0 2024-09-11T23:59:50.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4af504740 10 client.0 _ll_register_callbacks cb 0x7fb4a0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:50.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43284/0 (socket says 172.21.15.60:43284) 2024-09-11T23:59:50.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 -- 172.21.15.60:0/4171723604 learned_addr learned my addr 172.21.15.60:0/4171723604 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:50.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b2de0 0x55b7813d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a759e640 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813bdfc0 0x55b781437220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 -- 172.21.15.60:0/4171723604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813bdfc0 msgr2=0x55b781437220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:50.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813bdfc0 0x55b781437220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 -- 172.21.15.60:0/4171723604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b2de0 msgr2=0x55b7813d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:50.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b2de0 0x55b7813d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 -- 172.21.15.60:0/4171723604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7813bdbe0 con 0x55b7813b3700 2024-09-11T23:59:50.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb4a659c640 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813d1c70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb49c000c00 tx=0x7fb49c003fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bb5ec081a638fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:50.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.475+0000 7fb48aff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:50.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb48aff5640 1 -- 172.21.15.60:0/4171723604 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c01c470 con 0x55b7813b3700 2024-09-11T23:59:50.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb48aff5640 1 -- 172.21.15.60:0/4171723604 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb49c018040 con 0x55b7813b3700 2024-09-11T23:59:50.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 1 -- 172.21.15.60:0/4171723604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb49c005520 con 0x55b7813b3700 2024-09-11T23:59:50.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb48aff5640 1 -- 172.21.15.60:0/4171723604 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb49c01c610 con 0x55b7813b3700 2024-09-11T23:59:50.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 10 client.15528 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:50.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 1 -- 172.21.15.60:0/4171723604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7814386e0 con 0x55b7813b3700 2024-09-11T23:59:50.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb48aff5640 1 -- 172.21.15.60:0/4171723604 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb49c005520 con 0x55b7813b3700 2024-09-11T23:59:50.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb48aff5640 1 -- 172.21.15.60:0/4171723604 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb49c012860 con 0x55b7813b3700 2024-09-11T23:59:50.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 10 client.15528 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:50.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 10 client.15528 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:59:50.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 20 client.15528 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:50.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b78143d1a0 0x55b78143beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:50.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 4 client.15528 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:50.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.476+0000 7fb4af504740 1 -- 172.21.15.60:0/4171723604 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "status"}) -- 0x55b78131cb10 con 0x55b78143d1a0 2024-09-11T23:59:50.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b78143d1a0 0x55b78143beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:50.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb4a6d9d640 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b78143d1a0 0x55b78143beb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75343d1c1c60be8f server_cookie=bb7576a1cbabfe4e in_seq=0 out_seq=0 2024-09-11T23:59:50.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb48aff5640 10 client.15528 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-11T23:59:50.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb48aff5640 1 -- 172.21.15.60:0/4171723604 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b78131cb10 con 0x55b78143d1a0 2024-09-11T23:59:50.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb48aff5640 10 client.15528 handle_command_reply: tid=0 2024-09-11T23:59:50.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb4af504740 1 client.15528 shutdown 2024-09-11T23:59:50.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb4af504740 1 -- 172.21.15.60:0/4171723604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 msgr2=0x55b7813d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb4af504740 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813d1c70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb49c000c00 tx=0x7fb49c003fa0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb4af504740 1 -- 172.21.15.60:0/4171723604 shutdown_connections 2024-09-11T23:59:50.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb4af504740 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b78143d1a0 0x55b78143beb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.477+0000 7fb4af504740 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b7813bdfc0 0x55b781437220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4af504740 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b7813b3700 0x55b7813d1c70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4af504740 1 --2- 172.21.15.60:0/4171723604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b7813b2de0 0x55b7813d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4af504740 1 -- 172.21.15.60:0/4171723604 >> 172.21.15.60:0/4171723604 conn(0x55b7813af370 msgr2=0x55b7813bab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:50.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb48aff5640 0 client.15528 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-11T23:59:50.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4af504740 1 -- 172.21.15.60:0/4171723604 shutdown_connections 2024-09-11T23:59:50.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4af504740 1 -- 172.21.15.60:0/4171723604 wait complete. 2024-09-11T23:59:50.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4af504740 20 client.15528 trim_cache size 0 max 16384 2024-09-11T23:59:50.501 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:50.501 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:50.501 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 1, 2024-09-11T23:59:50.502 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24485, 2024-09-11T23:59:50.502 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:50.502 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:50.502 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:50.502 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 134.01780308799999, 2024-09-11T23:59:50.502 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 29, 2024-09-11T23:59:50.502 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 83, 2024-09-11T23:59:50.503 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:50.503 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 151.97098501299999 2024-09-11T23:59:50.503 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:50.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4900a2d80 msgr2=0x7fb4900a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4900a2d80 0x7fb4900a5240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb4a002a9a0 tx=0x7fb4a0032d90 comp rx=0 tx=0).stop 2024-09-11T23:59:50.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8100e20 msgr2=0x7fb4a8198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:50.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8100e20 0x7fb4a8198600 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb49800cce0 tx=0x7fb49800a620 comp rx=0 tx=0).stop 2024-09-11T23:59:50.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3922545714 shutdown_connections 2024-09-11T23:59:50.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4900a2d80 0x7fb4900a5240 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a8102ef0 0x7fb4a819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a8102570 0x7fb4a8198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 --2- 172.21.15.60:0/3922545714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a8100e20 0x7fb4a8198600 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:50.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.478+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3922545714 >> 172.21.15.60:0/3922545714 conn(0x7fb4a80fc7d0 msgr2=0x7fb4a806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:50.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.479+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3922545714 shutdown_connections 2024-09-11T23:59:50.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:50.479+0000 7fb4ad12b640 1 -- 172.21.15.60:0/3922545714 wait complete. 2024-09-11T23:59:51.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:50 smithi105 ceph-mon[34805]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-11T23:59:51.232 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:50 smithi060 ceph-mon[30953]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-11T23:59:51.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T23:59:51.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:50 smithi192 ceph-mon[35487]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-11T23:59:51.527 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T23:59:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 -- 172.21.15.60:0/1895368968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a0102e00 msgr2=0x7f18a01031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 --2- 172.21.15.60:0/1895368968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a0102e00 0x7f18a01031e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1890009900 tx=0x7f189002a480 comp rx=0 tx=0).stop 2024-09-11T23:59:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 -- 172.21.15.60:0/1895368968 shutdown_connections 2024-09-11T23:59:52.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 --2- 172.21.15.60:0/1895368968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a010c1a0 0x7f18a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 --2- 172.21.15.60:0/1895368968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18a0103720 0x7f18a010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 --2- 172.21.15.60:0/1895368968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a0102e00 0x7f18a01031e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 -- 172.21.15.60:0/1895368968 >> 172.21.15.60:0/1895368968 conn(0x7f18a00fc7a0 msgr2=0x7f18a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 -- 172.21.15.60:0/1895368968 shutdown_connections 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.005+0000 7f18a65dd640 1 -- 172.21.15.60:0/1895368968 wait complete. 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a65dd640 1 Processor -- start 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a65dd640 1 -- start start 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a65dd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18a0102e00 0x7f18a01985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a65dd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0103720 0x7f18a0198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a65dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a010c1a0 0x7f18a019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a65dd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0112090 con 0x7f18a010c1a0 2024-09-11T23:59:52.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a65dd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0111f10 con 0x7f18a0103720 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a65dd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f18a0112210 con 0x7f18a0102e00 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a4b7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a010c1a0 0x7f18a019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a4b7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a010c1a0 0x7f18a019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52510/0 (socket says 172.21.15.60:52510) 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f18a4b7a640 1 -- 172.21.15.60:0/2647626102 learned_addr learned my addr 172.21.15.60:0/2647626102 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.006+0000 7f189ffff640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18a0102e00 0x7f18a01985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f189f7fe640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0103720 0x7f18a0198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f18a4b7a640 1 -- 172.21.15.60:0/2647626102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18a0102e00 msgr2=0x7f18a01985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f18a4b7a640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18a0102e00 0x7f18a01985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f18a4b7a640 1 -- 172.21.15.60:0/2647626102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0103720 msgr2=0x7f18a0198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f18a4b7a640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0103720 0x7f18a0198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f18a4b7a640 1 -- 172.21.15.60:0/2647626102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a019d580 con 0x7f18a010c1a0 2024-09-11T23:59:52.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f189f7fe640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0103720 0x7f18a0198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f18a4b7a640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a010c1a0 0x7f18a019cea0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1898009fd0 tx=0x7f189800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f189d7fa640 1 -- 172.21.15.60:0/2647626102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898017070 con 0x7f18a010c1a0 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f189d7fa640 1 -- 172.21.15.60:0/2647626102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1898004020 con 0x7f18a010c1a0 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f18a65dd640 1 -- 172.21.15.60:0/2647626102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a019d870 con 0x7f18a010c1a0 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f189d7fa640 1 -- 172.21.15.60:0/2647626102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18980106c0 con 0x7f18a010c1a0 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.007+0000 7f18a65dd640 1 -- 172.21.15.60:0/2647626102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a01a5150 con 0x7f18a010c1a0 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.009+0000 7f189d7fa640 1 -- 172.21.15.60:0/2647626102 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f18980041d0 con 0x7f18a010c1a0 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a89b6740 1 Processor -- start 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a89b6740 1 -- start start 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 0x560455f41cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 0x560455f50a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f50fc0 0x560455f533b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a89b6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560455ea8090 con 0x560455f50fc0 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a89b6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560455e4fa70 con 0x560455f418d0 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a89b6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560455ea4050 con 0x560455f421f0 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f189d7fa640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f18880a2d80 0x7f18880a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f50fc0 0x560455f533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f18a4b7a640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f18880a2d80 0x7f18880a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f50fc0 0x560455f533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52512/0 (socket says 172.21.15.60:52512) 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f189ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 0x560455f50a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f189f7fe640 1 -- 172.21.15.60:0/3680954885 learned_addr learned my addr 172.21.15.60:0/3680954885 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.010+0000 7f189f7fe640 1 --2- 172.21.15.60:0/3680954885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 0x560455f41cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f189d7fa640 1 -- 172.21.15.60:0/2647626102 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f18980cf2a0 con 0x7f18a010c1a0 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f189ffff640 1 -- 172.21.15.60:0/3680954885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 msgr2=0x560455f41cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f189ffff640 1 --2- 172.21.15.60:0/3680954885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 0x560455f41cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f189ffff640 1 -- 172.21.15.60:0/3680954885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f50fc0 msgr2=0x560455f533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f189ffff640 1 --2- 172.21.15.60:0/3680954885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f50fc0 0x560455f533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f189ffff640 1 -- 172.21.15.60:0/3680954885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560455e5c130 con 0x560455f421f0 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f18a4b7a640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f18880a2d80 0x7f18880a5240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18980cc980 tx=0x7f189806d600 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f189ffff640 1 --2- 172.21.15.60:0/3680954885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 0x560455f50a80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1890005940 tx=0x7f1890005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dface04a1ed93db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f18867fc640 1 -- 172.21.15.60:0/3680954885 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890040070 con 0x560455f421f0 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f18867fc640 1 -- 172.21.15.60:0/3680954885 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1890031980 con 0x560455f421f0 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.011+0000 7f18867fc640 1 -- 172.21.15.60:0/3680954885 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890035040 con 0x560455f421f0 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 -- 172.21.15.60:0/3680954885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 msgr2=0x560455f50a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 --2- 172.21.15.60:0/3680954885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 0x560455f50a80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1890005940 tx=0x7f1890005c00 comp rx=0 tx=0).stop 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 -- 172.21.15.60:0/3680954885 shutdown_connections 2024-09-11T23:59:52.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 --2- 172.21.15.60:0/3680954885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f50fc0 0x560455f533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 --2- 172.21.15.60:0/3680954885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 0x560455f50a80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 --2- 172.21.15.60:0/3680954885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 0x560455f41cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 -- 172.21.15.60:0/3680954885 >> 172.21.15.60:0/3680954885 conn(0x560455f3df60 msgr2=0x560455f3e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 -- 172.21.15.60:0/3680954885 shutdown_connections 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 -- 172.21.15.60:0/3680954885 wait complete. 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.012+0000 7f18a89b6740 1 -- start start 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f18a89b6740 1 Processor -- start 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f418d0 0x560455f50800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f4db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 0x560455f4e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f18a89b6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560455f53b90 con 0x560455f421f0 2024-09-11T23:59:52.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f18a89b6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560455e62f20 con 0x560455f50fc0 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f18a89b6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560455f53d10 con 0x560455f418d0 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f18a89b6740 10 client.0 _ll_register_callbacks cb 0x560455e2c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f4db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f4db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52518/0 (socket says 172.21.15.60:52518) 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189ffff640 1 -- 172.21.15.60:0/1141874282 learned_addr learned my addr 172.21.15.60:0/1141874282 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189f7fe640 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f418d0 0x560455f50800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189f7fe640 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 0x560455f4e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189ffff640 1 -- 172.21.15.60:0/1141874282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f418d0 msgr2=0x560455f50800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189ffff640 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f418d0 0x560455f50800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189ffff640 1 -- 172.21.15.60:0/1141874282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 msgr2=0x560455f4e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189ffff640 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 0x560455f4e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189ffff640 1 -- 172.21.15.60:0/1141874282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560455c192b0 con 0x560455f421f0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.013+0000 7f189f7fe640 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 0x560455f4e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f189ffff640 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f4db50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1890009900 tx=0x7f1890031b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa1ac3effe3cf26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f187f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f187f7fe640 1 -- 172.21.15.60:0/1141874282 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890040030 con 0x560455f421f0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f18a89b6740 1 -- 172.21.15.60:0/1141874282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1890031980 con 0x560455f421f0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f187f7fe640 1 -- 172.21.15.60:0/1141874282 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1890031780 con 0x560455f421f0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f187f7fe640 1 -- 172.21.15.60:0/1141874282 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1890035070 con 0x560455f421f0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f18a89b6740 10 client.15540 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f18a89b6740 1 -- 172.21.15.60:0/1141874282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560455f5f490 con 0x560455f421f0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f187f7fe640 1 -- 172.21.15.60:0/1141874282 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1890031980 con 0x560455f421f0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f187f7fe640 1 -- 172.21.15.60:0/1141874282 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f18900035f0 con 0x560455f421f0 2024-09-11T23:59:52.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.014+0000 7f18a89b6740 10 client.15540 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.015+0000 7f18a89b6740 10 client.15540 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.015+0000 7f18a89b6740 20 client.15540 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.015+0000 7f18a89b6740 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560455f61680 0x560455f62af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.015+0000 7f18a89b6740 4 client.15540 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.015+0000 7f18a89b6740 1 -- 172.21.15.60:0/1141874282 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560455eb5600 con 0x560455f61680 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.015+0000 7f189f7fe640 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560455f61680 0x560455f62af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.015+0000 7f189f7fe640 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560455f61680 0x560455f62af0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81fa7558bc76933 server_cookie=7385a3f4478940eb in_seq=0 out_seq=0 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.015+0000 7f187f7fe640 10 client.15540 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f187f7fe640 1 -- 172.21.15.60:0/1141874282 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560455eb5600 con 0x560455f61680 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f187f7fe640 10 client.15540 handle_command_reply: tid=0 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 client.15540 shutdown 2024-09-11T23:59:52.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 -- 172.21.15.60:0/1141874282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 msgr2=0x560455f4db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f4db50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1890009900 tx=0x7f1890031b30 comp rx=0 tx=0).stop 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 -- 172.21.15.60:0/1141874282 shutdown_connections 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560455f61680 0x560455f62af0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 0x560455f4e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f4db50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 --2- 172.21.15.60:0/1141874282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f418d0 0x560455f50800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f187f7fe640 0 client.15540 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 -- 172.21.15.60:0/1141874282 >> 172.21.15.60:0/1141874282 conn(0x560455f3df60 msgr2=0x560455f43cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 -- 172.21.15.60:0/1141874282 shutdown_connections 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.016+0000 7f18a89b6740 1 -- 172.21.15.60:0/1141874282 wait complete. 2024-09-11T23:59:52.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.017+0000 7f18a89b6740 20 client.15540 trim_cache size 0 max 16384 2024-09-11T23:59:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f18a89b6740 1 Processor -- start 2024-09-11T23:59:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f18a89b6740 1 -- start start 2024-09-11T23:59:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f418d0 0x560455f62af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 0x560455f4cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 0x560455f38ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f18a89b6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560455f60e30 con 0x560455f418d0 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f18a89b6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560455f61500 con 0x560455f50fc0 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f18a89b6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560455f61bd0 con 0x560455f421f0 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.035+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f418d0 0x560455f62af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f189f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f418d0 0x560455f62af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52530/0 (socket says 172.21.15.60:52530) 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f189f7fe640 1 -- 172.21.15.60:0/527468353 learned_addr learned my addr 172.21.15.60:0/527468353 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f189f7fe640 1 -- 172.21.15.60:0/527468353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 msgr2=0x560455f4cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f189f7fe640 1 --2- 172.21.15.60:0/527468353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 0x560455f4cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f189f7fe640 1 -- 172.21.15.60:0/527468353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 msgr2=0x560455f38ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f189f7fe640 1 --2- 172.21.15.60:0/527468353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 0x560455f38ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f189f7fe640 1 -- 172.21.15.60:0/527468353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560455f3f0f0 con 0x560455f418d0 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f189f7fe640 1 --2- 172.21.15.60:0/527468353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f418d0 0x560455f62af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x560455f43470 tx=0x7f1894009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3055324591828d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f1885ffb640 1 -- 172.21.15.60:0/527468353 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894004050 con 0x560455f418d0 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f1885ffb640 1 -- 172.21.15.60:0/527468353 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f18940041f0 con 0x560455f418d0 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.036+0000 7f1885ffb640 1 -- 172.21.15.60:0/527468353 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894011920 con 0x560455f418d0 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 -- 172.21.15.60:0/527468353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f418d0 msgr2=0x560455f62af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 --2- 172.21.15.60:0/527468353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f418d0 0x560455f62af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x560455f43470 tx=0x7f1894009c40 comp rx=0 tx=0).stop 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 -- 172.21.15.60:0/527468353 shutdown_connections 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 --2- 172.21.15.60:0/527468353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f50fc0 0x560455f38ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 --2- 172.21.15.60:0/527468353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f421f0 0x560455f4cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 --2- 172.21.15.60:0/527468353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f418d0 0x560455f62af0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 -- 172.21.15.60:0/527468353 >> 172.21.15.60:0/527468353 conn(0x560455f3df60 msgr2=0x560455f3e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 -- 172.21.15.60:0/527468353 shutdown_connections 2024-09-11T23:59:52.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 -- 172.21.15.60:0/527468353 wait complete. 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.037+0000 7f18a89b6740 1 -- start start 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f18a89b6740 1 Processor -- start 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 0x560455f6b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f6b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f18a89b6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f50fc0 0x560455f64440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f18a89b6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560455f62970 con 0x560455f421f0 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f18a89b6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560455f622a0 con 0x560455f418d0 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f18a89b6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560455f63040 con 0x560455f50fc0 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f18a89b6740 10 client.0 _ll_register_callbacks cb 0x7f1894009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f189ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f6b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f189ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f6b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52540/0 (socket says 172.21.15.60:52540) 2024-09-11T23:59:52.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f189ffff640 1 -- 172.21.15.60:0/510615809 learned_addr learned my addr 172.21.15.60:0/510615809 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f189f7fe640 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 0x560455f6b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f189f7fe640 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f50fc0 0x560455f64440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f189ffff640 1 -- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f50fc0 msgr2=0x560455f64440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f189ffff640 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f50fc0 0x560455f64440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.038+0000 7f189ffff640 1 -- 172.21.15.60:0/510615809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 msgr2=0x560455f6b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f189ffff640 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 0x560455f6b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f189ffff640 1 -- 172.21.15.60:0/510615809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560455f3d810 con 0x560455f421f0 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f189f7fe640 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f50fc0 0x560455f64440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f189ffff640 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f6b5a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f189002a9a0 tx=0x7f18900058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df141d5646d733d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f187f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f187f7fe640 1 -- 172.21.15.60:0/510615809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189005d030 con 0x560455f421f0 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f187f7fe640 1 -- 172.21.15.60:0/510615809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f189004a070 con 0x560455f421f0 2024-09-11T23:59:52.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f18a89b6740 1 -- 172.21.15.60:0/510615809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18940041f0 con 0x560455f421f0 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f187f7fe640 1 -- 172.21.15.60:0/510615809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1890067050 con 0x560455f421f0 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f18a89b6740 10 client.15546 fetch_fsmap learned FSMap version 29 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f18a89b6740 1 -- 172.21.15.60:0/510615809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560455f69540 con 0x560455f421f0 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f187f7fe640 1 -- 172.21.15.60:0/510615809 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f18940041f0 con 0x560455f421f0 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.039+0000 7f187f7fe640 1 -- 172.21.15.60:0/510615809 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1890004750 con 0x560455f421f0 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f18a89b6740 10 client.15546 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f18a89b6740 10 client.15546 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f18a89b6740 20 client.15546 populate_metadata read hostname 'smithi060' 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f18a89b6740 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560455f61680 0x560455fcefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f18a89b6740 4 client.15546 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f18a89b6740 1 -- 172.21.15.60:0/510615809 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "status"}) -- 0x560455eafb10 con 0x560455f61680 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f189f7fe640 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560455f61680 0x560455fcefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:59:52.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f189f7fe640 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560455f61680 0x560455fcefd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=302849060903e26e server_cookie=634cf06593431bf1 in_seq=0 out_seq=0 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f187f7fe640 10 client.15546 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.040+0000 7f187f7fe640 1 -- 172.21.15.60:0/510615809 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x560455eafb10 con 0x560455f61680 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f187f7fe640 10 client.15546 handle_command_reply: tid=0 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 client.15546 shutdown 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 -- 172.21.15.60:0/510615809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 msgr2=0x560455f6b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f6b5a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f189002a9a0 tx=0x7f18900058d0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 -- 172.21.15.60:0/510615809 shutdown_connections 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560455f61680 0x560455fcefd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560455f50fc0 0x560455f64440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f187f7fe640 0 client.15546 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560455f421f0 0x560455f6b5a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 --2- 172.21.15.60:0/510615809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560455f418d0 0x560455f6b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 -- 172.21.15.60:0/510615809 >> 172.21.15.60:0/510615809 conn(0x560455f3df60 msgr2=0x560455f4cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 -- 172.21.15.60:0/510615809 shutdown_connections 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 1 -- 172.21.15.60:0/510615809 wait complete. 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a89b6740 20 client.15546 trim_cache size 0 max 16384 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "6b4d616e-7098-11ef-bcea-c7b262605968", 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 24496, 2024-09-11T23:59:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-11T23:59:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-11T23:59:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-11T23:59:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 142.611926603, 2024-09-11T23:59:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 29, 2024-09-11T23:59:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 83, 2024-09-11T23:59:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 82, 2024-09-11T23:59:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 163.088947964 2024-09-11T23:59:52.054 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a65dd640 1 -- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f18880a2d80 msgr2=0x7f18880a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a65dd640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f18880a2d80 0x7f18880a5240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18980cc980 tx=0x7f189806d600 comp rx=0 tx=0).stop 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a65dd640 1 -- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a010c1a0 msgr2=0x7f18a019cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.041+0000 7f18a65dd640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a010c1a0 0x7f18a019cea0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1898009fd0 tx=0x7f189800b260 comp rx=0 tx=0).stop 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.042+0000 7f18a65dd640 1 -- 172.21.15.60:0/2647626102 shutdown_connections 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.042+0000 7f18a65dd640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f18880a2d80 0x7f18880a5240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.042+0000 7f18a65dd640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18a010c1a0 0x7f18a019cea0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.042+0000 7f18a65dd640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18a0103720 0x7f18a0198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.042+0000 7f18a65dd640 1 --2- 172.21.15.60:0/2647626102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18a0102e00 0x7f18a01985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.042+0000 7f18a65dd640 1 -- 172.21.15.60:0/2647626102 >> 172.21.15.60:0/2647626102 conn(0x7f18a00fc7a0 msgr2=0x7f18a00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:59:52.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.042+0000 7f18a65dd640 1 -- 172.21.15.60:0/2647626102 shutdown_connections 2024-09-11T23:59:52.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-11T23:59:52.042+0000 7f18a65dd640 1 -- 172.21.15.60:0/2647626102 wait complete. 2024-09-11T23:59:52.774 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-11T23:59:53.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:52 smithi060 ceph-mon[30953]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-11T23:59:53.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:52 smithi105 ceph-mon[34805]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-11T23:59:53.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:52 smithi192 ceph-mon[35487]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-11T23:59:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:54 smithi105 ceph-mon[34805]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-11T23:59:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:54 smithi192 ceph-mon[35487]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-11T23:59:55.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:54 smithi060 ceph-mon[30953]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-11T23:59:57.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:56 smithi105 ceph-mon[34805]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-11T23:59:57.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:56 smithi192 ceph-mon[35487]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-11T23:59:57.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:56 smithi060 ceph-mon[30953]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-11T23:59:59.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 11 23:59:58 smithi105 ceph-mon[34805]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-11T23:59:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 11 23:59:58 smithi192 ceph-mon[35487]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-11T23:59:59.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 11 23:59:58 smithi060 ceph-mon[30953]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-12T00:00:01.202 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:00 smithi105 ceph-mon[34805]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T00:00:01.203 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:00 smithi105 ceph-mon[34805]: overall HEALTH_OK 2024-09-12T00:00:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:00 smithi192 ceph-mon[35487]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T00:00:01.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:00 smithi192 ceph-mon[35487]: overall HEALTH_OK 2024-09-12T00:00:01.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:00 smithi060 ceph-mon[30953]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T00:00:01.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:00 smithi060 ceph-mon[30953]: overall HEALTH_OK 2024-09-12T00:00:01.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:00:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-12T00:00:00.915+0000 7fe4c96c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:00:01.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:00:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-12T00:00:00.915+0000 7fe4c96c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:00:01.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:00:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-12T00:00:00.915+0000 7fe4c96c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:00:01.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:00:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-12T00:00:00.915+0000 7fe4c96c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:00:01.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:00:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-12T00:00:00.915+0000 7fe4c96c2640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T00:00:02.385 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:00:02.680 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:02.978 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:02 smithi060 ceph-mon[30953]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:02.978 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:02 smithi060 ceph-mon[30953]: mgrmap e24: x(active, since 40s), standbys: z, y 2024-09-12T00:00:03.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:02 smithi105 ceph-mon[34805]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:03.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:02 smithi105 ceph-mon[34805]: mgrmap e24: x(active, since 40s), standbys: z, y 2024-09-12T00:00:03.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 -- 172.21.15.60:0/901614220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 msgr2=0x7ff6fc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 --2- 172.21.15.60:0/901614220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 0x7ff6fc107b80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009930 tx=0x7ff6ec02a420 comp rx=0 tx=0).stop 2024-09-12T00:00:03.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 -- 172.21.15.60:0/901614220 shutdown_connections 2024-09-12T00:00:03.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 --2- 172.21.15.60:0/901614220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6fc108290 0x7ff6fc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 --2- 172.21.15.60:0/901614220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 0x7ff6fc107b80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 --2- 172.21.15.60:0/901614220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc102d90 0x7ff6fc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 -- 172.21.15.60:0/901614220 >> 172.21.15.60:0/901614220 conn(0x7ff6fc0fc7d0 msgr2=0x7ff6fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 -- 172.21.15.60:0/901614220 shutdown_connections 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.238+0000 7ff70331a640 1 -- 172.21.15.60:0/901614220 wait complete. 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff70331a640 1 Processor -- start 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff70331a640 1 -- start start 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff70331a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6fc102d90 0x7ff6fc1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff70331a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 0x7ff6fc198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff70331a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc108290 0x7ff6fc19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff70331a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1121b0 con 0x7ff6fc103740 2024-09-12T00:00:03.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff70331a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc112030 con 0x7ff6fc108290 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff70331a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc112330 con 0x7ff6fc102d90 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff7008b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 0x7ff6fc198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff7008b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 0x7ff6fc198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33100/0 (socket says 172.21.15.60:33100) 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff7008b5640 1 -- 172.21.15.60:0/3019410620 learned_addr learned my addr 172.21.15.60:0/3019410620 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff7010b6640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6fc102d90 0x7ff6fc1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff7008b5640 1 -- 172.21.15.60:0/3019410620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6fc102d90 msgr2=0x7ff6fc1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff7008b5640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6fc102d90 0x7ff6fc1986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff7008b5640 1 -- 172.21.15.60:0/3019410620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc108290 msgr2=0x7ff6fc19cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.239+0000 7ff7008b5640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc108290 0x7ff6fc19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.240+0000 7ff7008b5640 1 -- 172.21.15.60:0/3019410620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc19d650 con 0x7ff6fc103740 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.240+0000 7ff7010b6640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6fc102d90 0x7ff6fc1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:03.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.240+0000 7ff7008b5640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 0x7ff6fc198be0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005940 tx=0x7ff6ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.240+0000 7ff6f27fc640 1 -- 172.21.15.60:0/3019410620 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec03f030 con 0x7ff6fc103740 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.240+0000 7ff70331a640 1 -- 172.21.15.60:0/3019410620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc19d8e0 con 0x7ff6fc103740 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.240+0000 7ff6f27fc640 1 -- 172.21.15.60:0/3019410620 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6ec003d00 con 0x7ff6fc103740 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.240+0000 7ff6f27fc640 1 -- 172.21.15.60:0/3019410620 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec035070 con 0x7ff6fc103740 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.240+0000 7ff70331a640 1 -- 172.21.15.60:0/3019410620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc1a5220 con 0x7ff6fc103740 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.243+0000 7ff6f27fc640 1 -- 172.21.15.60:0/3019410620 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7ff6ec042030 con 0x7ff6fc103740 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.243+0000 7ff6f27fc640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6e80a2e90 0x7ff6e80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.243+0000 7ff7010b6640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6e80a2e90 0x7ff6e80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.243+0000 7ff6f27fc640 1 -- 172.21.15.60:0/3019410620 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff6ec0efa40 con 0x7ff6fc103740 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7056f3740 1 Processor -- start 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7010b6640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6e80a2e90 0x7ff6e80a5350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800bfd0 tx=0x7ff6f800b390 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7056f3740 1 -- start start 2024-09-12T00:00:03.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 0x56133256a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256adc0 0x561332575140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x561332577a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7056f3740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5613324d02e0 con 0x561332575680 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7056f3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561332477ce0 con 0x56133256a4a0 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7056f3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5613324cc2a0 con 0x56133256adc0 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7018b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x561332577a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7018b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x561332577a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33116/0 (socket says 172.21.15.60:33116) 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.244+0000 7ff7018b7640 1 -- 172.21.15.60:0/2707945331 learned_addr learned my addr 172.21.15.60:0/2707945331 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff7008b5640 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256adc0 0x561332575140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff7010b6640 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 0x56133256a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff7018b7640 1 -- 172.21.15.60:0/2707945331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256adc0 msgr2=0x561332575140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff7018b7640 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256adc0 0x561332575140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff7018b7640 1 -- 172.21.15.60:0/2707945331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 msgr2=0x56133256a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff7018b7640 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 0x56133256a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff7018b7640 1 -- 172.21.15.60:0/2707945331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56133245c440 con 0x561332575680 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff7018b7640 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x561332577a70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009d10 tx=0x7ff6f400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd06afc72fe50751 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff6e77fe640 1 -- 172.21.15.60:0/2707945331 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4016070 con 0x561332575680 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff6e77fe640 1 -- 172.21.15.60:0/2707945331 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6f4004b20 con 0x561332575680 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.245+0000 7ff6e77fe640 1 -- 172.21.15.60:0/2707945331 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40116d0 con 0x561332575680 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 -- 172.21.15.60:0/2707945331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 msgr2=0x561332577a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x561332577a70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009d10 tx=0x7ff6f400e6c0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 -- 172.21.15.60:0/2707945331 shutdown_connections 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x561332577a70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256adc0 0x561332575140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 --2- 172.21.15.60:0/2707945331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 0x56133256a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 -- 172.21.15.60:0/2707945331 >> 172.21.15.60:0/2707945331 conn(0x561332566a30 msgr2=0x561332566e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 -- 172.21.15.60:0/2707945331 shutdown_connections 2024-09-12T00:00:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.246+0000 7ff7056f3740 1 -- 172.21.15.60:0/2707945331 wait complete. 2024-09-12T00:00:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 1 -- start start 2024-09-12T00:00:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 1 Processor -- start 2024-09-12T00:00:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 0x561332574f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256adc0 0x5613325721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 0x5613325726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561332578250 con 0x56133256adc0 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56133248b050 con 0x56133256a4a0 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5613325783d0 con 0x561332575680 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7056f3740 10 client.0 _ll_register_callbacks cb 0x5613324cb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7008b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256adc0 0x5613325721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7008b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256adc0 0x5613325721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33118/0 (socket says 172.21.15.60:33118) 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7008b5640 1 -- 172.21.15.60:0/1681821075 learned_addr learned my addr 172.21.15.60:0/1681821075 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7018b7640 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 0x5613325726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.247+0000 7ff7010b6640 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 0x561332574f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7008b5640 1 -- 172.21.15.60:0/1681821075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 msgr2=0x5613325726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7008b5640 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 0x5613325726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7008b5640 1 -- 172.21.15.60:0/1681821075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 msgr2=0x561332574f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7008b5640 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 0x561332574f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7008b5640 1 -- 172.21.15.60:0/1681821075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613322413c0 con 0x56133256adc0 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7008b5640 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256adc0 0x5613325721b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0bbb30 tx=0x7ff6ec0bb850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916ce4b6c286229d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff6e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/1681821075 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec049050 con 0x56133256adc0 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/1681821075 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff6ec03bc50 con 0x56133256adc0 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7056f3740 1 -- 172.21.15.60:0/1681821075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6f4004b20 con 0x56133256adc0 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/1681821075 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff6ec03be50 con 0x56133256adc0 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7056f3740 10 client.15564 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff7056f3740 1 -- 172.21.15.60:0/1681821075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561332583b60 con 0x56133256adc0 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.248+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/1681821075 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6f4004b20 con 0x56133256adc0 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.249+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/1681821075 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff6ec0ed340 con 0x56133256adc0 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.249+0000 7ff7056f3740 10 client.15564 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.249+0000 7ff7056f3740 10 client.15564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.249+0000 7ff7056f3740 20 client.15564 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.249+0000 7ff7056f3740 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561332584f00 0x561332587350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.249+0000 7ff7056f3740 4 client.15564 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.249+0000 7ff7056f3740 1 -- 172.21.15.60:0/1681821075 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613324dd850 con 0x561332584f00 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.249+0000 7ff7010b6640 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561332584f00 0x561332587350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.250+0000 7ff6e4ff9640 10 client.15564 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.250+0000 7ff7010b6640 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561332584f00 0x561332587350 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef5c69f4faf2c77b server_cookie=8eae3ea2e86de204 in_seq=0 out_seq=0 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/1681821075 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613324dd850 con 0x561332584f00 2024-09-12T00:00:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff6e4ff9640 10 client.15564 handle_command_reply: tid=0 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 client.15564 shutdown 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 -- 172.21.15.60:0/1681821075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256adc0 msgr2=0x5613325721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256adc0 0x5613325721b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0bbb30 tx=0x7ff6ec0bb850 comp rx=0 tx=0).stop 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 -- 172.21.15.60:0/1681821075 shutdown_connections 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561332584f00 0x561332587350 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 0x5613325726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256adc0 0x5613325721b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 --2- 172.21.15.60:0/1681821075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256a4a0 0x561332574f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff6e4ff9640 0 client.15564 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.251+0000 7ff7056f3740 1 -- 172.21.15.60:0/1681821075 >> 172.21.15.60:0/1681821075 conn(0x561332566a30 msgr2=0x56133256c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.252+0000 7ff7056f3740 1 -- 172.21.15.60:0/1681821075 shutdown_connections 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.252+0000 7ff7056f3740 1 -- 172.21.15.60:0/1681821075 wait complete. 2024-09-12T00:00:03.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.252+0000 7ff7056f3740 20 client.15564 trim_cache size 0 max 16384 2024-09-12T00:00:03.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7056f3740 1 Processor -- start 2024-09-12T00:00:03.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7056f3740 1 -- start start 2024-09-12T00:00:03.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256a4a0 0x561332574120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133258cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x56133258d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7056f3740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1ad850 con 0x561332575680 2024-09-12T00:00:03.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7056f3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1af390 con 0x56133256adc0 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7056f3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1adf20 con 0x56133256a4a0 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7018b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x56133258d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7018b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x56133258d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33124/0 (socket says 172.21.15.60:33124) 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.271+0000 7ff7018b7640 1 -- 172.21.15.60:0/4258365971 learned_addr learned my addr 172.21.15.60:0/4258365971 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7008b5640 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133258cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7010b6640 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256a4a0 0x561332574120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7018b7640 1 -- 172.21.15.60:0/4258365971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256a4a0 msgr2=0x561332574120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7018b7640 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256a4a0 0x561332574120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7018b7640 1 -- 172.21.15.60:0/4258365971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 msgr2=0x56133258cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7018b7640 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133258cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7018b7640 1 -- 172.21.15.60:0/4258365971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613325879d0 con 0x561332575680 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7010b6640 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256a4a0 0x561332574120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7008b5640 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133258cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff7018b7640 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x56133258d1a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4005980 tx=0x7ff6f40058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577f19b454e62c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff6e6ffd640 1 -- 172.21.15.60:0/4258365971 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4016040 con 0x561332575680 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff6e6ffd640 1 -- 172.21.15.60:0/4258365971 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6f4028070 con 0x561332575680 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.272+0000 7ff6e6ffd640 1 -- 172.21.15.60:0/4258365971 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4004810 con 0x561332575680 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 -- 172.21.15.60:0/4258365971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 msgr2=0x56133258d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x56133258d1a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4005980 tx=0x7ff6f40058f0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 -- 172.21.15.60:0/4258365971 shutdown_connections 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561332575680 0x56133258d1a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133258cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 --2- 172.21.15.60:0/4258365971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56133256a4a0 0x561332574120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 -- 172.21.15.60:0/4258365971 >> 172.21.15.60:0/4258365971 conn(0x561332566a30 msgr2=0x561332573a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 -- 172.21.15.60:0/4258365971 shutdown_connections 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.273+0000 7ff7056f3740 1 -- 172.21.15.60:0/4258365971 wait complete. 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 1 -- start start 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 1 Processor -- start 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256a4a0 0x56133257b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133257bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 0x5613325f3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1aecc0 con 0x56133256a4a0 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1ae5f0 con 0x56133256adc0 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1ab830 con 0x561332575680 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7056f3740 10 client.0 _ll_register_callbacks cb 0x7ff6ec0bba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.274+0000 7ff7010b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256a4a0 0x56133257b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7010b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256a4a0 0x56133257b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33138/0 (socket says 172.21.15.60:33138) 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7010b6640 1 -- 172.21.15.60:0/3166586311 learned_addr learned my addr 172.21.15.60:0/3166586311 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7018b7640 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 0x5613325f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7008b5640 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133257bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7010b6640 1 -- 172.21.15.60:0/3166586311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 msgr2=0x5613325f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7010b6640 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 0x5613325f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7010b6640 1 -- 172.21.15.60:0/3166586311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 msgr2=0x56133257bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7010b6640 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133257bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7010b6640 1 -- 172.21.15.60:0/3166586311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613325676c0 con 0x56133256a4a0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7008b5640 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133257bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7010b6640 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256a4a0 0x56133257b790 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x561332587bd0 tx=0x7ff6f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ba255146ea9acc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff6e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/3166586311 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f801fc90 con 0x56133256a4a0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/3166586311 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff6f8004020 con 0x56133256a4a0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.275+0000 7ff7056f3740 1 -- 172.21.15.60:0/3166586311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6f4028070 con 0x56133256a4a0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/3166586311 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff6f8037050 con 0x56133256a4a0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7056f3740 10 client.15570 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7056f3740 1 -- 172.21.15.60:0/3166586311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561332566860 con 0x56133256a4a0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/3166586311 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff6f4028070 con 0x56133256a4a0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/3166586311 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff6f801e420 con 0x56133256a4a0 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7056f3740 10 client.15570 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:03.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7056f3740 10 client.15570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7056f3740 20 client.15570 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7056f3740 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5613325f4b00 0x5613325f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7056f3740 4 client.15570 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7056f3740 1 -- 172.21.15.60:0/3166586311 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561332572a80 con 0x5613325f4b00 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.276+0000 7ff7008b5640 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5613325f4b00 0x5613325f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7008b5640 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5613325f4b00 0x5613325f6f20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a101e6508383da5 server_cookie=a89fe5e490df1bb5 in_seq=0 out_seq=0 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff6e4ff9640 10 client.15570 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff6e4ff9640 1 -- 172.21.15.60:0/3166586311 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561332572a80 con 0x5613325f4b00 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff6e4ff9640 10 client.15570 handle_command_reply: tid=0 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 client.15570 shutdown 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 -- 172.21.15.60:0/3166586311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256a4a0 msgr2=0x56133257b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256a4a0 0x56133257b790 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x561332587bd0 tx=0x7ff6f8004730 comp rx=0 tx=0).stop 2024-09-12T00:00:03.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 -- 172.21.15.60:0/3166586311 shutdown_connections 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5613325f4b00 0x5613325f6f20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561332575680 0x5613325f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff6e4ff9640 0 client.15570 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56133256adc0 0x56133257bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 --2- 172.21.15.60:0/3166586311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56133256a4a0 0x56133257b790 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.277+0000 7ff7056f3740 1 -- 172.21.15.60:0/3166586311 >> 172.21.15.60:0/3166586311 conn(0x561332566a30 msgr2=0x561332565350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff7056f3740 1 -- 172.21.15.60:0/3166586311 shutdown_connections 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff7056f3740 1 -- 172.21.15.60:0/3166586311 wait complete. 2024-09-12T00:00:03.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff7056f3740 20 client.15570 trim_cache size 0 max 16384 2024-09-12T00:00:03.286 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:00:03.286 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:00:03.286 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:00:03.286 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:00:03.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:02 smithi192 ceph-mon[35487]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:03.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:02 smithi192 ceph-mon[35487]: mgrmap e24: x(active, since 40s), standbys: z, y 2024-09-12T00:00:03.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff70331a640 1 -- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6e80a2e90 msgr2=0x7ff6e80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff70331a640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6e80a2e90 0x7ff6e80a5350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800bfd0 tx=0x7ff6f800b390 comp rx=0 tx=0).stop 2024-09-12T00:00:03.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff70331a640 1 -- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 msgr2=0x7ff6fc198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:03.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff70331a640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 0x7ff6fc198be0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec005940 tx=0x7ff6ec0042f0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff70331a640 1 -- 172.21.15.60:0/3019410620 shutdown_connections 2024-09-12T00:00:03.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.278+0000 7ff70331a640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff6e80a2e90 0x7ff6e80a5350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.279+0000 7ff70331a640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc108290 0x7ff6fc19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.279+0000 7ff70331a640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc103740 0x7ff6fc198be0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.279+0000 7ff70331a640 1 --2- 172.21.15.60:0/3019410620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6fc102d90 0x7ff6fc1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.279+0000 7ff70331a640 1 -- 172.21.15.60:0/3019410620 >> 172.21.15.60:0/3019410620 conn(0x7ff6fc0fc7d0 msgr2=0x7ff6fc106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.279+0000 7ff70331a640 1 -- 172.21.15.60:0/3019410620 shutdown_connections 2024-09-12T00:00:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:03.279+0000 7ff70331a640 1 -- 172.21.15.60:0/3019410620 wait complete. 2024-09-12T00:00:04.038 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:00:04.039 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:00:04.316 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:04.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 -- 172.21.15.60:0/771832961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990102d90 msgr2=0x7f0990103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:04.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 --2- 172.21.15.60:0/771832961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990102d90 0x7f0990103170 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f098c009930 tx=0x7f098c02a420 comp rx=0 tx=0).stop 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 -- 172.21.15.60:0/771832961 shutdown_connections 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 --2- 172.21.15.60:0/771832961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0990108290 0x7f099010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 --2- 172.21.15.60:0/771832961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990103740 0x7f0990107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 --2- 172.21.15.60:0/771832961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990102d90 0x7f0990103170 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 -- 172.21.15.60:0/771832961 >> 172.21.15.60:0/771832961 conn(0x7f09900fc7d0 msgr2=0x7f09900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 -- 172.21.15.60:0/771832961 shutdown_connections 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 -- 172.21.15.60:0/771832961 wait complete. 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 Processor -- start 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.840+0000 7f09972cb640 1 -- start start 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f09972cb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0990102d90 0x7f0990198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:04.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f09972cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990103740 0x7f0990198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f09972cb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990108290 0x7f099019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f09972cb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09901121b0 con 0x7f0990108290 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f09972cb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0990112030 con 0x7f0990103740 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f09972cb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0990112330 con 0x7f0990102d90 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990108290 0x7f099019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990108290 0x7f099019cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33154/0 (socket says 172.21.15.60:33154) 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 -- 172.21.15.60:0/2956448504 learned_addr learned my addr 172.21.15.60:0/2956448504 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0994866640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990103740 0x7f0990198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995067640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0990102d90 0x7f0990198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 -- 172.21.15.60:0/2956448504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0990102d90 msgr2=0x7f0990198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0990102d90 0x7f0990198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:04.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 -- 172.21.15.60:0/2956448504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990103740 msgr2=0x7f0990198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990103740 0x7f0990198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 -- 172.21.15.60:0/2956448504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099019d5e0 con 0x7f0990108290 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0994866640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990103740 0x7f0990198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.841+0000 7f0995868640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990108290 0x7f099019cf00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f098800cce0 tx=0x7f098800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.842+0000 7f09867fc640 1 -- 172.21.15.60:0/2956448504 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098800f450 con 0x7f0990108290 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.842+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099019d8d0 con 0x7f0990108290 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.842+0000 7f09867fc640 1 -- 172.21.15.60:0/2956448504 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f098800faf0 con 0x7f0990108290 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.842+0000 7f09867fc640 1 -- 172.21.15.60:0/2956448504 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988018cc0 con 0x7f0990108290 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.842+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09901a51b0 con 0x7f0990108290 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.843+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099006a7f0 con 0x7f0990108290 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.844+0000 7f09867fc640 1 -- 172.21.15.60:0/2956448504 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f098800f5f0 con 0x7f0990108290 2024-09-12T00:00:04.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.845+0000 7f09867fc640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f097c0a2e90 0x7f097c0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:04.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.845+0000 7f0995067640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f097c0a2e90 0x7f097c0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:04.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.845+0000 7f09867fc640 1 -- 172.21.15.60:0/2956448504 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f09880cfb50 con 0x7f0990108290 2024-09-12T00:00:04.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.846+0000 7f0995067640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f097c0a2e90 0x7f097c0a5350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f098c000c00 tx=0x7f098c005a20 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:04.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:04.849+0000 7f09867fc640 1 -- 172.21.15.60:0/2956448504 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0988014030 con 0x7f0990108290 2024-09-12T00:00:05.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:04 smithi060 ceph-mon[30953]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:00:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.095+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f099010a2a0 con 0x7f0990108290 2024-09-12T00:00:05.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.096+0000 7f09867fc640 1 -- 172.21.15.60:0/2956448504 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7f098809c570 con 0x7f0990108290 2024-09-12T00:00:05.096 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:00:05.096 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:00:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-12T00:00:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f097c0a2e90 msgr2=0x7f097c0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f097c0a2e90 0x7f097c0a5350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f098c000c00 tx=0x7f098c005a20 comp rx=0 tx=0).stop 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990108290 msgr2=0x7f099019cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990108290 0x7f099019cf00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f098800cce0 tx=0x7f098800a620 comp rx=0 tx=0).stop 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 shutdown_connections 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f097c0a2e90 0x7f097c0a5350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0990108290 0x7f099019cf00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0990103740 0x7f0990198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 --2- 172.21.15.60:0/2956448504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0990102d90 0x7f0990198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 >> 172.21.15.60:0/2956448504 conn(0x7f09900fc7d0 msgr2=0x7f0990106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.098+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 shutdown_connections 2024-09-12T00:00:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:05.099+0000 7f09972cb640 1 -- 172.21.15.60:0/2956448504 wait complete. 2024-09-12T00:00:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:04 smithi105 ceph-mon[34805]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:00:05.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:04 smithi192 ceph-mon[35487]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:00:06.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:05 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2956448504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:06.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:05 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2956448504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:06.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:05 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2956448504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:07.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:06 smithi060 ceph-mon[30953]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:00:07.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:06 smithi105 ceph-mon[34805]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:00:07.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:06 smithi192 ceph-mon[35487]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:00:07.775 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T00:00:07.776 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:00:08.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:00:08.852 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:09.074 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:08 smithi060 ceph-mon[30953]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:00:09.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:08 smithi105 ceph-mon[34805]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:00:09.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:08 smithi192 ceph-mon[35487]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:00:09.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 -- 172.21.15.60:0/1127593267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102570 msgr2=0x7f2a281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:09.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/1127593267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102570 0x7f2a281029b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009900 tx=0x7f2a1402a480 comp rx=0 tx=0).stop 2024-09-12T00:00:09.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 -- 172.21.15.60:0/1127593267 shutdown_connections 2024-09-12T00:00:09.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/1127593267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a28102ef0 0x7f2a2810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/1127593267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102570 0x7f2a281029b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/1127593267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a28100e20 0x7f2a28101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 -- 172.21.15.60:0/1127593267 >> 172.21.15.60:0/1127593267 conn(0x7f2a280fc7d0 msgr2=0x7f2a280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 -- 172.21.15.60:0/1127593267 shutdown_connections 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 -- 172.21.15.60:0/1127593267 wait complete. 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.442+0000 7f2a2ef71640 1 Processor -- start 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2ef71640 1 -- start start 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2ef71640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a28100e20 0x7f2a28199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2ef71640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a28102570 0x7f2a28199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2ef71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102ef0 0x7f2a281a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:09.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2ef71640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a281110a0 con 0x7f2a28102ef0 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2ef71640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28110f20 con 0x7f2a28102570 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2ef71640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28111220 con 0x7f2a28100e20 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2d50e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102ef0 0x7f2a281a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2d50e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102ef0 0x7f2a281a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33172/0 (socket says 172.21.15.60:33172) 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2d50e640 1 -- 172.21.15.60:0/34439686 learned_addr learned my addr 172.21.15.60:0/34439686 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2cd0d640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a28100e20 0x7f2a28199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a27fff640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a28102570 0x7f2a28199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2d50e640 1 -- 172.21.15.60:0/34439686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a28100e20 msgr2=0x7f2a28199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2d50e640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a28100e20 0x7f2a28199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2d50e640 1 -- 172.21.15.60:0/34439686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a28102570 msgr2=0x7f2a28199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2d50e640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a28102570 0x7f2a28199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.443+0000 7f2a2d50e640 1 -- 172.21.15.60:0/34439686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a281a49f0 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.444+0000 7f2a2d50e640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102ef0 0x7f2a281a44b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000eaa0 tx=0x7f2a2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.444+0000 7f2a25ffb640 1 -- 172.21.15.60:0/34439686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000cdb0 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.444+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a281a4bc0 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.444+0000 7f2a25ffb640 1 -- 172.21.15.60:0/34439686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2a20004b20 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.444+0000 7f2a25ffb640 1 -- 172.21.15.60:0/34439686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a20011760 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.444+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a281a50d0 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.445+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a28101200 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.448+0000 7f2a25ffb640 1 -- 172.21.15.60:0/34439686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f2a20011900 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.448+0000 7f2a25ffb640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2a180a2e90 0x7f2a180a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.448+0000 7f2a25ffb640 1 -- 172.21.15.60:0/34439686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2a200cfad0 con 0x7f2a28102ef0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.449+0000 7f2a2cd0d640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2a180a2e90 0x7f2a180a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.449+0000 7f2a2cd0d640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2a180a2e90 0x7f2a180a5350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009bd0 tx=0x7f2a1c005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:09.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.452+0000 7f2a25ffb640 1 -- 172.21.15.60:0/34439686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a20016030 con 0x7f2a28102ef0 2024-09-12T00:00:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:09.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.688+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a2806a560 con 0x7f2a28102ef0 2024-09-12T00:00:09.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.689+0000 7f2a25ffb640 1 -- 172.21.15.60:0/34439686 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7f2a2806a560 con 0x7f2a28102ef0 2024-09-12T00:00:09.690 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:00:09.691 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:00:09.691 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-12T00:00:09.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2a180a2e90 msgr2=0x7f2a180a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:09.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2a180a2e90 0x7f2a180a5350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009bd0 tx=0x7f2a1c005f90 comp rx=0 tx=0).stop 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102ef0 msgr2=0x7f2a281a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102ef0 0x7f2a281a44b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000eaa0 tx=0x7f2a2000ef60 comp rx=0 tx=0).stop 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 shutdown_connections 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2a180a2e90 0x7f2a180a5350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a28102ef0 0x7f2a281a44b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a28102570 0x7f2a28199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 --2- 172.21.15.60:0/34439686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a28100e20 0x7f2a28199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 >> 172.21.15.60:0/34439686 conn(0x7f2a280fc7d0 msgr2=0x7f2a28106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 shutdown_connections 2024-09-12T00:00:09.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:09.692+0000 7f2a2ef71640 1 -- 172.21.15.60:0/34439686 wait complete. 2024-09-12T00:00:10.196 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:09 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/34439686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:10.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:09 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/34439686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:10.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:09 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/34439686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:10.537 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24496 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T00:00:10.537 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24496 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T00:00:10.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.733+0000 7f95c5e7a640 1 -- 172.21.15.60:0/2338123563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c01082a0 msgr2=0x7f95c010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.733+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/2338123563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c01082a0 0x7f95c010ec40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009cd0 tx=0x7f95b802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.733+0000 7f95c5e7a640 1 -- 172.21.15.60:0/2338123563 shutdown_connections 2024-09-12T00:00:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.733+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/2338123563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c01082a0 0x7f95c010ec40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.733+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/2338123563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95c01036e0 0x7f95c0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.733+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/2338123563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c0102d30 0x7f95c0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.733+0000 7f95c5e7a640 1 -- 172.21.15.60:0/2338123563 >> 172.21.15.60:0/2338123563 conn(0x7f95c00fc7d0 msgr2=0x7f95c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.733+0000 7f95c5e7a640 1 -- 172.21.15.60:0/2338123563 shutdown_connections 2024-09-12T00:00:10.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.734+0000 7f95c5e7a640 1 -- 172.21.15.60:0/2338123563 wait complete. 2024-09-12T00:00:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.734+0000 7f95c5e7a640 1 Processor -- start 2024-09-12T00:00:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95c5e7a640 1 -- start start 2024-09-12T00:00:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95c5e7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c0102d30 0x7f95c0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95c5e7a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c01036e0 0x7f95c0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95c5e7a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95c01082a0 0x7f95c0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95c5e7a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01121c0 con 0x7f95c0102d30 2024-09-12T00:00:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95c5e7a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0112040 con 0x7f95c01036e0 2024-09-12T00:00:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95c5e7a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0112340 con 0x7f95c01082a0 2024-09-12T00:00:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c0102d30 0x7f95c0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c0102d30 0x7f95c0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33200/0 (socket says 172.21.15.60:33200) 2024-09-12T00:00:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95bf7fe640 1 -- 172.21.15.60:0/1280675176 learned_addr learned my addr 172.21.15.60:0/1280675176 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:10.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95beffd640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c01036e0 0x7f95c0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.735+0000 7f95bffff640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95c01082a0 0x7f95c0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bf7fe640 1 -- 172.21.15.60:0/1280675176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95c01082a0 msgr2=0x7f95c0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95c01082a0 0x7f95c0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bf7fe640 1 -- 172.21.15.60:0/1280675176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c01036e0 msgr2=0x7f95c0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c01036e0 0x7f95c0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bf7fe640 1 -- 172.21.15.60:0/1280675176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c01a6b00 con 0x7f95c0102d30 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bffff640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95c01082a0 0x7f95c0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c0102d30 0x7f95c0100990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f95b000d950 tx=0x7f95b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bcff9640 1 -- 172.21.15.60:0/1280675176 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0017070 con 0x7f95c0102d30 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95c5e7a640 1 -- 172.21.15.60:0/1280675176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c01a6df0 con 0x7f95c0102d30 2024-09-12T00:00:10.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.736+0000 7f95bcff9640 1 -- 172.21.15.60:0/1280675176 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95b0009c30 con 0x7f95c0102d30 2024-09-12T00:00:10.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.737+0000 7f95bcff9640 1 -- 172.21.15.60:0/1280675176 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b000f740 con 0x7f95c0102d30 2024-09-12T00:00:10.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.737+0000 7f95c5e7a640 1 -- 172.21.15.60:0/1280675176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c01a72a0 con 0x7f95c0102d30 2024-09-12T00:00:10.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.740+0000 7f95bcff9640 1 -- 172.21.15.60:0/1280675176 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f95b0010a80 con 0x7f95c0102d30 2024-09-12T00:00:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.740+0000 7f95c8253740 1 Processor -- start 2024-09-12T00:00:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.740+0000 7f95c8253740 1 -- start start 2024-09-12T00:00:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95c8253740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ee4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95c8253740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7ee4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95c8253740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eef370 0x55b4f7ef1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95c8253740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b4f7e4a2f0 con 0x55b4f7ee45d0 2024-09-12T00:00:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95c8253740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b4f7df1cf0 con 0x55b4f7eef370 2024-09-12T00:00:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95c8253740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b4f7e462b0 con 0x55b4f7ee5b40 2024-09-12T00:00:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95bffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ee4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95bffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ee4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41272/0 (socket says 172.21.15.60:41272) 2024-09-12T00:00:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95bffff640 1 -- 172.21.15.60:0/2280548374 learned_addr learned my addr 172.21.15.60:0/2280548374 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7ee4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.741+0000 7f95beffd640 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eef370 0x55b4f7ef1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95bcff9640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95a80a2e50 0x7f95a80a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95bffff640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95a80a2e50 0x7f95a80a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95beffd640 1 -- 172.21.15.60:0/2280548374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 msgr2=0x55b4f7ee4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:10.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95beffd640 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ee4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95beffd640 1 -- 172.21.15.60:0/2280548374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 msgr2=0x55b4f7ee4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95beffd640 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7ee4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95beffd640 1 -- 172.21.15.60:0/2280548374 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4f7dd63a0 con 0x55b4f7eef370 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7ee4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.742+0000 7f95bcff9640 1 -- 172.21.15.60:0/1280675176 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f95b00cf630 con 0x7f95c0102d30 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.743+0000 7f95beffd640 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eef370 0x55b4f7ef1760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f95b4005d00 tx=0x7f95b40107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d61201f5185200c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.743+0000 7f95bffff640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95a80a2e50 0x7f95a80a5310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009a60 tx=0x7f95b80099f0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.743+0000 7f95a5ffb640 1 -- 172.21.15.60:0/2280548374 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b401c480 con 0x55b4f7eef370 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.743+0000 7f95a5ffb640 1 -- 172.21.15.60:0/2280548374 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95b401cb20 con 0x55b4f7eef370 2024-09-12T00:00:10.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.743+0000 7f95a5ffb640 1 -- 172.21.15.60:0/2280548374 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4011aa0 con 0x55b4f7eef370 2024-09-12T00:00:10.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 -- 172.21.15.60:0/2280548374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eef370 msgr2=0x55b4f7ef1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eef370 0x55b4f7ef1760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f95b4005d00 tx=0x7f95b40107a0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 -- 172.21.15.60:0/2280548374 shutdown_connections 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eef370 0x55b4f7ef1760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7ee4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 --2- 172.21.15.60:0/2280548374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ee4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 -- 172.21.15.60:0/2280548374 >> 172.21.15.60:0/2280548374 conn(0x55b4f7ead310 msgr2=0x55b4f7ee0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 -- 172.21.15.60:0/2280548374 shutdown_connections 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 -- 172.21.15.60:0/2280548374 wait complete. 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.744+0000 7f95c8253740 1 -- start start 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95c8253740 1 Processor -- start 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95c8253740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7eeece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95c8253740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7eebf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95c8253740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eef370 0x55b4f7eec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95c8253740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b4f7ef2070 con 0x55b4f7ee45d0 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95c8253740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b4f7e05060 con 0x55b4f7ee5b40 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95c8253740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b4f7ef21f0 con 0x55b4f7eef370 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95c8253740 10 client.0 _ll_register_callbacks cb 0x55b4f7b588c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7eeece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7eeece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33218/0 (socket says 172.21.15.60:33218) 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95bf7fe640 1 -- 172.21.15.60:0/1397610648 learned_addr learned my addr 172.21.15.60:0/1397610648 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f95bffff640 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eef370 0x55b4f7eec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.745+0000 7f95beffd640 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7eebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f95bf7fe640 1 -- 172.21.15.60:0/1397610648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eef370 msgr2=0x55b4f7eec4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eef370 0x55b4f7eec4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f95bf7fe640 1 -- 172.21.15.60:0/1397610648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 msgr2=0x55b4f7eebf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7eebf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f95bf7fe640 1 -- 172.21.15.60:0/1397610648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4f7bbb3c0 con 0x55b4f7ee45d0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7eeece0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f95b00cd3d0 tx=0x7f95b0097bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2d9a8af147a0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f959effd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f959effd640 1 -- 172.21.15.60:0/1397610648 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0020030 con 0x55b4f7ee45d0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.746+0000 7f95c8253740 1 -- 172.21.15.60:0/1397610648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95b401cb20 con 0x55b4f7ee45d0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.747+0000 7f959effd640 1 -- 172.21.15.60:0/1397610648 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f95b00862e0 con 0x55b4f7ee45d0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.747+0000 7f959effd640 1 -- 172.21.15.60:0/1397610648 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f95b009b490 con 0x55b4f7ee45d0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.747+0000 7f95c8253740 10 client.15594 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.747+0000 7f95c8253740 1 -- 172.21.15.60:0/1397610648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b4f7f06340 con 0x55b4f7ee45d0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.747+0000 7f959effd640 1 -- 172.21.15.60:0/1397610648 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95b401cb20 con 0x55b4f7ee45d0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.747+0000 7f959effd640 1 -- 172.21.15.60:0/1397610648 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f95b00a4130 con 0x55b4f7ee45d0 2024-09-12T00:00:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.748+0000 7f95c8253740 10 client.15594 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.748+0000 7f95c8253740 10 client.15594 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:00:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.748+0000 7f95c8253740 20 client.15594 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.748+0000 7f95c8253740 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b4f7f07800 0x55b4f7f09bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.748+0000 7f95c8253740 4 client.15594 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.748+0000 7f95c8253740 1 -- 172.21.15.60:0/1397610648 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4f7e57860 con 0x55b4f7f07800 2024-09-12T00:00:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.748+0000 7f95beffd640 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b4f7f07800 0x55b4f7f09bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.749+0000 7f959effd640 10 client.15594 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:00:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.749+0000 7f95beffd640 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b4f7f07800 0x55b4f7f09bf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b9fd2913cf35e7c0 server_cookie=8cc7557b325f0280 in_seq=0 out_seq=0 2024-09-12T00:00:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f959effd640 1 -- 172.21.15.60:0/1397610648 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4f7e57860 con 0x55b4f7f07800 2024-09-12T00:00:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f959effd640 10 client.15594 handle_command_reply: tid=0 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 client.15594 shutdown 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 -- 172.21.15.60:0/1397610648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 msgr2=0x55b4f7eeece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7eeece0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f95b00cd3d0 tx=0x7f95b0097bf0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 -- 172.21.15.60:0/1397610648 shutdown_connections 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eef370 0x55b4f7eec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b4f7f07800 0x55b4f7f09bf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f959effd640 0 client.15594 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7eebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 --2- 172.21.15.60:0/1397610648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7ee45d0 0x55b4f7eeece0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.750+0000 7f95c8253740 1 -- 172.21.15.60:0/1397610648 >> 172.21.15.60:0/1397610648 conn(0x55b4f7ead310 msgr2=0x55b4f7ee6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.751+0000 7f95c8253740 1 -- 172.21.15.60:0/1397610648 shutdown_connections 2024-09-12T00:00:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.751+0000 7f95c8253740 1 -- 172.21.15.60:0/1397610648 wait complete. 2024-09-12T00:00:10.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.751+0000 7f95c8253740 20 client.15594 trim_cache size 0 max 16384 2024-09-12T00:00:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.766+0000 7f95c8253740 1 Processor -- start 2024-09-12T00:00:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.766+0000 7f95c8253740 1 -- start start 2024-09-12T00:00:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95c8253740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7efb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95c8253740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7f0f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95c8253740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eeaf70 0x55b4f7f0f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95c8253740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01ab6d0 con 0x55b4f7eef370 2024-09-12T00:00:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95c8253740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01ad210 con 0x55b4f7ee5b40 2024-09-12T00:00:10.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95c8253740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01abda0 con 0x55b4f7eeaf70 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95beffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7f0f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95bffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eeaf70 0x55b4f7f0f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95beffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7f0f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33220/0 (socket says 172.21.15.60:33220) 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95bffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eeaf70 0x55b4f7f0f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41296/0 (socket says 172.21.15.60:41296) 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95beffd640 1 -- 172.21.15.60:0/3642157860 learned_addr learned my addr 172.21.15.60:0/3642157860 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.767+0000 7f95bf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7efb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.768+0000 7f95beffd640 1 -- 172.21.15.60:0/3642157860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eeaf70 msgr2=0x55b4f7f0f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.768+0000 7f95beffd640 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eeaf70 0x55b4f7f0f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.768+0000 7f95beffd640 1 -- 172.21.15.60:0/3642157860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 msgr2=0x55b4f7efb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.768+0000 7f95beffd640 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7efb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.768+0000 7f95beffd640 1 -- 172.21.15.60:0/3642157860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4f7f0a220 con 0x55b4f7eef370 2024-09-12T00:00:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.768+0000 7f95bffff640 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eeaf70 0x55b4f7f0f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.768+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7efb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.768+0000 7f95beffd640 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7f0f450 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f95b4011010 tx=0x7f95b400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220fe17ff8fc553d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.769+0000 7f95a57fa640 1 -- 172.21.15.60:0/3642157860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b402c070 con 0x55b4f7eef370 2024-09-12T00:00:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.769+0000 7f95a57fa640 1 -- 172.21.15.60:0/3642157860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95b401c480 con 0x55b4f7eef370 2024-09-12T00:00:10.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.769+0000 7f95a57fa640 1 -- 172.21.15.60:0/3642157860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40048c0 con 0x55b4f7eef370 2024-09-12T00:00:10.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.769+0000 7f95c8253740 1 -- 172.21.15.60:0/3642157860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 msgr2=0x55b4f7f0f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.769+0000 7f95c8253740 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7f0f450 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f95b4011010 tx=0x7f95b400b480 comp rx=0 tx=0).stop 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.770+0000 7f95c8253740 1 -- 172.21.15.60:0/3642157860 shutdown_connections 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.770+0000 7f95c8253740 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7eeaf70 0x55b4f7f0f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.770+0000 7f95c8253740 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7f0f450 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.770+0000 7f95c8253740 1 --2- 172.21.15.60:0/3642157860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7ee5b40 0x55b4f7efb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.770+0000 7f95c8253740 1 -- 172.21.15.60:0/3642157860 >> 172.21.15.60:0/3642157860 conn(0x55b4f7ead310 msgr2=0x55b4f7eea860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.770+0000 7f95c8253740 1 -- 172.21.15.60:0/3642157860 shutdown_connections 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.770+0000 7f95c8253740 1 -- 172.21.15.60:0/3642157860 wait complete. 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.770+0000 7f95c8253740 1 -- start start 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95c8253740 1 Processor -- start 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95c8253740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ef7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95c8253740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eeaf70 0x55b4f7ef79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95c8253740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7ef4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95c8253740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01acb40 con 0x55b4f7eef370 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95c8253740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01ac470 con 0x55b4f7eeaf70 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95c8253740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01a96d0 con 0x55b4f7ee5b40 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95c8253740 10 client.0 _ll_register_callbacks cb 0x7f95b00d5200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95beffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eeaf70 0x55b4f7ef79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95bf7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ef7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95bffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7ef4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95beffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eeaf70 0x55b4f7ef79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:52744/0 (socket says 172.21.15.60:52744) 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.771+0000 7f95beffd640 1 -- 172.21.15.60:0/3772786874 learned_addr learned my addr 172.21.15.60:0/3772786874 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f95beffd640 1 -- 172.21.15.60:0/3772786874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 msgr2=0x55b4f7ef7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f95beffd640 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ef7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f95beffd640 1 -- 172.21.15.60:0/3772786874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 msgr2=0x55b4f7ef4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f95beffd640 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7ef4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f95beffd640 1 -- 172.21.15.60:0/3772786874 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4f7ee1960 con 0x55b4f7eeaf70 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f95beffd640 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eeaf70 0x55b4f7ef79c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95b4000c00 tx=0x7f95b4010df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eeb530ebb88cbd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f959effd640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f959effd640 1 -- 172.21.15.60:0/3772786874 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b402c070 con 0x55b4f7eeaf70 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f959effd640 1 -- 172.21.15.60:0/3772786874 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f95b401ca40 con 0x55b4f7eeaf70 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.772+0000 7f95c8253740 1 -- 172.21.15.60:0/3772786874 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95b401c480 con 0x55b4f7eeaf70 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.773+0000 7f959effd640 1 -- 172.21.15.60:0/3772786874 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f95b4004020 con 0x55b4f7eeaf70 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.773+0000 7f95c8253740 10 client.25199 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:10.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.773+0000 7f95c8253740 1 -- 172.21.15.60:0/3772786874 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b4f7f72b10 con 0x55b4f7eeaf70 2024-09-12T00:00:10.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.773+0000 7f959effd640 1 -- 172.21.15.60:0/3772786874 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95b401c480 con 0x55b4f7eeaf70 2024-09-12T00:00:10.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.774+0000 7f959effd640 1 -- 172.21.15.60:0/3772786874 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f95b4004800 con 0x55b4f7eeaf70 2024-09-12T00:00:10.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.774+0000 7f95c8253740 10 client.25199 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:10.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.774+0000 7f95c8253740 10 client.25199 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:00:10.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.774+0000 7f95c8253740 20 client.25199 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:10.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.774+0000 7f95c8253740 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b4f7f73060 0x55b4f7f75480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.774+0000 7f95c8253740 4 client.25199 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.774+0000 7f95c8253740 1 -- 172.21.15.60:0/3772786874 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b4f7e51d70 con 0x55b4f7f73060 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.774+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b4f7f73060 0x55b4f7f75480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95bf7fe640 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b4f7f73060 0x55b4f7f75480 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b5a23b24052b4be8 server_cookie=ba35796b3099e7c5 in_seq=0 out_seq=0 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f959effd640 10 client.25199 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f959effd640 1 -- 172.21.15.60:0/3772786874 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b4f7e51d70 con 0x55b4f7f73060 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f959effd640 10 client.25199 handle_command_reply: tid=0 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 client.25199 shutdown 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 -- 172.21.15.60:0/3772786874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eeaf70 msgr2=0x55b4f7ef79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eeaf70 0x55b4f7ef79c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95b4000c00 tx=0x7f95b4010df0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 -- 172.21.15.60:0/3772786874 shutdown_connections 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b4f7eef370 0x55b4f7ef4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b4f7f73060 0x55b4f7f75480 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b4f7eeaf70 0x55b4f7ef79c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 --2- 172.21.15.60:0/3772786874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b4f7ee5b40 0x55b4f7ef7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.775+0000 7f95c8253740 1 -- 172.21.15.60:0/3772786874 >> 172.21.15.60:0/3772786874 conn(0x55b4f7ead310 msgr2=0x55b4f7ee6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.776+0000 7f959effd640 0 client.25199 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:00:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.776+0000 7f95c8253740 1 -- 172.21.15.60:0/3772786874 shutdown_connections 2024-09-12T00:00:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.776+0000 7f95c8253740 1 -- 172.21.15.60:0/3772786874 wait complete. 2024-09-12T00:00:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.776+0000 7f95c8253740 20 client.25199 trim_cache size 0 max 16384 2024-09-12T00:00:10.780 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.776+0000 7f95c5e7a640 1 -- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95a80a2e50 msgr2=0x7f95a80a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.776+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95a80a2e50 0x7f95a80a5310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009a60 tx=0x7f95b80099f0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.776+0000 7f95c5e7a640 1 -- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c0102d30 msgr2=0x7f95c0100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.776+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c0102d30 0x7f95c0100990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f95b000d950 tx=0x7f95b000de10 comp rx=0 tx=0).stop 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.777+0000 7f95c5e7a640 1 -- 172.21.15.60:0/1280675176 shutdown_connections 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.777+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95a80a2e50 0x7f95a80a5310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.777+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95c01082a0 0x7f95c0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.777+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c01036e0 0x7f95c0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.777+0000 7f95c5e7a640 1 --2- 172.21.15.60:0/1280675176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95c0102d30 0x7f95c0100990 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.777+0000 7f95c5e7a640 1 -- 172.21.15.60:0/1280675176 >> 172.21.15.60:0/1280675176 conn(0x7f95c00fc7d0 msgr2=0x7f95c00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.777+0000 7f95c5e7a640 1 -- 172.21.15.60:0/1280675176 shutdown_connections 2024-09-12T00:00:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:10.777+0000 7f95c5e7a640 1 -- 172.21.15.60:0/1280675176 wait complete. 2024-09-12T00:00:11.064 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:11.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:10 smithi060 ceph-mon[30953]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T00:00:11.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:10 smithi105 ceph-mon[34805]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T00:00:11.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:10 smithi192 ceph-mon[35487]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T00:00:11.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:00:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 -- 172.21.15.60:0/4257360647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 msgr2=0x7ff4641021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 --2- 172.21.15.60:0/4257360647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 0x7ff4641021d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff454009900 tx=0x7ff45402a3f0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 -- 172.21.15.60:0/4257360647 shutdown_connections 2024-09-12T00:00:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 --2- 172.21.15.60:0/4257360647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff464106f20 0x7ff46410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 --2- 172.21.15.60:0/4257360647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4641027a0 0x7ff4641067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 --2- 172.21.15.60:0/4257360647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 0x7ff4641021d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 -- 172.21.15.60:0/4257360647 >> 172.21.15.60:0/4257360647 conn(0x7ff4640fd8f0 msgr2=0x7ff4640ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 -- 172.21.15.60:0/4257360647 shutdown_connections 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.096+0000 7ff469d4f640 1 -- 172.21.15.60:0/4257360647 wait complete. 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff469d4f640 1 Processor -- start 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff469d4f640 1 -- start start 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff469d4f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 0x7ff4640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff469d4f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4641027a0 0x7ff464074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff469d4f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff464106f20 0x7ff464074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff469d4f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641120a0 con 0x7ff464101df0 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff469d4f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff464111f20 con 0x7ff4641027a0 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff469d4f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff464112220 con 0x7ff464106f20 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 0x7ff4640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 0x7ff4640744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34274/0 (socket says 172.21.15.60:34274) 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff4637fe640 1 -- 172.21.15.60:0/2383866103 learned_addr learned my addr 172.21.15.60:0/2383866103 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff462ffd640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4641027a0 0x7ff464074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.097+0000 7ff463fff640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff464106f20 0x7ff464074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff4637fe640 1 -- 172.21.15.60:0/2383866103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff464106f20 msgr2=0x7ff464074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff4637fe640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff464106f20 0x7ff464074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff4637fe640 1 -- 172.21.15.60:0/2383866103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4641027a0 msgr2=0x7ff464074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff4637fe640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4641027a0 0x7ff464074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff4637fe640 1 -- 172.21.15.60:0/2383866103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4641a68e0 con 0x7ff464101df0 2024-09-12T00:00:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff4637fe640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 0x7ff4640744f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff454006010 tx=0x7ff4540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff460ff9640 1 -- 172.21.15.60:0/2383866103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45403f030 con 0x7ff464101df0 2024-09-12T00:00:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff469d4f640 1 -- 172.21.15.60:0/2383866103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4641a6b70 con 0x7ff464101df0 2024-09-12T00:00:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff460ff9640 1 -- 172.21.15.60:0/2383866103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff454003d00 con 0x7ff464101df0 2024-09-12T00:00:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff460ff9640 1 -- 172.21.15.60:0/2383866103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454035070 con 0x7ff464101df0 2024-09-12T00:00:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.098+0000 7ff469d4f640 1 -- 172.21.15.60:0/2383866103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4641a70a0 con 0x7ff464101df0 2024-09-12T00:00:12.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.101+0000 7ff460ff9640 1 -- 172.21.15.60:0/2383866103 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7ff454042030 con 0x7ff464101df0 2024-09-12T00:00:12.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.101+0000 7ff46c128740 1 Processor -- start 2024-09-12T00:00:12.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.101+0000 7ff46c128740 1 -- start start 2024-09-12T00:00:12.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff460ff9640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff44c0a2e10 0x7ff44c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff46c128740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff46c128740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be4657400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff46c128740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be4659d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff46c128740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558be45b22a0 con 0x558be464c760 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff46c128740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558be4559b10 con 0x558be4657940 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff46c128740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558be45ae260 con 0x558be464d080 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff463fff640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff44c0a2e10 0x7ff44c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34280/0 (socket says 172.21.15.60:34280) 2024-09-12T00:00:12.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff4637fe640 1 -- 172.21.15.60:0/691116316 learned_addr learned my addr 172.21.15.60:0/691116316 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff460ff9640 1 -- 172.21.15.60:0/2383866103 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff4540efb60 con 0x7ff464101df0 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff462ffd640 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be4657400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.102+0000 7ff463fff640 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be4659d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff4637fe640 1 -- 172.21.15.60:0/691116316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 msgr2=0x558be4657400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff4637fe640 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be4657400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff4637fe640 1 -- 172.21.15.60:0/691116316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 msgr2=0x558be4659d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff4637fe640 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be4659d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff4637fe640 1 -- 172.21.15.60:0/691116316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be4323b90 con 0x558be464c760 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff462ffd640 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be4657400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff463fff640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff44c0a2e10 0x7ff44c0a52d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0136d0 tx=0x7ff45c013ad0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff4637fe640 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464cb40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff454005ab0 tx=0x7ff45403b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4217999f2ea5e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff449ffb640 1 -- 172.21.15.60:0/691116316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454049040 con 0x558be464c760 2024-09-12T00:00:12.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff449ffb640 1 -- 172.21.15.60:0/691116316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4540bc650 con 0x558be464c760 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.103+0000 7ff449ffb640 1 -- 172.21.15.60:0/691116316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4540c1810 con 0x558be464c760 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 -- 172.21.15.60:0/691116316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 msgr2=0x558be464cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464cb40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff454005ab0 tx=0x7ff45403b790 comp rx=0 tx=0).stop 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 -- 172.21.15.60:0/691116316 shutdown_connections 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be4659d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be4657400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 --2- 172.21.15.60:0/691116316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464cb40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 -- 172.21.15.60:0/691116316 >> 172.21.15.60:0/691116316 conn(0x558be4648cf0 msgr2=0x558be46490d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 -- 172.21.15.60:0/691116316 shutdown_connections 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 -- 172.21.15.60:0/691116316 wait complete. 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.105+0000 7ff46c128740 1 -- start start 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff46c128740 1 Processor -- start 2024-09-12T00:00:12.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff46c128740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464c760 0x558be4654880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff46c128740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464d080 0x558be4654dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff46c128740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be4655300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464d080 0x558be4654dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff46c128740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558be465a2d0 con 0x558be464d080 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464d080 0x558be4654dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34294/0 (socket says 172.21.15.60:34294) 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff462ffd640 1 -- 172.21.15.60:0/148973471 learned_addr learned my addr 172.21.15.60:0/148973471 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558be453a6e0 con 0x558be4657940 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558be465a450 con 0x558be464c760 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff46c128740 10 client.0 _ll_register_callbacks cb 0x558be455ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff463fff640 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be4655300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.106+0000 7ff4637fe640 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464c760 0x558be4654880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff462ffd640 1 -- 172.21.15.60:0/148973471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464c760 msgr2=0x558be4654880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:12.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff462ffd640 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464c760 0x558be4654880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff462ffd640 1 -- 172.21.15.60:0/148973471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 msgr2=0x558be4655300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:12.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff462ffd640 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be4655300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff462ffd640 1 -- 172.21.15.60:0/148973471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be4663780 con 0x558be464d080 2024-09-12T00:00:12.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff462ffd640 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464d080 0x558be4654dc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff458010a80 tx=0x7ff458010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ac932dbb337149 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:12.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff442ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:12.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff442ffd640 1 -- 172.21.15.60:0/148973471 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45800fbd0 con 0x558be464d080 2024-09-12T00:00:12.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff442ffd640 1 -- 172.21.15.60:0/148973471 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff45800fd70 con 0x558be464d080 2024-09-12T00:00:12.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4540bc650 con 0x558be464d080 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff442ffd640 1 -- 172.21.15.60:0/148973471 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff458005020 con 0x558be464d080 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff46c128740 10 client.15612 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.107+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558be4666150 con 0x558be464d080 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff442ffd640 1 -- 172.21.15.60:0/148973471 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4580047a0 con 0x558be464d080 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff442ffd640 1 -- 172.21.15.60:0/148973471 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff458022540 con 0x558be464d080 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff46c128740 10 client.15612 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff46c128740 10 client.15612 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff46c128740 20 client.15612 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff46c128740 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558be46676b0 0x558be4669aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff46c128740 4 client.15612 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff4540bc650 con 0x558be46676b0 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.108+0000 7ff4637fe640 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558be46676b0 0x558be4669aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.109+0000 7ff4637fe640 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558be46676b0 0x558be4669aa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebba54e57d51bec6 server_cookie=269f7cd246fa359e in_seq=0 out_seq=0 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.109+0000 7ff442ffd640 10 client.15612 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff442ffd640 1 -- 172.21.15.60:0/148973471 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff4540bc650 con 0x558be46676b0 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff442ffd640 10 client.15612 handle_command_reply: tid=0 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 client.15612 shutdown 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464d080 msgr2=0x558be4654dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464d080 0x558be4654dc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff458010a80 tx=0x7ff458010f40 comp rx=0 tx=0).stop 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 shutdown_connections 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558be46676b0 0x558be4669aa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be4655300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464d080 0x558be4654dc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 --2- 172.21.15.60:0/148973471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464c760 0x558be4654880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 >> 172.21.15.60:0/148973471 conn(0x558be4648cf0 msgr2=0x558be4647e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:12.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff442ffd640 0 client.15612 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 shutdown_connections 2024-09-12T00:00:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 1 -- 172.21.15.60:0/148973471 wait complete. 2024-09-12T00:00:12.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.110+0000 7ff46c128740 20 client.15612 trim_cache size 0 max 16384 2024-09-12T00:00:12.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff46c128740 1 Processor -- start 2024-09-12T00:00:12.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff46c128740 1 -- start start 2024-09-12T00:00:12.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff46c128740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff46c128740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be464d080 0x558be466f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff46c128740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be4657940 0x558be466f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff46c128740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641af9f0 con 0x558be464c760 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff46c128740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b1530 con 0x558be464d080 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff46c128740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b00c0 con 0x558be4657940 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34308/0 (socket says 172.21.15.60:34308) 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.128+0000 7ff4637fe640 1 -- 172.21.15.60:0/2190080085 learned_addr learned my addr 172.21.15.60:0/2190080085 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff462ffd640 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be464d080 0x558be466f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4637fe640 1 -- 172.21.15.60:0/2190080085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be4657940 msgr2=0x558be466f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff463fff640 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be4657940 0x558be466f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4637fe640 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be4657940 0x558be466f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4637fe640 1 -- 172.21.15.60:0/2190080085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be464d080 msgr2=0x558be466f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4637fe640 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be464d080 0x558be466f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4637fe640 1 -- 172.21.15.60:0/2190080085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be4652dd0 con 0x558be464c760 2024-09-12T00:00:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff462ffd640 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be464d080 0x558be466f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff463fff640 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be4657940 0x558be466f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:00:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4637fe640 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464f1c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff454005ec0 tx=0x7ff4540dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b01d7cdfff891f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4497fa640 1 -- 172.21.15.60:0/2190080085 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4540da070 con 0x558be464c760 2024-09-12T00:00:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4497fa640 1 -- 172.21.15.60:0/2190080085 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4540a5240 con 0x558be464c760 2024-09-12T00:00:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.129+0000 7ff4497fa640 1 -- 172.21.15.60:0/2190080085 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4540d4070 con 0x558be464c760 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 -- 172.21.15.60:0/2190080085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 msgr2=0x558be464f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464f1c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff454005ec0 tx=0x7ff4540dc040 comp rx=0 tx=0).stop 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 -- 172.21.15.60:0/2190080085 shutdown_connections 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be4657940 0x558be466f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be464d080 0x558be466f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 --2- 172.21.15.60:0/2190080085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be464f1c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 -- 172.21.15.60:0/2190080085 >> 172.21.15.60:0/2190080085 conn(0x558be4648cf0 msgr2=0x558be4656900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 -- 172.21.15.60:0/2190080085 shutdown_connections 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.130+0000 7ff46c128740 1 -- 172.21.15.60:0/2190080085 wait complete. 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 1 -- start start 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 1 Processor -- start 2024-09-12T00:00:12.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be465b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be465b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be465bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b0e60 con 0x558be464c760 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641b0790 con 0x558be4657940 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641ad9d0 con 0x558be464d080 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff46c128740 10 client.0 _ll_register_callbacks cb 0x7ff458010660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.131+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be465b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be465b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34320/0 (socket says 172.21.15.60:34320) 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff4637fe640 1 -- 172.21.15.60:0/3609654267 learned_addr learned my addr 172.21.15.60:0/3609654267 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff463fff640 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be465bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff462ffd640 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be465b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff4637fe640 1 -- 172.21.15.60:0/3609654267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 msgr2=0x558be465b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff4637fe640 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be465b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff4637fe640 1 -- 172.21.15.60:0/3609654267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 msgr2=0x558be465bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff4637fe640 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be465bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff4637fe640 1 -- 172.21.15.60:0/3609654267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be46d14e0 con 0x558be464c760 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff4637fe640 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be465b420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff4540b8920 tx=0x7ff4540095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86e4d3f616d30f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff442ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff442ffd640 1 -- 172.21.15.60:0/3609654267 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45409e060 con 0x558be464c760 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff442ffd640 1 -- 172.21.15.60:0/3609654267 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7ff45403b460 con 0x558be464c760 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.132+0000 7ff46c128740 1 -- 172.21.15.60:0/3609654267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4540a5240 con 0x558be464c760 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff442ffd640 1 -- 172.21.15.60:0/3609654267 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff4540da070 con 0x558be464c760 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff46c128740 10 client.15618 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff46c128740 1 -- 172.21.15.60:0/3609654267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558be46d26f0 con 0x558be464c760 2024-09-12T00:00:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff442ffd640 1 -- 172.21.15.60:0/3609654267 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4540bc650 con 0x558be464c760 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff442ffd640 1 -- 172.21.15.60:0/3609654267 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff4540b85c0 con 0x558be464c760 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff46c128740 10 client.15618 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff46c128740 10 client.15618 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff46c128740 20 client.15618 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff46c128740 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558be46d2a30 0x558be46d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff46c128740 4 client.15618 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.133+0000 7ff46c128740 1 -- 172.21.15.60:0/3609654267 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x7ff4540a5240 con 0x558be46d2a30 2024-09-12T00:00:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.134+0000 7ff462ffd640 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558be46d2a30 0x558be46d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.134+0000 7ff442ffd640 10 client.15618 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.134+0000 7ff462ffd640 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558be46d2a30 0x558be46d4e20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa6d22253c08e25a server_cookie=1d129ca4ed8a162b in_seq=0 out_seq=0 2024-09-12T00:00:12.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff442ffd640 1 -- 172.21.15.60:0/3609654267 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7ff4540a5240 con 0x558be46d2a30 2024-09-12T00:00:12.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff442ffd640 10 client.15618 handle_command_reply: tid=0 2024-09-12T00:00:12.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 client.15618 shutdown 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 -- 172.21.15.60:0/3609654267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 msgr2=0x558be465b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be465b420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff4540b8920 tx=0x7ff4540095a0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 -- 172.21.15.60:0/3609654267 shutdown_connections 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558be46d2a30 0x558be46d4e20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558be4657940 0x558be465bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff442ffd640 0 client.15618 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558be464d080 0x558be465b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 --2- 172.21.15.60:0/3609654267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558be464c760 0x558be465b420 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 -- 172.21.15.60:0/3609654267 >> 172.21.15.60:0/3609654267 conn(0x558be4648cf0 msgr2=0x558be4647650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 -- 172.21.15.60:0/3609654267 shutdown_connections 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.147+0000 7ff46c128740 1 -- 172.21.15.60:0/3609654267 wait complete. 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff46c128740 20 client.15618 trim_cache size 0 max 16384 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 29, 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stdout: "leader": 24496, 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stdout: "set_version": 2, 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stdout: "sets": { 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stdout: "5bc56bcb": { 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stdout: "version": 2, 2024-09-12T00:00:12.149 INFO:teuthology.orchestra.run.smithi060.stdout: "age_ref": 0.0, 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "QUIESCED", 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "timeout": 90.0, 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "expiration": 144.5, 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "members": { 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "file:/": { 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "excluded": false, 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "QUIESCED", 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:00:12.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:12.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:12.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:12.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:12.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:12.151 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:00:12.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 -- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff44c0a2e10 msgr2=0x7ff44c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff44c0a2e10 0x7ff44c0a52d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0136d0 tx=0x7ff45c013ad0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 -- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 msgr2=0x7ff4640744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 0x7ff4640744f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff454006010 tx=0x7ff4540042f0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 -- 172.21.15.60:0/2383866103 shutdown_connections 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff44c0a2e10 0x7ff44c0a52d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff464106f20 0x7ff464074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4641027a0 0x7ff464074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 --2- 172.21.15.60:0/2383866103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff464101df0 0x7ff4640744f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.148+0000 7ff469d4f640 1 -- 172.21.15.60:0/2383866103 >> 172.21.15.60:0/2383866103 conn(0x7ff4640fd8f0 msgr2=0x7ff4640fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.149+0000 7ff469d4f640 1 -- 172.21.15.60:0/2383866103 shutdown_connections 2024-09-12T00:00:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:12.149+0000 7ff469d4f640 1 -- 172.21.15.60:0/2383866103 wait complete. 2024-09-12T00:00:12.409 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:12.880 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5bc56bcb', quiesce took 5.1 seconds. Will release after: 19.4 2024-09-12T00:00:13.116 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:12 smithi060 ceph-mon[30953]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-12T00:00:13.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:12 smithi105 ceph-mon[34805]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-12T00:00:13.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:12 smithi192 ceph-mon[35487]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-12T00:00:13.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 -- 172.21.15.60:0/149947969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 msgr2=0x7f39dc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 --2- 172.21.15.60:0/149947969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 0x7f39dc1029b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009900 tx=0x7f39cc02a480 comp rx=0 tx=0).stop 2024-09-12T00:00:13.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 -- 172.21.15.60:0/149947969 shutdown_connections 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 --2- 172.21.15.60:0/149947969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc102ef0 0x7f39dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 --2- 172.21.15.60:0/149947969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 0x7f39dc1029b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 --2- 172.21.15.60:0/149947969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39dc100e20 0x7f39dc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 -- 172.21.15.60:0/149947969 >> 172.21.15.60:0/149947969 conn(0x7f39dc0fc7d0 msgr2=0x7f39dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 -- 172.21.15.60:0/149947969 shutdown_connections 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.344+0000 7f39e463e640 1 -- 172.21.15.60:0/149947969 wait complete. 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.345+0000 7f39e463e640 1 Processor -- start 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e463e640 1 -- start start 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e463e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc100e20 0x7f39dc199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e463e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 0x7f39dc1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e463e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39dc102ef0 0x7f39dc1a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e463e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc1110f0 con 0x7f39dc102570 2024-09-12T00:00:13.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e463e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc110f70 con 0x7f39dc100e20 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e463e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc111270 con 0x7f39dc102ef0 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e1bd9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 0x7f39dc1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e1bd9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 0x7f39dc1999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34332/0 (socket says 172.21.15.60:34332) 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e1bd9640 1 -- 172.21.15.60:0/4021555341 learned_addr learned my addr 172.21.15.60:0/4021555341 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e23da640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc100e20 0x7f39dc199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e2bdb640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39dc102ef0 0x7f39dc1a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e1bd9640 1 -- 172.21.15.60:0/4021555341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39dc102ef0 msgr2=0x7f39dc1a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39dc102ef0 0x7f39dc1a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e1bd9640 1 -- 172.21.15.60:0/4021555341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc100e20 msgr2=0x7f39dc199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc100e20 0x7f39dc199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.346+0000 7f39e1bd9640 1 -- 172.21.15.60:0/4021555341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc1a4a20 con 0x7f39dc102570 2024-09-12T00:00:13.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.347+0000 7f39e23da640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc100e20 0x7f39dc199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:13.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.347+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 0x7f39dc1999a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f39cc004770 tx=0x7f39cc031470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:13.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.347+0000 7f39d37fe640 1 -- 172.21.15.60:0/4021555341 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc03f070 con 0x7f39dc102570 2024-09-12T00:00:13.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.347+0000 7f39e463e640 1 -- 172.21.15.60:0/4021555341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39dc1a4bf0 con 0x7f39dc102570 2024-09-12T00:00:13.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.347+0000 7f39d37fe640 1 -- 172.21.15.60:0/4021555341 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39cc005510 con 0x7f39dc102570 2024-09-12T00:00:13.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.347+0000 7f39d37fe640 1 -- 172.21.15.60:0/4021555341 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc035030 con 0x7f39dc102570 2024-09-12T00:00:13.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.347+0000 7f39e463e640 1 -- 172.21.15.60:0/4021555341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39dc1a50a0 con 0x7f39dc102570 2024-09-12T00:00:13.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.350+0000 7f39d37fe640 1 -- 172.21.15.60:0/4021555341 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f39cc042070 con 0x7f39dc102570 2024-09-12T00:00:13.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39e6a17740 1 Processor -- start 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39e6a17740 1 -- start start 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39d37fe640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f39c80a2e90 0x7f39c80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa28783090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287835d0 0x55fa28783a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28792780 0x55fa28794b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39e6a17740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fa286e92f0 con 0x55fa28784b40 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39e6a17740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fa28690cf0 con 0x55fa287835d0 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39e6a17740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fa286e52b0 con 0x55fa28792780 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.351+0000 7f39d37fe640 1 -- 172.21.15.60:0/4021555341 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f39cc0f0200 con 0x7f39dc102570 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e2bdb640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f39c80a2e90 0x7f39c80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e2bdb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28792780 0x55fa28794b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e23da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa28783090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e2bdb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28792780 0x55fa28794b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41752/0 (socket says 172.21.15.60:41752) 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e2bdb640 1 -- 172.21.15.60:0/2659328839 learned_addr learned my addr 172.21.15.60:0/2659328839 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/2659328839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287835d0 0x55fa28783a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e2bdb640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f39c80a2e90 0x7f39c80a5350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39d40137f0 tx=0x7f39d4009a40 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e23da640 1 -- 172.21.15.60:0/2659328839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28792780 msgr2=0x55fa28794b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e23da640 1 --2- 172.21.15.60:0/2659328839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28792780 0x55fa28794b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e23da640 1 -- 172.21.15.60:0/2659328839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287835d0 msgr2=0x55fa28783a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e23da640 1 --2- 172.21.15.60:0/2659328839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287835d0 0x55fa28783a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e23da640 1 -- 172.21.15.60:0/2659328839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa286753a0 con 0x55fa28784b40 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.352+0000 7f39e23da640 1 --2- 172.21.15.60:0/2659328839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa28783090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f39d800bc80 tx=0x7f39d800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d70d8592156715a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.353+0000 7f39d0ff9640 1 -- 172.21.15.60:0/2659328839 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8015070 con 0x55fa28784b40 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.353+0000 7f39d0ff9640 1 -- 172.21.15.60:0/2659328839 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39d8011940 con 0x55fa28784b40 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.353+0000 7f39d0ff9640 1 -- 172.21.15.60:0/2659328839 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8010890 con 0x55fa28784b40 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 -- 172.21.15.60:0/2659328839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 msgr2=0x55fa28783090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 --2- 172.21.15.60:0/2659328839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa28783090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f39d800bc80 tx=0x7f39d800f730 comp rx=0 tx=0).stop 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 -- 172.21.15.60:0/2659328839 shutdown_connections 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 --2- 172.21.15.60:0/2659328839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28792780 0x55fa28794b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 --2- 172.21.15.60:0/2659328839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287835d0 0x55fa28783a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 --2- 172.21.15.60:0/2659328839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa28783090 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 -- 172.21.15.60:0/2659328839 >> 172.21.15.60:0/2659328839 conn(0x55fa2874c310 msgr2=0x55fa2877fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:13.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 -- 172.21.15.60:0/2659328839 shutdown_connections 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.354+0000 7f39e6a17740 1 -- 172.21.15.60:0/2659328839 wait complete. 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.355+0000 7f39e6a17740 1 -- start start 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.355+0000 7f39e6a17740 1 Processor -- start 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.355+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287835d0 0x55fa28792150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.355+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa2878f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.355+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28792780 0x55fa2878f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e6a17740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fa28795480 con 0x55fa28784b40 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e6a17740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fa286a4060 con 0x55fa28792780 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e6a17740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fa28795600 con 0x55fa287835d0 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e6a17740 10 client.0 _ll_register_callbacks cb 0x55fa283f78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:13.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa2878f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa2878f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34358/0 (socket says 172.21.15.60:34358) 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 -- 172.21.15.60:0/1415375179 learned_addr learned my addr 172.21.15.60:0/1415375179 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e23da640 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287835d0 0x55fa28792150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e2bdb640 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28792780 0x55fa2878f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 -- 172.21.15.60:0/1415375179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287835d0 msgr2=0x55fa28792150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287835d0 0x55fa28792150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 -- 172.21.15.60:0/1415375179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28792780 msgr2=0x55fa2878f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28792780 0x55fa2878f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 -- 172.21.15.60:0/1415375179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa2845a3c0 con 0x55fa28784b40 2024-09-12T00:00:13.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa2878f400 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0bc290 tx=0x7f39cc0bc360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544c7c2881a5fa46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.356+0000 7f39c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39c5ffb640 1 -- 172.21.15.60:0/1415375179 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0d4020 con 0x55fa28784b40 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39c5ffb640 1 -- 172.21.15.60:0/1415375179 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f39cc0b8c00 con 0x55fa28784b40 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39e6a17740 1 -- 172.21.15.60:0/1415375179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d8011940 con 0x55fa28784b40 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39c5ffb640 1 -- 172.21.15.60:0/1415375179 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39cc049040 con 0x55fa28784b40 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39e6a17740 10 client.15630 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39e6a17740 1 -- 172.21.15.60:0/1415375179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fa28786310 con 0x55fa28784b40 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39c5ffb640 1 -- 172.21.15.60:0/1415375179 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39d8011940 con 0x55fa28784b40 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39c5ffb640 1 -- 172.21.15.60:0/1415375179 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f39cc031cb0 con 0x55fa28784b40 2024-09-12T00:00:13.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39e6a17740 10 client.15630 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39e6a17740 10 client.15630 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39e6a17740 20 client.15630 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.357+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55fa287876d0 0x55fa28789ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.358+0000 7f39e6a17740 4 client.15630 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.358+0000 7f39e6a17740 1 -- 172.21.15.60:0/1415375179 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa286f6860 con 0x55fa287876d0 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.358+0000 7f39e23da640 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55fa287876d0 0x55fa28789ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.358+0000 7f39c5ffb640 10 client.15630 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.358+0000 7f39e23da640 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55fa287876d0 0x55fa28789ae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=278b0fa297335855 server_cookie=ca718c649fad62b2 in_seq=0 out_seq=0 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39c5ffb640 1 -- 172.21.15.60:0/1415375179 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa286f6860 con 0x55fa287876d0 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39c5ffb640 10 client.15630 handle_command_reply: tid=0 2024-09-12T00:00:13.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 client.15630 shutdown 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 -- 172.21.15.60:0/1415375179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 msgr2=0x55fa2878f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa2878f400 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0bc290 tx=0x7f39cc0bc360 comp rx=0 tx=0).stop 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 -- 172.21.15.60:0/1415375179 shutdown_connections 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55fa287876d0 0x55fa28789ae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39c5ffb640 0 client.15630 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28792780 0x55fa2878f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28784b40 0x55fa2878f400 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1415375179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287835d0 0x55fa28792150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 -- 172.21.15.60:0/1415375179 >> 172.21.15.60:0/1415375179 conn(0x55fa2874c310 msgr2=0x55fa28785990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:13.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 -- 172.21.15.60:0/1415375179 shutdown_connections 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.359+0000 7f39e6a17740 1 -- 172.21.15.60:0/1415375179 wait complete. 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.360+0000 7f39e6a17740 20 client.15630 trim_cache size 0 max 16384 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e6a17740 1 Processor -- start 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e6a17740 1 -- start start 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa287835d0 0x55fa2878aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28784b40 0x55fa287a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287876d0 0x55fa287a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e6a17740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc1ab6a0 con 0x55fa287835d0 2024-09-12T00:00:13.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e6a17740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc1ad1e0 con 0x55fa287876d0 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e6a17740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc1abd70 con 0x55fa28784b40 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e23da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa287835d0 0x55fa2878aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e23da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa287835d0 0x55fa2878aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34364/0 (socket says 172.21.15.60:34364) 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.373+0000 7f39e23da640 1 -- 172.21.15.60:0/1238396519 learned_addr learned my addr 172.21.15.60:0/1238396519 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28784b40 0x55fa287a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39e2bdb640 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287876d0 0x55fa287a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39e23da640 1 -- 172.21.15.60:0/1238396519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28784b40 msgr2=0x55fa287a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39e23da640 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28784b40 0x55fa287a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39e23da640 1 -- 172.21.15.60:0/1238396519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287876d0 msgr2=0x55fa287a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39e23da640 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287876d0 0x55fa287a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39e23da640 1 -- 172.21.15.60:0/1238396519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa28786120 con 0x55fa287835d0 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39e23da640 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa287835d0 0x55fa2878aad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f39d800fc30 tx=0x7f39d800b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49ff415f026866a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:13.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39c7fff640 1 -- 172.21.15.60:0/1238396519 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8015040 con 0x55fa287835d0 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.374+0000 7f39c7fff640 1 -- 172.21.15.60:0/1238396519 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39d8022380 con 0x55fa287835d0 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.375+0000 7f39c7fff640 1 -- 172.21.15.60:0/1238396519 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80048e0 con 0x55fa287835d0 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.375+0000 7f39e6a17740 1 -- 172.21.15.60:0/1238396519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa287835d0 msgr2=0x55fa2878aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.375+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa287835d0 0x55fa2878aad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f39d800fc30 tx=0x7f39d800b5a0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.375+0000 7f39e6a17740 1 -- 172.21.15.60:0/1238396519 shutdown_connections 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.375+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa287876d0 0x55fa287a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.375+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa28784b40 0x55fa287a5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.375+0000 7f39e6a17740 1 --2- 172.21.15.60:0/1238396519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa287835d0 0x55fa2878aad0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.375+0000 7f39e6a17740 1 -- 172.21.15.60:0/1238396519 >> 172.21.15.60:0/1238396519 conn(0x55fa2874c310 msgr2=0x55fa2878a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.376+0000 7f39e6a17740 1 -- 172.21.15.60:0/1238396519 shutdown_connections 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.376+0000 7f39e6a17740 1 -- 172.21.15.60:0/1238396519 wait complete. 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.376+0000 7f39e6a17740 1 -- start start 2024-09-12T00:00:13.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.376+0000 7f39e6a17740 1 Processor -- start 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28784b40 0x55fa287a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287876d0 0x55fa287a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e6a17740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28792780 0x55fa28807f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e6a17740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc1acb10 con 0x55fa28792780 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e6a17740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc1ac440 con 0x55fa28784b40 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e6a17740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc1a96a0 con 0x55fa287876d0 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e6a17740 10 client.0 _ll_register_callbacks cb 0x7f39cc0315e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e2bdb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28792780 0x55fa28807f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e2bdb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28792780 0x55fa28807f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34368/0 (socket says 172.21.15.60:34368) 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e2bdb640 1 -- 172.21.15.60:0/3172663617 learned_addr learned my addr 172.21.15.60:0/3172663617 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287876d0 0x55fa287a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e23da640 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28784b40 0x55fa287a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e1bd9640 1 -- 172.21.15.60:0/3172663617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28784b40 msgr2=0x55fa287a3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28784b40 0x55fa287a3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e1bd9640 1 -- 172.21.15.60:0/3172663617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28792780 msgr2=0x55fa28807f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28792780 0x55fa28807f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e1bd9640 1 -- 172.21.15.60:0/3172663617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa287a4d80 con 0x55fa287876d0 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.377+0000 7f39e1bd9640 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287876d0 0x55fa287a44a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0ba840 tx=0x7f39cc0bc490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3813e0fc6218a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39c5ffb640 1 -- 172.21.15.60:0/3172663617 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0d4040 con 0x55fa287876d0 2024-09-12T00:00:13.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39c5ffb640 1 -- 172.21.15.60:0/3172663617 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f39cc0bb9e0 con 0x55fa287876d0 2024-09-12T00:00:13.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39e6a17740 1 -- 172.21.15.60:0/3172663617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d8022380 con 0x55fa287876d0 2024-09-12T00:00:13.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39c5ffb640 1 -- 172.21.15.60:0/3172663617 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39cc0b8830 con 0x55fa287876d0 2024-09-12T00:00:13.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39e6a17740 10 client.25189 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:13.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39e6a17740 1 -- 172.21.15.60:0/3172663617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fa28809550 con 0x55fa287876d0 2024-09-12T00:00:13.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39c5ffb640 1 -- 172.21.15.60:0/3172663617 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39cc0047a0 con 0x55fa287876d0 2024-09-12T00:00:13.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39c5ffb640 1 -- 172.21.15.60:0/3172663617 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f39cc0b82e0 con 0x55fa287876d0 2024-09-12T00:00:13.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39e6a17740 10 client.25189 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:13.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39e6a17740 10 client.25189 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:00:13.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39e6a17740 20 client.25189 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:13.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.378+0000 7f39e6a17740 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55fa28809b40 0x55fa2880bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:13.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.379+0000 7f39e6a17740 4 client.25189 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:00:13.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.379+0000 7f39e6a17740 1 -- 172.21.15.60:0/3172663617 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f39d8022380 con 0x55fa28809b40 2024-09-12T00:00:13.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.379+0000 7f39e23da640 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55fa28809b40 0x55fa2880bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:13.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.379+0000 7f39c5ffb640 10 client.25189 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.379+0000 7f39e23da640 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55fa28809b40 0x55fa2880bf60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3d4d26d1332b2f3d server_cookie=acf9106ef36a4bb4 in_seq=0 out_seq=0 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.379+0000 7f39c5ffb640 1 -- 172.21.15.60:0/3172663617 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f39d8022380 con 0x55fa28809b40 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.379+0000 7f39c5ffb640 10 client.25189 handle_command_reply: tid=0 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.379+0000 7f39e6a17740 1 client.25189 shutdown 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.380+0000 7f39e6a17740 1 -- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287876d0 msgr2=0x55fa287a44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.380+0000 7f39e6a17740 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287876d0 0x55fa287a44a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0ba840 tx=0x7f39cc0bc490 comp rx=0 tx=0).stop 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.380+0000 7f39e6a17740 1 -- 172.21.15.60:0/3172663617 shutdown_connections 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.380+0000 7f39e6a17740 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55fa28809b40 0x55fa2880bf60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.380+0000 7f39e6a17740 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fa28792780 0x55fa28807f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.380+0000 7f39e6a17740 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa287876d0 0x55fa287a44a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.380+0000 7f39c5ffb640 0 client.25189 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:00:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.380+0000 7f39e6a17740 1 --2- 172.21.15.60:0/3172663617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fa28784b40 0x55fa287a3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.381+0000 7f39e6a17740 1 -- 172.21.15.60:0/3172663617 >> 172.21.15.60:0/3172663617 conn(0x55fa2874c310 msgr2=0x55fa28790c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:13.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.381+0000 7f39e6a17740 1 -- 172.21.15.60:0/3172663617 shutdown_connections 2024-09-12T00:00:13.425 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:00:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.381+0000 7f39e6a17740 1 -- 172.21.15.60:0/3172663617 wait complete. 2024-09-12T00:00:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.381+0000 7f39e6a17740 20 client.25189 trim_cache size 0 max 16384 2024-09-12T00:00:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.382+0000 7f39e463e640 1 -- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f39c80a2e90 msgr2=0x7f39c80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.382+0000 7f39e463e640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f39c80a2e90 0x7f39c80a5350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39d40137f0 tx=0x7f39d4009a40 comp rx=0 tx=0).stop 2024-09-12T00:00:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.382+0000 7f39e463e640 1 -- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 msgr2=0x7f39dc1999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.382+0000 7f39e463e640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 0x7f39dc1999a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f39cc004770 tx=0x7f39cc031470 comp rx=0 tx=0).stop 2024-09-12T00:00:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.383+0000 7f39e463e640 1 -- 172.21.15.60:0/4021555341 shutdown_connections 2024-09-12T00:00:13.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.383+0000 7f39e463e640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f39c80a2e90 0x7f39c80a5350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.383+0000 7f39e463e640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39dc102ef0 0x7f39dc1a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.383+0000 7f39e463e640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc102570 0x7f39dc1999a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.383+0000 7f39e463e640 1 --2- 172.21.15.60:0/4021555341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc100e20 0x7f39dc199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.383+0000 7f39e463e640 1 -- 172.21.15.60:0/4021555341 >> 172.21.15.60:0/4021555341 conn(0x7f39dc0fc7d0 msgr2=0x7f39dc106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.383+0000 7f39e463e640 1 -- 172.21.15.60:0/4021555341 shutdown_connections 2024-09-12T00:00:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:13.383+0000 7f39e463e640 1 -- 172.21.15.60:0/4021555341 wait complete. 2024-09-12T00:00:14.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:00:14.475 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:15.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 -- 172.21.15.60:0/3264480223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470106a60 msgr2=0x7fc470106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 --2- 172.21.15.60:0/3264480223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470106a60 0x7fc470106e40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc460009930 tx=0x7fc46002a420 comp rx=0 tx=0).stop 2024-09-12T00:00:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 -- 172.21.15.60:0/3264480223 shutdown_connections 2024-09-12T00:00:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 --2- 172.21.15.60:0/3264480223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc470101400 0x7fc47010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 --2- 172.21.15.60:0/3264480223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470100a60 0x7fc470100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 --2- 172.21.15.60:0/3264480223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470106a60 0x7fc470106e40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 -- 172.21.15.60:0/3264480223 >> 172.21.15.60:0/3264480223 conn(0x7fc4700fc780 msgr2=0x7fc4700feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 -- 172.21.15.60:0/3264480223 shutdown_connections 2024-09-12T00:00:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.056+0000 7fc475c82640 1 -- 172.21.15.60:0/3264480223 wait complete. 2024-09-12T00:00:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.057+0000 7fc475c82640 1 Processor -- start 2024-09-12T00:00:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.057+0000 7fc475c82640 1 -- start start 2024-09-12T00:00:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.057+0000 7fc475c82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470100a60 0x7fc47006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc475c82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470101400 0x7fc47006acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc475c82640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc470106a60 0x7fc47006b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc475c82640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc47006c780 con 0x7fc470100a60 2024-09-12T00:00:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc475c82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc47006c600 con 0x7fc470101400 2024-09-12T00:00:15.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc475c82640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc47006c900 con 0x7fc470106a60 2024-09-12T00:00:15.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470100a60 0x7fc47006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470100a60 0x7fc47006a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34388/0 (socket says 172.21.15.60:34388) 2024-09-12T00:00:15.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46f7fe640 1 -- 172.21.15.60:0/2406801771 learned_addr learned my addr 172.21.15.60:0/2406801771 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46ffff640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc470106a60 0x7fc47006b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46effd640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470101400 0x7fc47006acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46f7fe640 1 -- 172.21.15.60:0/2406801771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc470106a60 msgr2=0x7fc47006b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc470106a60 0x7fc47006b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46f7fe640 1 -- 172.21.15.60:0/2406801771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470101400 msgr2=0x7fc47006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470101400 0x7fc47006acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46f7fe640 1 -- 172.21.15.60:0/2406801771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4701af220 con 0x7fc470100a60 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.058+0000 7fc46effd640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470101400 0x7fc47006acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.059+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470100a60 0x7fc47006a790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc46002a940 tx=0x7fc460032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.059+0000 7fc46cff9640 1 -- 172.21.15.60:0/2406801771 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46003f030 con 0x7fc470100a60 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.059+0000 7fc46cff9640 1 -- 172.21.15.60:0/2406801771 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc460032e10 con 0x7fc470100a60 2024-09-12T00:00:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.059+0000 7fc475c82640 1 -- 172.21.15.60:0/2406801771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4701af4b0 con 0x7fc470100a60 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.059+0000 7fc46cff9640 1 -- 172.21.15.60:0/2406801771 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460035070 con 0x7fc470100a60 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.059+0000 7fc475c82640 1 -- 172.21.15.60:0/2406801771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4701af990 con 0x7fc470100a60 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.062+0000 7fc47805b740 1 Processor -- start 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.062+0000 7fc47805b740 1 -- start start 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.062+0000 7fc46cff9640 1 -- 172.21.15.60:0/2406801771 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7fc460042030 con 0x7fc470100a60 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.062+0000 7fc47805b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c9893b40 0x5616c9892090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.062+0000 7fc47805b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c9892a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc47805b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c989f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc47805b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5616c97f82f0 con 0x5616c989d370 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc47805b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5616c979fcf0 con 0x5616c98925d0 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc47805b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5616c97f42b0 con 0x5616c9893b40 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c9893b40 0x5616c9892090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c9893b40 0x5616c9892090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41796/0 (socket says 172.21.15.60:41796) 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46ffff640 1 -- 172.21.15.60:0/2954301737 learned_addr learned my addr 172.21.15.60:0/2954301737 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46effd640 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c989f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c9892a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46effd640 1 -- 172.21.15.60:0/2954301737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c9893b40 msgr2=0x5616c9892090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46effd640 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c9893b40 0x5616c9892090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46effd640 1 -- 172.21.15.60:0/2954301737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 msgr2=0x5616c9892a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46effd640 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c9892a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46effd640 1 -- 172.21.15.60:0/2954301737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616c97843a0 con 0x5616c989d370 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c9892a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.063+0000 7fc46cff9640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc4580a2f60 0x7fc4580a5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.064+0000 7fc46ffff640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc4580a2f60 0x7fc4580a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.064+0000 7fc46cff9640 1 -- 172.21.15.60:0/2406801771 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc4600efe50 con 0x7fc470100a60 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.064+0000 7fc46effd640 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c989f760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc464009b60 tx=0x7fc46400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1eea3d50cf9d0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.064+0000 7fc455ffb640 1 -- 172.21.15.60:0/2954301737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464016070 con 0x5616c989d370 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.064+0000 7fc455ffb640 1 -- 172.21.15.60:0/2954301737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc464009e50 con 0x5616c989d370 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.064+0000 7fc455ffb640 1 -- 172.21.15.60:0/2954301737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464011470 con 0x5616c989d370 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc46ffff640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc4580a2f60 0x7fc4580a5420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc46800b600 tx=0x7fc46800e040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 -- 172.21.15.60:0/2954301737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 msgr2=0x5616c989f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c989f760 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc464009b60 tx=0x7fc46400e6c0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 -- 172.21.15.60:0/2954301737 shutdown_connections 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c989f760 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c9892a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 --2- 172.21.15.60:0/2954301737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c9893b40 0x5616c9892090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 -- 172.21.15.60:0/2954301737 >> 172.21.15.60:0/2954301737 conn(0x5616c985b310 msgr2=0x5616c988ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 -- 172.21.15.60:0/2954301737 shutdown_connections 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.065+0000 7fc47805b740 1 -- 172.21.15.60:0/2954301737 wait complete. 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.066+0000 7fc47805b740 1 -- start start 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.066+0000 7fc47805b740 1 Processor -- start 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.066+0000 7fc47805b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c989ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.066+0000 7fc47805b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c9899f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.066+0000 7fc47805b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 0x5616c989a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.066+0000 7fc47805b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5616c98a0070 con 0x5616c9893b40 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.066+0000 7fc47805b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5616c97b3060 con 0x5616c98925d0 2024-09-12T00:00:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.066+0000 7fc47805b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5616c98a01f0 con 0x5616c989d370 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc47805b740 10 client.0 _ll_register_callbacks cb 0x5616c95068c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c9899f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c9899f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34414/0 (socket says 172.21.15.60:34414) 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 -- 172.21.15.60:0/2724634494 learned_addr learned my addr 172.21.15.60:0/2724634494 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46ffff640 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 0x5616c989a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 -- 172.21.15.60:0/2724634494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 msgr2=0x5616c989a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 0x5616c989a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 -- 172.21.15.60:0/2724634494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 msgr2=0x5616c989ccc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c989ccc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 -- 172.21.15.60:0/2724634494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616c95693c0 con 0x5616c9893b40 2024-09-12T00:00:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc46effd640 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c9899f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc464000c00 tx=0x7fc464005010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fffa56f918f8b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc44effd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.067+0000 7fc44effd640 1 -- 172.21.15.60:0/2724634494 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464028060 con 0x5616c9893b40 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc44effd640 1 -- 172.21.15.60:0/2724634494 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc464009c50 con 0x5616c9893b40 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 1 -- 172.21.15.60:0/2724634494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc464009e50 con 0x5616c9893b40 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc44effd640 1 -- 172.21.15.60:0/2724634494 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc464016040 con 0x5616c9893b40 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 10 client.15648 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 1 -- 172.21.15.60:0/2724634494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5616c98aba80 con 0x5616c9893b40 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc44effd640 1 -- 172.21.15.60:0/2724634494 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc464009e50 con 0x5616c9893b40 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc44effd640 1 -- 172.21.15.60:0/2724634494 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc46400f040 con 0x5616c9893b40 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 10 client.15648 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 10 client.15648 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:00:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 20 client.15648 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5616c98ace30 0x5616c98af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 4 client.15648 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.068+0000 7fc47805b740 1 -- 172.21.15.60:0/2724634494 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616c9805860 con 0x5616c98ace30 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.069+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5616c98ace30 0x5616c98af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.069+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5616c98ace30 0x5616c98af220 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6546967c65a2cd0 server_cookie=464cf408b32032aa in_seq=0 out_seq=0 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.069+0000 7fc44effd640 10 client.15648 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc44effd640 1 -- 172.21.15.60:0/2724634494 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616c9805860 con 0x5616c98ace30 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc44effd640 10 client.15648 handle_command_reply: tid=0 2024-09-12T00:00:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 client.15648 shutdown 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 -- 172.21.15.60:0/2724634494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 msgr2=0x5616c9899f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c9899f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc464000c00 tx=0x7fc464005010 comp rx=0 tx=0).stop 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 -- 172.21.15.60:0/2724634494 shutdown_connections 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5616c98ace30 0x5616c98af220 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc44effd640 0 client.15648 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 0x5616c989a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c9899f70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 --2- 172.21.15.60:0/2724634494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c989ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.070+0000 7fc47805b740 1 -- 172.21.15.60:0/2724634494 >> 172.21.15.60:0/2724634494 conn(0x5616c985b310 msgr2=0x5616c9894960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.071+0000 7fc47805b740 1 -- 172.21.15.60:0/2724634494 shutdown_connections 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.071+0000 7fc47805b740 1 -- 172.21.15.60:0/2724634494 wait complete. 2024-09-12T00:00:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.071+0000 7fc47805b740 20 client.15648 trim_cache size 0 max 16384 2024-09-12T00:00:15.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.096+0000 7fc47805b740 1 Processor -- start 2024-09-12T00:00:15.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.096+0000 7fc47805b740 1 -- start start 2024-09-12T00:00:15.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc47805b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c98925d0 0x5616c989bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc47805b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c9893b40 0x5616c9895120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc47805b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c9895660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc47805b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc4701b8280 con 0x5616c989d370 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc47805b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4701b9dc0 con 0x5616c9893b40 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc47805b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc4701b8950 con 0x5616c98925d0 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c98925d0 0x5616c989bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c98925d0 0x5616c989bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41804/0 (socket says 172.21.15.60:41804) 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46f7fe640 1 -- 172.21.15.60:0/3083261159 learned_addr learned my addr 172.21.15.60:0/3083261159 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46ffff640 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c9895660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46effd640 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c9893b40 0x5616c9895120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46f7fe640 1 -- 172.21.15.60:0/3083261159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c9893b40 msgr2=0x5616c9895120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c9893b40 0x5616c9895120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46f7fe640 1 -- 172.21.15.60:0/3083261159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 msgr2=0x5616c9895660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:15.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c9895660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46f7fe640 1 -- 172.21.15.60:0/3083261159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616c988f960 con 0x5616c98925d0 2024-09-12T00:00:15.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.097+0000 7fc46effd640 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c9893b40 0x5616c9895120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:00:15.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.098+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c98925d0 0x5616c989bee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc46002a9e0 tx=0x7fc460003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eab5fbd5787ccf1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:15.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.098+0000 7fc4557fa640 1 -- 172.21.15.60:0/3083261159 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460049040 con 0x5616c98925d0 2024-09-12T00:00:15.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.098+0000 7fc4557fa640 1 -- 172.21.15.60:0/3083261159 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4600c0590 con 0x5616c98925d0 2024-09-12T00:00:15.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.098+0000 7fc4557fa640 1 -- 172.21.15.60:0/3083261159 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46003bcc0 con 0x5616c98925d0 2024-09-12T00:00:15.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 -- 172.21.15.60:0/3083261159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c98925d0 msgr2=0x5616c989bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c98925d0 0x5616c989bee0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc46002a9e0 tx=0x7fc460003f90 comp rx=0 tx=0).stop 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 -- 172.21.15.60:0/3083261159 shutdown_connections 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c989d370 0x5616c9895660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c9893b40 0x5616c9895120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 --2- 172.21.15.60:0/3083261159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c98925d0 0x5616c989bee0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 -- 172.21.15.60:0/3083261159 >> 172.21.15.60:0/3083261159 conn(0x5616c985b310 msgr2=0x5616c989b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 -- 172.21.15.60:0/3083261159 shutdown_connections 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.099+0000 7fc47805b740 1 -- 172.21.15.60:0/3083261159 wait complete. 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.100+0000 7fc47805b740 1 -- start start 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.100+0000 7fc47805b740 1 Processor -- start 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.101+0000 7fc47805b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c98a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.101+0000 7fc47805b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c98a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.101+0000 7fc47805b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 0x5616c98a1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.101+0000 7fc46effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c98a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.101+0000 7fc46effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c98a10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34418/0 (socket says 172.21.15.60:34418) 2024-09-12T00:00:15.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.101+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c98a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.101+0000 7fc46f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c98a5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39378/0 (socket says 172.21.15.60:39378) 2024-09-12T00:00:15.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.101+0000 7fc46effd640 1 -- 172.21.15.60:0/2557246309 learned_addr learned my addr 172.21.15.60:0/2557246309 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:15.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc4701b96f0 con 0x5616c9893b40 2024-09-12T00:00:15.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc46ffff640 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 0x5616c98a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4701b9020 con 0x5616c98925d0 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc4701b6260 con 0x5616c989d370 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc47805b740 10 client.0 _ll_register_callbacks cb 0x7fc468009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc46effd640 1 -- 172.21.15.60:0/2557246309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 msgr2=0x5616c98a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc46effd640 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 0x5616c98a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc46effd640 1 -- 172.21.15.60:0/2557246309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 msgr2=0x5616c98a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc46effd640 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c98a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc46effd640 1 -- 172.21.15.60:0/2557246309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616c9916840 con 0x5616c9893b40 2024-09-12T00:00:15.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c98a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc46effd640 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c98a10e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc464010010 tx=0x7fc46400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04d654d713860e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.102+0000 7fc44effd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.103+0000 7fc44effd640 1 -- 172.21.15.60:0/2557246309 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464028050 con 0x5616c9893b40 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.103+0000 7fc44effd640 1 -- 172.21.15.60:0/2557246309 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc464005390 con 0x5616c9893b40 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.103+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4600c0590 con 0x5616c9893b40 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.103+0000 7fc44effd640 1 -- 172.21.15.60:0/2557246309 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc464032080 con 0x5616c9893b40 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.103+0000 7fc47805b740 10 client.15654 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.103+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5616c9917930 con 0x5616c9893b40 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc44effd640 1 -- 172.21.15.60:0/2557246309 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4600c0590 con 0x5616c9893b40 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc44effd640 1 -- 172.21.15.60:0/2557246309 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc4640116e0 con 0x5616c9893b40 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc47805b740 10 client.15654 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:15.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc47805b740 10 client.15654 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:00:15.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc47805b740 20 client.15654 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:15.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc47805b740 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5616c98ace30 0x5616c991a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:15.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc47805b740 4 client.15654 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:00:15.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616c97ffd70 con 0x5616c98ace30 2024-09-12T00:00:15.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.104+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5616c98ace30 0x5616c991a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:15.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.105+0000 7fc46f7fe640 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5616c98ace30 0x5616c991a0e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a52ba1df9274dfb8 server_cookie=63d202df522ea018 in_seq=0 out_seq=0 2024-09-12T00:00:15.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.105+0000 7fc44effd640 10 client.15654 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:00:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.105+0000 7fc44effd640 1 -- 172.21.15.60:0/2557246309 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616c97ffd70 con 0x5616c98ace30 2024-09-12T00:00:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.105+0000 7fc44effd640 10 client.15654 handle_command_reply: tid=0 2024-09-12T00:00:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.105+0000 7fc47805b740 1 client.15654 shutdown 2024-09-12T00:00:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.105+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 msgr2=0x5616c98a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.105+0000 7fc47805b740 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c98a10e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc464010010 tx=0x7fc46400ed10 comp rx=0 tx=0).stop 2024-09-12T00:00:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 shutdown_connections 2024-09-12T00:00:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5616c98ace30 0x5616c991a0e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc44effd640 0 client.15654 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:00:15.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5616c989d370 0x5616c98a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5616c9893b40 0x5616c98a10e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 1 --2- 172.21.15.60:0/2557246309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5616c98925d0 0x5616c98a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 >> 172.21.15.60:0/2557246309 conn(0x5616c985b310 msgr2=0x5616c988dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:15.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 shutdown_connections 2024-09-12T00:00:15.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 1 -- 172.21.15.60:0/2557246309 wait complete. 2024-09-12T00:00:15.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.106+0000 7fc47805b740 20 client.15654 trim_cache size 0 max 16384 2024-09-12T00:00:15.131 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 -- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc4580a2f60 msgr2=0x7fc4580a5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc4580a2f60 0x7fc4580a5420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc46800b600 tx=0x7fc46800e040 comp rx=0 tx=0).stop 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 -- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470100a60 msgr2=0x7fc47006a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470100a60 0x7fc47006a790 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc46002a940 tx=0x7fc460032bf0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 -- 172.21.15.60:0/2406801771 shutdown_connections 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc4580a2f60 0x7fc4580a5420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc470106a60 0x7fc47006b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc470101400 0x7fc47006acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 --2- 172.21.15.60:0/2406801771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc470100a60 0x7fc47006a790 secure :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc46002a940 tx=0x7fc460032bf0 comp rx=0 tx=0).stop 2024-09-12T00:00:15.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 -- 172.21.15.60:0/2406801771 >> 172.21.15.60:0/2406801771 conn(0x7fc4700fc780 msgr2=0x7fc4700fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:15.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.107+0000 7fc475c82640 1 -- 172.21.15.60:0/2406801771 shutdown_connections 2024-09-12T00:00:15.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:15.108+0000 7fc475c82640 1 -- 172.21.15.60:0/2406801771 wait complete. 2024-09-12T00:00:15.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:14 smithi105 ceph-mon[34805]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T00:00:15.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:14 smithi192 ceph-mon[35487]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T00:00:15.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:14 smithi060 ceph-mon[30953]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T00:00:15.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:00:16.129 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.631+0000 7fbc931e8640 1 -- 172.21.15.60:0/1570078337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c102d30 msgr2=0x7fbc8c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.631+0000 7fbc931e8640 1 --2- 172.21.15.60:0/1570078337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c102d30 0x7fbc8c103110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009930 tx=0x7fbc8002a420 comp rx=0 tx=0).stop 2024-09-12T00:00:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.632+0000 7fbc931e8640 1 -- 172.21.15.60:0/1570078337 shutdown_connections 2024-09-12T00:00:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.632+0000 7fbc931e8640 1 --2- 172.21.15.60:0/1570078337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8c1082a0 0x7fbc8c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.632+0000 7fbc931e8640 1 --2- 172.21.15.60:0/1570078337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc8c1036e0 0x7fbc8c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.632+0000 7fbc931e8640 1 --2- 172.21.15.60:0/1570078337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c102d30 0x7fbc8c103110 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.632+0000 7fbc931e8640 1 -- 172.21.15.60:0/1570078337 >> 172.21.15.60:0/1570078337 conn(0x7fbc8c0fc7d0 msgr2=0x7fbc8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.632+0000 7fbc931e8640 1 -- 172.21.15.60:0/1570078337 shutdown_connections 2024-09-12T00:00:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.632+0000 7fbc931e8640 1 -- 172.21.15.60:0/1570078337 wait complete. 2024-09-12T00:00:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.632+0000 7fbc931e8640 1 Processor -- start 2024-09-12T00:00:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc931e8640 1 -- start start 2024-09-12T00:00:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc931e8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc8c102d30 0x7fbc8c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc931e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c1036e0 0x7fbc8c198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc931e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8c1082a0 0x7fbc8c19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc931e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1121c0 con 0x7fbc8c1036e0 2024-09-12T00:00:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc931e8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c112040 con 0x7fbc8c1082a0 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc931e8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c112340 con 0x7fbc8c102d30 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c1036e0 0x7fbc8c198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c1036e0 0x7fbc8c198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34442/0 (socket says 172.21.15.60:34442) 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc8bfff640 1 -- 172.21.15.60:0/2933993367 learned_addr learned my addr 172.21.15.60:0/2933993367 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc90f84640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc8c102d30 0x7fbc8c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc91785640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8c1082a0 0x7fbc8c19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc8bfff640 1 -- 172.21.15.60:0/2933993367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc8c102d30 msgr2=0x7fbc8c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc8c102d30 0x7fbc8c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc8bfff640 1 -- 172.21.15.60:0/2933993367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8c1082a0 msgr2=0x7fbc8c19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8c1082a0 0x7fbc8c19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.633+0000 7fbc8bfff640 1 -- 172.21.15.60:0/2933993367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8c19d600 con 0x7fbc8c1036e0 2024-09-12T00:00:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.634+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c1036e0 0x7fbc8c198b90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800e9f0 tx=0x7fbc7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.634+0000 7fbc89ffb640 1 -- 172.21.15.60:0/2933993367 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800ccc0 con 0x7fbc8c1036e0 2024-09-12T00:00:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.634+0000 7fbc931e8640 1 -- 172.21.15.60:0/2933993367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8c19d8f0 con 0x7fbc8c1036e0 2024-09-12T00:00:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.634+0000 7fbc89ffb640 1 -- 172.21.15.60:0/2933993367 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc78010930 con 0x7fbc8c1036e0 2024-09-12T00:00:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.634+0000 7fbc89ffb640 1 -- 172.21.15.60:0/2933993367 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78018a30 con 0x7fbc8c1036e0 2024-09-12T00:00:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.634+0000 7fbc931e8640 1 -- 172.21.15.60:0/2933993367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8c1a51d0 con 0x7fbc8c1036e0 2024-09-12T00:00:16.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.637+0000 7fbc89ffb640 1 -- 172.21.15.60:0/2933993367 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7fbc78010ae0 con 0x7fbc8c1036e0 2024-09-12T00:00:16.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc955c1740 1 Processor -- start 2024-09-12T00:00:16.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc89ffb640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc7c0a2e10 0x7fbc7c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc955c1740 1 -- start start 2024-09-12T00:00:16.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc89ffb640 1 -- 172.21.15.60:0/2933993367 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbc780cfab0 con 0x7fbc8c1036e0 2024-09-12T00:00:16.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc91785640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc7c0a2e10 0x7fbc7c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b72090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b725d0 0x5606f6b72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b7f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc955c1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5606f6ad82f0 con 0x5606f6b725d0 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc955c1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5606f6a7fcf0 con 0x5606f6b7d370 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.638+0000 7fbc955c1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5606f6ad42b0 con 0x5606f6b73b40 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b7f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b725d0 0x5606f6b72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc7c0a2e10 0x7fbc7c0a52d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc84005fd0 tx=0x7fbc840107a0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b7f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39398/0 (socket says 172.21.15.60:39398) 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 -- 172.21.15.60:0/1769998064 learned_addr learned my addr 172.21.15.60:0/1769998064 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:16.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc90f84640 1 --2- 172.21.15.60:0/1769998064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b72090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 -- 172.21.15.60:0/1769998064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 msgr2=0x5606f6b72090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 --2- 172.21.15.60:0/1769998064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b72090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 -- 172.21.15.60:0/1769998064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b725d0 msgr2=0x5606f6b72a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 --2- 172.21.15.60:0/1769998064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b725d0 0x5606f6b72a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 -- 172.21.15.60:0/1769998064 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f6a643a0 con 0x5606f6b7d370 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.639+0000 7fbc91785640 1 --2- 172.21.15.60:0/1769998064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b7f760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc84003ca0 tx=0x7fbc84018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d0cbdee4ae20d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.640+0000 7fbc76ffd640 1 -- 172.21.15.60:0/1769998064 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8401f640 con 0x5606f6b7d370 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.640+0000 7fbc76ffd640 1 -- 172.21.15.60:0/1769998064 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc84024070 con 0x5606f6b7d370 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.640+0000 7fbc76ffd640 1 -- 172.21.15.60:0/1769998064 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84011ca0 con 0x5606f6b7d370 2024-09-12T00:00:16.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 -- 172.21.15.60:0/1769998064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 msgr2=0x5606f6b7f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 --2- 172.21.15.60:0/1769998064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b7f760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc84003ca0 tx=0x7fbc84018000 comp rx=0 tx=0).stop 2024-09-12T00:00:16.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 -- 172.21.15.60:0/1769998064 shutdown_connections 2024-09-12T00:00:16.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 --2- 172.21.15.60:0/1769998064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b7f760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 --2- 172.21.15.60:0/1769998064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b725d0 0x5606f6b72a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 --2- 172.21.15.60:0/1769998064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b72090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 -- 172.21.15.60:0/1769998064 >> 172.21.15.60:0/1769998064 conn(0x5606f6b3b310 msgr2=0x5606f6b6ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:16.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 -- 172.21.15.60:0/1769998064 shutdown_connections 2024-09-12T00:00:16.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 -- 172.21.15.60:0/1769998064 wait complete. 2024-09-12T00:00:16.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 -- start start 2024-09-12T00:00:16.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.641+0000 7fbc955c1740 1 Processor -- start 2024-09-12T00:00:16.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b7cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b79fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b7a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc955c1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5606f6b91070 con 0x5606f6b7d370 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc955c1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5606f6a93060 con 0x5606f6b725d0 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc955c1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5606f6b911f0 con 0x5606f6b73b40 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc955c1740 10 client.0 _ll_register_callbacks cb 0x5606f67e68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b79fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc8bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b79fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41858/0 (socket says 172.21.15.60:41858) 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc8bfff640 1 -- 172.21.15.60:0/309383219 learned_addr learned my addr 172.21.15.60:0/309383219 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.642+0000 7fbc90f84640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b7cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc91785640 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b7a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc90f84640 1 -- 172.21.15.60:0/309383219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 msgr2=0x5606f6b79fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:16.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc90f84640 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b79fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc90f84640 1 -- 172.21.15.60:0/309383219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 msgr2=0x5606f6b7a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc90f84640 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b7a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc90f84640 1 -- 172.21.15.60:0/309383219 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f68493c0 con 0x5606f6b725d0 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc91785640 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b7a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc90f84640 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b7cd10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc80005940 tx=0x7fbc80031870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da2efd3f1d32f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.643+0000 7fbc6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc6bfff640 1 -- 172.21.15.60:0/309383219 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80035040 con 0x5606f6b725d0 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc955c1740 1 -- 172.21.15.60:0/309383219 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc84024070 con 0x5606f6b725d0 2024-09-12T00:00:16.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc6bfff640 1 -- 172.21.15.60:0/309383219 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbc80004240 con 0x5606f6b725d0 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc6bfff640 1 -- 172.21.15.60:0/309383219 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc80031a60 con 0x5606f6b725d0 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc955c1740 10 client.25253 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc955c1740 1 -- 172.21.15.60:0/309383219 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5606f6b9cb10 con 0x5606f6b725d0 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc6bfff640 1 -- 172.21.15.60:0/309383219 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc84024070 con 0x5606f6b725d0 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc6bfff640 1 -- 172.21.15.60:0/309383219 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbc80004c10 con 0x5606f6b725d0 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc955c1740 10 client.25253 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc955c1740 10 client.25253 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.644+0000 7fbc955c1740 20 client.25253 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.645+0000 7fbc955c1740 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5606f6b9df20 0x5606f6ba0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.645+0000 7fbc955c1740 4 client.25253 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.645+0000 7fbc955c1740 1 -- 172.21.15.60:0/309383219 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606f6ae5860 con 0x5606f6b9df20 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.645+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5606f6b9df20 0x5606f6ba0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.647+0000 7fbc6bfff640 10 client.25253 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.647+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5606f6b9df20 0x5606f6ba0310 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f80ace16ba992837 server_cookie=5b1c2109bb0b0ef2 in_seq=0 out_seq=0 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc6bfff640 1 -- 172.21.15.60:0/309383219 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606f6ae5860 con 0x5606f6b9df20 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc6bfff640 10 client.25253 handle_command_reply: tid=0 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 client.25253 shutdown 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 -- 172.21.15.60:0/309383219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 msgr2=0x5606f6b7cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b7cd10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc80005940 tx=0x7fbc80031870 comp rx=0 tx=0).stop 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 -- 172.21.15.60:0/309383219 shutdown_connections 2024-09-12T00:00:16.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5606f6b9df20 0x5606f6ba0310 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b7a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b79fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 --2- 172.21.15.60:0/309383219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b7cd10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc6bfff640 0 client.25253 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:00:16.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.648+0000 7fbc955c1740 1 -- 172.21.15.60:0/309383219 >> 172.21.15.60:0/309383219 conn(0x5606f6b3b310 msgr2=0x5606f6b74960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:16.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.649+0000 7fbc955c1740 1 -- 172.21.15.60:0/309383219 shutdown_connections 2024-09-12T00:00:16.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.649+0000 7fbc955c1740 1 -- 172.21.15.60:0/309383219 wait complete. 2024-09-12T00:00:16.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.649+0000 7fbc955c1740 20 client.25253 trim_cache size 0 max 16384 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc955c1740 1 Processor -- start 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc955c1740 1 -- start start 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b6dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b75120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b75660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc955c1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c074130 con 0x5606f6b7d370 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc955c1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1a6bf0 con 0x5606f6b725d0 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc955c1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1a5780 con 0x5606f6b73b40 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc91785640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b75660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc91785640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b75660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34472/0 (socket says 172.21.15.60:34472) 2024-09-12T00:00:16.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc91785640 1 -- 172.21.15.60:0/1766905886 learned_addr learned my addr 172.21.15.60:0/1766905886 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b75120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.662+0000 7fbc90f84640 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b6dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc91785640 1 -- 172.21.15.60:0/1766905886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 msgr2=0x5606f6b75120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc91785640 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b75120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc91785640 1 -- 172.21.15.60:0/1766905886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 msgr2=0x5606f6b6dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc91785640 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b6dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc91785640 1 -- 172.21.15.60:0/1766905886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f6b78f70 con 0x5606f6b7d370 2024-09-12T00:00:16.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc91785640 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b75660 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbc84011890 tx=0x7fbc840118c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e421695f0aaa03b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc767fc640 1 -- 172.21.15.60:0/1766905886 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84004bd0 con 0x5606f6b7d370 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc767fc640 1 -- 172.21.15.60:0/1766905886 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc84024070 con 0x5606f6b7d370 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.663+0000 7fbc767fc640 1 -- 172.21.15.60:0/1766905886 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84005710 con 0x5606f6b7d370 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 -- 172.21.15.60:0/1766905886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 msgr2=0x5606f6b75660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b75660 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbc84011890 tx=0x7fbc840118c0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 -- 172.21.15.60:0/1766905886 shutdown_connections 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b7d370 0x5606f6b75660 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b73b40 0x5606f6b75120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 --2- 172.21.15.60:0/1766905886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b725d0 0x5606f6b6dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 -- 172.21.15.60:0/1766905886 >> 172.21.15.60:0/1766905886 conn(0x5606f6b3b310 msgr2=0x5606f6b6d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 -- 172.21.15.60:0/1766905886 shutdown_connections 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 -- 172.21.15.60:0/1766905886 wait complete. 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.664+0000 7fbc955c1740 1 -- start start 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc955c1740 1 Processor -- start 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b725d0 0x5606f6b96d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b73b40 0x5606f6b76e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc955c1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b77590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc955c1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1a6520 con 0x5606f6b73b40 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc955c1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c1a5e50 con 0x5606f6b7d370 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc955c1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8c072110 con 0x5606f6b725d0 2024-09-12T00:00:16.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc955c1740 10 client.0 _ll_register_callbacks cb 0x7fbc80009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc90f84640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b725d0 0x5606f6b96d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc90f84640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b725d0 0x5606f6b96d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41872/0 (socket says 172.21.15.60:41872) 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc90f84640 1 -- 172.21.15.60:0/2174358737 learned_addr learned my addr 172.21.15.60:0/2174358737 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc91785640 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b77590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.665+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b73b40 0x5606f6b76e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc90f84640 1 -- 172.21.15.60:0/2174358737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 msgr2=0x5606f6b77590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc90f84640 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b77590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc90f84640 1 -- 172.21.15.60:0/2174358737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b73b40 msgr2=0x5606f6b76e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc90f84640 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b73b40 0x5606f6b76e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc90f84640 1 -- 172.21.15.60:0/2174358737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f6c0bf20 con 0x5606f6b725d0 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc90f84640 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b725d0 0x5606f6b96d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009850 tx=0x7fbc80003a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cafe8dbef02116ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc6bfff640 1 -- 172.21.15.60:0/2174358737 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80035050 con 0x5606f6b725d0 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc955c1740 1 -- 172.21.15.60:0/2174358737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc84024070 con 0x5606f6b725d0 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.666+0000 7fbc6bfff640 1 -- 172.21.15.60:0/2174358737 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbc80005450 con 0x5606f6b725d0 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc6bfff640 1 -- 172.21.15.60:0/2174358737 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc80056070 con 0x5606f6b725d0 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc955c1740 10 client.25222 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc955c1740 1 -- 172.21.15.60:0/2174358737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5606f6c00ad0 con 0x5606f6b725d0 2024-09-12T00:00:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc6bfff640 1 -- 172.21.15.60:0/2174358737 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc84024070 con 0x5606f6b725d0 2024-09-12T00:00:16.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc6bfff640 1 -- 172.21.15.60:0/2174358737 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbc80003d60 con 0x5606f6b725d0 2024-09-12T00:00:16.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc955c1740 10 client.25222 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:16.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc955c1740 10 client.25222 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc955c1740 20 client.25222 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc955c1740 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5606f6c01270 0x5606f6c03690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc955c1740 4 client.25222 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.667+0000 7fbc955c1740 1 -- 172.21.15.60:0/2174358737 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606f6adfd70 con 0x5606f6c01270 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.668+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5606f6c01270 0x5606f6c03690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.668+0000 7fbc8bfff640 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5606f6c01270 0x5606f6c03690 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63de870ebd712460 server_cookie=4577e93270ff8df4 in_seq=0 out_seq=0 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.668+0000 7fbc6bfff640 10 client.25222 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.668+0000 7fbc6bfff640 1 -- 172.21.15.60:0/2174358737 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606f6adfd70 con 0x5606f6c01270 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.668+0000 7fbc6bfff640 10 client.25222 handle_command_reply: tid=0 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.668+0000 7fbc955c1740 1 client.25222 shutdown 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 -- 172.21.15.60:0/2174358737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b725d0 msgr2=0x5606f6b96d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b725d0 0x5606f6b96d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009850 tx=0x7fbc80003a60 comp rx=0 tx=0).stop 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 -- 172.21.15.60:0/2174358737 shutdown_connections 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5606f6c01270 0x5606f6c03690 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5606f6b7d370 0x5606f6b77590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5606f6b73b40 0x5606f6b76e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc6bfff640 0 client.25222 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 --2- 172.21.15.60:0/2174358737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5606f6b725d0 0x5606f6b96d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 -- 172.21.15.60:0/2174358737 >> 172.21.15.60:0/2174358737 conn(0x5606f6b3b310 msgr2=0x5606f6b6dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 -- 172.21.15.60:0/2174358737 shutdown_connections 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 1 -- 172.21.15.60:0/2174358737 wait complete. 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.669+0000 7fbc955c1740 20 client.25222 trim_cache size 0 max 16384 2024-09-12T00:00:16.674 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:00:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 -- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc7c0a2e10 msgr2=0x7fbc7c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc7c0a2e10 0x7fbc7c0a52d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc84005fd0 tx=0x7fbc840107a0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 -- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c1036e0 msgr2=0x7fbc8c198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c1036e0 0x7fbc8c198b90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800e9f0 tx=0x7fbc7800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 -- 172.21.15.60:0/2933993367 shutdown_connections 2024-09-12T00:00:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbc7c0a2e10 0x7fbc7c0a52d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8c1082a0 0x7fbc8c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc8c1036e0 0x7fbc8c198b90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 --2- 172.21.15.60:0/2933993367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc8c102d30 0x7fbc8c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 -- 172.21.15.60:0/2933993367 >> 172.21.15.60:0/2933993367 conn(0x7fbc8c0fc7d0 msgr2=0x7fbc8c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 -- 172.21.15.60:0/2933993367 shutdown_connections 2024-09-12T00:00:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:16.670+0000 7fbc931e8640 1 -- 172.21.15.60:0/2933993367 wait complete. 2024-09-12T00:00:17.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:16 smithi105 ceph-mon[34805]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T00:00:17.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:16 smithi192 ceph-mon[35487]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T00:00:17.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:16 smithi060 ceph-mon[30953]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T00:00:17.409 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:00:17.753 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 -- 172.21.15.60:0/82828714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c4108300 msgr2=0x7fd3c410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 --2- 172.21.15.60:0/82828714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c4108300 0x7fd3c410ec70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009cd0 tx=0x7fd3bc02a8d0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 -- 172.21.15.60:0/82828714 shutdown_connections 2024-09-12T00:00:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 --2- 172.21.15.60:0/82828714 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c4108300 0x7fd3c410ec70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 --2- 172.21.15.60:0/82828714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c4103780 0x7fd3c4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 --2- 172.21.15.60:0/82828714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3c4102dd0 0x7fd3c41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 -- 172.21.15.60:0/82828714 >> 172.21.15.60:0/82828714 conn(0x7fd3c40fc7d0 msgr2=0x7fd3c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 -- 172.21.15.60:0/82828714 shutdown_connections 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.284+0000 7fd3cabec640 1 -- 172.21.15.60:0/82828714 wait complete. 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.285+0000 7fd3cabec640 1 Processor -- start 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.285+0000 7fd3cabec640 1 -- start start 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.285+0000 7fd3cabec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3c4102dd0 0x7fd3c41986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.285+0000 7fd3cabec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c4103780 0x7fd3c4198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.285+0000 7fd3cabec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c4108300 0x7fd3c419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.285+0000 7fd3cabec640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41122a0 con 0x7fd3c4108300 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.285+0000 7fd3cabec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4112120 con 0x7fd3c4103780 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.285+0000 7fd3cabec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4112420 con 0x7fd3c4102dd0 2024-09-12T00:00:18.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c4103780 0x7fd3c4198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c4103780 0x7fd3c4198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39430/0 (socket says 172.21.15.60:39430) 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 -- 172.21.15.60:0/3329664273 learned_addr learned my addr 172.21.15.60:0/3329664273 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c8988640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3c4102dd0 0x7fd3c41986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 -- 172.21.15.60:0/3329664273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3c4102dd0 msgr2=0x7fd3c41986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3c4102dd0 0x7fd3c41986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 -- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c4108300 msgr2=0x7fd3c419cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c4108300 0x7fd3c419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 -- 172.21.15.60:0/3329664273 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c419d650 con 0x7fd3c4103780 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c8988640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3c4102dd0 0x7fd3c41986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.286+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c4103780 0x7fd3c4198be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000e9f0 tx=0x7fd3b000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.287+0000 7fd3c1ffb640 1 -- 172.21.15.60:0/3329664273 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000ccc0 con 0x7fd3c4103780 2024-09-12T00:00:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.287+0000 7fd3c1ffb640 1 -- 172.21.15.60:0/3329664273 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b0010930 con 0x7fd3c4103780 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.287+0000 7fd3cabec640 1 -- 172.21.15.60:0/3329664273 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c419d940 con 0x7fd3c4103780 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.287+0000 7fd3c1ffb640 1 -- 172.21.15.60:0/3329664273 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0018a30 con 0x7fd3c4103780 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.287+0000 7fd3cabec640 1 -- 172.21.15.60:0/3329664273 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c4100960 con 0x7fd3c4103780 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.289+0000 7fd3c1ffb640 1 -- 172.21.15.60:0/3329664273 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7fd3b0010ae0 con 0x7fd3c4103780 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.289+0000 7fd3ccfc5740 1 Processor -- start 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3ccfc5740 1 -- start start 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8dab40 0x5566fd8d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8d95d0 0x5566fd8d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5566fd83f2f0 con 0x5566fd8e4370 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5566fd7e6cf0 con 0x5566fd8dab40 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5566fd83b2b0 con 0x5566fd8d95d0 2024-09-12T00:00:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3c9189640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8dab40 0x5566fd8d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3c8988640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8d95d0 0x5566fd8d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3c8988640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8d95d0 0x5566fd8d9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41894/0 (socket says 172.21.15.60:41894) 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3c9189640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8dab40 0x5566fd8d9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39438/0 (socket says 172.21.15.60:39438) 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.290+0000 7fd3c8988640 1 -- 172.21.15.60:0/3135720155 learned_addr learned my addr 172.21.15.60:0/3135720155 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c1ffb640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd3b40a2e90 0x7fd3b40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c9189640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd3b40a2e90 0x7fd3b40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c8988640 1 -- 172.21.15.60:0/3135720155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8dab40 msgr2=0x5566fd8d9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c8988640 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8dab40 0x5566fd8d9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c8988640 1 -- 172.21.15.60:0/3135720155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 msgr2=0x5566fd8e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c1ffb640 1 -- 172.21.15.60:0/3329664273 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd3b00cfab0 con 0x7fd3c4103780 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c8988640 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c8988640 1 -- 172.21.15.60:0/3135720155 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566fd7cb3a0 con 0x5566fd8d95d0 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.291+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.292+0000 7fd3c8988640 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8d95d0 0x5566fd8d9a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800aa10 tx=0x7fd3b800aed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313b21707d34f1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.292+0000 7fd3c9189640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd3b40a2e90 0x7fd3b40a5350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009430 tx=0x7fd3bc0095c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.292+0000 7fd3aeffd640 1 -- 172.21.15.60:0/3135720155 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8015070 con 0x5566fd8d95d0 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.292+0000 7fd3aeffd640 1 -- 172.21.15.60:0/3135720155 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b800cc60 con 0x5566fd8d95d0 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.292+0000 7fd3aeffd640 1 -- 172.21.15.60:0/3135720155 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8018740 con 0x5566fd8d95d0 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/3135720155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8d95d0 msgr2=0x5566fd8d9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8d95d0 0x5566fd8d9a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800aa10 tx=0x7fd3b800aed0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/3135720155 shutdown_connections 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8d95d0 0x5566fd8d9a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/3135720155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8dab40 0x5566fd8d9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/3135720155 >> 172.21.15.60:0/3135720155 conn(0x5566fd8a2310 msgr2=0x5566fd8d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/3135720155 shutdown_connections 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/3135720155 wait complete. 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 -- start start 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.293+0000 7fd3ccfc5740 1 Processor -- start 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8e0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 0x5566fd8e1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8e0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5566fd8e7070 con 0x5566fd8dab40 2024-09-12T00:00:18.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8e0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34506/0 (socket says 172.21.15.60:34506) 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 -- 172.21.15.60:0/1643723865 learned_addr learned my addr 172.21.15.60:0/1643723865 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5566fd7fa060 con 0x5566fd8d95d0 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5566fd8e71f0 con 0x5566fd8e4370 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3ccfc5740 10 client.0 _ll_register_callbacks cb 0x5566fd54d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c8988640 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 -- 172.21.15.60:0/1643723865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 msgr2=0x5566fd8e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 0x5566fd8e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 -- 172.21.15.60:0/1643723865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 msgr2=0x5566fd8e3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8e3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 -- 172.21.15.60:0/1643723865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566fd5b03c0 con 0x5566fd8dab40 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.294+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8e0fb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000e9c0 tx=0x7fd3b009bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5626a946afcda27e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.295+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1643723865 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00d7040 con 0x5566fd8dab40 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.295+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1643723865 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd3b00cd3b0 con 0x5566fd8dab40 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.295+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b800cc60 con 0x5566fd8dab40 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.295+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1643723865 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3b009bdd0 con 0x5566fd8dab40 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.295+0000 7fd3ccfc5740 10 client.15681 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.295+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566fd8f2af0 con 0x5566fd8dab40 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.295+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1643723865 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b800cc60 con 0x5566fd8dab40 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1643723865 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd3b00b1070 con 0x5566fd8dab40 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3ccfc5740 10 client.15681 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3ccfc5740 10 client.15681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3ccfc5740 20 client.15681 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5566fd8f3f00 0x5566fd8f6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3ccfc5740 4 client.15681 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:18.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566fd84c860 con 0x5566fd8f3f00 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3c8988640 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5566fd8f3f00 0x5566fd8f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3c8988640 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5566fd8f3f00 0x5566fd8f6330 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ed194ccc7d12eb server_cookie=864c279fca4c67e7 in_seq=0 out_seq=0 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.296+0000 7fd3a3fff640 10 client.15681 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.297+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1643723865 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5566fd84c860 con 0x5566fd8f3f00 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.297+0000 7fd3a3fff640 10 client.15681 handle_command_reply: tid=0 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.297+0000 7fd3ccfc5740 1 client.15681 shutdown 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.297+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 msgr2=0x5566fd8e0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.297+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8e0fb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000e9c0 tx=0x7fd3b009bc90 comp rx=0 tx=0).stop 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 shutdown_connections 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5566fd8f3f00 0x5566fd8f6330 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 0x5566fd8e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8e0fb0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1643723865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8e3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3a3fff640 0 client.15681 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:18.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 >> 172.21.15.60:0/1643723865 conn(0x5566fd8a2310 msgr2=0x5566fd8db960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 shutdown_connections 2024-09-12T00:00:18.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1643723865 wait complete. 2024-09-12T00:00:18.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.298+0000 7fd3ccfc5740 20 client.15681 trim_cache size 0 max 16384 2024-09-12T00:00:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.311+0000 7fd3ccfc5740 1 Processor -- start 2024-09-12T00:00:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.311+0000 7fd3ccfc5740 1 -- start start 2024-09-12T00:00:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.311+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.311+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8dc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.311+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 0x5566fd8dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.311+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41afc40 con 0x5566fd8dab40 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.311+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41b1780 con 0x5566fd8d95d0 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.311+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41b0310 con 0x5566fd8e4370 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c8988640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8dc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34514/0 (socket says 172.21.15.60:34514) 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c3fff640 1 -- 172.21.15.60:0/2221605751 learned_addr learned my addr 172.21.15.60:0/2221605751 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c9189640 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 0x5566fd8dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c3fff640 1 -- 172.21.15.60:0/2221605751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 msgr2=0x5566fd8dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 0x5566fd8dc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c3fff640 1 -- 172.21.15.60:0/2221605751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 msgr2=0x5566fd8e2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8e2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c3fff640 1 -- 172.21.15.60:0/2221605751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566fd8df540 con 0x5566fd8dab40 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.312+0000 7fd3c9189640 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 0x5566fd8dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.313+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8dc120 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00cd1e0 tx=0x7fd3b0097a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c518a90997a413e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.313+0000 7fd3ae7fc640 1 -- 172.21.15.60:0/2221605751 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b009b730 con 0x5566fd8dab40 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.313+0000 7fd3ae7fc640 1 -- 172.21.15.60:0/2221605751 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b00a0180 con 0x5566fd8dab40 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.313+0000 7fd3ae7fc640 1 -- 172.21.15.60:0/2221605751 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00cd610 con 0x5566fd8dab40 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/2221605751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 msgr2=0x5566fd8dc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8dc120 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00cd1e0 tx=0x7fd3b0097a40 comp rx=0 tx=0).stop 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/2221605751 shutdown_connections 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8e4370 0x5566fd8dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8dab40 0x5566fd8dc120 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/2221605751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8e2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/2221605751 >> 172.21.15.60:0/2221605751 conn(0x5566fd8a2310 msgr2=0x5566fd8e2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/2221605751 shutdown_connections 2024-09-12T00:00:18.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.314+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/2221605751 wait complete. 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.315+0000 7fd3ccfc5740 1 -- start start 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.315+0000 7fd3ccfc5740 1 Processor -- start 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.315+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8ec480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8dab40 0x5566fd8ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3ccfc5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41b10b0 con 0x5566fd8e4370 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41b09e0 con 0x5566fd8d95d0 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3ccfc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41adc20 con 0x5566fd8dab40 2024-09-12T00:00:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c9189640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c9189640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34530/0 (socket says 172.21.15.60:34530) 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c9189640 1 -- 172.21.15.60:0/1543649659 learned_addr learned my addr 172.21.15.60:0/1543649659 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3ccfc5740 10 client.0 _ll_register_callbacks cb 0x7fd3b0010dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c8988640 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8ec480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c3fff640 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8dab40 0x5566fd8ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c9189640 1 -- 172.21.15.60:0/1543649659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8dab40 msgr2=0x5566fd8ec9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c9189640 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8dab40 0x5566fd8ec9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c9189640 1 -- 172.21.15.60:0/1543649659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 msgr2=0x5566fd8ec480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c9189640 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8ec480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.316+0000 7fd3c9189640 1 -- 172.21.15.60:0/1543649659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566fd8ed080 con 0x5566fd8e4370 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.317+0000 7fd3c9189640 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e9450 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009cd0 tx=0x7fd3bc02f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb753c83adf9cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.317+0000 7fd3a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.317+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1543649659 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc050030 con 0x5566fd8e4370 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.317+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1543649659 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd3bc047040 con 0x5566fd8e4370 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.317+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1543649659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b00a0180 con 0x5566fd8e4370 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.317+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1543649659 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3bc059030 con 0x5566fd8e4370 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.317+0000 7fd3ccfc5740 10 client.15687 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.317+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1543649659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566fd967990 con 0x5566fd8e4370 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1543649659 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3b00a0180 con 0x5566fd8e4370 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1543649659 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd3bc05c070 con 0x5566fd8e4370 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3ccfc5740 10 client.15687 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3ccfc5740 10 client.15687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3ccfc5740 20 client.15687 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5566fd968140 0x5566fd96a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3ccfc5740 4 client.15687 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:00:18.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1543649659 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5566fd846d70 con 0x5566fd968140 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.318+0000 7fd3c8988640 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5566fd968140 0x5566fd96a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3c8988640 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5566fd968140 0x5566fd96a530 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=becb5a1635e45ee7 server_cookie=5c2df11da7ab71d3 in_seq=0 out_seq=0 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3a3fff640 10 client.15687 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3a3fff640 1 -- 172.21.15.60:0/1543649659 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5566fd846d70 con 0x5566fd968140 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3a3fff640 10 client.15687 handle_command_reply: tid=0 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 client.15687 shutdown 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1543649659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 msgr2=0x5566fd8e9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e9450 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009cd0 tx=0x7fd3bc02f3d0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1543649659 shutdown_connections 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5566fd968140 0x5566fd96a530 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5566fd8e4370 0x5566fd8e9450 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5566fd8dab40 0x5566fd8ec9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3a3fff640 0 client.15687 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:18.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 --2- 172.21.15.60:0/1543649659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5566fd8d95d0 0x5566fd8ec480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.319+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1543649659 >> 172.21.15.60:0/1543649659 conn(0x5566fd8a2310 msgr2=0x5566fd8e3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.320+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1543649659 shutdown_connections 2024-09-12T00:00:18.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.320+0000 7fd3ccfc5740 1 -- 172.21.15.60:0/1543649659 wait complete. 2024-09-12T00:00:18.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.320+0000 7fd3ccfc5740 20 client.15687 trim_cache size 0 max 16384 2024-09-12T00:00:18.324 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:00:18.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 -- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd3b40a2e90 msgr2=0x7fd3b40a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd3b40a2e90 0x7fd3b40a5350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009430 tx=0x7fd3bc0095c0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 -- 172.21.15.60:0/3329664273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c4103780 msgr2=0x7fd3c4198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:18.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c4103780 0x7fd3c4198be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000e9f0 tx=0x7fd3b000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 -- 172.21.15.60:0/3329664273 shutdown_connections 2024-09-12T00:00:18.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd3b40a2e90 0x7fd3b40a5350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c4108300 0x7fd3c419cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c4103780 0x7fd3c4198be0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 --2- 172.21.15.60:0/3329664273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3c4102dd0 0x7fd3c41986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:18.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 -- 172.21.15.60:0/3329664273 >> 172.21.15.60:0/3329664273 conn(0x7fd3c40fc7d0 msgr2=0x7fd3c40fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:18.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 -- 172.21.15.60:0/3329664273 shutdown_connections 2024-09-12T00:00:18.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:18.321+0000 7fd3cabec640 1 -- 172.21.15.60:0/3329664273 wait complete. 2024-09-12T00:00:19.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:18 smithi105 ceph-mon[34805]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T00:00:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:18 smithi192 ceph-mon[35487]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T00:00:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:18 smithi060 ceph-mon[30953]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-12T00:00:20.057 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:00:20.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:00:20.443 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.027+0000 7fec0bc18640 1 -- 172.21.15.60:0/1965857838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04106f50 msgr2=0x7fec0410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.027+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1965857838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04106f50 0x7fec0410eaf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7febfc009cd0 tx=0x7febfc02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.027+0000 7fec0bc18640 1 -- 172.21.15.60:0/1965857838 shutdown_connections 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.027+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1965857838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec04106f50 0x7fec0410eaf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.027+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1965857838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec04100ca0 0x7fec04106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.027+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1965857838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec041002f0 0x7fec041006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.027+0000 7fec0bc18640 1 -- 172.21.15.60:0/1965857838 >> 172.21.15.60:0/1965857838 conn(0x7fec04077220 msgr2=0x7fec040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.028+0000 7fec0bc18640 1 -- 172.21.15.60:0/1965857838 shutdown_connections 2024-09-12T00:00:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.028+0000 7fec0bc18640 1 -- 172.21.15.60:0/1965857838 wait complete. 2024-09-12T00:00:21.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.028+0000 7fec0bc18640 1 Processor -- start 2024-09-12T00:00:21.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.029+0000 7fec0bc18640 1 -- start start 2024-09-12T00:00:21.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec0bc18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041002f0 0x7fec04198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec0bc18640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec04100ca0 0x7fec04198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec0bc18640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec04106f50 0x7fec0419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec0bc18640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec041120e0 con 0x7fec041002f0 2024-09-12T00:00:21.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec0bc18640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec04111f60 con 0x7fec04100ca0 2024-09-12T00:00:21.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec0bc18640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec04112260 con 0x7fec04106f50 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec099b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041002f0 0x7fec04198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec099b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041002f0 0x7fec04198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34556/0 (socket says 172.21.15.60:34556) 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec099b4640 1 -- 172.21.15.60:0/1680157236 learned_addr learned my addr 172.21.15.60:0/1680157236 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec091b3640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec04100ca0 0x7fec04198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec04106f50 0x7fec0419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec091b3640 1 -- 172.21.15.60:0/1680157236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec04106f50 msgr2=0x7fec0419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec091b3640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec04106f50 0x7fec0419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec091b3640 1 -- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041002f0 msgr2=0x7fec04198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec091b3640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041002f0 0x7fec04198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.030+0000 7fec091b3640 1 -- 172.21.15.60:0/1680157236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0419d510 con 0x7fec04100ca0 2024-09-12T00:00:21.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.031+0000 7fec091b3640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec04100ca0 0x7fec04198aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7febf4005fd0 tx=0x7febf400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:21.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.031+0000 7febfaffd640 1 -- 172.21.15.60:0/1680157236 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4009c00 con 0x7fec04100ca0 2024-09-12T00:00:21.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.031+0000 7febfaffd640 1 -- 172.21.15.60:0/1680157236 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7febf4009da0 con 0x7fec04100ca0 2024-09-12T00:00:21.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.031+0000 7febfaffd640 1 -- 172.21.15.60:0/1680157236 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4010460 con 0x7fec04100ca0 2024-09-12T00:00:21.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.031+0000 7fec0bc18640 1 -- 172.21.15.60:0/1680157236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0419d800 con 0x7fec04100ca0 2024-09-12T00:00:21.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.031+0000 7fec0bc18640 1 -- 172.21.15.60:0/1680157236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041011a0 con 0x7fec04100ca0 2024-09-12T00:00:21.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.033+0000 7febfaffd640 1 -- 172.21.15.60:0/1680157236 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7febf4004000 con 0x7fec04100ca0 2024-09-12T00:00:21.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.034+0000 7fec0dff1740 1 Processor -- start 2024-09-12T00:00:21.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.034+0000 7fec0dff1740 1 -- start start 2024-09-12T00:00:21.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.034+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02baff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.034+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bba800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.034+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bbd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.034+0000 7fec0dff1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ed02b15280 con 0x55ed02bbad40 2024-09-12T00:00:21.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.034+0000 7fec0dff1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ed02abcb10 con 0x55ed02bb0480 2024-09-12T00:00:21.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.034+0000 7fec0dff1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ed02b11240 con 0x55ed02bafb60 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7febfaffd640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7febf00a2e10 0x7febf00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bba800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39482/0 (socket says 172.21.15.60:39482) 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 -- 172.21.15.60:0/2206091268 learned_addr learned my addr 172.21.15.60:0/2206091268 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7febf00a2e10 0x7febf00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 -- 172.21.15.60:0/2206091268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 msgr2=0x55ed02baff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02baff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 -- 172.21.15.60:0/2206091268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 msgr2=0x55ed02bbd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec091b3640 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bbd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7febfaffd640 1 -- 172.21.15.60:0/1680157236 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7febf40cf0c0 con 0x7fec04100ca0 2024-09-12T00:00:21.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bbd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 -- 172.21.15.60:0/2206091268 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed02ac91f0 con 0x55ed02bb0480 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec091b3640 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bbd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.035+0000 7fec099b4640 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bba800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec0000bdd0 tx=0x7fec000107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b9d3807cf5b5e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7febeffff640 1 -- 172.21.15.60:0/2206091268 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00005220 con 0x55ed02bb0480 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7febeffff640 1 -- 172.21.15.60:0/2206091268 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec00004ca0 con 0x55ed02bb0480 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7febeffff640 1 -- 172.21.15.60:0/2206091268 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec000118d0 con 0x55ed02bb0480 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7fec0dff1740 1 -- 172.21.15.60:0/2206091268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 msgr2=0x55ed02bba800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bba800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec0000bdd0 tx=0x7fec000107a0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7febf00a2e10 0x7febf00a52d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7febfc006010 tx=0x7febfc03e040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7fec0dff1740 1 -- 172.21.15.60:0/2206091268 shutdown_connections 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bbd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bba800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2206091268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02baff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.036+0000 7fec0dff1740 1 -- 172.21.15.60:0/2206091268 >> 172.21.15.60:0/2206091268 conn(0x55ed02bac0f0 msgr2=0x55ed02bac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:21.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.037+0000 7fec0dff1740 1 -- 172.21.15.60:0/2206091268 shutdown_connections 2024-09-12T00:00:21.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.037+0000 7fec0dff1740 1 -- 172.21.15.60:0/2206091268 wait complete. 2024-09-12T00:00:21.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.037+0000 7fec0dff1740 1 -- start start 2024-09-12T00:00:21.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.037+0000 7fec0dff1740 1 Processor -- start 2024-09-12T00:00:21.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02bb7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bb0480 0x55ed02bb80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bb8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec0dff1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ed02bbd960 con 0x55ed02bb0480 2024-09-12T00:00:21.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec0dff1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ed02acff10 con 0x55ed02bbad40 2024-09-12T00:00:21.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec0dff1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ed02bbdae0 con 0x55ed02bafb60 2024-09-12T00:00:21.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec0dff1740 10 client.0 _ll_register_callbacks cb 0x55ed02a98a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:21.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec091b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bb0480 0x55ed02bb80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec091b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bb0480 0x55ed02bb80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34578/0 (socket says 172.21.15.60:34578) 2024-09-12T00:00:21.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec091b3640 1 -- 172.21.15.60:0/2323520260 learned_addr learned my addr 172.21.15.60:0/2323520260 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:21.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec099b4640 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02bb7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bb8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.038+0000 7fec091b3640 1 -- 172.21.15.60:0/2323520260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 msgr2=0x55ed02bb7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:21.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7fec091b3640 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02bb7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7fec091b3640 1 -- 172.21.15.60:0/2323520260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 msgr2=0x55ed02bb8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:21.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7fec091b3640 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bb8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7fec091b3640 1 -- 172.21.15.60:0/2323520260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed028866a0 con 0x55ed02bb0480 2024-09-12T00:00:21.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7fec091b3640 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bb0480 0x55ed02bb80f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7febf4097e00 tx=0x7febf409af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0e3e5e9a0a1bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:21.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7febed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:21.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7febed7fa640 1 -- 172.21.15.60:0/2323520260 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4020070 con 0x55ed02bb0480 2024-09-12T00:00:21.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7febed7fa640 1 -- 172.21.15.60:0/2323520260 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7febf4052ad0 con 0x55ed02bb0480 2024-09-12T00:00:21.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.039+0000 7fec0dff1740 1 -- 172.21.15.60:0/2323520260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec00004ca0 con 0x55ed02bb0480 2024-09-12T00:00:21.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7febed7fa640 1 -- 172.21.15.60:0/2323520260 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7febf409f730 con 0x55ed02bb0480 2024-09-12T00:00:21.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7fec0dff1740 10 client.15696 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:21.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7fec0dff1740 1 -- 172.21.15.60:0/2323520260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed02bc9460 con 0x55ed02bb0480 2024-09-12T00:00:21.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7febed7fa640 1 -- 172.21.15.60:0/2323520260 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec00004ca0 con 0x55ed02bb0480 2024-09-12T00:00:21.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7febed7fa640 1 -- 172.21.15.60:0/2323520260 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7febf404c1c0 con 0x55ed02bb0480 2024-09-12T00:00:21.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7fec0dff1740 10 client.15696 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:21.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7fec0dff1740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:21.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7fec0dff1740 20 client.15696 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:21.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed02bcabd0 0x55ed02bcd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7fec0dff1740 4 client.15696 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:21.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.040+0000 7fec0dff1740 1 -- 172.21.15.60:0/2323520260 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed02b227f0 con 0x55ed02bcabd0 2024-09-12T00:00:21.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.041+0000 7fec099b4640 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed02bcabd0 0x55ed02bcd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.041+0000 7fec099b4640 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed02bcabd0 0x55ed02bcd010 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34877ef10520bdd8 server_cookie=24799f20479607f6 in_seq=0 out_seq=0 2024-09-12T00:00:21.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.041+0000 7febed7fa640 10 client.15696 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:21.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7febed7fa640 1 -- 172.21.15.60:0/2323520260 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed02b227f0 con 0x55ed02bcabd0 2024-09-12T00:00:21.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7febed7fa640 10 client.15696 handle_command_reply: tid=0 2024-09-12T00:00:21.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 client.15696 shutdown 2024-09-12T00:00:21.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 -- 172.21.15.60:0/2323520260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bb0480 msgr2=0x55ed02bb80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bb0480 0x55ed02bb80f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7febf4097e00 tx=0x7febf409af70 comp rx=0 tx=0).stop 2024-09-12T00:00:21.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 -- 172.21.15.60:0/2323520260 shutdown_connections 2024-09-12T00:00:21.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed02bcabd0 0x55ed02bcd010 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bb8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bb0480 0x55ed02bb80f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2323520260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02bb7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7fec0dff1740 1 -- 172.21.15.60:0/2323520260 >> 172.21.15.60:0/2323520260 conn(0x55ed02bac0f0 msgr2=0x55ed02bb1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:21.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.042+0000 7febed7fa640 0 client.15696 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:21.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.043+0000 7fec0dff1740 1 -- 172.21.15.60:0/2323520260 shutdown_connections 2024-09-12T00:00:21.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.043+0000 7fec0dff1740 1 -- 172.21.15.60:0/2323520260 wait complete. 2024-09-12T00:00:21.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.043+0000 7fec0dff1740 20 client.15696 trim_cache size 0 max 16384 2024-09-12T00:00:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.060+0000 7fec0dff1740 1 Processor -- start 2024-09-12T00:00:21.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.060+0000 7fec0dff1740 1 -- start start 2024-09-12T00:00:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02bd2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bd2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bb15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0dff1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec040721d0 con 0x55ed02bbad40 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0dff1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec04073d10 con 0x55ed02bb0480 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0dff1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec040728a0 con 0x55ed02bafb60 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0a1b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bb15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0a1b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bb15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34582/0 (socket says 172.21.15.60:34582) 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0a1b5640 1 -- 172.21.15.60:0/2898904385 learned_addr learned my addr 172.21.15.60:0/2898904385 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec099b4640 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02bd2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec091b3640 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bd2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0a1b5640 1 -- 172.21.15.60:0/2898904385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 msgr2=0x55ed02bd2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02bd2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0a1b5640 1 -- 172.21.15.60:0/2898904385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 msgr2=0x55ed02bd2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bd2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.061+0000 7fec0a1b5640 1 -- 172.21.15.60:0/2898904385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed02ba7830 con 0x55ed02bbad40 2024-09-12T00:00:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.062+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bb15b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7febfc009cd0 tx=0x7febfc041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2208ca69d61f2534 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.062+0000 7febef7fe640 1 -- 172.21.15.60:0/2898904385 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc066070 con 0x55ed02bbad40 2024-09-12T00:00:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.062+0000 7febef7fe640 1 -- 172.21.15.60:0/2898904385 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7febfc031e50 con 0x55ed02bbad40 2024-09-12T00:00:21.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.062+0000 7febef7fe640 1 -- 172.21.15.60:0/2898904385 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc061480 con 0x55ed02bbad40 2024-09-12T00:00:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 -- 172.21.15.60:0/2898904385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 msgr2=0x55ed02bb15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bb15b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7febfc009cd0 tx=0x7febfc041000 comp rx=0 tx=0).stop 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 -- 172.21.15.60:0/2898904385 shutdown_connections 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bbad40 0x55ed02bb15b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bb0480 0x55ed02bd2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2898904385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bafb60 0x55ed02bd2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 -- 172.21.15.60:0/2898904385 >> 172.21.15.60:0/2898904385 conn(0x55ed02bac0f0 msgr2=0x55ed02bb6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 -- 172.21.15.60:0/2898904385 shutdown_connections 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.063+0000 7fec0dff1740 1 -- 172.21.15.60:0/2898904385 wait complete. 2024-09-12T00:00:21.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 1 -- start start 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 1 Processor -- start 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bafb60 0x55ed02bc3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bb0480 0x55ed02bc35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bbe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec04073640 con 0x55ed02bafb60 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec04072f70 con 0x55ed02bbad40 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec040701d0 con 0x55ed02bb0480 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec0dff1740 10 client.0 _ll_register_callbacks cb 0x7febf400df10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.064+0000 7fec091b3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bb0480 0x55ed02bc35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec091b3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bb0480 0x55ed02bc35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41960/0 (socket says 172.21.15.60:41960) 2024-09-12T00:00:21.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec091b3640 1 -- 172.21.15.60:0/2710221295 learned_addr learned my addr 172.21.15.60:0/2710221295 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec099b4640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bafb60 0x55ed02bc3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bbe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec091b3640 1 -- 172.21.15.60:0/2710221295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 msgr2=0x55ed02bbe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec091b3640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bbe480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec091b3640 1 -- 172.21.15.60:0/2710221295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bafb60 msgr2=0x55ed02bc3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec091b3640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bafb60 0x55ed02bc3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec091b3640 1 -- 172.21.15.60:0/2710221295 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed02bbecb0 con 0x55ed02bb0480 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec0a1b5640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bbe480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec099b4640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bafb60 0x55ed02bc3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7fec091b3640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bb0480 0x55ed02bc35c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febf40ccaf0 tx=0x7febf409b0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8203cbf58679e65f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:21.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7febed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.065+0000 7febed7fa640 1 -- 172.21.15.60:0/2710221295 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4020070 con 0x55ed02bb0480 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7febed7fa640 1 -- 172.21.15.60:0/2710221295 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7febf409aa80 con 0x55ed02bb0480 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 1 -- 172.21.15.60:0/2710221295 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febfc031e50 con 0x55ed02bb0480 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7febed7fa640 1 -- 172.21.15.60:0/2710221295 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7febf40cc5c0 con 0x55ed02bb0480 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 10 client.25243 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 1 -- 172.21.15.60:0/2710221295 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed02c35530 con 0x55ed02bb0480 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7febed7fa640 1 -- 172.21.15.60:0/2710221295 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7febf40a3ff0 con 0x55ed02bb0480 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7febed7fa640 1 -- 172.21.15.60:0/2710221295 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7febf409a380 con 0x55ed02bb0480 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 10 client.25243 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 10 client.25243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 20 client.25243 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:21.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed02c35b50 0x55ed02c37f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:21.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 4 client.25243 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:00:21.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.066+0000 7fec0dff1740 1 -- 172.21.15.60:0/2710221295 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7febfc031e50 con 0x55ed02c35b50 2024-09-12T00:00:21.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.067+0000 7fec099b4640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed02c35b50 0x55ed02c37f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:21.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.067+0000 7febed7fa640 10 client.25243 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:21.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.067+0000 7fec099b4640 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed02c35b50 0x55ed02c37f70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c4342a936c9ef0 server_cookie=e03edabb7c1ca335 in_seq=0 out_seq=0 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.068+0000 7febed7fa640 1 -- 172.21.15.60:0/2710221295 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7febfc031e50 con 0x55ed02c35b50 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.068+0000 7febed7fa640 10 client.25243 handle_command_reply: tid=0 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.068+0000 7fec0dff1740 1 client.25243 shutdown 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 -- 172.21.15.60:0/2710221295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bb0480 msgr2=0x55ed02bc35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bb0480 0x55ed02bc35c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7febf40ccaf0 tx=0x7febf409b0a0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 -- 172.21.15.60:0/2710221295 shutdown_connections 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed02c35b50 0x55ed02c37f70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed02bbad40 0x55ed02bbe480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed02bb0480 0x55ed02bc35c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7febed7fa640 0 client.25243 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 --2- 172.21.15.60:0/2710221295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed02bafb60 0x55ed02bc3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 -- 172.21.15.60:0/2710221295 >> 172.21.15.60:0/2710221295 conn(0x55ed02bac0f0 msgr2=0x55ed02baaa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 -- 172.21.15.60:0/2710221295 shutdown_connections 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 1 -- 172.21.15.60:0/2710221295 wait complete. 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.069+0000 7fec0dff1740 20 client.25243 trim_cache size 0 max 16384 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "51c68eca-cc8c-41ee-8405-ce1f0bfebf5d", 2024-09-12T00:00:21.074 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:00:21.075 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:00:21.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 -- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7febf00a2e10 msgr2=0x7febf00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7febf00a2e10 0x7febf00a52d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7febfc006010 tx=0x7febfc03e040 comp rx=0 tx=0).stop 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 -- 172.21.15.60:0/1680157236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec04100ca0 msgr2=0x7fec04198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec04100ca0 0x7fec04198aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7febf4005fd0 tx=0x7febf400dde0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 -- 172.21.15.60:0/1680157236 shutdown_connections 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7febf00a2e10 0x7febf00a52d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec04106f50 0x7fec0419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec04100ca0 0x7fec04198aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 --2- 172.21.15.60:0/1680157236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec041002f0 0x7fec04198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.070+0000 7fec0bc18640 1 -- 172.21.15.60:0/1680157236 >> 172.21.15.60:0/1680157236 conn(0x7fec04077220 msgr2=0x7fec04105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:21.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.071+0000 7fec0bc18640 1 -- 172.21.15.60:0/1680157236 shutdown_connections 2024-09-12T00:00:21.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:21.071+0000 7fec0bc18640 1 -- 172.21.15.60:0/1680157236 wait complete. 2024-09-12T00:00:21.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:20 smithi105 ceph-mon[34805]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-12T00:00:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:20 smithi192 ceph-mon[35487]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-12T00:00:21.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:20 smithi060 ceph-mon[30953]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-12T00:00:21.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:00:22.259 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.813+0000 7efd75a71640 1 -- 172.21.15.60:0/1166162844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70106f20 msgr2=0x7efd7010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.813+0000 7efd75a71640 1 --2- 172.21.15.60:0/1166162844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70106f20 0x7efd7010eaa0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efd68009ca0 tx=0x7efd6802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.813+0000 7efd75a71640 1 -- 172.21.15.60:0/1166162844 shutdown_connections 2024-09-12T00:00:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.813+0000 7efd75a71640 1 --2- 172.21.15.60:0/1166162844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70106f20 0x7efd7010eaa0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.813+0000 7efd75a71640 1 --2- 172.21.15.60:0/1166162844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd701027a0 0x7efd701067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.813+0000 7efd75a71640 1 --2- 172.21.15.60:0/1166162844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd70101df0 0x7efd701021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.813+0000 7efd75a71640 1 -- 172.21.15.60:0/1166162844 >> 172.21.15.60:0/1166162844 conn(0x7efd700fd8f0 msgr2=0x7efd700ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.813+0000 7efd75a71640 1 -- 172.21.15.60:0/1166162844 shutdown_connections 2024-09-12T00:00:22.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.814+0000 7efd75a71640 1 -- 172.21.15.60:0/1166162844 wait complete. 2024-09-12T00:00:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.814+0000 7efd75a71640 1 Processor -- start 2024-09-12T00:00:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.815+0000 7efd75a71640 1 -- start start 2024-09-12T00:00:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.815+0000 7efd75a71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70101df0 0x7efd700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.815+0000 7efd75a71640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd701027a0 0x7efd70074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.815+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70101df0 0x7efd700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.815+0000 7efd75a71640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd70106f20 0x7efd70074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.815+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70101df0 0x7efd700744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48056/0 (socket says 172.21.15.60:48056) 2024-09-12T00:00:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.815+0000 7efd6f7fe640 1 -- 172.21.15.60:0/297247039 learned_addr learned my addr 172.21.15.60:0/297247039 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.815+0000 7efd6effd640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd701027a0 0x7efd70074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd701120a0 con 0x7efd70101df0 2024-09-12T00:00:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd70111f20 con 0x7efd701027a0 2024-09-12T00:00:22.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd70112220 con 0x7efd70106f20 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd6ffff640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd70106f20 0x7efd70074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd6effd640 1 -- 172.21.15.60:0/297247039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd70106f20 msgr2=0x7efd70074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd6effd640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd70106f20 0x7efd70074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd6effd640 1 -- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70101df0 msgr2=0x7efd700744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd6effd640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70101df0 0x7efd700744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd6effd640 1 -- 172.21.15.60:0/297247039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd701a6960 con 0x7efd701027a0 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.816+0000 7efd6effd640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd701027a0 0x7efd70074a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efd6400e9f0 tx=0x7efd6400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.817+0000 7efd6cff9640 1 -- 172.21.15.60:0/297247039 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6400ccc0 con 0x7efd701027a0 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.817+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd701a6c50 con 0x7efd701027a0 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.817+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd701a7190 con 0x7efd701027a0 2024-09-12T00:00:22.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.817+0000 7efd6cff9640 1 -- 172.21.15.60:0/297247039 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efd64010930 con 0x7efd701027a0 2024-09-12T00:00:22.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.817+0000 7efd6cff9640 1 -- 172.21.15.60:0/297247039 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd640189f0 con 0x7efd701027a0 2024-09-12T00:00:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.820+0000 7efd77e4a740 1 Processor -- start 2024-09-12T00:00:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.820+0000 7efd77e4a740 1 -- start start 2024-09-12T00:00:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.820+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d61880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.820+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.820+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d6ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.820+0000 7efd77e4a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558576cc72e0 con 0x558576d6c680 2024-09-12T00:00:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.820+0000 7efd77e4a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558576c6ece0 con 0x558576d614a0 2024-09-12T00:00:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.820+0000 7efd77e4a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558576cc32a0 con 0x558576d61dc0 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.821+0000 7efd6cff9640 1 -- 172.21.15.60:0/297247039 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7efd64018b90 con 0x7efd701027a0 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.821+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d61880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.821+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d61880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:59390/0 (socket says 172.21.15.60:59390) 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.821+0000 7efd6ffff640 1 -- 172.21.15.60:0/206230033 learned_addr learned my addr 172.21.15.60:0/206230033 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.821+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.821+0000 7efd6effd640 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d6ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.822+0000 7efd6cff9640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efd580a2f10 0x7efd580a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.822+0000 7efd6f7fe640 1 -- 172.21.15.60:0/206230033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 msgr2=0x558576d61880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.822+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d61880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.822+0000 7efd6f7fe640 1 -- 172.21.15.60:0/206230033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 msgr2=0x558576d6ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.822+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d6ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.822+0000 7efd6f7fe640 1 -- 172.21.15.60:0/206230033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558576c53440 con 0x558576d61dc0 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.822+0000 7efd6ffff640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efd580a2f10 0x7efd580a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.822+0000 7efd6effd640 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d6ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.823+0000 7efd6cff9640 1 -- 172.21.15.60:0/297247039 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7efd640cfae0 con 0x7efd701027a0 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.823+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6c140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd60004590 tx=0x7efd6000bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40e9ed51f810973d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.823+0000 7efd6ffff640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efd580a2f10 0x7efd580a53d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd68009430 tx=0x7efd6802f390 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.823+0000 7efd55ffb640 1 -- 172.21.15.60:0/206230033 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60003bd0 con 0x558576d61dc0 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.824+0000 7efd55ffb640 1 -- 172.21.15.60:0/206230033 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efd60015070 con 0x558576d61dc0 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.824+0000 7efd55ffb640 1 -- 172.21.15.60:0/206230033 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd60004dd0 con 0x558576d61dc0 2024-09-12T00:00:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.824+0000 7efd77e4a740 1 -- 172.21.15.60:0/206230033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 msgr2=0x558576d6c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.824+0000 7efd77e4a740 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6c140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd60004590 tx=0x7efd6000bbb0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.824+0000 7efd77e4a740 1 -- 172.21.15.60:0/206230033 shutdown_connections 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.824+0000 7efd77e4a740 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d6ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.824+0000 7efd77e4a740 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6c140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.825+0000 7efd77e4a740 1 --2- 172.21.15.60:0/206230033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d61880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.825+0000 7efd77e4a740 1 -- 172.21.15.60:0/206230033 >> 172.21.15.60:0/206230033 conn(0x558576d5da30 msgr2=0x558576d5de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.825+0000 7efd77e4a740 1 -- 172.21.15.60:0/206230033 shutdown_connections 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.825+0000 7efd77e4a740 1 -- 172.21.15.60:0/206230033 wait complete. 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.825+0000 7efd77e4a740 1 -- start start 2024-09-12T00:00:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.825+0000 7efd77e4a740 1 Processor -- start 2024-09-12T00:00:22.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.826+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d6bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.826+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d691d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.826+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d69710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.826+0000 7efd77e4a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558576d6f250 con 0x558576d6c680 2024-09-12T00:00:22.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.826+0000 7efd77e4a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558576c82050 con 0x558576d614a0 2024-09-12T00:00:22.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.826+0000 7efd77e4a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558576d6f3d0 con 0x558576d61dc0 2024-09-12T00:00:22.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d6bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6effd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6effd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d691d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:53420/0 (socket says 172.21.15.60:53420) 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6effd640 1 -- 172.21.15.60:0/1519003646 learned_addr learned my addr 172.21.15.60:0/1519003646 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6ffff640 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d69710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd77e4a740 10 client.0 _ll_register_callbacks cb 0x558576cc2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6ffff640 1 -- 172.21.15.60:0/1519003646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 msgr2=0x558576d691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6ffff640 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6ffff640 1 -- 172.21.15.60:0/1519003646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 msgr2=0x558576d6bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6ffff640 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d6bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.827+0000 7efd6ffff640 1 -- 172.21.15.60:0/1519003646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558576a383c0 con 0x558576d6c680 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.828+0000 7efd6ffff640 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d69710 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efd68006010 tx=0x7efd680093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2746043a2ea28d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.828+0000 7efd4effd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.828+0000 7efd4effd640 1 -- 172.21.15.60:0/1519003646 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68004690 con 0x558576d6c680 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.828+0000 7efd4effd640 1 -- 172.21.15.60:0/1519003646 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7efd6802f610 con 0x558576d6c680 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.828+0000 7efd77e4a740 1 -- 172.21.15.60:0/1519003646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd60015070 con 0x558576d6c680 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.828+0000 7efd4effd640 1 -- 172.21.15.60:0/1519003646 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd68004830 con 0x558576d6c680 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.828+0000 7efd77e4a740 10 client.15714 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.828+0000 7efd77e4a740 1 -- 172.21.15.60:0/1519003646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558576d7abd0 con 0x558576d6c680 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.829+0000 7efd4effd640 1 -- 172.21.15.60:0/1519003646 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efd68036040 con 0x558576d6c680 2024-09-12T00:00:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.829+0000 7efd4effd640 1 -- 172.21.15.60:0/1519003646 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7efd68030a00 con 0x558576d6c680 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.829+0000 7efd77e4a740 10 client.15714 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.829+0000 7efd77e4a740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.829+0000 7efd77e4a740 20 client.15714 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.829+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558576d7bfe0 0x558576d7e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.829+0000 7efd77e4a740 4 client.15714 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.829+0000 7efd77e4a740 1 -- 172.21.15.60:0/1519003646 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efd60015070 con 0x558576d7bfe0 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.830+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558576d7bfe0 0x558576d7e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.830+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558576d7bfe0 0x558576d7e3d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb062a0a174f081a server_cookie=894d2fe72fd56627 in_seq=0 out_seq=0 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.830+0000 7efd4effd640 10 client.15714 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd4effd640 1 -- 172.21.15.60:0/1519003646 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7efd60015070 con 0x558576d7bfe0 2024-09-12T00:00:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd4effd640 10 client.15714 handle_command_reply: tid=0 2024-09-12T00:00:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 client.15714 shutdown 2024-09-12T00:00:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 -- 172.21.15.60:0/1519003646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 msgr2=0x558576d69710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d69710 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efd68006010 tx=0x7efd680093a0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 -- 172.21.15.60:0/1519003646 shutdown_connections 2024-09-12T00:00:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558576d7bfe0 0x558576d7e3d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d69710 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1519003646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d6bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 -- 172.21.15.60:0/1519003646 >> 172.21.15.60:0/1519003646 conn(0x558576d5da30 msgr2=0x558576d5cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd4effd640 0 client.15714 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 -- 172.21.15.60:0/1519003646 shutdown_connections 2024-09-12T00:00:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.831+0000 7efd77e4a740 1 -- 172.21.15.60:0/1519003646 wait complete. 2024-09-12T00:00:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.832+0000 7efd77e4a740 20 client.15714 trim_cache size 0 max 16384 2024-09-12T00:00:22.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.866+0000 7efd77e4a740 1 Processor -- start 2024-09-12T00:00:22.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.866+0000 7efd77e4a740 1 -- start start 2024-09-12T00:00:22.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d64720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d83ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd77e4a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c00e650 con 0x558576d6c680 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd77e4a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c010190 con 0x558576d614a0 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d83ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d83ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48078/0 (socket says 172.21.15.60:48078) 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6ffff640 1 -- 172.21.15.60:0/1803992676 learned_addr learned my addr 172.21.15.60:0/1803992676 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd77e4a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c00ed20 con 0x558576d61dc0 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d64720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6effd640 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6ffff640 1 -- 172.21.15.60:0/1803992676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 msgr2=0x558576d6b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:22.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6ffff640 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6ffff640 1 -- 172.21.15.60:0/1803992676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 msgr2=0x558576d64720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:22.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6ffff640 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d64720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.867+0000 7efd6ffff640 1 -- 172.21.15.60:0/1803992676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558576d61bf0 con 0x558576d6c680 2024-09-12T00:00:22.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.868+0000 7efd6ffff640 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d83ca0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efd68005fe0 tx=0x7efd68031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b5d3f026061ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:22.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.868+0000 7efd557fa640 1 -- 172.21.15.60:0/1803992676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68049440 con 0x558576d6c680 2024-09-12T00:00:22.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.868+0000 7efd557fa640 1 -- 172.21.15.60:0/1803992676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efd6805f020 con 0x558576d6c680 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.868+0000 7efd557fa640 1 -- 172.21.15.60:0/1803992676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68004b40 con 0x558576d6c680 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 -- 172.21.15.60:0/1803992676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 msgr2=0x558576d83ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d83ca0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efd68005fe0 tx=0x7efd68031a10 comp rx=0 tx=0).stop 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 -- 172.21.15.60:0/1803992676 shutdown_connections 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d6c680 0x558576d83ca0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d61dc0 0x558576d6b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 --2- 172.21.15.60:0/1803992676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d64720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 -- 172.21.15.60:0/1803992676 >> 172.21.15.60:0/1803992676 conn(0x558576d5da30 msgr2=0x558576d6aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 -- 172.21.15.60:0/1803992676 shutdown_connections 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 -- 172.21.15.60:0/1803992676 wait complete. 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.869+0000 7efd77e4a740 1 -- start start 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd77e4a740 1 Processor -- start 2024-09-12T00:00:22.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d70530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d61dc0 0x558576d70a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd77e4a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d6c680 0x558576d70fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd6effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d61dc0 0x558576d70a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd6effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d61dc0 0x558576d70a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48080/0 (socket says 172.21.15.60:48080) 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd6effd640 1 -- 172.21.15.60:0/4122404571 learned_addr learned my addr 172.21.15.60:0/4122404571 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c00fac0 con 0x558576d61dc0 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c00f3f0 con 0x558576d614a0 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c00c630 con 0x558576d6c680 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d70530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.870+0000 7efd77e4a740 10 client.0 _ll_register_callbacks cb 0x7efd68009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd6effd640 1 -- 172.21.15.60:0/4122404571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d6c680 msgr2=0x558576d70fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd6effd640 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d6c680 0x558576d70fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd6effd640 1 -- 172.21.15.60:0/4122404571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 msgr2=0x558576d70530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:22.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd6effd640 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d70530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd6effd640 1 -- 172.21.15.60:0/4122404571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558576dee5e0 con 0x558576d61dc0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd6effd640 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d61dc0 0x558576d70a70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efd64098200 tx=0x7efd6409b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42a3490ad1cefdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd4effd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd4effd640 1 -- 172.21.15.60:0/4122404571 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6409f020 con 0x558576d61dc0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.871+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd6805f020 con 0x558576d61dc0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.872+0000 7efd4effd640 1 -- 172.21.15.60:0/4122404571 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7efd640cd380 con 0x558576d61dc0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd4effd640 1 -- 172.21.15.60:0/4122404571 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd640a0150 con 0x558576d61dc0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd77e4a740 10 client.15720 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558576def900 con 0x558576d61dc0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd4effd640 1 -- 172.21.15.60:0/4122404571 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efd6805f020 con 0x558576d61dc0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd4effd640 1 -- 172.21.15.60:0/4122404571 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7efd64010ae0 con 0x558576d61dc0 2024-09-12T00:00:22.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd77e4a740 10 client.15720 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd77e4a740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd77e4a740 20 client.15720 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd77e4a740 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558576df0060 0x558576df2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd77e4a740 4 client.15720 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.873+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558576cd4850 con 0x558576df0060 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.874+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558576df0060 0x558576df2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.874+0000 7efd4effd640 10 client.15720 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd6f7fe640 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558576df0060 0x558576df2480 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af2670d9ccdeedde server_cookie=16ff95796f5ebadd in_seq=0 out_seq=0 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd4effd640 1 -- 172.21.15.60:0/4122404571 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558576cd4850 con 0x558576df0060 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd4effd640 10 client.15720 handle_command_reply: tid=0 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 client.15720 shutdown 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d61dc0 msgr2=0x558576d70a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d61dc0 0x558576d70a70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efd64098200 tx=0x7efd6409b7c0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 shutdown_connections 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558576df0060 0x558576df2480 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558576d6c680 0x558576d70fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558576d61dc0 0x558576d70a70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stdout: "51c68eca-cc8c-41ee-8405-ce1f0bfebf5d": { 2024-09-12T00:00:22.880 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "51c68eca-cc8c-41ee-8405-ce1f0bfebf5d", 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 --2- 172.21.15.60:0/4122404571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558576d614a0 0x558576d70530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.875+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 >> 172.21.15.60:0/4122404571 conn(0x558576d5da30 msgr2=0x558576d5cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.876+0000 7efd4effd640 0 client.15720 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.876+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 shutdown_connections 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.876+0000 7efd77e4a740 1 -- 172.21.15.60:0/4122404571 wait complete. 2024-09-12T00:00:22.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.876+0000 7efd77e4a740 20 client.15720 trim_cache size 0 max 16384 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.876+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efd580a2f10 msgr2=0x7efd580a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.876+0000 7efd75a71640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efd580a2f10 0x7efd580a53d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd68009430 tx=0x7efd6802f390 comp rx=0 tx=0).stop 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.876+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd701027a0 msgr2=0x7efd70074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.876+0000 7efd75a71640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd701027a0 0x7efd70074a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efd6400e9f0 tx=0x7efd6400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.877+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 shutdown_connections 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.877+0000 7efd75a71640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efd580a2f10 0x7efd580a53d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.877+0000 7efd75a71640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd70106f20 0x7efd70074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.877+0000 7efd75a71640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd701027a0 0x7efd70074a30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.877+0000 7efd75a71640 1 --2- 172.21.15.60:0/297247039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd70101df0 0x7efd700744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.877+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 >> 172.21.15.60:0/297247039 conn(0x7efd700fd8f0 msgr2=0x7efd700fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.877+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 shutdown_connections 2024-09-12T00:00:22.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:22.877+0000 7efd75a71640 1 -- 172.21.15.60:0/297247039 wait complete. 2024-09-12T00:00:23.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:22 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:00:23.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:22 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:00:23.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:22 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:00:23.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:22 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:00:23.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:22 smithi060 ceph-mon[30953]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:00:23.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:22 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:00:23.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:22 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:00:23.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:22 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:00:23.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:22 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:00:23.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:22 smithi105 ceph-mon[34805]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:00:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:22 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:00:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:22 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:00:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:22 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:00:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:22 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:00:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:22 smithi192 ceph-mon[35487]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-12T00:00:23.694 INFO:tasks.cephfs.filesystem:scrub status for tag:51c68eca-cc8c-41ee-8405-ce1f0bfebf5d - {'path': '/', 'tag': '51c68eca-cc8c-41ee-8405-ce1f0bfebf5d', 'options': 'recursive,force'} 2024-09-12T00:00:25.185 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:24 smithi060 ceph-mon[30953]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T00:00:25.186 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:24 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:00:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:24 smithi105 ceph-mon[34805]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T00:00:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:24 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:00:25.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:24 smithi192 ceph-mon[35487]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-12T00:00:25.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:24 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:00:27.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:26 smithi105 ceph-mon[34805]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:27.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:26 smithi192 ceph-mon[35487]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:27.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:26 smithi060 ceph-mon[30953]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:29.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:28 smithi105 ceph-mon[34805]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:28 smithi192 ceph-mon[35487]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:29.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:28 smithi060 ceph-mon[30953]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:30 smithi105 ceph-mon[34805]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:00:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:00:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:00:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:00:31.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:30 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:00:31.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:30 smithi192 ceph-mon[35487]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:00:31.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:00:31.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:00:31.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:00:31.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:30 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:00:31.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:30 smithi060 ceph-mon[30953]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:00:31.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:00:31.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:00:31.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:00:31.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:30 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:00:32.281 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:00:32.630 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:33.068 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:32 smithi060 ceph-mon[30953]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:33.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 -- 172.21.15.60:0/1772430284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198102570 msgr2=0x7fb1981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:33.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1772430284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198102570 0x7fb1981029b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009900 tx=0x7fb18c02a480 comp rx=0 tx=0).stop 2024-09-12T00:00:33.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 -- 172.21.15.60:0/1772430284 shutdown_connections 2024-09-12T00:00:33.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1772430284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb198102ef0 0x7fb19810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1772430284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198102570 0x7fb1981029b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1772430284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb198100e20 0x7fb198101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 -- 172.21.15.60:0/1772430284 >> 172.21.15.60:0/1772430284 conn(0x7fb1980fc7d0 msgr2=0x7fb1980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 -- 172.21.15.60:0/1772430284 shutdown_connections 2024-09-12T00:00:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.155+0000 7fb19c89d640 1 -- 172.21.15.60:0/1772430284 wait complete. 2024-09-12T00:00:33.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19c89d640 1 Processor -- start 2024-09-12T00:00:33.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19c89d640 1 -- start start 2024-09-12T00:00:33.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19c89d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198100e20 0x7fb198198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:33.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19c89d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb198102570 0x7fb198198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:33.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19c89d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb198102ef0 0x7fb19819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:33.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19c89d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981110f0 con 0x7fb198100e20 2024-09-12T00:00:33.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19c89d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb198110f70 con 0x7fb198102570 2024-09-12T00:00:33.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19c89d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb198111270 con 0x7fb198102ef0 2024-09-12T00:00:33.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198100e20 0x7fb198198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:33.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198100e20 0x7fb198198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45648/0 (socket says 172.21.15.60:45648) 2024-09-12T00:00:33.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.156+0000 7fb19659c640 1 -- 172.21.15.60:0/1118445981 learned_addr learned my addr 172.21.15.60:0/1118445981 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:33.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb195d9b640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb198102570 0x7fb198198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:33.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb196d9d640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb198102ef0 0x7fb19819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb19659c640 1 -- 172.21.15.60:0/1118445981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb198102ef0 msgr2=0x7fb19819cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb19659c640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb198102ef0 0x7fb19819cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb19659c640 1 -- 172.21.15.60:0/1118445981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb198102570 msgr2=0x7fb198198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb19659c640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb198102570 0x7fb198198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb19659c640 1 -- 172.21.15.60:0/1118445981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19819d610 con 0x7fb198100e20 2024-09-12T00:00:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb196d9d640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb198102ef0 0x7fb19819cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:33.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb19659c640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198100e20 0x7fb198198660 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb18800d950 tx=0x7fb18800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.157+0000 7fb1877fe640 1 -- 172.21.15.60:0/1118445981 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188017070 con 0x7fb198100e20 2024-09-12T00:00:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.158+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19819d900 con 0x7fb198100e20 2024-09-12T00:00:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.158+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1981a51e0 con 0x7fb198100e20 2024-09-12T00:00:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.158+0000 7fb1877fe640 1 -- 172.21.15.60:0/1118445981 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb188009c30 con 0x7fb198100e20 2024-09-12T00:00:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.158+0000 7fb1877fe640 1 -- 172.21.15.60:0/1118445981 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18800f740 con 0x7fb198100e20 2024-09-12T00:00:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.159+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb198101200 con 0x7fb198100e20 2024-09-12T00:00:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.161+0000 7fb1877fe640 1 -- 172.21.15.60:0/1118445981 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7fb188010a80 con 0x7fb198100e20 2024-09-12T00:00:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.162+0000 7fb1877fe640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb1800a2e90 0x7fb1800a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.162+0000 7fb195d9b640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb1800a2e90 0x7fb1800a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.162+0000 7fb1877fe640 1 -- 172.21.15.60:0/1118445981 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb1880cf5d0 con 0x7fb198100e20 2024-09-12T00:00:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.162+0000 7fb195d9b640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb1800a2e90 0x7fb1800a5350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb18c000c00 tx=0x7fb18c005e80 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.166+0000 7fb1877fe640 1 -- 172.21.15.60:0/1118445981 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb188009de0 con 0x7fb198100e20 2024-09-12T00:00:33.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:32 smithi105 ceph-mon[34805]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:33.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:32 smithi192 ceph-mon[35487]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:00:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.568+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb19810a0a0 con 0x7fb198100e20 2024-09-12T00:00:33.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.569+0000 7fb1877fe640 1 -- 172.21.15.60:0/1118445981 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7fb18809b940 con 0x7fb198100e20 2024-09-12T00:00:33.569 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:00:33.569 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:00:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-12T00:00:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.571+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb1800a2e90 msgr2=0x7fb1800a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:33.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.571+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb1800a2e90 0x7fb1800a5350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb18c000c00 tx=0x7fb18c005e80 comp rx=0 tx=0).stop 2024-09-12T00:00:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.571+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198100e20 msgr2=0x7fb198198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.571+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198100e20 0x7fb198198660 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb18800d950 tx=0x7fb18800de10 comp rx=0 tx=0).stop 2024-09-12T00:00:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.571+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 shutdown_connections 2024-09-12T00:00:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.572+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb1800a2e90 0x7fb1800a5350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.572+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb198102ef0 0x7fb19819cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.572+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb198102570 0x7fb198198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.572+0000 7fb19c89d640 1 --2- 172.21.15.60:0/1118445981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb198100e20 0x7fb198198660 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:33.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.572+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 >> 172.21.15.60:0/1118445981 conn(0x7fb1980fc7d0 msgr2=0x7fb19806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:33.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.572+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 shutdown_connections 2024-09-12T00:00:33.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:33.572+0000 7fb19c89d640 1 -- 172.21.15.60:0/1118445981 wait complete. 2024-09-12T00:00:34.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:33 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1118445981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:34.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:33 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1118445981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:34.333 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:33 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1118445981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:34.375 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24496 quiesce db --set-id 5bc56bcb --release --await' 2024-09-12T00:00:34.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24496 quiesce db --set-id 5bc56bcb --release --await 2024-09-12T00:00:34.699 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:35.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:34 smithi060 ceph-mon[30953]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:00:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:34 smithi105 ceph-mon[34805]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:00:35.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:34 smithi192 ceph-mon[35487]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:00:35.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.471+0000 7fdfc29f9640 1 -- 172.21.15.60:0/1213227517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc102d30 msgr2=0x7fdfbc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.471+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/1213227517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc102d30 0x7fdfbc103110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009930 tx=0x7fdfac02a420 comp rx=0 tx=0).stop 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.471+0000 7fdfc29f9640 1 -- 172.21.15.60:0/1213227517 shutdown_connections 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.472+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/1213227517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfbc1082a0 0x7fdfbc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.472+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/1213227517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfbc1036e0 0x7fdfbc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.472+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/1213227517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc102d30 0x7fdfbc103110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.472+0000 7fdfc29f9640 1 -- 172.21.15.60:0/1213227517 >> 172.21.15.60:0/1213227517 conn(0x7fdfbc0fc7d0 msgr2=0x7fdfbc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.472+0000 7fdfc29f9640 1 -- 172.21.15.60:0/1213227517 shutdown_connections 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.472+0000 7fdfc29f9640 1 -- 172.21.15.60:0/1213227517 wait complete. 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.472+0000 7fdfc29f9640 1 Processor -- start 2024-09-12T00:00:35.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.472+0000 7fdfc29f9640 1 -- start start 2024-09-12T00:00:35.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc29f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc102d30 0x7fdfbc198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc29f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfbc1036e0 0x7fdfbc198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc29f9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfbc1082a0 0x7fdfbc19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc29f9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc1121c0 con 0x7fdfbc102d30 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc29f9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc112040 con 0x7fdfbc1082a0 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc29f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc112340 con 0x7fdfbc1036e0 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfbbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc102d30 0x7fdfbc198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc0f96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfbc1082a0 0x7fdfbc19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfbc1036e0 0x7fdfbc198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc0f96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfbc1082a0 0x7fdfbc19cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:60778/0 (socket says 172.21.15.60:60778) 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.473+0000 7fdfc0f96640 1 -- 172.21.15.60:0/2936586204 learned_addr learned my addr 172.21.15.60:0/2936586204 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:35.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfc0f96640 1 -- 172.21.15.60:0/2936586204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfbc1036e0 msgr2=0x7fdfbc198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfc0f96640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfbc1036e0 0x7fdfbc198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfc0f96640 1 -- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc102d30 msgr2=0x7fdfbc198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfc0f96640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc102d30 0x7fdfbc198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfc0f96640 1 -- 172.21.15.60:0/2936586204 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc19d610 con 0x7fdfbc1082a0 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfc0f96640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfbc1082a0 0x7fdfbc19cf30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400eb10 tx=0x7fdfb400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfb97fa640 1 -- 172.21.15.60:0/2936586204 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4004b20 con 0x7fdfbc1082a0 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfb97fa640 1 -- 172.21.15.60:0/2936586204 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfb4004cc0 con 0x7fdfbc1082a0 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfc29f9640 1 -- 172.21.15.60:0/2936586204 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc19d900 con 0x7fdfbc1082a0 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfb97fa640 1 -- 172.21.15.60:0/2936586204 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40107f0 con 0x7fdfbc1082a0 2024-09-12T00:00:35.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.474+0000 7fdfc29f9640 1 -- 172.21.15.60:0/2936586204 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc1a51e0 con 0x7fdfbc1082a0 2024-09-12T00:00:35.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.477+0000 7fdfc4dd2740 1 Processor -- start 2024-09-12T00:00:35.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.478+0000 7fdfb97fa640 1 -- 172.21.15.60:0/2936586204 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7fdfb4005020 con 0x7fdfbc1082a0 2024-09-12T00:00:35.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.478+0000 7fdfc4dd2740 1 -- start start 2024-09-12T00:00:35.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.478+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d060 0x55991103d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.478+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d980 0x559911047d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991104a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d060 0x55991103d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfbbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d980 0x559911047d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d060 0x55991103d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:60788/0 (socket says 172.21.15.60:60788) 2024-09-12T00:00:35.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfbbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d980 0x559911047d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45674/0 (socket says 172.21.15.60:45674) 2024-09-12T00:00:35.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/254038079 learned_addr learned my addr 172.21.15.60:0/254038079 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:35.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfb97fa640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdfa40a2e10 0x7fdfa40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/254038079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559910fa2620 con 0x55991103d980 2024-09-12T00:00:35.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/254038079 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559910f49e50 con 0x55991103d060 2024-09-12T00:00:35.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/254038079 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559910f9e5e0 con 0x559911048240 2024-09-12T00:00:35.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfb97fa640 1 -- 172.21.15.60:0/2936586204 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fdfb40cfb90 con 0x7fdfbc1082a0 2024-09-12T00:00:35.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991104a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.479+0000 7fdfc0f96640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdfa40a2e10 0x7fdfa40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/254038079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 msgr2=0x55991104a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991104a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/254038079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d980 msgr2=0x559911047d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d980 0x559911047d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/254038079 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559910f3ad40 con 0x55991103d060 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d980 0x559911047d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfc0f96640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdfa40a2e10 0x7fdfa40a52d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40cd210 tx=0x7fdfb400efd0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d060 0x55991103d440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00058c0 tx=0x7fdfb0005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b3366bb0aa69e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfa27fc640 1 -- 172.21.15.60:0/254038079 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0004050 con 0x55991103d060 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.480+0000 7fdfa27fc640 1 -- 172.21.15.60:0/254038079 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfb00041f0 con 0x55991103d060 2024-09-12T00:00:35.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.481+0000 7fdfa27fc640 1 -- 172.21.15.60:0/254038079 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00108f0 con 0x55991103d060 2024-09-12T00:00:35.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.481+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/254038079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d060 msgr2=0x55991103d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.481+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d060 0x55991103d440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00058c0 tx=0x7fdfb0005850 comp rx=0 tx=0).stop 2024-09-12T00:00:35.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.481+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/254038079 shutdown_connections 2024-09-12T00:00:35.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.481+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991104a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.481+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d980 0x559911047d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.482+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/254038079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d060 0x55991103d440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.482+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/254038079 >> 172.21.15.60:0/254038079 conn(0x5599110395f0 msgr2=0x5599110399d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.482+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/254038079 shutdown_connections 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.482+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/254038079 wait complete. 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 1 -- start start 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 1 Processor -- start 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x5599110451d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d980 0x559911045710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x559911045c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55991104ae10 con 0x55991103d060 2024-09-12T00:00:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559910f2af10 con 0x55991103d980 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55991104af90 con 0x559911048240 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfc4dd2740 10 client.0 _ll_register_callbacks cb 0x559910f4edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.483+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x5599110451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x5599110451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45680/0 (socket says 172.21.15.60:45680) 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/1332192169 learned_addr learned my addr 172.21.15.60:0/1332192169 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d980 0x559911045710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x559911045c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbbfff640 1 -- 172.21.15.60:0/1332192169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 msgr2=0x559911045c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x559911045c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbbfff640 1 -- 172.21.15.60:0/1332192169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 msgr2=0x5599110451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x5599110451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbbfff640 1 -- 172.21.15.60:0/1332192169 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559910cb1580 con 0x55991103d980 2024-09-12T00:00:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d980 0x559911045710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdfac005940 tx=0x7fdfac031870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=516cbc8a2dea7802 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:35.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdf9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:00:35.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.484+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/1332192169 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac035040 con 0x55991103d980 2024-09-12T00:00:35.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/1332192169 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfb00041f0 con 0x55991103d980 2024-09-12T00:00:35.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/1332192169 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fdfac004240 con 0x55991103d980 2024-09-12T00:00:35.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/1332192169 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdfac031a60 con 0x55991103d980 2024-09-12T00:00:35.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 10 client.25328 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/1332192169 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559910d7b960 con 0x55991103d980 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/1332192169 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfb00041f0 con 0x55991103d980 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/1332192169 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdfac046600 con 0x55991103d980 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 10 client.25328 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 10 client.25328 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 20 client.25328 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559911057df0 0x55991105a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 4 client.25328 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.485+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/1332192169 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559910fafb90 con 0x559911057df0 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.486+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559911057df0 0x55991105a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.486+0000 7fdf9b7fe640 10 client.25328 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.486+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559911057df0 0x55991105a1e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9033fee84a7b082b server_cookie=a2aa5cf6b2d3b6cc in_seq=0 out_seq=0 2024-09-12T00:00:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/1332192169 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559910fafb90 con 0x559911057df0 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdf9b7fe640 10 client.25328 handle_command_reply: tid=0 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 client.25328 shutdown 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/1332192169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d980 msgr2=0x559911045710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d980 0x559911045710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdfac005940 tx=0x7fdfac031870 comp rx=0 tx=0).stop 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/1332192169 shutdown_connections 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559911057df0 0x55991105a1e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x559911045c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdf9b7fe640 0 client.25328 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55991103d980 0x559911045710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/1332192169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x5599110451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.487+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/1332192169 >> 172.21.15.60:0/1332192169 conn(0x5599110395f0 msgr2=0x559911038750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.488+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/1332192169 shutdown_connections 2024-09-12T00:00:35.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.488+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/1332192169 wait complete. 2024-09-12T00:00:35.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.488+0000 7fdfc4dd2740 20 client.25328 trim_cache size 0 max 16384 2024-09-12T00:00:35.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.521+0000 7fdfc4dd2740 1 Processor -- start 2024-09-12T00:00:35.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.521+0000 7fdfc4dd2740 1 -- start start 2024-09-12T00:00:35.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.521+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911047140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.521+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991105fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911057df0 0x55991105ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc1ab6f0 con 0x55991103d060 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc1ad230 con 0x559911057df0 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc1abdc0 con 0x559911048240 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911047140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911047140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45694/0 (socket says 172.21.15.60:45694) 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/3755659685 learned_addr learned my addr 172.21.15.60:0/3755659685 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991105fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911057df0 0x55991105ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbbfff640 1 -- 172.21.15.60:0/3755659685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911057df0 msgr2=0x55991105ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911057df0 0x55991105ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbbfff640 1 -- 172.21.15.60:0/3755659685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 msgr2=0x559911047140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:35.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911047140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.522+0000 7fdfbbfff640 1 -- 172.21.15.60:0/3755659685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559911040dd0 con 0x559911048240 2024-09-12T00:00:35.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.523+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991105fa60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x559911046780 tx=0x7fdfac02a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29eaae3f3501499 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:35.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.523+0000 7fdfa1ffb640 1 -- 172.21.15.60:0/3755659685 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac035070 con 0x559911048240 2024-09-12T00:00:35.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.523+0000 7fdfa1ffb640 1 -- 172.21.15.60:0/3755659685 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfac005530 con 0x559911048240 2024-09-12T00:00:35.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.523+0000 7fdfa1ffb640 1 -- 172.21.15.60:0/3755659685 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0049d0 con 0x559911048240 2024-09-12T00:00:35.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/3755659685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 msgr2=0x55991105fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991105fa60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x559911046780 tx=0x7fdfac02a420 comp rx=0 tx=0).stop 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/3755659685 shutdown_connections 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911057df0 0x55991105ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911048240 0x55991105fa60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/3755659685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911047140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/3755659685 >> 172.21.15.60:0/3755659685 conn(0x5599110395f0 msgr2=0x559911046a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/3755659685 shutdown_connections 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/3755659685 wait complete. 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.524+0000 7fdfc4dd2740 1 -- start start 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfc4dd2740 1 Processor -- start 2024-09-12T00:00:35.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911050570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911048240 0x559911050ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfc4dd2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911057df0 0x55991104d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc1acb60 con 0x55991103d060 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc1ac490 con 0x559911048240 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfc4dd2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc1a96f0 con 0x559911057df0 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfc4dd2740 10 client.0 _ll_register_callbacks cb 0x7fdfac031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911050570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911050570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45704/0 (socket says 172.21.15.60:45704) 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.525+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/2303189171 learned_addr learned my addr 172.21.15.60:0/2303189171 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911048240 0x559911050ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/2303189171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911057df0 msgr2=0x55991104d3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911057df0 0x55991104d3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/2303189171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911048240 msgr2=0x559911050ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:35.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911048240 0x559911050ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdfbb7fe640 1 -- 172.21.15.60:0/2303189171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55991104dbe0 con 0x55991103d060 2024-09-12T00:00:35.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911048240 0x559911050ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:35.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdfbb7fe640 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911050570 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x559911048210 tx=0x7fdfb00052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfebead1d35ebc78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:35.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdf9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:35.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.526+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/2303189171 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0027040 con 0x55991103d060 2024-09-12T00:00:35.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/2303189171 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fdfb0005440 con 0x55991103d060 2024-09-12T00:00:35.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/2303189171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfac005530 con 0x55991103d060 2024-09-12T00:00:35.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/2303189171 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdfb0005640 con 0x55991103d060 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdfc4dd2740 10 client.15744 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/2303189171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599110c3780 con 0x55991103d060 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/2303189171 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdfac005530 con 0x55991103d060 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/2303189171 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdfb00037a0 con 0x55991103d060 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdfc4dd2740 10 client.15744 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdfc4dd2740 10 client.15744 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.527+0000 7fdfc4dd2740 20 client.15744 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.528+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5599110c3c70 0x5599110c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.528+0000 7fdfc4dd2740 4 client.15744 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5bc56bcb", "release": true, "await": true}] 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.528+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/2303189171 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5bc56bcb", "release": true, "await": true}) -- 0x559910faa0a0 con 0x5599110c3c70 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.528+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5599110c3c70 0x5599110c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.528+0000 7fdfbbfff640 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5599110c3c70 0x5599110c6060 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e46cdcf3bc96fa9 server_cookie=fadbcf457e9e4e0b in_seq=0 out_seq=0 2024-09-12T00:00:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.528+0000 7fdf9b7fe640 10 client.15744 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.530+0000 7fdf9b7fe640 1 -- 172.21.15.60:0/2303189171 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559910faa0a0 con 0x5599110c3c70 2024-09-12T00:00:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.530+0000 7fdf9b7fe640 10 client.15744 handle_command_reply: tid=0 2024-09-12T00:00:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.530+0000 7fdfc4dd2740 1 client.15744 shutdown 2024-09-12T00:00:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/2303189171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 msgr2=0x559911050570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911050570 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x559911048210 tx=0x7fdfb00052d0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/2303189171 shutdown_connections 2024-09-12T00:00:35.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5599110c3c70 0x5599110c6060 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559911057df0 0x55991104d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559911048240 0x559911050ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 --2- 172.21.15.60:0/2303189171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991103d060 0x559911050570 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/2303189171 >> 172.21.15.60:0/2303189171 conn(0x5599110395f0 msgr2=0x559911045990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdf9b7fe640 0 client.15744 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/2303189171 shutdown_connections 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 1 -- 172.21.15.60:0/2303189171 wait complete. 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.531+0000 7fdfc4dd2740 20 client.15744 trim_cache size 0 max 16384 2024-09-12T00:00:35.535 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 29, 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "leader": 24496, 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "set_version": 4, 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "sets": { 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "5bc56bcb": { 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "version": 4, 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "age_ref": 0.0, 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RELEASED", 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:00:35.536 INFO:teuthology.orchestra.run.smithi060.stdout: "timeout": 90.0, 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: "expiration": 144.5, 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: "members": { 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: "file:/": { 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: "excluded": false, 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RELEASED", 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:35.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:35.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:35.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:00:35.538 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:00:35.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 -- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdfa40a2e10 msgr2=0x7fdfa40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdfa40a2e10 0x7fdfa40a52d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40cd210 tx=0x7fdfb400efd0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 -- 172.21.15.60:0/2936586204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfbc1082a0 msgr2=0x7fdfbc19cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfbc1082a0 0x7fdfbc19cf30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400eb10 tx=0x7fdfb400c2d0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 -- 172.21.15.60:0/2936586204 shutdown_connections 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdfa40a2e10 0x7fdfa40a52d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdfbc1082a0 0x7fdfbc19cf30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfbc1036e0 0x7fdfbc198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 --2- 172.21.15.60:0/2936586204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfbc102d30 0x7fdfbc198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 -- 172.21.15.60:0/2936586204 >> 172.21.15.60:0/2936586204 conn(0x7fdfbc0fc7d0 msgr2=0x7fdfbc105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 -- 172.21.15.60:0/2936586204 shutdown_connections 2024-09-12T00:00:35.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:35.532+0000 7fdfc29f9640 1 -- 172.21.15.60:0/2936586204 wait complete. 2024-09-12T00:00:36.390 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5bc56bcb', total seconds elapsed: 28.6 2024-09-12T00:00:37.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:36 smithi105 ceph-mon[34805]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:37.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:36 smithi192 ceph-mon[35487]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:37.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:36 smithi060 ceph-mon[30953]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:39.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:38 smithi105 ceph-mon[34805]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:39.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:38 smithi192 ceph-mon[35487]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:39.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:38 smithi060 ceph-mon[30953]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:41.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:40 smithi105 ceph-mon[34805]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:00:41.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:40 smithi192 ceph-mon[35487]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:00:41.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:40 smithi060 ceph-mon[30953]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:00:42.781 INFO:tasks.workunit.client.0.smithi060.stderr:Updating files: 93% (12082/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T00:00:43.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:42 smithi105 ceph-mon[34805]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:43.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:42 smithi192 ceph-mon[35487]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:43.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:42 smithi060 ceph-mon[30953]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:43.677 INFO:tasks.workunit.client.0.smithi060.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T00:00:43.677 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T00:00:43.677 INFO:tasks.workunit.client.0.smithi060.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:00:43.677 INFO:tasks.workunit.client.0.smithi060.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:00:43.677 INFO:tasks.workunit.client.0.smithi060.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:00:43.677 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T00:00:43.677 INFO:tasks.workunit.client.0.smithi060.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:00:43.677 INFO:tasks.workunit.client.0.smithi060.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr: git switch -c 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr:Or undo this operation with: 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr: git switch - 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:00:43.678 INFO:tasks.workunit.client.0.smithi060.stderr: 2024-09-12T00:00:43.679 INFO:tasks.workunit.client.0.smithi060.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T00:00:43.682 DEBUG:teuthology.orchestra.run.smithi060:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:00:43.717 INFO:tasks.workunit.client.0.smithi060.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:00:43.719 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:00:43.719 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:00:44.391 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:00:44.469 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:00:44.511 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:00:44.513 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:00:44.513 INFO:tasks.workunit.client.0.smithi060.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:00:44.552 INFO:tasks.workunit.client.0.smithi060.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:00:44.556 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T00:00:44.556 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:00:44.614 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-12T00:00:44.615 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-12T00:00:44.615 DEBUG:teuthology.orchestra.run.smithi060:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-12T00:00:44.677 INFO:tasks.workunit.client.0.smithi060.stderr:+ KERNEL=linux-4.0.5 2024-09-12T00:00:44.678 INFO:tasks.workunit.client.0.smithi060.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-12T00:00:45.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:44 smithi105 ceph-mon[34805]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:00:45.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:44 smithi192 ceph-mon[35487]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:00:45.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:44 smithi060 ceph-mon[30953]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:00:47.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:46 smithi105 ceph-mon[34805]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:47.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:46 smithi192 ceph-mon[35487]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:47.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:46 smithi060 ceph-mon[30953]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:47.702 INFO:tasks.workunit.client.0.smithi060.stderr:+ mkdir untar_tar 2024-09-12T00:00:47.704 INFO:tasks.workunit.client.0.smithi060.stderr:+ cd untar_tar 2024-09-12T00:00:47.705 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-12T00:00:47.733 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ 2024-09-12T00:00:47.735 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-12T00:00:47.735 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-12T00:00:47.736 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-12T00:00:47.737 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-12T00:00:47.738 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-12T00:00:47.739 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-12T00:00:47.740 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-12T00:00:47.741 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-12T00:00:47.742 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-12T00:00:47.743 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-12T00:00:47.744 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-12T00:00:47.745 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-12T00:00:47.746 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-12T00:00:47.747 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-12T00:00:47.748 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-12T00:00:47.749 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-12T00:00:47.750 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-12T00:00:47.751 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-12T00:00:47.752 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-12T00:00:47.753 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-12T00:00:47.754 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-12T00:00:47.755 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-12T00:00:47.757 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-12T00:00:47.757 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-12T00:00:47.758 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-12T00:00:47.759 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-12T00:00:47.760 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-12T00:00:47.761 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-12T00:00:47.762 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-12T00:00:47.763 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-12T00:00:47.764 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-12T00:00:47.765 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-12T00:00:47.767 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-12T00:00:47.768 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-12T00:00:47.768 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-12T00:00:47.769 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-12T00:00:47.770 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-12T00:00:47.771 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-12T00:00:47.772 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-12T00:00:47.774 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-12T00:00:47.774 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-12T00:00:47.775 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-12T00:00:47.776 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-12T00:00:47.777 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-12T00:00:47.778 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-12T00:00:47.779 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-12T00:00:47.781 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-12T00:00:47.781 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-12T00:00:47.782 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-12T00:00:47.783 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-12T00:00:47.784 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-12T00:00:47.785 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-12T00:00:47.786 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-12T00:00:47.787 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-12T00:00:47.788 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-12T00:00:47.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-12T00:00:47.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-12T00:00:47.791 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-12T00:00:47.792 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-12T00:00:47.793 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-12T00:00:47.794 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-12T00:00:47.795 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-12T00:00:47.796 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-12T00:00:47.797 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-12T00:00:47.798 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-12T00:00:47.799 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-12T00:00:47.800 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-12T00:00:47.801 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-12T00:00:47.802 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-12T00:00:47.803 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-12T00:00:47.804 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-12T00:00:47.805 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-12T00:00:47.805 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-12T00:00:47.806 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-12T00:00:47.807 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-12T00:00:47.808 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-12T00:00:47.809 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-12T00:00:47.810 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-12T00:00:47.811 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-12T00:00:47.812 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-12T00:00:47.813 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-12T00:00:47.814 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-12T00:00:47.815 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-12T00:00:47.816 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-12T00:00:47.817 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-12T00:00:47.818 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-12T00:00:47.820 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-12T00:00:47.820 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-12T00:00:47.822 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-12T00:00:47.823 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-12T00:00:47.823 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-12T00:00:47.824 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-12T00:00:47.825 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-12T00:00:47.826 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-12T00:00:47.827 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-12T00:00:47.828 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-12T00:00:47.829 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-12T00:00:47.830 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-12T00:00:47.831 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-12T00:00:47.832 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-12T00:00:47.833 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-12T00:00:47.834 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-12T00:00:47.835 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-12T00:00:47.836 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-12T00:00:47.837 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-12T00:00:47.838 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-12T00:00:47.839 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-12T00:00:47.841 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-12T00:00:47.841 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-12T00:00:47.842 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-12T00:00:47.843 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-12T00:00:47.844 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-12T00:00:47.845 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-12T00:00:47.846 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-12T00:00:47.847 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-12T00:00:47.848 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-12T00:00:47.849 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-12T00:00:47.851 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-12T00:00:47.852 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-12T00:00:47.853 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-12T00:00:47.854 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-12T00:00:47.854 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-12T00:00:47.855 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-12T00:00:47.856 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-12T00:00:47.857 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-12T00:00:47.858 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-12T00:00:47.859 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-12T00:00:47.861 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-12T00:00:47.861 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-12T00:00:47.862 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-12T00:00:47.863 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-12T00:00:47.864 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-12T00:00:47.865 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-12T00:00:47.866 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-12T00:00:47.866 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-12T00:00:47.867 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-12T00:00:47.868 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-12T00:00:47.869 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-12T00:00:47.869 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-12T00:00:47.870 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-12T00:00:47.871 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-12T00:00:47.872 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-12T00:00:47.873 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-12T00:00:47.873 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-12T00:00:47.874 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-12T00:00:47.875 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-12T00:00:47.876 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-12T00:00:47.877 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-12T00:00:47.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-12T00:00:47.879 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-12T00:00:47.879 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-12T00:00:47.880 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-12T00:00:47.881 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-12T00:00:47.882 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-12T00:00:47.883 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-12T00:00:47.884 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-12T00:00:47.885 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-12T00:00:47.886 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-12T00:00:47.887 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-12T00:00:47.887 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-12T00:00:47.888 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-12T00:00:47.889 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-12T00:00:47.890 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-12T00:00:47.891 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-12T00:00:47.892 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-12T00:00:47.893 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-12T00:00:47.894 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-12T00:00:47.895 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-12T00:00:47.896 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-12T00:00:47.897 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-12T00:00:47.898 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-12T00:00:47.899 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-12T00:00:47.900 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-12T00:00:47.901 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-12T00:00:47.902 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-12T00:00:47.904 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-12T00:00:47.905 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-12T00:00:47.905 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-12T00:00:47.905 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-12T00:00:47.906 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-12T00:00:47.907 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-12T00:00:47.908 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-12T00:00:47.909 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-12T00:00:47.909 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-12T00:00:47.910 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-12T00:00:47.911 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-12T00:00:47.911 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-12T00:00:47.913 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-12T00:00:47.913 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-12T00:00:47.914 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-12T00:00:47.914 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-12T00:00:47.915 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-12T00:00:47.916 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-12T00:00:47.917 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-12T00:00:47.918 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-12T00:00:47.919 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-12T00:00:47.920 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-12T00:00:47.929 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-12T00:00:49.063 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-12T00:00:49.064 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-12T00:00:49.065 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-12T00:00:49.067 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-12T00:00:49.068 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-12T00:00:49.070 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-12T00:00:49.071 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-12T00:00:49.073 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-12T00:00:49.074 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-12T00:00:49.076 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-12T00:00:49.077 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-12T00:00:49.078 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-12T00:00:49.080 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-12T00:00:49.081 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-12T00:00:49.083 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-12T00:00:49.084 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-12T00:00:49.086 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-12T00:00:49.087 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-12T00:00:49.089 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-12T00:00:49.091 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-12T00:00:49.092 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-12T00:00:49.094 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-12T00:00:49.096 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-12T00:00:49.096 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-12T00:00:49.098 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-12T00:00:49.100 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-12T00:00:49.102 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-12T00:00:49.103 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-12T00:00:49.104 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-12T00:00:49.106 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-12T00:00:49.107 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-12T00:00:49.109 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-12T00:00:49.110 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-12T00:00:49.112 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-12T00:00:49.113 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-12T00:00:49.115 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-12T00:00:49.116 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-12T00:00:49.118 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-12T00:00:49.120 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-12T00:00:49.121 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-12T00:00:49.123 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-12T00:00:49.124 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-12T00:00:49.125 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-12T00:00:49.127 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-12T00:00:49.129 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-12T00:00:49.130 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-12T00:00:49.133 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-12T00:00:49.133 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-12T00:00:49.135 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-12T00:00:49.135 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-12T00:00:49.137 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-12T00:00:49.138 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-12T00:00:49.140 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-12T00:00:49.141 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-12T00:00:49.143 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-12T00:00:49.144 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-12T00:00:49.151 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-12T00:00:49.151 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-12T00:00:49.151 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-12T00:00:49.151 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-12T00:00:49.152 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-12T00:00:49.153 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-12T00:00:49.155 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-12T00:00:49.156 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/Changes 2024-09-12T00:00:49.158 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-12T00:00:49.159 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-12T00:00:49.161 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-12T00:00:49.162 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-12T00:00:49.164 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-12T00:00:49.171 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-12T00:00:49.171 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-12T00:00:49.171 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-12T00:00:49.171 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-12T00:00:49.171 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-12T00:00:49.172 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-12T00:00:49.173 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-12T00:00:49.173 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-12T00:00:49.175 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-12T00:00:49.176 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-12T00:00:49.177 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-12T00:00:49.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-12T00:00:49.192 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-12T00:00:49.192 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-12T00:00:49.192 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-12T00:00:49.192 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-12T00:00:49.192 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-12T00:00:49.193 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-12T00:00:49.193 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-12T00:00:49.194 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-12T00:00:49.195 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-12T00:00:49.197 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-12T00:00:49.197 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-12T00:00:49.198 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-12T00:00:49.199 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-12T00:00:49.201 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-12T00:00:49.202 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-12T00:00:49.203 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-12T00:00:49.204 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-12T00:00:49.204 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-12T00:00:49.205 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-12T00:00:49.206 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-12T00:00:49.207 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-12T00:00:49.209 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-12T00:00:49.210 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-12T00:00:49.212 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-12T00:00:49.213 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-12T00:00:49.213 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-12T00:00:49.214 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-12T00:00:49.215 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-12T00:00:49.216 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-12T00:00:49.217 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-12T00:00:49.218 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-12T00:00:49.219 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-12T00:00:49.220 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-12T00:00:49.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-12T00:00:49.224 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-12T00:00:49.225 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-12T00:00:49.226 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-12T00:00:49.227 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-12T00:00:49.228 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-12T00:00:49.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:48 smithi105 ceph-mon[34805]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:49.229 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-12T00:00:49.230 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-12T00:00:49.230 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-12T00:00:49.231 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-12T00:00:49.233 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-12T00:00:49.233 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-12T00:00:49.234 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-12T00:00:49.235 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-12T00:00:49.236 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-12T00:00:49.237 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-12T00:00:49.238 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-12T00:00:49.239 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-12T00:00:49.240 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-12T00:00:49.241 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-12T00:00:49.242 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-12T00:00:49.243 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-12T00:00:49.244 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-12T00:00:49.245 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-12T00:00:49.245 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-12T00:00:49.246 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-12T00:00:49.247 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-12T00:00:49.248 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-12T00:00:49.249 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-12T00:00:49.250 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-12T00:00:49.251 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-12T00:00:49.252 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-12T00:00:49.253 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-12T00:00:49.254 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-12T00:00:49.255 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-12T00:00:49.256 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-12T00:00:49.258 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-12T00:00:49.260 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-12T00:00:49.261 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-12T00:00:49.262 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-12T00:00:49.263 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-12T00:00:49.265 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-12T00:00:49.266 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-12T00:00:49.268 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-12T00:00:49.269 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-12T00:00:49.271 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-12T00:00:49.272 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-12T00:00:49.274 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-12T00:00:49.275 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-12T00:00:49.276 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-12T00:00:49.278 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-12T00:00:49.280 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-12T00:00:49.280 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-12T00:00:49.282 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-12T00:00:49.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:48 smithi192 ceph-mon[35487]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:49.284 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-12T00:00:49.285 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-12T00:00:49.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-12T00:00:49.288 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-12T00:00:49.289 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-12T00:00:49.290 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-12T00:00:49.292 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-12T00:00:49.293 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-12T00:00:49.294 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-12T00:00:49.296 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-12T00:00:49.297 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-12T00:00:49.299 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-12T00:00:49.300 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-12T00:00:49.302 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-12T00:00:49.303 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-12T00:00:49.304 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-12T00:00:49.306 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-12T00:00:49.308 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-12T00:00:49.309 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-12T00:00:49.310 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-12T00:00:49.311 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-12T00:00:49.313 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-12T00:00:49.314 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-12T00:00:49.316 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-12T00:00:49.317 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-12T00:00:49.319 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-12T00:00:49.320 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-12T00:00:49.321 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-12T00:00:49.323 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-12T00:00:49.324 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-12T00:00:49.326 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-12T00:00:49.328 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-12T00:00:49.329 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-12T00:00:49.330 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-12T00:00:49.332 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-12T00:00:49.334 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-12T00:00:49.336 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-12T00:00:49.337 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-12T00:00:49.338 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-12T00:00:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:48 smithi060 ceph-mon[30953]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:00:49.340 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-12T00:00:49.341 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-12T00:00:49.342 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-12T00:00:49.344 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-12T00:00:49.345 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-12T00:00:49.347 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-12T00:00:49.348 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-12T00:00:49.353 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-12T00:00:49.353 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-12T00:00:49.353 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-12T00:00:49.354 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-12T00:00:49.355 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-12T00:00:49.356 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-12T00:00:49.358 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-12T00:00:49.359 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-12T00:00:49.361 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-12T00:00:49.362 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-12T00:00:49.364 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-12T00:00:49.365 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-12T00:00:49.367 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-12T00:00:49.368 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-12T00:00:49.370 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-12T00:00:49.371 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-12T00:00:49.372 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-12T00:00:49.374 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-12T00:00:49.375 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-12T00:00:49.377 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-12T00:00:49.378 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-12T00:00:49.379 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-12T00:00:49.381 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-12T00:00:49.383 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-12T00:00:49.384 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-12T00:00:49.385 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-12T00:00:49.387 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-12T00:00:49.388 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-12T00:00:49.389 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-12T00:00:49.391 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-12T00:00:49.391 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-12T00:00:49.392 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-12T00:00:49.393 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-12T00:00:49.395 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-12T00:00:49.395 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-12T00:00:49.396 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-12T00:00:49.397 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-12T00:00:49.399 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-12T00:00:49.400 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-12T00:00:49.401 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-12T00:00:49.401 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-12T00:00:49.403 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-12T00:00:49.404 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-12T00:00:49.405 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-12T00:00:49.406 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-12T00:00:49.406 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-12T00:00:49.408 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-12T00:00:50.572 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-12T00:00:50.574 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-12T00:00:50.576 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-12T00:00:50.577 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-12T00:00:50.579 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-12T00:00:50.581 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-12T00:00:50.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-12T00:00:50.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-12T00:00:50.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-12T00:00:50.587 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-12T00:00:50.588 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-12T00:00:50.589 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-12T00:00:50.591 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-12T00:00:50.592 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-12T00:00:50.593 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-12T00:00:50.594 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-12T00:00:50.595 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-12T00:00:50.596 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-12T00:00:50.597 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-12T00:00:50.598 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-12T00:00:50.599 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-12T00:00:50.600 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-12T00:00:50.601 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-12T00:00:50.602 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-12T00:00:50.603 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-12T00:00:50.604 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-12T00:00:50.605 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-12T00:00:50.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-12T00:00:50.607 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-12T00:00:50.608 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-12T00:00:50.609 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-12T00:00:50.612 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-12T00:00:50.612 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-12T00:00:50.613 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-12T00:00:50.615 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-12T00:00:50.615 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-12T00:00:50.616 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-12T00:00:50.617 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-12T00:00:50.618 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-12T00:00:50.619 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-12T00:00:50.620 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-12T00:00:50.621 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-12T00:00:50.622 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-12T00:00:50.622 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-12T00:00:50.623 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-12T00:00:50.624 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-12T00:00:50.626 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-12T00:00:50.626 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-12T00:00:50.628 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-12T00:00:50.629 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-12T00:00:50.629 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-12T00:00:50.630 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/Makefile 2024-09-12T00:00:50.631 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-12T00:00:50.632 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-12T00:00:50.633 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-12T00:00:50.634 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-12T00:00:50.635 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-12T00:00:50.636 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-12T00:00:50.637 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-12T00:00:50.638 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-12T00:00:50.638 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-12T00:00:50.639 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-12T00:00:50.640 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-12T00:00:50.641 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-12T00:00:50.642 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-12T00:00:50.643 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-12T00:00:50.644 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-12T00:00:50.645 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-12T00:00:50.646 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-12T00:00:50.647 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-12T00:00:50.648 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-12T00:00:50.649 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-12T00:00:50.650 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-12T00:00:50.650 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-12T00:00:50.651 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-12T00:00:50.652 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-12T00:00:50.653 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-12T00:00:50.654 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-12T00:00:50.655 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-12T00:00:50.656 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-12T00:00:50.657 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-12T00:00:50.658 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-12T00:00:50.659 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-12T00:00:50.659 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-12T00:00:50.660 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-12T00:00:50.661 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-12T00:00:50.662 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-12T00:00:50.663 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-12T00:00:50.664 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-12T00:00:50.665 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-12T00:00:50.666 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-12T00:00:50.667 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-12T00:00:50.668 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-12T00:00:50.669 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-12T00:00:50.669 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-12T00:00:50.670 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-12T00:00:50.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-12T00:00:50.672 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-12T00:00:50.672 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-12T00:00:50.673 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-12T00:00:50.674 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-12T00:00:50.675 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-12T00:00:50.676 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-12T00:00:50.677 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-12T00:00:50.677 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-12T00:00:50.678 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-12T00:00:50.679 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-12T00:00:50.680 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-12T00:00:50.680 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-12T00:00:50.681 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-12T00:00:50.682 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-12T00:00:50.683 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-12T00:00:50.684 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-12T00:00:50.685 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-12T00:00:50.686 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-12T00:00:50.687 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-12T00:00:50.688 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-12T00:00:50.689 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/ 2024-09-12T00:00:50.690 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-12T00:00:50.691 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-12T00:00:50.692 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-12T00:00:50.693 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-12T00:00:50.694 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-12T00:00:50.695 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-12T00:00:50.696 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-12T00:00:50.697 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-12T00:00:50.698 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-12T00:00:50.698 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-12T00:00:50.699 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-12T00:00:50.700 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-12T00:00:50.701 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-12T00:00:50.702 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-12T00:00:50.703 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-12T00:00:50.703 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/README 2024-09-12T00:00:50.704 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-12T00:00:50.705 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-12T00:00:50.706 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-12T00:00:50.707 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-12T00:00:50.708 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-12T00:00:50.709 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-12T00:00:50.709 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-12T00:00:50.710 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-12T00:00:50.711 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-12T00:00:50.712 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-12T00:00:50.713 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-12T00:00:50.714 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-12T00:00:50.715 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-12T00:00:50.716 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-12T00:00:50.716 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-12T00:00:50.717 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-12T00:00:50.718 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-12T00:00:50.719 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-12T00:00:50.721 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-12T00:00:50.721 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-12T00:00:50.721 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-12T00:00:50.722 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-12T00:00:50.723 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-12T00:00:50.724 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-12T00:00:50.725 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-12T00:00:50.726 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-12T00:00:50.726 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-12T00:00:50.727 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-12T00:00:50.728 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-12T00:00:50.729 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-12T00:00:50.729 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-12T00:00:50.730 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-12T00:00:50.731 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-12T00:00:50.732 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-12T00:00:50.733 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-12T00:00:50.733 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-12T00:00:50.734 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-12T00:00:50.735 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-12T00:00:50.736 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-12T00:00:50.737 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-12T00:00:50.738 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-12T00:00:50.738 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-12T00:00:50.739 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-12T00:00:50.741 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-12T00:00:50.741 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-12T00:00:50.742 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-12T00:00:50.743 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-12T00:00:50.744 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-12T00:00:50.745 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-12T00:00:50.746 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-12T00:00:50.746 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-12T00:00:50.747 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-12T00:00:50.748 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-12T00:00:50.749 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-12T00:00:50.750 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-12T00:00:50.751 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-12T00:00:50.752 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-12T00:00:50.753 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-12T00:00:50.754 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-12T00:00:50.755 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-12T00:00:50.755 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-12T00:00:50.756 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-12T00:00:50.757 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-12T00:00:50.758 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-12T00:00:50.759 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-12T00:00:50.760 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-12T00:00:50.761 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-12T00:00:50.762 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-12T00:00:50.763 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-12T00:00:50.764 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-12T00:00:50.765 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-12T00:00:50.765 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-12T00:00:50.766 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-12T00:00:50.767 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-12T00:00:50.768 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-12T00:00:50.769 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-12T00:00:50.770 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-12T00:00:50.771 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-12T00:00:50.771 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-12T00:00:50.772 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-12T00:00:50.773 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-12T00:00:50.774 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-12T00:00:50.775 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-12T00:00:50.776 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-12T00:00:50.777 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-12T00:00:50.778 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-12T00:00:50.779 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-12T00:00:50.780 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-12T00:00:50.780 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-12T00:00:50.781 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-12T00:00:50.782 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-12T00:00:50.783 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-12T00:00:50.784 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-12T00:00:50.789 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-12T00:00:50.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-12T00:00:50.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-12T00:00:50.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-12T00:00:50.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-12T00:00:50.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-12T00:00:50.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/ 2024-09-12T00:00:50.791 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-12T00:00:50.792 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-12T00:00:50.792 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-12T00:00:50.793 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-12T00:00:50.794 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-12T00:00:50.795 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-12T00:00:50.796 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-12T00:00:50.796 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-12T00:00:50.797 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-12T00:00:50.798 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-12T00:00:50.799 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-12T00:00:50.800 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-12T00:00:50.801 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-12T00:00:50.801 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-12T00:00:50.802 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-12T00:00:50.803 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-12T00:00:50.804 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-12T00:00:50.805 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-12T00:00:50.806 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-12T00:00:50.807 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-12T00:00:50.807 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-12T00:00:50.808 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-12T00:00:50.809 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-12T00:00:50.810 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-12T00:00:50.811 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-12T00:00:50.812 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-12T00:00:50.813 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-12T00:00:50.814 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-12T00:00:50.814 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-12T00:00:50.815 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-12T00:00:50.816 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-12T00:00:50.817 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-12T00:00:50.818 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-12T00:00:50.819 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-12T00:00:50.820 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-12T00:00:50.821 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-12T00:00:50.822 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-12T00:00:50.823 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-12T00:00:50.824 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-12T00:00:50.825 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-12T00:00:50.825 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-12T00:00:50.826 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-12T00:00:50.827 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-12T00:00:50.828 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-12T00:00:50.829 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-12T00:00:50.830 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-12T00:00:50.831 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-12T00:00:50.832 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-12T00:00:50.832 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-12T00:00:50.833 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-12T00:00:50.834 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-12T00:00:50.835 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-12T00:00:50.836 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-12T00:00:50.837 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-12T00:00:50.838 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-12T00:00:50.839 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-12T00:00:50.840 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-12T00:00:50.841 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-12T00:00:50.842 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-12T00:00:50.843 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-12T00:00:50.844 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-12T00:00:50.845 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-12T00:00:50.846 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-12T00:00:50.846 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-12T00:00:50.847 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-12T00:00:50.848 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/connector/ 2024-09-12T00:00:50.849 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-12T00:00:50.851 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-12T00:00:50.851 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-12T00:00:50.852 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-12T00:00:50.852 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-12T00:00:50.853 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/console/ 2024-09-12T00:00:50.854 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-12T00:00:50.855 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-12T00:00:50.856 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-12T00:00:50.857 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-12T00:00:50.857 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-12T00:00:50.858 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-12T00:00:50.859 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-12T00:00:50.860 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-12T00:00:50.861 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-12T00:00:50.862 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-12T00:00:50.863 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-12T00:00:50.864 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-12T00:00:50.865 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-12T00:00:50.865 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-12T00:00:50.866 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-12T00:00:50.867 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-12T00:00:50.868 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-12T00:00:50.870 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-12T00:00:50.870 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-12T00:00:50.871 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-12T00:00:50.871 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-12T00:00:50.872 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-12T00:00:50.873 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cris/ 2024-09-12T00:00:50.874 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/cris/README 2024-09-12T00:00:50.875 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-12T00:00:50.876 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-12T00:00:50.877 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-12T00:00:50.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-12T00:00:50.879 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-12T00:00:50.880 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-12T00:00:50.881 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-12T00:00:50.882 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-12T00:00:50.883 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-12T00:00:50.884 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-12T00:00:50.885 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-12T00:00:50.886 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-12T00:00:50.887 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-12T00:00:50.888 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-12T00:00:50.889 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-12T00:00:50.890 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-12T00:00:50.891 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-12T00:00:50.891 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-12T00:00:50.892 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-12T00:00:50.893 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-12T00:00:50.894 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-12T00:00:50.895 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-12T00:00:50.896 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-12T00:00:50.897 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-12T00:00:50.898 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-12T00:00:50.899 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-12T00:00:50.900 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-12T00:00:50.901 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-12T00:00:50.902 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-12T00:00:50.903 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-12T00:00:50.904 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-12T00:00:50.905 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-12T00:00:50.906 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-12T00:00:50.907 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-12T00:00:50.908 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-12T00:00:50.909 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-12T00:00:50.911 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-12T00:00:50.911 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-12T00:00:50.912 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-12T00:00:50.913 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-12T00:00:50.914 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-12T00:00:50.915 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-12T00:00:50.916 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-12T00:00:50.918 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-12T00:00:50.920 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-12T00:00:50.921 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-12T00:00:50.921 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-12T00:00:50.922 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-12T00:00:50.923 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-12T00:00:50.924 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-12T00:00:50.925 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-12T00:00:50.926 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-12T00:00:50.926 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-12T00:00:50.927 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-12T00:00:50.928 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-12T00:00:50.929 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-12T00:00:50.930 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-12T00:00:50.931 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-12T00:00:50.931 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-12T00:00:50.932 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-12T00:00:50.933 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-12T00:00:50.934 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-12T00:00:50.934 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-12T00:00:50.936 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-12T00:00:50.936 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-12T00:00:50.937 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-12T00:00:50.938 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-12T00:00:50.939 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-12T00:00:50.939 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-12T00:00:50.940 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-12T00:00:50.941 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-12T00:00:50.942 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-12T00:00:50.942 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-12T00:00:50.943 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-12T00:00:50.944 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-12T00:00:50.945 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-12T00:00:50.946 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-12T00:00:50.947 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-12T00:00:50.948 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-12T00:00:50.949 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-12T00:00:50.950 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-12T00:00:50.951 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-12T00:00:50.952 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-12T00:00:50.954 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-12T00:00:50.954 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-12T00:00:50.955 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-12T00:00:50.956 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-12T00:00:50.956 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-12T00:00:50.957 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-12T00:00:50.958 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-12T00:00:50.959 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-12T00:00:50.960 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-12T00:00:50.960 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-12T00:00:50.961 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-12T00:00:50.962 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-12T00:00:50.963 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-12T00:00:50.963 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-12T00:00:50.964 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-12T00:00:50.965 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-12T00:00:50.965 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-12T00:00:50.966 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-12T00:00:50.967 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-12T00:00:50.968 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-12T00:00:50.968 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-12T00:00:50.969 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-12T00:00:50.970 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-12T00:00:50.971 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-12T00:00:50.972 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-12T00:00:50.977 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-12T00:00:50.977 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-12T00:00:50.977 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-12T00:00:50.977 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-12T00:00:50.977 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-12T00:00:50.978 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-12T00:00:50.979 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-12T00:00:50.979 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-12T00:00:50.980 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-12T00:00:50.981 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-12T00:00:50.982 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-12T00:00:50.983 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-12T00:00:50.983 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-12T00:00:50.984 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-12T00:00:50.985 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-12T00:00:50.986 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-12T00:00:50.987 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-12T00:00:50.987 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-12T00:00:50.988 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-12T00:00:50.989 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-12T00:00:50.990 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-12T00:00:50.990 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-12T00:00:50.991 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-12T00:00:50.992 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-12T00:00:50.993 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-12T00:00:50.994 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-12T00:00:50.994 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-12T00:00:50.995 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-12T00:00:50.996 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-12T00:00:50.997 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-12T00:00:50.998 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-12T00:00:50.999 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-12T00:00:50.999 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-12T00:00:51.000 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-12T00:00:51.001 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-12T00:00:51.002 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-12T00:00:51.003 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-12T00:00:51.004 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-12T00:00:51.005 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-12T00:00:51.006 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-12T00:00:51.007 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-12T00:00:51.008 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-12T00:00:51.009 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-12T00:00:51.010 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-12T00:00:51.010 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-12T00:00:51.011 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-12T00:00:51.012 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-12T00:00:51.013 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-12T00:00:51.014 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-12T00:00:51.015 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-12T00:00:51.016 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-12T00:00:51.017 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-12T00:00:51.017 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-12T00:00:51.018 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-12T00:00:51.019 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-12T00:00:51.020 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-12T00:00:51.021 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-12T00:00:51.022 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-12T00:00:51.023 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-12T00:00:51.024 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-12T00:00:51.025 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-12T00:00:51.026 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-12T00:00:51.027 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-12T00:00:51.028 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-12T00:00:51.029 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-12T00:00:51.030 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-12T00:00:51.031 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-12T00:00:51.032 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-12T00:00:51.033 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-12T00:00:51.034 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-12T00:00:51.035 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-12T00:00:51.036 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-12T00:00:51.037 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-12T00:00:51.038 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-12T00:00:51.039 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-12T00:00:51.040 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-12T00:00:51.041 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-12T00:00:51.042 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-12T00:00:51.043 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-12T00:00:51.044 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-12T00:00:51.045 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-12T00:00:51.046 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-12T00:00:51.047 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-12T00:00:51.048 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-12T00:00:51.050 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-12T00:00:51.050 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-12T00:00:51.051 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-12T00:00:51.053 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-12T00:00:51.053 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-12T00:00:51.054 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-12T00:00:51.055 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-12T00:00:51.056 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-12T00:00:51.057 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-12T00:00:51.058 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-12T00:00:51.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:50 smithi105 ceph-mon[34805]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 KiB/s wr, 13 op/s 2024-09-12T00:00:51.241 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-12T00:00:51.242 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-12T00:00:51.243 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-12T00:00:51.244 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-12T00:00:51.245 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-12T00:00:51.246 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-12T00:00:51.247 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-12T00:00:51.248 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-12T00:00:51.249 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-12T00:00:51.250 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-12T00:00:51.251 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-12T00:00:51.252 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-12T00:00:51.253 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-12T00:00:51.253 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-12T00:00:51.254 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-12T00:00:51.255 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-12T00:00:51.256 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-12T00:00:51.257 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-12T00:00:51.258 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-12T00:00:51.259 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-12T00:00:51.260 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-12T00:00:51.261 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-12T00:00:51.262 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-12T00:00:51.263 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-12T00:00:51.263 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-12T00:00:51.264 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-12T00:00:51.265 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-12T00:00:51.266 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-12T00:00:51.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-12T00:00:51.268 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-12T00:00:51.268 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-12T00:00:51.270 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-12T00:00:51.270 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-12T00:00:51.271 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-12T00:00:51.271 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-12T00:00:51.273 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-12T00:00:51.273 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-12T00:00:51.274 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-12T00:00:51.275 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-12T00:00:51.276 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-12T00:00:51.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-12T00:00:51.278 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-12T00:00:51.279 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-12T00:00:51.280 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-12T00:00:51.281 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-12T00:00:51.281 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-12T00:00:51.282 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-12T00:00:51.283 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-12T00:00:51.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:50 smithi192 ceph-mon[35487]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 KiB/s wr, 13 op/s 2024-09-12T00:00:51.284 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-12T00:00:51.285 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-12T00:00:51.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-12T00:00:51.287 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-12T00:00:51.288 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-12T00:00:51.289 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-12T00:00:51.289 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-12T00:00:51.290 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-12T00:00:51.291 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-12T00:00:51.292 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-12T00:00:51.293 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-12T00:00:51.293 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-12T00:00:51.294 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-12T00:00:51.295 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-12T00:00:51.295 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-12T00:00:51.296 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-12T00:00:51.297 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-12T00:00:51.298 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-12T00:00:51.298 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-12T00:00:51.299 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-12T00:00:51.300 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-12T00:00:51.301 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-12T00:00:51.302 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-12T00:00:51.302 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-12T00:00:51.303 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-12T00:00:51.304 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-12T00:00:51.305 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-12T00:00:51.305 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-12T00:00:51.306 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-12T00:00:51.307 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-12T00:00:51.308 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-12T00:00:51.309 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-12T00:00:51.309 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-12T00:00:51.310 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-12T00:00:51.311 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-12T00:00:51.312 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-12T00:00:51.313 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-12T00:00:51.314 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-12T00:00:51.315 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-12T00:00:51.316 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-12T00:00:51.316 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-12T00:00:51.317 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-12T00:00:51.318 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-12T00:00:51.319 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-12T00:00:51.320 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-12T00:00:51.320 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-12T00:00:51.322 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-12T00:00:51.322 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-12T00:00:51.323 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-12T00:00:51.324 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-12T00:00:51.325 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-12T00:00:51.326 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-12T00:00:51.327 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-12T00:00:51.327 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-12T00:00:51.328 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-12T00:00:51.329 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-12T00:00:51.330 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-12T00:00:51.331 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-12T00:00:51.332 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-12T00:00:51.332 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-12T00:00:51.333 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-12T00:00:51.334 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-12T00:00:51.335 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-12T00:00:51.336 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-12T00:00:51.337 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-12T00:00:51.338 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-12T00:00:51.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:50 smithi060 ceph-mon[30953]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 KiB/s wr, 13 op/s 2024-09-12T00:00:51.338 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-12T00:00:51.339 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-12T00:00:51.340 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-12T00:00:51.341 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-12T00:00:51.342 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-12T00:00:51.343 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-12T00:00:51.343 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-12T00:00:51.344 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-12T00:00:51.345 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-12T00:00:51.346 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-12T00:00:51.346 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-12T00:00:51.347 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-12T00:00:51.348 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-12T00:00:51.349 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-12T00:00:51.350 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-12T00:00:51.351 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-12T00:00:51.352 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-12T00:00:51.352 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-12T00:00:51.353 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-12T00:00:51.354 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-12T00:00:51.355 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-12T00:00:51.356 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-12T00:00:51.357 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-12T00:00:51.357 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-12T00:00:51.358 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-12T00:00:51.359 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-12T00:00:51.360 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-12T00:00:51.361 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-12T00:00:51.362 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-12T00:00:51.363 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-12T00:00:51.363 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-12T00:00:51.364 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-12T00:00:51.365 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-12T00:00:51.366 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-12T00:00:51.367 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-12T00:00:51.368 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-12T00:00:51.368 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-12T00:00:51.369 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-12T00:00:51.370 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-12T00:00:51.371 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-12T00:00:51.371 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-12T00:00:51.373 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-12T00:00:51.373 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-12T00:00:51.374 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-12T00:00:51.375 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-12T00:00:51.376 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-12T00:00:51.377 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-12T00:00:51.377 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-12T00:00:51.378 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-12T00:00:51.379 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-12T00:00:51.380 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-12T00:00:51.381 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-12T00:00:51.382 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-12T00:00:51.382 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-12T00:00:51.383 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-12T00:00:51.384 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-12T00:00:51.385 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-12T00:00:51.386 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-12T00:00:51.386 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-12T00:00:51.387 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-12T00:00:51.388 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-12T00:00:51.389 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-12T00:00:51.390 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-12T00:00:51.391 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-12T00:00:51.391 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-12T00:00:51.393 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-12T00:00:51.394 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-12T00:00:51.394 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-12T00:00:51.395 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-12T00:00:51.396 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-12T00:00:51.398 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-12T00:00:51.398 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-12T00:00:51.399 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-12T00:00:51.400 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-12T00:00:51.401 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-12T00:00:51.402 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-12T00:00:51.403 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-12T00:00:51.404 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-12T00:00:51.404 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-12T00:00:51.405 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-12T00:00:51.406 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-12T00:00:51.407 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-12T00:00:51.408 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-12T00:00:51.408 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-12T00:00:51.409 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-12T00:00:51.410 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-12T00:00:51.411 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-12T00:00:51.412 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-12T00:00:51.413 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-12T00:00:51.414 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-12T00:00:51.415 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-12T00:00:51.416 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-12T00:00:51.417 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-12T00:00:51.418 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-12T00:00:51.418 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-12T00:00:51.419 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-12T00:00:51.420 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-12T00:00:51.421 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-12T00:00:51.422 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-12T00:00:51.422 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-12T00:00:51.423 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-12T00:00:51.424 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-12T00:00:51.425 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-12T00:00:51.426 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-12T00:00:51.426 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-12T00:00:51.427 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-12T00:00:51.428 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-12T00:00:51.429 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-12T00:00:51.430 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-12T00:00:51.431 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-12T00:00:51.432 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-12T00:00:51.432 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-12T00:00:51.433 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-12T00:00:51.434 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-12T00:00:51.436 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-12T00:00:51.436 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-12T00:00:51.437 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-12T00:00:51.438 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-12T00:00:51.439 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-12T00:00:51.440 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-12T00:00:51.440 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-12T00:00:51.441 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-12T00:00:51.442 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-12T00:00:51.443 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-12T00:00:51.444 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-12T00:00:51.445 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-12T00:00:51.446 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-12T00:00:51.447 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-12T00:00:51.448 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-12T00:00:51.449 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-12T00:00:51.449 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-12T00:00:51.450 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-12T00:00:51.451 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-12T00:00:51.452 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-12T00:00:51.453 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-12T00:00:51.454 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-12T00:00:51.455 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-12T00:00:51.456 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-12T00:00:51.457 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-12T00:00:51.458 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-12T00:00:51.459 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-12T00:00:51.460 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-12T00:00:51.461 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-12T00:00:51.462 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-12T00:00:51.463 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-12T00:00:51.464 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-12T00:00:51.465 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-12T00:00:51.466 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-12T00:00:51.466 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-12T00:00:51.467 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-12T00:00:51.468 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-12T00:00:51.469 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-12T00:00:51.470 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-12T00:00:51.471 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-12T00:00:51.472 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-12T00:00:51.473 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-12T00:00:51.473 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-12T00:00:51.474 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-12T00:00:51.475 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-12T00:00:51.476 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-12T00:00:51.477 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-12T00:00:51.477 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-12T00:00:51.478 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-12T00:00:51.479 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-12T00:00:51.480 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-12T00:00:51.481 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-12T00:00:51.482 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-12T00:00:51.483 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-12T00:00:51.485 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-12T00:00:51.485 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-12T00:00:51.486 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-12T00:00:51.487 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-12T00:00:51.488 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-12T00:00:51.489 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-12T00:00:51.490 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-12T00:00:51.491 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-12T00:00:51.492 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-12T00:00:51.493 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-12T00:00:51.494 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-12T00:00:51.495 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-12T00:00:51.496 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-12T00:00:51.497 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-12T00:00:51.499 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-12T00:00:51.499 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-12T00:00:51.500 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-12T00:00:51.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-12T00:00:51.502 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-12T00:00:51.503 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-12T00:00:51.504 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-12T00:00:51.505 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-12T00:00:51.506 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-12T00:00:51.507 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-12T00:00:51.508 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-12T00:00:51.509 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-12T00:00:51.509 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-12T00:00:51.510 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-12T00:00:51.511 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-12T00:00:51.513 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-12T00:00:51.513 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-12T00:00:51.514 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-12T00:00:51.515 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-12T00:00:51.516 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-12T00:00:51.517 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-12T00:00:51.522 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-12T00:00:51.523 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-12T00:00:51.523 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-12T00:00:51.524 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-12T00:00:51.525 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-12T00:00:51.527 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-12T00:00:51.527 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-12T00:00:51.527 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-12T00:00:51.527 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-12T00:00:51.527 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-12T00:00:51.528 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-12T00:00:51.529 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-12T00:00:51.530 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-12T00:00:51.530 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-12T00:00:51.531 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-12T00:00:51.532 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-12T00:00:51.533 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-12T00:00:51.534 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-12T00:00:51.535 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-12T00:00:51.536 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-12T00:00:51.537 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-12T00:00:51.538 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-12T00:00:51.539 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-12T00:00:51.540 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-12T00:00:51.541 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-12T00:00:51.542 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-12T00:00:51.543 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-12T00:00:51.544 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-12T00:00:51.545 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-12T00:00:51.547 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-12T00:00:51.548 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-12T00:00:51.549 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-12T00:00:51.550 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-12T00:00:51.552 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-12T00:00:51.553 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-12T00:00:51.554 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-12T00:00:51.555 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-12T00:00:51.557 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-12T00:00:51.558 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-12T00:00:51.559 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-12T00:00:51.561 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-12T00:00:51.562 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-12T00:00:51.563 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-12T00:00:51.565 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-12T00:00:51.566 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-12T00:00:51.567 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-12T00:00:51.569 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-12T00:00:51.571 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-12T00:00:51.572 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-12T00:00:51.573 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-12T00:00:51.574 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-12T00:00:51.576 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-12T00:00:51.577 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-12T00:00:51.578 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-12T00:00:51.580 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-12T00:00:51.581 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-12T00:00:51.583 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-12T00:00:51.584 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-12T00:00:51.585 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-12T00:00:51.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-12T00:00:51.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-12T00:00:51.587 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-12T00:00:51.588 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-12T00:00:51.589 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-12T00:00:51.590 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-12T00:00:51.591 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-12T00:00:51.592 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-12T00:00:51.593 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-12T00:00:51.594 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-12T00:00:51.595 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-12T00:00:51.596 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-12T00:00:51.597 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-12T00:00:51.598 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-12T00:00:51.598 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-12T00:00:51.599 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-12T00:00:51.600 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-12T00:00:51.605 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-12T00:00:51.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-12T00:00:51.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-12T00:00:51.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-12T00:00:51.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-12T00:00:51.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-12T00:00:51.607 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-12T00:00:51.607 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-12T00:00:51.608 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-12T00:00:51.609 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-12T00:00:51.610 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-12T00:00:51.611 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-12T00:00:51.612 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-12T00:00:51.613 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-12T00:00:51.614 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-12T00:00:51.615 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-12T00:00:51.616 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-12T00:00:51.617 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-12T00:00:51.618 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-12T00:00:51.619 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-12T00:00:51.620 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-12T00:00:51.621 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-12T00:00:51.622 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-12T00:00:51.623 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-12T00:00:51.624 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-12T00:00:51.625 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-12T00:00:51.626 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-12T00:00:51.627 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-12T00:00:51.628 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-12T00:00:51.629 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-12T00:00:51.630 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-12T00:00:51.631 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-12T00:00:51.632 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-12T00:00:51.633 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-12T00:00:51.635 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-12T00:00:51.636 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-12T00:00:51.638 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-12T00:00:51.639 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-12T00:00:51.640 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-12T00:00:51.642 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-12T00:00:51.643 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-12T00:00:51.644 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-12T00:00:51.645 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-12T00:00:51.647 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-12T00:00:51.648 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-12T00:00:51.649 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-12T00:00:51.650 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-12T00:00:51.652 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-12T00:00:51.653 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-12T00:00:51.654 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-12T00:00:51.655 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-12T00:00:51.657 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-12T00:00:51.658 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-12T00:00:51.659 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-12T00:00:51.660 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-12T00:00:51.662 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-12T00:00:51.663 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-12T00:00:51.664 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-12T00:00:51.665 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-12T00:00:51.666 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-12T00:00:51.668 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-12T00:00:51.669 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-12T00:00:51.670 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-12T00:00:51.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-12T00:00:51.672 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-12T00:00:51.673 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-12T00:00:51.674 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-12T00:00:51.675 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-12T00:00:51.676 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-12T00:00:51.678 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-12T00:00:51.679 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-12T00:00:51.680 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-12T00:00:51.681 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-12T00:00:51.682 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-12T00:00:51.683 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-12T00:00:51.684 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-12T00:00:51.685 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-12T00:00:51.686 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-12T00:00:51.687 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-12T00:00:51.689 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-12T00:00:51.690 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-12T00:00:51.691 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-12T00:00:51.692 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-12T00:00:51.693 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-12T00:00:51.694 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-12T00:00:51.695 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-12T00:00:51.696 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-12T00:00:51.697 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-12T00:00:51.699 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-12T00:00:51.700 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-12T00:00:51.701 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-12T00:00:51.702 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-12T00:00:51.703 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-12T00:00:51.704 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-12T00:00:51.705 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-12T00:00:51.706 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-12T00:00:51.707 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-12T00:00:51.708 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-12T00:00:51.709 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-12T00:00:51.710 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-12T00:00:51.712 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-12T00:00:51.713 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-12T00:00:51.714 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-12T00:00:51.715 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-12T00:00:51.716 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-12T00:00:51.717 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-12T00:00:51.718 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-12T00:00:51.720 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-12T00:00:51.721 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-12T00:00:51.722 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-12T00:00:51.723 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-12T00:00:51.724 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-12T00:00:51.725 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-12T00:00:51.726 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-12T00:00:51.727 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-12T00:00:51.728 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-12T00:00:51.729 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-12T00:00:51.730 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-12T00:00:51.732 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-12T00:00:51.733 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-12T00:00:51.734 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-12T00:00:51.735 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-12T00:00:51.736 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-12T00:00:51.737 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-12T00:00:51.738 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-12T00:00:51.739 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-12T00:00:51.741 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-12T00:00:51.742 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-12T00:00:51.743 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-12T00:00:51.744 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-12T00:00:51.745 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-12T00:00:51.746 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-12T00:00:51.747 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-12T00:00:51.748 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-12T00:00:51.749 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-12T00:00:51.750 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-12T00:00:51.751 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-12T00:00:51.752 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-12T00:00:51.753 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-12T00:00:51.754 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-12T00:00:51.755 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-12T00:00:51.756 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-12T00:00:51.758 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-12T00:00:51.759 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-12T00:00:51.760 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-12T00:00:51.761 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-12T00:00:51.762 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-12T00:00:51.764 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-12T00:00:51.765 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-12T00:00:51.765 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-12T00:00:51.767 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-12T00:00:51.768 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-12T00:00:51.769 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-12T00:00:51.770 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-12T00:00:51.771 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-12T00:00:51.772 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-12T00:00:51.773 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-12T00:00:51.774 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-12T00:00:51.776 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-12T00:00:51.777 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-12T00:00:51.778 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-12T00:00:51.779 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-12T00:00:51.781 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-12T00:00:51.782 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-12T00:00:51.784 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-12T00:00:51.785 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-12T00:00:51.786 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-12T00:00:51.787 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-12T00:00:51.788 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-12T00:00:51.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-12T00:00:51.791 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-12T00:00:51.792 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-12T00:00:51.794 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-12T00:00:51.795 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-12T00:00:51.796 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-12T00:00:51.798 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-12T00:00:51.799 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-12T00:00:51.800 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-12T00:00:51.801 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-12T00:00:51.802 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-12T00:00:51.804 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-12T00:00:51.809 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-12T00:00:51.809 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-12T00:00:51.809 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-12T00:00:51.809 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-12T00:00:51.810 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-12T00:00:51.811 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-12T00:00:51.813 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-12T00:00:51.814 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-12T00:00:51.815 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-12T00:00:51.816 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-12T00:00:51.818 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-12T00:00:51.819 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-12T00:00:51.820 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-12T00:00:51.821 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-12T00:00:51.823 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-12T00:00:51.824 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-12T00:00:51.826 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-12T00:00:51.827 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-12T00:00:51.828 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-12T00:00:51.829 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-12T00:00:51.830 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-12T00:00:51.832 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-12T00:00:51.833 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-12T00:00:51.834 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-12T00:00:51.837 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-12T00:00:51.837 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-12T00:00:51.838 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-12T00:00:51.839 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-12T00:00:51.840 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-12T00:00:51.842 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-12T00:00:51.843 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-12T00:00:51.844 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-12T00:00:51.845 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-12T00:00:51.847 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-12T00:00:51.848 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-12T00:00:51.849 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-12T00:00:51.851 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-12T00:00:51.852 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-12T00:00:51.853 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-12T00:00:51.854 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-12T00:00:51.856 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-12T00:00:51.857 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-12T00:00:51.858 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-12T00:00:51.860 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-12T00:00:51.861 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-12T00:00:51.862 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-12T00:00:51.863 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-12T00:00:51.865 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-12T00:00:51.866 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-12T00:00:51.867 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-12T00:00:51.868 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-12T00:00:51.869 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-12T00:00:51.871 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-12T00:00:51.872 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-12T00:00:51.873 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-12T00:00:51.875 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-12T00:00:51.876 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-12T00:00:51.877 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-12T00:00:51.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-12T00:00:51.880 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-12T00:00:51.882 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-12T00:00:51.882 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-12T00:00:51.883 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-12T00:00:51.885 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-12T00:00:51.886 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-12T00:00:51.887 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-12T00:00:51.889 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-12T00:00:51.890 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-12T00:00:51.892 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-12T00:00:51.893 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-12T00:00:51.894 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-12T00:00:51.895 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-12T00:00:51.897 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-12T00:00:51.898 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-12T00:00:51.899 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-12T00:00:51.900 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-12T00:00:51.902 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-12T00:00:51.904 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-12T00:00:51.904 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-12T00:00:51.906 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-12T00:00:51.907 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-12T00:00:51.908 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-12T00:00:51.909 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-12T00:00:51.911 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-12T00:00:51.912 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-12T00:00:51.913 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-12T00:00:51.915 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-12T00:00:51.915 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-12T00:00:51.916 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-12T00:00:51.917 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-12T00:00:51.918 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-12T00:00:51.920 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-12T00:00:51.921 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-12T00:00:51.921 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-12T00:00:51.923 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-12T00:00:51.924 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-12T00:00:51.925 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-12T00:00:51.926 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-12T00:00:51.927 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-12T00:00:51.928 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-12T00:00:51.929 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-12T00:00:51.930 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-12T00:00:51.931 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-12T00:00:51.932 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-12T00:00:51.933 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-12T00:00:51.934 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-12T00:00:51.935 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-12T00:00:51.936 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-12T00:00:51.937 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-12T00:00:51.939 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-12T00:00:51.941 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-12T00:00:51.942 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-12T00:00:51.943 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-12T00:00:51.944 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-12T00:00:51.945 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-12T00:00:51.946 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-12T00:00:51.947 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-12T00:00:51.948 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-12T00:00:51.949 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-12T00:00:51.951 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-12T00:00:51.952 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-12T00:00:51.953 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-12T00:00:51.954 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-12T00:00:51.955 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-12T00:00:51.956 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-12T00:00:51.957 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-12T00:00:51.958 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-12T00:00:51.959 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-12T00:00:51.960 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-12T00:00:51.962 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-12T00:00:51.963 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-12T00:00:51.964 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-12T00:00:51.965 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-12T00:00:51.966 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-12T00:00:51.967 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-12T00:00:51.969 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-12T00:00:51.970 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-12T00:00:51.971 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-12T00:00:51.972 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-12T00:00:51.973 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-12T00:00:51.974 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-12T00:00:51.975 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-12T00:00:51.977 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-12T00:00:51.978 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-12T00:00:51.979 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-12T00:00:51.980 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-12T00:00:51.981 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-12T00:00:51.982 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-12T00:00:51.983 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-12T00:00:51.984 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-12T00:00:51.985 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-12T00:00:51.987 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-12T00:00:51.988 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-12T00:00:51.989 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-12T00:00:51.990 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-12T00:00:51.991 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-12T00:00:51.992 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-12T00:00:51.993 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-12T00:00:51.994 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-12T00:00:51.996 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-12T00:00:51.997 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-12T00:00:51.998 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-12T00:00:51.999 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-12T00:00:52.000 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-12T00:00:52.001 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-12T00:00:52.002 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-12T00:00:52.004 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-12T00:00:52.005 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-12T00:00:52.006 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-12T00:00:52.007 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-12T00:00:52.008 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-12T00:00:52.014 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-12T00:00:52.014 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-12T00:00:52.014 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-12T00:00:52.014 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-12T00:00:52.014 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-12T00:00:52.015 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-12T00:00:52.016 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-12T00:00:52.018 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-12T00:00:52.019 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-12T00:00:52.020 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-12T00:00:52.021 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-12T00:00:52.022 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-12T00:00:52.024 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-12T00:00:52.025 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-12T00:00:52.026 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-12T00:00:52.027 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-12T00:00:52.029 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-12T00:00:52.030 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-12T00:00:52.031 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-12T00:00:52.032 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-12T00:00:52.033 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-12T00:00:52.035 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-12T00:00:52.036 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-12T00:00:52.037 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-12T00:00:52.038 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-12T00:00:52.040 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-12T00:00:52.041 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-12T00:00:52.042 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-12T00:00:52.043 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-12T00:00:52.044 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-12T00:00:52.046 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-12T00:00:52.047 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-12T00:00:52.048 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-12T00:00:52.049 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-12T00:00:52.050 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-12T00:00:52.052 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-12T00:00:52.053 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-12T00:00:52.054 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-12T00:00:52.055 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-12T00:00:52.057 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-12T00:00:52.058 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-12T00:00:52.059 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-12T00:00:52.060 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-12T00:00:52.062 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-12T00:00:52.063 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-12T00:00:52.064 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-12T00:00:52.065 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-12T00:00:52.066 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-12T00:00:52.068 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-12T00:00:52.069 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-12T00:00:52.070 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-12T00:00:52.072 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-12T00:00:52.073 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-12T00:00:52.074 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-12T00:00:52.075 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-12T00:00:52.077 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-12T00:00:52.078 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-12T00:00:52.079 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-12T00:00:52.080 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-12T00:00:52.081 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-12T00:00:52.082 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-12T00:00:52.083 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-12T00:00:52.085 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-12T00:00:52.086 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-12T00:00:52.087 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-12T00:00:52.088 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-12T00:00:52.089 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-12T00:00:52.091 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-12T00:00:52.092 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-12T00:00:52.093 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-12T00:00:52.094 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-12T00:00:52.096 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-12T00:00:52.096 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-12T00:00:52.098 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-12T00:00:52.099 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-12T00:00:52.100 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-12T00:00:52.101 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-12T00:00:52.102 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-12T00:00:52.103 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-12T00:00:52.105 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-12T00:00:52.106 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-12T00:00:52.107 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-12T00:00:52.108 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-12T00:00:52.109 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-12T00:00:52.111 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-12T00:00:52.112 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-12T00:00:52.114 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-12T00:00:52.115 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-12T00:00:52.116 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-12T00:00:52.117 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-12T00:00:52.118 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-12T00:00:52.119 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-12T00:00:52.120 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-12T00:00:52.121 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-12T00:00:52.122 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-12T00:00:52.123 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-12T00:00:52.125 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-12T00:00:52.126 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-12T00:00:52.127 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-12T00:00:52.128 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-12T00:00:52.130 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-12T00:00:52.131 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-12T00:00:52.132 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-12T00:00:52.133 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-12T00:00:52.134 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-12T00:00:52.136 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-12T00:00:52.137 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-12T00:00:52.138 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-12T00:00:52.139 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-12T00:00:52.140 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-12T00:00:52.141 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-12T00:00:52.142 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-12T00:00:52.144 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-12T00:00:52.144 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-12T00:00:52.145 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-12T00:00:52.146 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-12T00:00:52.147 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-12T00:00:52.148 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-12T00:00:52.148 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-12T00:00:52.149 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-12T00:00:52.150 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-12T00:00:52.151 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-12T00:00:52.152 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-12T00:00:52.153 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-12T00:00:52.154 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-12T00:00:52.155 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-12T00:00:52.155 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-12T00:00:52.156 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-12T00:00:52.157 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-12T00:00:52.158 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-12T00:00:52.159 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-12T00:00:52.160 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-12T00:00:52.161 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-12T00:00:52.162 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-12T00:00:52.162 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-12T00:00:52.163 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-12T00:00:52.164 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-12T00:00:52.165 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-12T00:00:52.166 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-12T00:00:52.166 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-12T00:00:52.167 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-12T00:00:52.168 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-12T00:00:52.169 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-12T00:00:52.170 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-12T00:00:52.171 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-12T00:00:52.172 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-12T00:00:52.173 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-12T00:00:52.174 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-12T00:00:52.175 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-12T00:00:52.176 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-12T00:00:52.177 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-12T00:00:52.178 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-12T00:00:52.178 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-12T00:00:52.179 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-12T00:00:52.180 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-12T00:00:52.181 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-12T00:00:52.182 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-12T00:00:52.183 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-12T00:00:52.184 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-12T00:00:52.185 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-12T00:00:52.186 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-12T00:00:52.187 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-12T00:00:52.188 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-12T00:00:52.188 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-12T00:00:52.189 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-12T00:00:52.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-12T00:00:52.191 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-12T00:00:52.192 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-12T00:00:52.193 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-12T00:00:52.194 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-12T00:00:52.195 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-12T00:00:52.196 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-12T00:00:52.196 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-12T00:00:52.197 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-12T00:00:52.198 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-12T00:00:52.199 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-12T00:00:52.200 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-12T00:00:52.201 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-12T00:00:52.202 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-12T00:00:52.202 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-12T00:00:52.203 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-12T00:00:52.204 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-12T00:00:52.205 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-12T00:00:52.206 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-12T00:00:52.207 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-12T00:00:52.208 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-12T00:00:52.209 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-12T00:00:52.209 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-12T00:00:52.210 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-12T00:00:52.211 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-12T00:00:52.212 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-12T00:00:52.213 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-12T00:00:52.214 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-12T00:00:52.215 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-12T00:00:52.216 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-12T00:00:52.216 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-12T00:00:52.217 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-12T00:00:52.221 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-12T00:00:52.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-12T00:00:52.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-12T00:00:52.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-12T00:00:52.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-12T00:00:52.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-12T00:00:52.223 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-12T00:00:52.224 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-12T00:00:52.225 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-12T00:00:52.226 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-12T00:00:52.226 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-12T00:00:52.227 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-12T00:00:52.228 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-12T00:00:52.229 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-12T00:00:52.230 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-12T00:00:52.230 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-12T00:00:52.231 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-12T00:00:52.232 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-12T00:00:52.233 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-12T00:00:52.234 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-12T00:00:52.235 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-12T00:00:52.235 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-12T00:00:52.236 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-12T00:00:52.237 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-12T00:00:52.238 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-12T00:00:52.239 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-12T00:00:52.239 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-12T00:00:52.240 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-12T00:00:52.241 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-12T00:00:52.242 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-12T00:00:52.243 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-12T00:00:52.244 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-12T00:00:52.245 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-12T00:00:52.245 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-12T00:00:52.246 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-12T00:00:52.247 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-12T00:00:52.248 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-12T00:00:52.249 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-12T00:00:52.250 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-12T00:00:52.251 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-12T00:00:52.251 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-12T00:00:52.252 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-12T00:00:52.253 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-12T00:00:52.254 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-12T00:00:52.255 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-12T00:00:52.256 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-12T00:00:52.257 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-12T00:00:52.258 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-12T00:00:52.259 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-12T00:00:52.260 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-12T00:00:52.261 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-12T00:00:52.262 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-12T00:00:52.262 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-12T00:00:52.263 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-12T00:00:52.265 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-12T00:00:52.265 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-12T00:00:52.266 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-12T00:00:52.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-12T00:00:52.268 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-12T00:00:52.269 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-12T00:00:52.271 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-12T00:00:52.492 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-12T00:00:52.493 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-12T00:00:52.494 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-12T00:00:52.495 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-12T00:00:52.496 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-12T00:00:52.497 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-12T00:00:52.498 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-12T00:00:52.498 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-12T00:00:52.499 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-12T00:00:52.500 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-12T00:00:52.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-12T00:00:52.502 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-12T00:00:52.503 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-12T00:00:52.504 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-12T00:00:52.505 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-12T00:00:52.506 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-12T00:00:52.507 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-12T00:00:52.508 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-12T00:00:52.509 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-12T00:00:52.510 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-12T00:00:52.510 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-12T00:00:52.511 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-12T00:00:52.512 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-12T00:00:52.513 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-12T00:00:52.514 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-12T00:00:52.515 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-12T00:00:52.516 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-12T00:00:52.517 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-12T00:00:52.517 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-12T00:00:52.518 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-12T00:00:52.519 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-12T00:00:52.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-12T00:00:52.521 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-12T00:00:52.522 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-12T00:00:52.523 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-12T00:00:52.524 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-12T00:00:52.524 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-12T00:00:52.525 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-12T00:00:52.526 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-12T00:00:52.527 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-12T00:00:52.528 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-12T00:00:52.529 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-12T00:00:52.530 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-12T00:00:52.531 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-12T00:00:52.531 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-12T00:00:52.532 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-12T00:00:52.533 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-12T00:00:52.534 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-12T00:00:52.535 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-12T00:00:52.536 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-12T00:00:52.537 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-12T00:00:52.537 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-12T00:00:52.538 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-12T00:00:52.539 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-12T00:00:52.540 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-12T00:00:52.541 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-12T00:00:52.542 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-12T00:00:52.542 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-12T00:00:52.543 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-12T00:00:52.544 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-12T00:00:52.545 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-12T00:00:52.546 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-12T00:00:52.547 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-12T00:00:52.547 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-12T00:00:52.548 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-12T00:00:52.549 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-12T00:00:52.550 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-12T00:00:52.551 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-12T00:00:52.553 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-12T00:00:52.553 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-12T00:00:52.554 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-12T00:00:52.555 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-12T00:00:52.556 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-12T00:00:52.556 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-12T00:00:52.557 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-12T00:00:52.558 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-12T00:00:52.559 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-12T00:00:52.560 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-12T00:00:52.561 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-12T00:00:52.561 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-12T00:00:52.562 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-12T00:00:52.563 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-12T00:00:52.564 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-12T00:00:52.565 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-12T00:00:52.566 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-12T00:00:52.567 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-12T00:00:52.568 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-12T00:00:52.568 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-12T00:00:52.570 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-12T00:00:52.570 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-12T00:00:52.571 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-12T00:00:52.572 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-12T00:00:52.573 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-12T00:00:52.574 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-12T00:00:52.575 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-12T00:00:52.576 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-12T00:00:52.577 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-12T00:00:52.577 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-12T00:00:52.578 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-12T00:00:52.579 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-12T00:00:52.580 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-12T00:00:52.581 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-12T00:00:52.582 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-12T00:00:52.583 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-12T00:00:52.583 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-12T00:00:52.584 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-12T00:00:52.585 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-12T00:00:52.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-12T00:00:52.587 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-12T00:00:52.588 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-12T00:00:52.589 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-12T00:00:52.589 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-12T00:00:52.590 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-12T00:00:52.591 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-12T00:00:52.592 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-12T00:00:52.593 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-12T00:00:52.594 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-12T00:00:52.594 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-12T00:00:52.595 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-12T00:00:52.596 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-12T00:00:52.597 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-12T00:00:52.598 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-12T00:00:52.598 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-12T00:00:52.599 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-12T00:00:52.600 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-12T00:00:52.601 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-12T00:00:52.602 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-12T00:00:52.603 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-12T00:00:52.604 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-12T00:00:52.605 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-12T00:00:52.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-12T00:00:52.607 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-12T00:00:52.608 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-12T00:00:52.608 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-12T00:00:52.609 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-12T00:00:52.610 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-12T00:00:52.611 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-12T00:00:52.612 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-12T00:00:52.613 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-12T00:00:52.613 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-12T00:00:52.614 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-12T00:00:52.616 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-12T00:00:52.616 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-12T00:00:52.617 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-12T00:00:52.618 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-12T00:00:52.619 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-12T00:00:52.620 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-12T00:00:52.621 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-12T00:00:52.621 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-12T00:00:52.622 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-12T00:00:52.623 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-12T00:00:52.625 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-12T00:00:52.625 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-12T00:00:52.630 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-12T00:00:52.630 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-12T00:00:52.630 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-12T00:00:52.630 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-12T00:00:52.630 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-12T00:00:52.631 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-12T00:00:52.632 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-12T00:00:52.633 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-12T00:00:52.633 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-12T00:00:52.634 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-12T00:00:52.635 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-12T00:00:52.636 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-12T00:00:52.637 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-12T00:00:52.638 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-12T00:00:52.639 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-12T00:00:52.640 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-12T00:00:52.641 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-12T00:00:52.642 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-12T00:00:52.643 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-12T00:00:52.644 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-12T00:00:52.645 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-12T00:00:52.646 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-12T00:00:52.646 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-12T00:00:52.647 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-12T00:00:52.648 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-12T00:00:52.648 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-12T00:00:52.650 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-12T00:00:52.650 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-12T00:00:52.651 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-12T00:00:52.652 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-12T00:00:52.653 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-12T00:00:52.654 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-12T00:00:52.655 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-12T00:00:52.656 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-12T00:00:52.657 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-12T00:00:52.657 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-12T00:00:52.658 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-12T00:00:52.659 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-12T00:00:52.660 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-12T00:00:52.661 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-12T00:00:52.662 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-12T00:00:52.663 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-12T00:00:52.663 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-12T00:00:52.664 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-12T00:00:52.665 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-12T00:00:52.667 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-12T00:00:52.667 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-12T00:00:52.668 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-12T00:00:52.668 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-12T00:00:52.669 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-12T00:00:52.670 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-12T00:00:52.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-12T00:00:52.672 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-12T00:00:52.673 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-12T00:00:52.673 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-12T00:00:52.674 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-12T00:00:52.675 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-12T00:00:52.676 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-12T00:00:52.677 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-12T00:00:52.678 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-12T00:00:52.679 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-12T00:00:52.679 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-12T00:00:52.680 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-12T00:00:52.681 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-12T00:00:52.682 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-12T00:00:52.683 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-12T00:00:52.684 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-12T00:00:52.684 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-12T00:00:52.686 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-12T00:00:52.686 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-12T00:00:52.687 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-12T00:00:52.688 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-12T00:00:52.689 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-12T00:00:52.690 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-12T00:00:52.690 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-12T00:00:52.691 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-12T00:00:52.692 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-12T00:00:52.693 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-12T00:00:52.694 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-12T00:00:52.695 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-12T00:00:52.696 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-12T00:00:52.697 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-12T00:00:52.697 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-12T00:00:52.698 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-12T00:00:52.699 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-12T00:00:52.700 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-12T00:00:52.701 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-12T00:00:52.702 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-12T00:00:52.703 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-12T00:00:52.703 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-12T00:00:52.704 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-12T00:00:52.705 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-12T00:00:52.706 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-12T00:00:52.707 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-12T00:00:52.708 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-12T00:00:52.708 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-12T00:00:52.709 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-12T00:00:52.710 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-12T00:00:52.711 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-12T00:00:52.712 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-12T00:00:52.712 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-12T00:00:52.713 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-12T00:00:52.714 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-12T00:00:52.715 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-12T00:00:52.716 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-12T00:00:52.717 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-12T00:00:52.718 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-12T00:00:52.718 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-12T00:00:52.719 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-12T00:00:52.720 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-12T00:00:52.721 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-12T00:00:52.722 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-12T00:00:52.723 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-12T00:00:52.724 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-12T00:00:52.725 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-12T00:00:52.726 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-12T00:00:52.726 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-12T00:00:52.727 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-12T00:00:52.728 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-12T00:00:52.729 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-12T00:00:52.730 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-12T00:00:52.731 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-12T00:00:52.732 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-12T00:00:52.733 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-12T00:00:52.734 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-12T00:00:52.735 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-12T00:00:52.736 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-12T00:00:52.736 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-12T00:00:52.737 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-12T00:00:52.738 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-12T00:00:52.739 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-12T00:00:52.740 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-12T00:00:52.741 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-12T00:00:52.742 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-12T00:00:52.743 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-12T00:00:52.744 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-12T00:00:52.745 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-12T00:00:52.746 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-12T00:00:52.747 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-12T00:00:52.748 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-12T00:00:52.749 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-12T00:00:52.750 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-12T00:00:52.751 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-12T00:00:52.752 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-12T00:00:52.753 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-12T00:00:52.753 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-12T00:00:52.754 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-12T00:00:52.755 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-12T00:00:52.756 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-12T00:00:52.757 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-12T00:00:52.758 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-12T00:00:52.759 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-12T00:00:52.760 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-12T00:00:52.761 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-12T00:00:52.762 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-12T00:00:52.763 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-12T00:00:52.763 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-12T00:00:52.764 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-12T00:00:52.765 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-12T00:00:52.766 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-12T00:00:52.767 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-12T00:00:52.768 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-12T00:00:52.769 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-12T00:00:52.770 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-12T00:00:52.771 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-12T00:00:52.772 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-12T00:00:52.773 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-12T00:00:52.774 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-12T00:00:52.775 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-12T00:00:52.776 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-12T00:00:52.776 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-12T00:00:52.777 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-12T00:00:52.778 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-12T00:00:52.779 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-12T00:00:52.780 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-12T00:00:52.781 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-12T00:00:52.782 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-12T00:00:52.783 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-12T00:00:52.783 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-12T00:00:52.784 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-12T00:00:52.785 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-12T00:00:52.786 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-12T00:00:52.787 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-12T00:00:52.788 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-12T00:00:52.788 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-12T00:00:52.789 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-12T00:00:52.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-12T00:00:52.791 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-12T00:00:52.792 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-12T00:00:52.793 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-12T00:00:52.793 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-12T00:00:52.794 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-12T00:00:52.795 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-12T00:00:52.796 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-12T00:00:52.797 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-12T00:00:52.798 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-12T00:00:52.799 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-12T00:00:52.800 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-12T00:00:52.801 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-12T00:00:52.802 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-12T00:00:52.803 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-12T00:00:52.804 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-12T00:00:52.805 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-12T00:00:52.805 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-12T00:00:52.806 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-12T00:00:52.807 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-12T00:00:52.808 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-12T00:00:52.810 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-12T00:00:52.811 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-12T00:00:52.811 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-12T00:00:52.811 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-12T00:00:52.812 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-12T00:00:52.813 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-12T00:00:52.814 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-12T00:00:52.815 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-12T00:00:52.816 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-12T00:00:52.817 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-12T00:00:52.817 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-12T00:00:52.818 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-12T00:00:52.819 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-12T00:00:52.820 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-12T00:00:52.821 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-12T00:00:52.821 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-12T00:00:52.822 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-12T00:00:52.823 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-12T00:00:52.824 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-12T00:00:52.825 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-12T00:00:52.827 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-12T00:00:52.828 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-12T00:00:52.830 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-12T00:00:52.833 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-12T00:00:52.834 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-12T00:00:52.834 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-12T00:00:52.835 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-12T00:00:52.836 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-12T00:00:52.838 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-12T00:00:52.839 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-12T00:00:52.841 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-12T00:00:52.842 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-12T00:00:52.843 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-12T00:00:52.845 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-12T00:00:52.846 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-12T00:00:52.847 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-12T00:00:52.849 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-12T00:00:52.850 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-12T00:00:52.851 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-12T00:00:52.853 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-12T00:00:52.854 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-12T00:00:52.855 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-12T00:00:52.857 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-12T00:00:52.858 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-12T00:00:52.860 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-12T00:00:52.861 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-12T00:00:52.862 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-12T00:00:52.864 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-12T00:00:52.865 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-12T00:00:52.866 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-12T00:00:52.868 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-12T00:00:52.869 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-12T00:00:52.870 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-12T00:00:52.872 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-12T00:00:52.873 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-12T00:00:52.875 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-12T00:00:52.876 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-12T00:00:52.877 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-12T00:00:52.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-12T00:00:52.880 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-12T00:00:52.882 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-12T00:00:52.883 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-12T00:00:52.884 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-12T00:00:52.886 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-12T00:00:52.887 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-12T00:00:52.888 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-12T00:00:52.890 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-12T00:00:52.891 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-12T00:00:52.892 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-12T00:00:52.894 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-12T00:00:52.896 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-12T00:00:52.897 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-12T00:00:52.898 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-12T00:00:52.899 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-12T00:00:52.901 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-12T00:00:52.902 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-12T00:00:52.903 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-12T00:00:52.905 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-12T00:00:52.906 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-12T00:00:52.908 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-12T00:00:52.909 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-12T00:00:52.910 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-12T00:00:52.912 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-12T00:00:52.913 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-12T00:00:52.915 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-12T00:00:52.916 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-12T00:00:52.917 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-12T00:00:52.918 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-12T00:00:52.919 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-12T00:00:52.920 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-12T00:00:52.921 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-12T00:00:52.921 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-12T00:00:52.922 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-12T00:00:52.923 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-12T00:00:52.924 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-12T00:00:52.925 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-12T00:00:52.926 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-12T00:00:52.928 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-12T00:00:52.929 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-12T00:00:52.929 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-12T00:00:52.930 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-12T00:00:52.931 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-12T00:00:52.932 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-12T00:00:52.933 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-12T00:00:52.934 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-12T00:00:52.935 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-12T00:00:52.936 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-12T00:00:52.937 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-12T00:00:52.937 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-12T00:00:52.938 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-12T00:00:52.939 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-12T00:00:52.940 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-12T00:00:52.941 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-12T00:00:52.942 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-12T00:00:52.943 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-12T00:00:52.944 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-12T00:00:52.944 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-12T00:00:52.945 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-12T00:00:52.946 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-12T00:00:52.947 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-12T00:00:52.948 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-12T00:00:52.949 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-12T00:00:52.950 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-12T00:00:52.951 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-12T00:00:52.951 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-12T00:00:52.952 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-12T00:00:52.953 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-12T00:00:52.954 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-12T00:00:52.955 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-12T00:00:52.956 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-12T00:00:52.957 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-12T00:00:52.958 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-12T00:00:52.958 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-12T00:00:52.959 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-12T00:00:52.960 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-12T00:00:52.961 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-12T00:00:52.961 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-12T00:00:52.962 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-12T00:00:52.963 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-12T00:00:52.964 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-12T00:00:52.965 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-12T00:00:52.967 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-12T00:00:53.175 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-12T00:00:53.176 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-12T00:00:53.176 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-12T00:00:53.177 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-12T00:00:53.178 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-12T00:00:53.180 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-12T00:00:53.181 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-12T00:00:53.182 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-12T00:00:53.183 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-12T00:00:53.184 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-12T00:00:53.185 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-12T00:00:53.185 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-12T00:00:53.187 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-12T00:00:53.187 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-12T00:00:53.188 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-12T00:00:53.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-12T00:00:53.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-12T00:00:53.191 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-12T00:00:53.192 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-12T00:00:53.194 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-12T00:00:53.195 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-12T00:00:53.196 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-12T00:00:53.197 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-12T00:00:53.198 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-12T00:00:53.200 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-12T00:00:53.201 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-12T00:00:53.202 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-12T00:00:53.203 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-12T00:00:53.204 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-12T00:00:53.205 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-12T00:00:53.206 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-12T00:00:53.206 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-12T00:00:53.207 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-12T00:00:53.208 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-12T00:00:53.209 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-12T00:00:53.210 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-12T00:00:53.211 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-12T00:00:53.212 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-12T00:00:53.213 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-12T00:00:53.214 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-12T00:00:53.215 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-12T00:00:53.216 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-12T00:00:53.217 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-12T00:00:53.218 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-12T00:00:53.219 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-12T00:00:53.220 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-12T00:00:53.221 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-12T00:00:53.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-12T00:00:53.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-12T00:00:53.223 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-12T00:00:53.224 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-12T00:00:53.225 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-12T00:00:53.226 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-12T00:00:53.227 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-12T00:00:53.228 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-12T00:00:53.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:52 smithi105 ceph-mon[34805]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-12T00:00:53.229 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-12T00:00:53.230 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-12T00:00:53.231 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-12T00:00:53.232 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-12T00:00:53.233 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-12T00:00:53.234 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-12T00:00:53.235 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-12T00:00:53.236 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-12T00:00:53.241 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-12T00:00:53.241 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-12T00:00:53.242 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-12T00:00:53.242 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-12T00:00:53.242 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-12T00:00:53.242 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-12T00:00:53.244 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-12T00:00:53.245 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-12T00:00:53.246 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-12T00:00:53.247 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-12T00:00:53.247 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-12T00:00:53.248 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-12T00:00:53.249 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-12T00:00:53.250 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-12T00:00:53.251 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-12T00:00:53.252 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-12T00:00:53.253 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-12T00:00:53.254 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-12T00:00:53.254 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-12T00:00:53.255 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-12T00:00:53.256 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-12T00:00:53.257 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-12T00:00:53.258 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-12T00:00:53.259 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-12T00:00:53.260 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-12T00:00:53.261 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-12T00:00:53.262 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-12T00:00:53.263 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-12T00:00:53.264 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-12T00:00:53.265 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-12T00:00:53.266 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-12T00:00:53.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-12T00:00:53.268 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-12T00:00:53.269 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-12T00:00:53.270 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-12T00:00:53.271 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-12T00:00:53.272 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-12T00:00:53.273 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-12T00:00:53.275 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-12T00:00:53.276 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-12T00:00:53.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-12T00:00:53.279 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-12T00:00:53.280 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-12T00:00:53.282 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-12T00:00:53.283 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-12T00:00:53.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:52 smithi192 ceph-mon[35487]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-12T00:00:53.285 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-12T00:00:53.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-12T00:00:53.288 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-12T00:00:53.289 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-12T00:00:53.291 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-12T00:00:53.292 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-12T00:00:53.294 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-12T00:00:53.295 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-12T00:00:53.296 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-12T00:00:53.298 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-12T00:00:53.299 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/ 2024-09-12T00:00:53.300 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-12T00:00:53.302 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-12T00:00:53.303 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-12T00:00:53.305 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-12T00:00:53.306 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-12T00:00:53.307 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-12T00:00:53.309 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-12T00:00:53.310 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-12T00:00:53.311 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-12T00:00:53.313 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-12T00:00:53.314 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-12T00:00:53.316 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-12T00:00:53.317 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-12T00:00:53.319 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-12T00:00:53.320 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-12T00:00:53.321 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-12T00:00:53.323 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-12T00:00:53.324 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-12T00:00:53.325 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-12T00:00:53.327 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-12T00:00:53.328 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-12T00:00:53.330 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-12T00:00:53.331 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-12T00:00:53.332 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-12T00:00:53.333 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-12T00:00:53.335 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-12T00:00:53.336 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-12T00:00:53.338 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-12T00:00:53.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:52 smithi060 ceph-mon[30953]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-09-12T00:00:53.339 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-12T00:00:53.340 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-12T00:00:53.341 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-12T00:00:53.342 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-12T00:00:53.343 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-12T00:00:53.344 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-12T00:00:53.345 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-12T00:00:53.346 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-12T00:00:53.347 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-12T00:00:53.348 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-12T00:00:53.349 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-12T00:00:53.350 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-12T00:00:53.351 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-12T00:00:53.353 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-12T00:00:53.353 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-12T00:00:53.354 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-12T00:00:53.355 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-12T00:00:53.356 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-12T00:00:53.357 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-12T00:00:53.358 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-12T00:00:53.359 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-12T00:00:53.360 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-12T00:00:53.361 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-12T00:00:53.362 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-12T00:00:53.363 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-12T00:00:53.364 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-12T00:00:53.365 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-12T00:00:53.366 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-12T00:00:53.367 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-12T00:00:53.368 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-12T00:00:53.369 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-12T00:00:53.370 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-12T00:00:53.371 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-12T00:00:53.372 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-12T00:00:53.372 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-12T00:00:53.373 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-12T00:00:53.374 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-12T00:00:53.375 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-12T00:00:53.376 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-12T00:00:53.377 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-12T00:00:53.378 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-12T00:00:53.379 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-12T00:00:53.380 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-12T00:00:53.381 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-12T00:00:53.382 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-12T00:00:53.383 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-12T00:00:53.384 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-12T00:00:53.385 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-12T00:00:53.386 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-12T00:00:53.387 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-12T00:00:53.388 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-12T00:00:53.389 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-12T00:00:53.389 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-12T00:00:53.390 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-12T00:00:53.391 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-12T00:00:53.392 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-12T00:00:53.393 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-12T00:00:53.394 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-12T00:00:53.395 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-12T00:00:53.396 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-12T00:00:53.397 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-12T00:00:53.398 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-12T00:00:53.399 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-12T00:00:53.400 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-12T00:00:53.401 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-12T00:00:53.402 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-12T00:00:53.403 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-12T00:00:53.404 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-12T00:00:53.405 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-12T00:00:53.406 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-12T00:00:53.407 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-12T00:00:53.408 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-12T00:00:53.409 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-12T00:00:53.410 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-12T00:00:53.411 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-12T00:00:53.411 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-12T00:00:53.412 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-12T00:00:53.413 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-12T00:00:53.414 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-12T00:00:53.415 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-12T00:00:53.416 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-12T00:00:53.417 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-12T00:00:53.418 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-12T00:00:53.419 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-12T00:00:53.419 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-12T00:00:53.420 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-12T00:00:53.421 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-12T00:00:53.422 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-12T00:00:53.423 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-12T00:00:53.424 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-12T00:00:53.424 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-12T00:00:53.425 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-12T00:00:53.426 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-12T00:00:53.427 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-12T00:00:53.428 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-12T00:00:53.429 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-12T00:00:53.430 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-12T00:00:53.431 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-12T00:00:53.432 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-12T00:00:53.432 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-12T00:00:53.433 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-12T00:00:53.435 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-12T00:00:53.436 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-12T00:00:53.436 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-12T00:00:53.437 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-12T00:00:53.438 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-12T00:00:53.439 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-12T00:00:53.440 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-12T00:00:53.440 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-12T00:00:53.445 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-12T00:00:53.446 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-12T00:00:53.446 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-12T00:00:53.446 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-12T00:00:53.446 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-12T00:00:53.446 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-12T00:00:53.446 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-12T00:00:53.447 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-12T00:00:53.448 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-12T00:00:53.449 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-12T00:00:53.450 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-12T00:00:53.451 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-12T00:00:53.452 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-12T00:00:53.453 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-12T00:00:53.453 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-12T00:00:53.454 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-12T00:00:53.455 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-12T00:00:53.456 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-12T00:00:53.457 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-12T00:00:53.458 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-12T00:00:53.459 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-12T00:00:53.459 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-12T00:00:53.460 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-12T00:00:53.461 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-12T00:00:53.462 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-12T00:00:53.463 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-12T00:00:53.464 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-12T00:00:53.465 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-12T00:00:53.466 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-12T00:00:53.467 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-12T00:00:53.468 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/ 2024-09-12T00:00:53.469 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-12T00:00:53.470 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-12T00:00:53.471 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-12T00:00:53.473 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-12T00:00:53.473 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-12T00:00:53.474 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-12T00:00:53.475 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-12T00:00:53.475 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-12T00:00:53.476 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-12T00:00:53.477 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-12T00:00:53.478 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-12T00:00:53.479 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-12T00:00:53.480 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-12T00:00:53.481 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-12T00:00:53.482 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-12T00:00:53.483 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-12T00:00:53.484 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-12T00:00:53.485 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-12T00:00:53.486 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-12T00:00:53.487 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-12T00:00:53.488 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-12T00:00:53.489 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hid/ 2024-09-12T00:00:53.490 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-12T00:00:53.491 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-12T00:00:53.492 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-12T00:00:53.492 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-12T00:00:53.493 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-12T00:00:53.494 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-12T00:00:53.495 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-12T00:00:53.497 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-12T00:00:53.497 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-12T00:00:53.498 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-12T00:00:53.499 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-12T00:00:53.500 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-12T00:00:53.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-12T00:00:53.502 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-12T00:00:53.503 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-12T00:00:53.504 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-12T00:00:53.505 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-12T00:00:53.506 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-12T00:00:53.507 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-12T00:00:53.508 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-12T00:00:53.508 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-12T00:00:53.510 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-12T00:00:53.511 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-12T00:00:53.512 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-12T00:00:53.512 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-12T00:00:53.514 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-12T00:00:53.514 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-12T00:00:53.515 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-12T00:00:53.516 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-12T00:00:53.518 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-12T00:00:53.518 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-12T00:00:53.519 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-12T00:00:53.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-12T00:00:53.521 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-12T00:00:53.522 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-12T00:00:53.523 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-12T00:00:53.524 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-12T00:00:53.526 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-12T00:00:53.527 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-12T00:00:53.528 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-12T00:00:53.528 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-12T00:00:53.529 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-12T00:00:53.530 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-12T00:00:53.531 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-12T00:00:53.532 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-12T00:00:53.533 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-12T00:00:53.534 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-12T00:00:53.535 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-12T00:00:53.536 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-12T00:00:53.537 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-12T00:00:53.538 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-12T00:00:53.539 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-12T00:00:53.540 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-12T00:00:53.541 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-12T00:00:53.542 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-12T00:00:53.542 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-12T00:00:53.543 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-12T00:00:53.545 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-12T00:00:53.545 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-12T00:00:53.546 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-12T00:00:53.547 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-12T00:00:53.548 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-12T00:00:53.549 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-12T00:00:53.550 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-12T00:00:53.550 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-12T00:00:53.551 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-12T00:00:53.552 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-12T00:00:53.553 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-12T00:00:53.554 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-12T00:00:53.554 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-12T00:00:53.555 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-12T00:00:53.556 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-12T00:00:53.557 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-12T00:00:53.558 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-12T00:00:53.559 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-12T00:00:53.560 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-12T00:00:53.560 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-12T00:00:53.562 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-12T00:00:53.562 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-12T00:00:53.563 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-12T00:00:53.564 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-12T00:00:53.565 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-12T00:00:53.566 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-12T00:00:53.567 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-12T00:00:53.568 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-12T00:00:53.569 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-12T00:00:53.570 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-12T00:00:53.571 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-12T00:00:53.573 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-12T00:00:53.574 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-12T00:00:53.575 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-12T00:00:53.577 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-12T00:00:53.578 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-12T00:00:53.579 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-12T00:00:53.581 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-12T00:00:53.582 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-12T00:00:53.583 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-12T00:00:53.585 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-12T00:00:53.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-12T00:00:53.587 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-12T00:00:53.589 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-12T00:00:53.590 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-12T00:00:53.592 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-12T00:00:53.593 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-12T00:00:53.594 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-12T00:00:53.595 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-12T00:00:53.597 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-12T00:00:53.598 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-12T00:00:53.599 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-12T00:00:53.601 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-12T00:00:53.602 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-12T00:00:53.604 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-12T00:00:53.605 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-12T00:00:53.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-12T00:00:53.608 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-12T00:00:53.609 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-12T00:00:53.611 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-12T00:00:53.612 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-12T00:00:53.613 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-12T00:00:53.615 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-12T00:00:53.616 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-12T00:00:53.618 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-12T00:00:53.619 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-12T00:00:53.620 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-12T00:00:53.622 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-12T00:00:53.623 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-12T00:00:53.625 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-12T00:00:53.627 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-12T00:00:53.628 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-12T00:00:53.629 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-12T00:00:53.631 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-12T00:00:53.632 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-12T00:00:53.633 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-12T00:00:53.635 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-12T00:00:53.636 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-12T00:00:53.638 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-12T00:00:53.639 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-12T00:00:53.640 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-12T00:00:53.642 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-12T00:00:53.643 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-12T00:00:53.645 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-12T00:00:53.649 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-12T00:00:53.649 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-12T00:00:53.649 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-12T00:00:53.650 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-12T00:00:53.652 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-12T00:00:53.653 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-12T00:00:53.654 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-12T00:00:53.656 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-12T00:00:53.657 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-12T00:00:53.659 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-12T00:00:53.660 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-12T00:00:53.661 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-12T00:00:53.663 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-12T00:00:53.664 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-12T00:00:53.665 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-12T00:00:53.667 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-12T00:00:53.668 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-12T00:00:53.670 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-12T00:00:53.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-12T00:00:53.673 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-12T00:00:53.674 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-12T00:00:53.675 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-12T00:00:53.677 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-12T00:00:53.678 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-12T00:00:53.679 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-12T00:00:53.681 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-12T00:00:53.682 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-12T00:00:53.684 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-12T00:00:53.685 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-12T00:00:53.686 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-12T00:00:53.688 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-12T00:00:53.689 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-12T00:00:53.690 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-12T00:00:53.692 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-12T00:00:53.693 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-12T00:00:53.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:00:53.696 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-12T00:00:53.696 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-12T00:00:53.699 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-12T00:00:53.699 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-12T00:00:53.700 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-12T00:00:53.701 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-12T00:00:53.702 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-12T00:00:53.703 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-12T00:00:53.705 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-12T00:00:53.706 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-12T00:00:53.707 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-12T00:00:53.708 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-12T00:00:53.710 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-12T00:00:53.711 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-12T00:00:53.712 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-12T00:00:53.714 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-12T00:00:53.715 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-12T00:00:53.924 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-12T00:00:53.925 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-12T00:00:53.926 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-12T00:00:53.927 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-12T00:00:53.928 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-12T00:00:53.928 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-12T00:00:53.929 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ide/ 2024-09-12T00:00:53.930 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-12T00:00:53.931 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-12T00:00:53.932 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-12T00:00:53.932 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-12T00:00:53.933 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-12T00:00:53.934 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-12T00:00:53.934 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-12T00:00:53.935 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-12T00:00:53.936 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-12T00:00:53.937 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-12T00:00:53.938 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-12T00:00:53.938 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-12T00:00:53.939 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-12T00:00:53.940 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/init.txt 2024-09-12T00:00:53.941 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-12T00:00:53.942 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/ 2024-09-12T00:00:53.942 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-12T00:00:53.943 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-12T00:00:53.944 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-12T00:00:53.945 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-12T00:00:53.945 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-12T00:00:53.946 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-12T00:00:53.947 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-12T00:00:53.948 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-12T00:00:53.948 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-12T00:00:53.949 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-12T00:00:53.950 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-12T00:00:53.951 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-12T00:00:53.952 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-12T00:00:53.952 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-12T00:00:53.953 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-12T00:00:53.954 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-12T00:00:53.955 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-12T00:00:53.956 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-12T00:00:53.957 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-12T00:00:53.957 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-12T00:00:53.958 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:53.958 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-12T00:00:53.960 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-12T00:00:53.961 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-12T00:00:53.962 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-12T00:00:53.963 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-12T00:00:53.964 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-12T00:00:53.965 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-12T00:00:53.966 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-12T00:00:53.967 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-12T00:00:53.969 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-12T00:00:53.970 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-12T00:00:53.971 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-12T00:00:53.996 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-12T00:00:53.997 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-12T00:00:53.998 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-12T00:00:53.999 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-12T00:00:53.999 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-12T00:00:54.000 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-12T00:00:54.001 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-12T00:00:54.002 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-12T00:00:54.003 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-12T00:00:54.004 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-12T00:00:54.005 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-12T00:00:54.006 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-12T00:00:54.006 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-12T00:00:54.007 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-12T00:00:54.008 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-12T00:00:54.009 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-12T00:00:54.010 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-12T00:00:54.011 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-12T00:00:54.011 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-12T00:00:54.012 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-12T00:00:54.014 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-12T00:00:54.014 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-12T00:00:54.015 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-12T00:00:54.016 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-12T00:00:54.017 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-12T00:00:54.018 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-12T00:00:54.019 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-12T00:00:54.020 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-12T00:00:54.021 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-12T00:00:54.022 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-12T00:00:54.022 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-12T00:00:54.023 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-12T00:00:54.024 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-12T00:00:54.025 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-12T00:00:54.026 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-12T00:00:54.027 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-12T00:00:54.028 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-12T00:00:54.029 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-12T00:00:54.030 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-12T00:00:54.030 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-12T00:00:54.031 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-12T00:00:54.032 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-12T00:00:54.033 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-12T00:00:54.034 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-12T00:00:54.035 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/java.txt 2024-09-12T00:00:54.036 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-12T00:00:54.037 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-12T00:00:54.038 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-12T00:00:54.039 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-12T00:00:54.040 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-12T00:00:54.041 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-12T00:00:54.042 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-12T00:00:54.043 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-12T00:00:54.043 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-12T00:00:54.044 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-12T00:00:54.045 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-12T00:00:54.046 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-12T00:00:54.047 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-12T00:00:54.048 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-12T00:00:54.049 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-12T00:00:54.051 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-12T00:00:54.052 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-12T00:00:54.053 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-12T00:00:54.054 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-12T00:00:54.055 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-12T00:00:54.056 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-12T00:00:54.057 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-12T00:00:54.058 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-12T00:00:54.058 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-12T00:00:54.059 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-12T00:00:54.060 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-12T00:00:54.061 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-12T00:00:54.062 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-12T00:00:54.063 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-12T00:00:54.063 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-12T00:00:54.064 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-12T00:00:54.065 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-12T00:00:54.066 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-12T00:00:54.067 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-12T00:00:54.068 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-12T00:00:54.068 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-12T00:00:54.069 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-12T00:00:54.070 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-12T00:00:54.071 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-12T00:00:54.072 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/ 2024-09-12T00:00:54.073 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-12T00:00:54.073 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-12T00:00:54.074 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-12T00:00:54.075 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-12T00:00:54.076 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-12T00:00:54.076 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-12T00:00:54.077 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-12T00:00:54.078 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-12T00:00:54.079 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-12T00:00:54.079 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-12T00:00:54.080 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-12T00:00:54.081 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-12T00:00:54.082 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/ 2024-09-12T00:00:54.083 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-12T00:00:54.084 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-12T00:00:54.085 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-12T00:00:54.086 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-12T00:00:54.087 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-12T00:00:54.087 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-12T00:00:54.088 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-12T00:00:54.089 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-12T00:00:54.089 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-12T00:00:54.090 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-12T00:00:54.091 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-12T00:00:54.092 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-12T00:00:54.093 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-12T00:00:54.094 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-12T00:00:54.095 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-12T00:00:54.096 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-12T00:00:54.097 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-12T00:00:54.097 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-12T00:00:54.098 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-12T00:00:54.099 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-12T00:00:54.100 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/md.txt 2024-09-12T00:00:54.101 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-12T00:00:54.102 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-12T00:00:54.161 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-12T00:00:54.162 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-12T00:00:54.162 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-12T00:00:54.163 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/metag/ 2024-09-12T00:00:54.164 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-12T00:00:54.165 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-12T00:00:54.166 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/ 2024-09-12T00:00:54.167 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-12T00:00:54.168 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-12T00:00:54.169 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-12T00:00:54.170 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-12T00:00:54.170 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-12T00:00:54.171 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-12T00:00:54.172 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-12T00:00:54.173 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-12T00:00:54.174 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-12T00:00:54.175 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-12T00:00:54.176 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mips/ 2024-09-12T00:00:54.177 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-12T00:00:54.178 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-12T00:00:54.179 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-12T00:00:54.180 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-12T00:00:54.180 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-12T00:00:54.181 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-12T00:00:54.182 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-12T00:00:54.183 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-12T00:00:54.184 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-12T00:00:54.185 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-12T00:00:54.185 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-12T00:00:54.186 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-12T00:00:54.187 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-12T00:00:54.188 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-12T00:00:54.189 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-12T00:00:54.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-12T00:00:54.190 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-12T00:00:54.191 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-12T00:00:54.192 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-12T00:00:54.193 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-12T00:00:54.194 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-12T00:00:54.194 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-12T00:00:54.195 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-12T00:00:54.196 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-12T00:00:54.197 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-12T00:00:54.198 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-12T00:00:54.198 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-12T00:00:54.199 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-12T00:00:54.200 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-12T00:00:54.201 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-12T00:00:54.202 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-12T00:00:54.203 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-12T00:00:54.204 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-12T00:00:54.205 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-12T00:00:54.205 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-12T00:00:54.206 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-12T00:00:54.207 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-12T00:00:54.208 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-12T00:00:54.209 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-12T00:00:54.209 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-12T00:00:54.210 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-12T00:00:54.211 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-12T00:00:54.212 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-12T00:00:54.213 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-12T00:00:54.214 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-12T00:00:54.214 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ 2024-09-12T00:00:54.215 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-12T00:00:54.216 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-12T00:00:54.216 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-12T00:00:54.217 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-12T00:00:54.218 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-12T00:00:54.219 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-12T00:00:54.220 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-12T00:00:54.220 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-12T00:00:54.221 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-12T00:00:54.222 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-12T00:00:54.223 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-12T00:00:54.224 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-12T00:00:54.225 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-12T00:00:54.226 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-12T00:00:54.227 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-12T00:00:54.228 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-12T00:00:54.229 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-12T00:00:54.230 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-12T00:00:54.231 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-12T00:00:54.231 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-12T00:00:54.233 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-12T00:00:54.234 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-12T00:00:54.234 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-12T00:00:54.235 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-12T00:00:54.236 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-12T00:00:54.237 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-12T00:00:54.237 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-12T00:00:54.238 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-12T00:00:54.239 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-12T00:00:54.240 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-12T00:00:54.241 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-12T00:00:54.242 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-12T00:00:54.243 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-12T00:00:54.244 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-12T00:00:54.245 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-12T00:00:54.245 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-12T00:00:54.246 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-12T00:00:54.247 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-12T00:00:54.248 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-12T00:00:54.248 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-12T00:00:54.249 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-12T00:00:54.250 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-12T00:00:54.250 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-12T00:00:54.251 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-12T00:00:54.252 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-12T00:00:54.253 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-12T00:00:54.256 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-12T00:00:54.256 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-12T00:00:54.257 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-12T00:00:54.267 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-12T00:00:54.277 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-12T00:00:54.278 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-12T00:00:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-12T00:00:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-12T00:00:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-12T00:00:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-12T00:00:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-12T00:00:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-12T00:00:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-12T00:00:54.286 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-12T00:00:54.304 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-12T00:00:54.305 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-12T00:00:54.307 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-12T00:00:54.307 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-12T00:00:54.308 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-12T00:00:54.309 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-12T00:00:54.310 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-12T00:00:54.311 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-12T00:00:54.312 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-12T00:00:54.313 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-12T00:00:54.314 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-12T00:00:54.315 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-12T00:00:54.316 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-12T00:00:54.317 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-12T00:00:54.319 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-12T00:00:54.319 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-12T00:00:54.319 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-12T00:00:54.320 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-12T00:00:54.321 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-12T00:00:54.322 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-12T00:00:54.323 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-12T00:00:54.323 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-12T00:00:54.324 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-12T00:00:54.325 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-12T00:00:54.326 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-12T00:00:54.327 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-12T00:00:54.328 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-12T00:00:54.328 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-12T00:00:54.329 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-12T00:00:54.330 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-12T00:00:54.331 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-12T00:00:54.333 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-12T00:00:54.334 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-12T00:00:54.335 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-12T00:00:54.335 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-12T00:00:54.336 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-12T00:00:54.337 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-12T00:00:54.339 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-12T00:00:54.339 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-12T00:00:54.340 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-12T00:00:54.341 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-12T00:00:54.341 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-12T00:00:54.342 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-12T00:00:54.343 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-12T00:00:54.344 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-12T00:00:54.345 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-12T00:00:54.345 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-12T00:00:54.346 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-12T00:00:54.347 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-12T00:00:54.348 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-12T00:00:54.348 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-12T00:00:54.349 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-12T00:00:54.350 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-12T00:00:54.351 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-12T00:00:54.352 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-12T00:00:54.352 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-12T00:00:54.353 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-12T00:00:54.354 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-12T00:00:54.354 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-12T00:00:54.355 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-12T00:00:54.356 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-12T00:00:54.357 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-12T00:00:54.358 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-12T00:00:54.359 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-12T00:00:54.360 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-12T00:00:54.361 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-12T00:00:54.362 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-12T00:00:54.363 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-12T00:00:54.364 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-12T00:00:54.365 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-12T00:00:54.366 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-12T00:00:54.367 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-12T00:00:54.368 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-12T00:00:54.369 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-12T00:00:54.370 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-12T00:00:54.371 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-12T00:00:54.371 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-12T00:00:54.373 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-12T00:00:54.373 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-12T00:00:54.374 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-12T00:00:54.374 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-12T00:00:54.376 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-12T00:00:54.376 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/phy/ 2024-09-12T00:00:54.377 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-12T00:00:54.378 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-12T00:00:54.379 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-12T00:00:54.380 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/platform/ 2024-09-12T00:00:54.381 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-12T00:00:54.381 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-12T00:00:54.383 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/ 2024-09-12T00:00:54.384 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-12T00:00:54.385 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-12T00:00:54.386 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-12T00:00:54.387 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-12T00:00:54.388 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-12T00:00:54.389 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-12T00:00:54.390 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-12T00:00:54.391 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-12T00:00:54.392 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-12T00:00:54.393 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-12T00:00:54.394 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-12T00:00:54.395 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-12T00:00:54.396 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-12T00:00:54.397 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-12T00:00:54.398 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-12T00:00:54.399 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-12T00:00:54.400 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-12T00:00:54.401 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-12T00:00:54.402 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-12T00:00:54.403 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-12T00:00:54.404 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-12T00:00:54.405 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-12T00:00:54.406 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-12T00:00:54.407 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-12T00:00:54.409 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-12T00:00:54.409 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-12T00:00:54.410 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-12T00:00:54.411 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-12T00:00:54.412 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-12T00:00:54.413 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-12T00:00:54.414 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-12T00:00:54.415 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-12T00:00:54.416 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-12T00:00:54.417 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-12T00:00:54.418 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-12T00:00:54.419 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-12T00:00:54.420 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-12T00:00:54.421 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-12T00:00:54.422 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-12T00:00:54.423 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-12T00:00:54.424 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-12T00:00:54.425 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-12T00:00:54.426 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-12T00:00:54.427 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-12T00:00:54.428 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-12T00:00:54.429 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-12T00:00:54.430 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pps/ 2024-09-12T00:00:54.431 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-12T00:00:54.432 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-12T00:00:54.433 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-12T00:00:54.434 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-12T00:00:54.435 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-12T00:00:54.436 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-12T00:00:54.437 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-12T00:00:54.438 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-12T00:00:54.440 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-12T00:00:54.440 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-12T00:00:54.441 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-12T00:00:54.442 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pti/ 2024-09-12T00:00:54.443 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-12T00:00:54.444 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-12T00:00:54.445 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-12T00:00:54.446 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-12T00:00:54.447 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-12T00:00:54.448 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-12T00:00:54.449 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-12T00:00:54.450 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-12T00:00:54.451 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-12T00:00:54.452 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-12T00:00:54.453 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-12T00:00:54.454 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-12T00:00:54.455 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-12T00:00:54.456 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-12T00:00:54.457 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-12T00:00:54.458 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-12T00:00:54.459 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-12T00:00:54.460 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-12T00:00:54.465 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-12T00:00:54.466 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-12T00:00:54.466 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/ 2024-09-12T00:00:54.466 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-12T00:00:54.466 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-12T00:00:54.468 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-12T00:00:54.469 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-12T00:00:54.470 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-12T00:00:54.471 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-12T00:00:54.473 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-12T00:00:54.475 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-12T00:00:54.476 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-12T00:00:54.477 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-12T00:00:54.478 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-12T00:00:54.480 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-12T00:00:54.482 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-12T00:00:54.483 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-12T00:00:54.484 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-12T00:00:54.485 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-12T00:00:54.486 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-12T00:00:54.487 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-12T00:00:54.488 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-12T00:00:54.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.467+0000 7fe6973c3640 1 -- 172.21.15.60:0/1061465162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690106f20 msgr2=0x7fe69010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.467+0000 7fe6973c3640 1 --2- 172.21.15.60:0/1061465162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690106f20 0x7fe69010eaa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe688009ca0 tx=0x7fe68802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.467+0000 7fe6973c3640 1 -- 172.21.15.60:0/1061465162 shutdown_connections 2024-09-12T00:00:54.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.467+0000 7fe6973c3640 1 --2- 172.21.15.60:0/1061465162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690106f20 0x7fe69010eaa0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.467+0000 7fe6973c3640 1 --2- 172.21.15.60:0/1061465162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6901027a0 0x7fe6901067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.467+0000 7fe6973c3640 1 --2- 172.21.15.60:0/1061465162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690101df0 0x7fe6901021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.467+0000 7fe6973c3640 1 -- 172.21.15.60:0/1061465162 >> 172.21.15.60:0/1061465162 conn(0x7fe6900fd8f0 msgr2=0x7fe6900ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.468+0000 7fe6973c3640 1 -- 172.21.15.60:0/1061465162 shutdown_connections 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.468+0000 7fe6973c3640 1 -- 172.21.15.60:0/1061465162 wait complete. 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.468+0000 7fe6973c3640 1 Processor -- start 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.468+0000 7fe6973c3640 1 -- start start 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe6973c3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690101df0 0x7fe6901984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe6973c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6901027a0 0x7fe690198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe6973c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690106f20 0x7fe69019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe6973c3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901120a0 con 0x7fe690101df0 2024-09-12T00:00:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe6973c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe690111f20 con 0x7fe6901027a0 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe6973c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe690112220 con 0x7fe690106f20 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690101df0 0x7fe6901984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690101df0 0x7fe6901984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37432/0 (socket says 172.21.15.60:37432) 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 -- 172.21.15.60:0/2573074559 learned_addr learned my addr 172.21.15.60:0/2573074559 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe695960640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690106f20 0x7fe69019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69495e640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6901027a0 0x7fe690198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 -- 172.21.15.60:0/2573074559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690106f20 msgr2=0x7fe69019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690106f20 0x7fe69019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 -- 172.21.15.60:0/2573074559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6901027a0 msgr2=0x7fe690198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6901027a0 0x7fe690198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 -- 172.21.15.60:0/2573074559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69019d490 con 0x7fe690101df0 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe69515f640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690101df0 0x7fe6901984e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00d950 tx=0x7fe68c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.469+0000 7fe6867fc640 1 -- 172.21.15.60:0/2573074559 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c017030 con 0x7fe690101df0 2024-09-12T00:00:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.470+0000 7fe6973c3640 1 -- 172.21.15.60:0/2573074559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69019d780 con 0x7fe690101df0 2024-09-12T00:00:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.470+0000 7fe6867fc640 1 -- 172.21.15.60:0/2573074559 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe68c004020 con 0x7fe690101df0 2024-09-12T00:00:54.492 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-12T00:00:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.470+0000 7fe6973c3640 1 -- 172.21.15.60:0/2573074559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a5060 con 0x7fe690101df0 2024-09-12T00:00:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.470+0000 7fe6867fc640 1 -- 172.21.15.60:0/2573074559 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c004a00 con 0x7fe690101df0 2024-09-12T00:00:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.472+0000 7fe6867fc640 1 -- 172.21.15.60:0/2573074559 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe68c0041d0 con 0x7fe690101df0 2024-09-12T00:00:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.472+0000 7fe69979c740 1 Processor -- start 2024-09-12T00:00:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69979c740 1 -- start start 2024-09-12T00:00:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69979c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed3058a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69979c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30595140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69979c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed30597a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69979c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ed304f02e0 con 0x55ed3058adc0 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69979c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ed30497ce0 con 0x55ed30595680 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69979c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ed304ec2a0 con 0x55ed3058a4a0 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe695960640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed3058a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69515f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30595140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe695960640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed3058a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:50122/0 (socket says 172.21.15.60:50122) 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe695960640 1 -- 172.21.15.60:0/4194302309 learned_addr learned my addr 172.21.15.60:0/4194302309 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69495e640 1 --2- 172.21.15.60:0/4194302309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed30597a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69495e640 1 -- 172.21.15.60:0/4194302309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 msgr2=0x55ed3058a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69495e640 1 --2- 172.21.15.60:0/4194302309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed3058a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69495e640 1 -- 172.21.15.60:0/4194302309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 msgr2=0x55ed30595140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69495e640 1 --2- 172.21.15.60:0/4194302309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30595140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe69495e640 1 -- 172.21.15.60:0/4194302309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed3047c440 con 0x55ed30595680 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.473+0000 7fe6867fc640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe67c0a2cf0 0x7fe67c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.474+0000 7fe695960640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe67c0a2cf0 0x7fe67c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.474+0000 7fe6867fc640 1 -- 172.21.15.60:0/2573074559 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe68c0cec70 con 0x7fe690101df0 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.474+0000 7fe69495e640 1 --2- 172.21.15.60:0/4194302309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed30597a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe68000bb40 tx=0x7fe6800103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c4ce67e885adce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.474+0000 7fe67b7fe640 1 -- 172.21.15.60:0/4194302309 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680004030 con 0x55ed30595680 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.474+0000 7fe67b7fe640 1 -- 172.21.15.60:0/4194302309 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6800041d0 con 0x55ed30595680 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.474+0000 7fe67b7fe640 1 -- 172.21.15.60:0/4194302309 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6800116a0 con 0x55ed30595680 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 -- 172.21.15.60:0/4194302309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 msgr2=0x55ed30597a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 --2- 172.21.15.60:0/4194302309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed30597a70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe68000bb40 tx=0x7fe6800103d0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe695960640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe67c0a2cf0 0x7fe67c0a51b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe688005f60 tx=0x7fe688005ef0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 -- 172.21.15.60:0/4194302309 shutdown_connections 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 --2- 172.21.15.60:0/4194302309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed30597a70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 --2- 172.21.15.60:0/4194302309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30595140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 --2- 172.21.15.60:0/4194302309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed3058a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 -- 172.21.15.60:0/4194302309 >> 172.21.15.60:0/4194302309 conn(0x55ed30586a30 msgr2=0x55ed30586e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 -- 172.21.15.60:0/4194302309 shutdown_connections 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.475+0000 7fe69979c740 1 -- 172.21.15.60:0/4194302309 wait complete. 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.476+0000 7fe69979c740 1 -- start start 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.476+0000 7fe69979c740 1 Processor -- start 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69979c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058a4a0 0x55ed30594f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69979c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058adc0 0x55ed305921d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69979c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed30595680 0x55ed30592710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69979c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ed30598250 con 0x55ed30595680 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69979c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ed304ab050 con 0x55ed3058a4a0 2024-09-12T00:00:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69979c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ed305983d0 con 0x55ed3058adc0 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69979c740 10 client.0 _ll_register_callbacks cb 0x55ed304eb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69495e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058adc0 0x55ed305921d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69495e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058adc0 0x55ed305921d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:50138/0 (socket says 172.21.15.60:50138) 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69495e640 1 -- 172.21.15.60:0/1139184748 learned_addr learned my addr 172.21.15.60:0/1139184748 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe695960640 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed30595680 0x55ed30592710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69515f640 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058a4a0 0x55ed30594f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69495e640 1 -- 172.21.15.60:0/1139184748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058a4a0 msgr2=0x55ed30594f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69495e640 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058a4a0 0x55ed30594f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69495e640 1 -- 172.21.15.60:0/1139184748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed30595680 msgr2=0x55ed30592710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69495e640 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed30595680 0x55ed30592710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.477+0000 7fe69495e640 1 -- 172.21.15.60:0/1139184748 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed302613c0 con 0x55ed3058adc0 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69495e640 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058adc0 0x55ed305921d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe680005f80 tx=0x7fe680010ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88be3c425fd5ca88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe678ff9640 1 -- 172.21.15.60:0/1139184748 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680005250 con 0x55ed3058adc0 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 1 -- 172.21.15.60:0/1139184748 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6800041d0 con 0x55ed3058adc0 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe678ff9640 1 -- 172.21.15.60:0/1139184748 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe6800053f0 con 0x55ed3058adc0 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe678ff9640 1 -- 172.21.15.60:0/1139184748 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe6800055f0 con 0x55ed3058adc0 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 10 client.25285 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 1 -- 172.21.15.60:0/1139184748 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed305a3bd0 con 0x55ed3058adc0 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe678ff9640 1 -- 172.21.15.60:0/1139184748 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6800041d0 con 0x55ed3058adc0 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe678ff9640 1 -- 172.21.15.60:0/1139184748 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe680004b30 con 0x55ed3058adc0 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 10 client.25285 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 10 client.25285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 20 client.25285 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed305a4f80 0x55ed305a7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 4 client.25285 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.478+0000 7fe69979c740 1 -- 172.21.15.60:0/1139184748 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed304fd850 con 0x55ed305a4f80 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.479+0000 7fe69515f640 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed305a4f80 0x55ed305a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.479+0000 7fe69515f640 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed305a4f80 0x55ed305a7370 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dde169527c21c8a server_cookie=5fc2ef0ceeae2995 in_seq=0 out_seq=0 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.479+0000 7fe678ff9640 10 client.25285 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe678ff9640 1 -- 172.21.15.60:0/1139184748 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed304fd850 con 0x55ed305a4f80 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe678ff9640 10 client.25285 handle_command_reply: tid=0 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 client.25285 shutdown 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 -- 172.21.15.60:0/1139184748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058adc0 msgr2=0x55ed305921d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058adc0 0x55ed305921d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe680005f80 tx=0x7fe680010ef0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 -- 172.21.15.60:0/1139184748 shutdown_connections 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed305a4f80 0x55ed305a7370 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed30595680 0x55ed30592710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058adc0 0x55ed305921d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe678ff9640 0 client.25285 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:54.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 --2- 172.21.15.60:0/1139184748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058a4a0 0x55ed30594f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 -- 172.21.15.60:0/1139184748 >> 172.21.15.60:0/1139184748 conn(0x55ed30586a30 msgr2=0x55ed3058c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:54.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 -- 172.21.15.60:0/1139184748 shutdown_connections 2024-09-12T00:00:54.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 1 -- 172.21.15.60:0/1139184748 wait complete. 2024-09-12T00:00:54.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.481+0000 7fe69979c740 20 client.25285 trim_cache size 0 max 16384 2024-09-12T00:00:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-12T00:00:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-12T00:00:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-12T00:00:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-12T00:00:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-12T00:00:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-12T00:00:54.501 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-12T00:00:54.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69979c740 1 Processor -- start 2024-09-12T00:00:54.502 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-12T00:00:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69979c740 1 -- start start 2024-09-12T00:00:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69979c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058a4a0 0x55ed305a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69979c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058adc0 0x55ed305ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69979c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed30595680 0x55ed305acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69979c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400e650 con 0x55ed3058a4a0 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69979c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe674010190 con 0x55ed3058adc0 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69979c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400ed20 con 0x55ed30595680 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69515f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058a4a0 0x55ed305a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69515f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058a4a0 0x55ed305a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37468/0 (socket says 172.21.15.60:37468) 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69515f640 1 -- 172.21.15.60:0/88040592 learned_addr learned my addr 172.21.15.60:0/88040592 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69495e640 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058adc0 0x55ed305ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe695960640 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed30595680 0x55ed305acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69495e640 1 -- 172.21.15.60:0/88040592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed30595680 msgr2=0x55ed305acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69495e640 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed30595680 0x55ed305acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69495e640 1 -- 172.21.15.60:0/88040592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058a4a0 msgr2=0x55ed305a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:54.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69495e640 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058a4a0 0x55ed305a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69495e640 1 -- 172.21.15.60:0/88040592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed30586860 con 0x55ed3058adc0 2024-09-12T00:00:54.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.499+0000 7fe69515f640 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058a4a0 0x55ed305a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:54.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.500+0000 7fe69495e640 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058adc0 0x55ed305ac9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe680030520 tx=0x7fe68000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4387a281ed5e89cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:54.505 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.500+0000 7fe67affd640 1 -- 172.21.15.60:0/88040592 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680035070 con 0x55ed3058adc0 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.500+0000 7fe67affd640 1 -- 172.21.15.60:0/88040592 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe680030720 con 0x55ed3058adc0 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.500+0000 7fe67affd640 1 -- 172.21.15.60:0/88040592 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68001f070 con 0x55ed3058adc0 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.500+0000 7fe69979c740 1 -- 172.21.15.60:0/88040592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058adc0 msgr2=0x55ed305ac9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.500+0000 7fe69979c740 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058adc0 0x55ed305ac9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe680030520 tx=0x7fe68000b390 comp rx=0 tx=0).stop 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 -- 172.21.15.60:0/88040592 shutdown_connections 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed30595680 0x55ed305acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed3058adc0 0x55ed305ac9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 --2- 172.21.15.60:0/88040592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058a4a0 0x55ed305a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 -- 172.21.15.60:0/88040592 >> 172.21.15.60:0/88040592 conn(0x55ed30586a30 msgr2=0x55ed30590aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:54.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 -- 172.21.15.60:0/88040592 shutdown_connections 2024-09-12T00:00:54.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 -- 172.21.15.60:0/88040592 wait complete. 2024-09-12T00:00:54.507 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 -- start start 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.501+0000 7fe69979c740 1 Processor -- start 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69979c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed30599a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69979c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30599f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69979c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed3060e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69979c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400fac0 con 0x55ed3058adc0 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69979c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400f3f0 con 0x55ed30595680 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69979c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe67400c630 con 0x55ed3058a4a0 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69979c740 10 client.0 _ll_register_callbacks cb 0x7fe68c0d2690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69515f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed30599a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69495e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30599f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69515f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed30599a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:50148/0 (socket says 172.21.15.60:50148) 2024-09-12T00:00:54.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69515f640 1 -- 172.21.15.60:0/2279623206 learned_addr learned my addr 172.21.15.60:0/2279623206 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:54.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe695960640 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed3060e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.509 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-12T00:00:54.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69495e640 1 -- 172.21.15.60:0/2279623206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 msgr2=0x55ed30599a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:54.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69495e640 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed30599a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69495e640 1 -- 172.21.15.60:0/2279623206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 msgr2=0x55ed3060e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:54.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69495e640 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed3060e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69495e640 1 -- 172.21.15.60:0/2279623206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed3060eeb0 con 0x55ed3058adc0 2024-09-12T00:00:54.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69515f640 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed30599a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe695960640 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed3060e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe69495e640 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30599f80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55ed30590900 tx=0x7fe6800059b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2393b0aedc4c83f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.502+0000 7fe678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe678ff9640 1 -- 172.21.15.60:0/2279623206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680035030 con 0x55ed3058adc0 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe678ff9640 1 -- 172.21.15.60:0/2279623206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe680022070 con 0x55ed3058adc0 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 1 -- 172.21.15.60:0/2279623206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe680030720 con 0x55ed3058adc0 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe678ff9640 1 -- 172.21.15.60:0/2279623206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe68003e020 con 0x55ed3058adc0 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 10 client.15762 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:54.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 1 -- 172.21.15.60:0/2279623206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed306100d0 con 0x55ed3058adc0 2024-09-12T00:00:54.511 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-12T00:00:54.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe678ff9640 1 -- 172.21.15.60:0/2279623206 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe680030720 con 0x55ed3058adc0 2024-09-12T00:00:54.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe678ff9640 1 -- 172.21.15.60:0/2279623206 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe680011560 con 0x55ed3058adc0 2024-09-12T00:00:54.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 10 client.15762 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:54.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:00:54.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 20 client.15762 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:54.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed305a4f80 0x55ed30612730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:54.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 4 client.15762 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:00:54.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.503+0000 7fe69979c740 1 -- 172.21.15.60:0/2279623206 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ed304f7d60 con 0x55ed305a4f80 2024-09-12T00:00:54.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.504+0000 7fe69515f640 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed305a4f80 0x55ed30612730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:54.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.504+0000 7fe69515f640 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed305a4f80 0x55ed30612730 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f1dd54ba2c6a213 server_cookie=b0ef54ff9db01309 in_seq=0 out_seq=0 2024-09-12T00:00:54.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.504+0000 7fe678ff9640 10 client.15762 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:54.513 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-12T00:00:54.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe678ff9640 1 -- 172.21.15.60:0/2279623206 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ed304f7d60 con 0x55ed305a4f80 2024-09-12T00:00:54.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe678ff9640 10 client.15762 handle_command_reply: tid=0 2024-09-12T00:00:54.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 client.15762 shutdown 2024-09-12T00:00:54.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 -- 172.21.15.60:0/2279623206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 msgr2=0x55ed30599f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30599f80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55ed30590900 tx=0x7fe6800059b0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 -- 172.21.15.60:0/2279623206 shutdown_connections 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55ed305a4f80 0x55ed30612730 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ed30595680 0x55ed3060e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed3058adc0 0x55ed30599f80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe678ff9640 0 client.15762 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 --2- 172.21.15.60:0/2279623206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed3058a4a0 0x55ed30599a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.506+0000 7fe69979c740 1 -- 172.21.15.60:0/2279623206 >> 172.21.15.60:0/2279623206 conn(0x55ed30586a30 msgr2=0x55ed30593a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe69979c740 1 -- 172.21.15.60:0/2279623206 shutdown_connections 2024-09-12T00:00:54.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe69979c740 1 -- 172.21.15.60:0/2279623206 wait complete. 2024-09-12T00:00:54.516 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-12T00:00:54.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe69979c740 20 client.15762 trim_cache size 0 max 16384 2024-09-12T00:00:54.516 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:00:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:00:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:00:54.517 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:00:54.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 -- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe67c0a2cf0 msgr2=0x7fe67c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe67c0a2cf0 0x7fe67c0a51b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe688005f60 tx=0x7fe688005ef0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 -- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690101df0 msgr2=0x7fe6901984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690101df0 0x7fe6901984e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00d950 tx=0x7fe68c00de10 comp rx=0 tx=0).stop 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 -- 172.21.15.60:0/2573074559 shutdown_connections 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe67c0a2cf0 0x7fe67c0a51b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe690106f20 0x7fe69019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6901027a0 0x7fe690198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.507+0000 7fe6973c3640 1 --2- 172.21.15.60:0/2573074559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe690101df0 0x7fe6901984e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.508+0000 7fe6973c3640 1 -- 172.21.15.60:0/2573074559 >> 172.21.15.60:0/2573074559 conn(0x7fe6900fd8f0 msgr2=0x7fe6900fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.508+0000 7fe6973c3640 1 -- 172.21.15.60:0/2573074559 shutdown_connections 2024-09-12T00:00:54.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:54.508+0000 7fe6973c3640 1 -- 172.21.15.60:0/2573074559 wait complete. 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-12T00:00:54.520 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-12T00:00:54.521 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-12T00:00:54.521 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-12T00:00:54.521 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-12T00:00:54.521 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-12T00:00:54.521 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-12T00:00:54.521 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-12T00:00:54.522 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-12T00:00:54.523 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-12T00:00:54.524 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-12T00:00:54.525 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-12T00:00:54.526 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-12T00:00:54.527 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-12T00:00:54.528 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-12T00:00:54.529 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-12T00:00:54.530 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-12T00:00:54.531 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-12T00:00:54.532 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-12T00:00:54.533 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-12T00:00:54.534 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-12T00:00:54.535 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-12T00:00:54.536 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-12T00:00:54.537 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-12T00:00:54.538 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-12T00:00:54.539 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-12T00:00:54.540 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-12T00:00:54.541 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-12T00:00:54.542 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-12T00:00:54.544 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-12T00:00:54.545 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-12T00:00:54.546 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-12T00:00:54.547 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-12T00:00:54.548 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-12T00:00:54.550 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-12T00:00:54.551 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-12T00:00:54.552 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-12T00:00:54.553 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-12T00:00:54.554 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-12T00:00:54.556 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-12T00:00:54.557 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-12T00:00:54.558 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-12T00:00:54.560 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-12T00:00:54.561 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-12T00:00:54.562 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/ 2024-09-12T00:00:54.563 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-12T00:00:54.564 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-12T00:00:54.566 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-12T00:00:54.567 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-12T00:00:54.568 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-12T00:00:54.569 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-12T00:00:54.570 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-12T00:00:54.572 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-12T00:00:54.573 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-12T00:00:54.574 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-12T00:00:54.575 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-12T00:00:54.577 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-12T00:00:54.578 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-12T00:00:54.579 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-12T00:00:54.581 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/ 2024-09-12T00:00:54.582 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-12T00:00:54.583 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-12T00:00:54.585 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-12T00:00:54.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-12T00:00:54.586 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-12T00:00:54.587 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-12T00:00:54.589 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-12T00:00:54.589 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-12T00:00:54.590 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-12T00:00:54.591 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sh/ 2024-09-12T00:00:54.592 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-12T00:00:54.593 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-12T00:00:54.594 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-12T00:00:54.595 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/ 2024-09-12T00:00:54.597 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-12T00:00:54.597 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-12T00:00:54.599 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-12T00:00:54.599 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-12T00:00:54.601 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-12T00:00:54.601 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-12T00:00:54.602 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-12T00:00:54.603 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-12T00:00:54.604 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-12T00:00:54.606 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-12T00:00:54.607 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-12T00:00:54.608 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-12T00:00:54.609 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-12T00:00:54.610 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-12T00:00:54.611 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-12T00:00:54.612 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-12T00:00:54.613 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-12T00:00:54.614 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-12T00:00:54.615 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-12T00:00:54.616 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-12T00:00:54.617 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-12T00:00:54.618 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-12T00:00:54.619 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-12T00:00:54.620 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-12T00:00:54.621 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-12T00:00:54.622 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-12T00:00:54.623 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-12T00:00:54.624 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-12T00:00:54.625 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-12T00:00:54.626 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-12T00:00:54.627 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-12T00:00:54.627 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-12T00:00:54.628 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-12T00:00:54.629 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-12T00:00:54.630 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-12T00:00:54.631 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-12T00:00:54.632 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-12T00:00:54.633 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-12T00:00:54.633 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-12T00:00:54.634 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-12T00:00:54.635 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-12T00:00:54.636 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-12T00:00:54.637 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-12T00:00:54.637 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-12T00:00:54.638 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-12T00:00:54.639 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-12T00:00:54.640 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-12T00:00:54.640 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-12T00:00:54.641 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-12T00:00:54.642 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-12T00:00:54.643 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-12T00:00:54.645 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-12T00:00:54.645 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-12T00:00:54.646 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-12T00:00:54.647 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-12T00:00:54.648 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-12T00:00:54.649 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-12T00:00:54.650 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-12T00:00:54.651 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-12T00:00:54.652 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-12T00:00:54.653 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-12T00:00:54.653 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-12T00:00:54.654 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-12T00:00:54.655 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/ 2024-09-12T00:00:54.657 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-12T00:00:54.657 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-12T00:00:54.658 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-12T00:00:54.659 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-12T00:00:54.660 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-12T00:00:54.660 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-12T00:00:54.661 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-12T00:00:54.662 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-12T00:00:54.663 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-12T00:00:54.664 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-12T00:00:54.665 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-12T00:00:54.670 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-12T00:00:54.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-12T00:00:54.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-12T00:00:54.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-12T00:00:54.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-12T00:00:54.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-12T00:00:54.671 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-12T00:00:54.672 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-12T00:00:54.672 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-12T00:00:54.673 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-12T00:00:54.674 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-12T00:00:54.675 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-12T00:00:54.676 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-12T00:00:54.677 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-12T00:00:54.678 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-12T00:00:54.678 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-12T00:00:54.679 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/target/ 2024-09-12T00:00:54.680 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-12T00:00:54.681 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-12T00:00:54.682 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-12T00:00:54.683 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-12T00:00:54.684 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-12T00:00:54.684 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-12T00:00:54.685 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-12T00:00:54.686 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-12T00:00:54.687 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-12T00:00:54.688 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-12T00:00:54.688 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-12T00:00:54.689 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-12T00:00:54.690 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/ 2024-09-12T00:00:54.691 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-12T00:00:54.692 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-12T00:00:54.693 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-12T00:00:54.694 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-12T00:00:54.695 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-12T00:00:54.696 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-12T00:00:54.697 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-12T00:00:54.697 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-12T00:00:54.698 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-12T00:00:54.699 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-12T00:00:54.700 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-12T00:00:54.701 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-12T00:00:54.701 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-12T00:00:54.702 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/ 2024-09-12T00:00:54.703 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-12T00:00:54.704 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-12T00:00:54.705 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-12T00:00:54.706 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-12T00:00:54.707 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-12T00:00:54.708 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-12T00:00:54.709 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-12T00:00:54.711 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-12T00:00:54.712 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-12T00:00:54.712 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-12T00:00:54.713 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-12T00:00:54.714 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-12T00:00:54.715 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-12T00:00:54.716 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-12T00:00:54.717 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-12T00:00:54.718 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-12T00:00:54.719 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-12T00:00:54.720 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-12T00:00:54.721 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-12T00:00:54.722 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-12T00:00:54.722 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/ 2024-09-12T00:00:54.723 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-12T00:00:54.724 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-12T00:00:54.725 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-12T00:00:54.725 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-12T00:00:54.726 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-12T00:00:54.727 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-12T00:00:54.728 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-12T00:00:54.728 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-12T00:00:54.729 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-12T00:00:54.730 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-12T00:00:54.731 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-12T00:00:54.732 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-12T00:00:54.733 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-12T00:00:54.733 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-12T00:00:54.734 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-12T00:00:54.735 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-12T00:00:54.737 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-12T00:00:54.737 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-12T00:00:54.738 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-12T00:00:54.739 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-12T00:00:54.739 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-12T00:00:54.740 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-12T00:00:54.741 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-12T00:00:54.742 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-12T00:00:54.743 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-12T00:00:54.743 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-12T00:00:54.744 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-12T00:00:54.745 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-12T00:00:54.746 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-12T00:00:54.746 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-12T00:00:54.747 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-12T00:00:54.748 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-12T00:00:54.749 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-12T00:00:54.750 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-12T00:00:54.751 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-12T00:00:54.751 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-12T00:00:54.753 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-12T00:00:54.753 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-12T00:00:54.754 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-12T00:00:54.755 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-12T00:00:54.756 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-12T00:00:54.757 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-12T00:00:54.758 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-12T00:00:54.758 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-12T00:00:54.760 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-12T00:00:54.761 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-12T00:00:54.761 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-12T00:00:54.762 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-12T00:00:54.763 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-12T00:00:54.764 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-12T00:00:54.765 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-12T00:00:54.765 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-12T00:00:54.766 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-12T00:00:54.767 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-12T00:00:54.768 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-12T00:00:54.769 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-12T00:00:54.769 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-12T00:00:54.770 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-12T00:00:54.771 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-12T00:00:54.772 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-12T00:00:54.772 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-12T00:00:54.773 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-12T00:00:54.774 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-12T00:00:54.775 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-12T00:00:54.775 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-12T00:00:54.776 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-12T00:00:54.777 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-12T00:00:54.778 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-12T00:00:54.779 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-12T00:00:54.780 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-12T00:00:54.781 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-12T00:00:54.781 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-12T00:00:54.782 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-12T00:00:54.783 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-12T00:00:54.784 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-12T00:00:54.785 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-12T00:00:54.786 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-12T00:00:54.787 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-12T00:00:54.788 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-12T00:00:54.789 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-12T00:00:54.790 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-12T00:00:54.791 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-12T00:00:54.791 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-12T00:00:54.792 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-12T00:00:54.793 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-12T00:00:54.794 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-12T00:00:54.795 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-12T00:00:54.796 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-12T00:00:54.797 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-12T00:00:54.798 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-12T00:00:54.799 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-12T00:00:54.800 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-12T00:00:54.801 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-12T00:00:54.801 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-12T00:00:54.802 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-12T00:00:54.803 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-12T00:00:54.805 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-12T00:00:54.805 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-12T00:00:54.806 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-12T00:00:54.807 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-12T00:00:54.808 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-12T00:00:54.808 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-12T00:00:54.810 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-12T00:00:54.810 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-12T00:00:54.811 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-12T00:00:54.812 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-12T00:00:54.813 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-12T00:00:54.814 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-12T00:00:54.815 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-12T00:00:54.816 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-12T00:00:54.817 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-12T00:00:54.818 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-12T00:00:54.819 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-12T00:00:54.820 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-12T00:00:54.821 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-12T00:00:54.822 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-12T00:00:54.823 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-12T00:00:54.824 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-12T00:00:54.825 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-12T00:00:54.826 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-12T00:00:54.827 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-12T00:00:54.828 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-12T00:00:54.829 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-12T00:00:54.829 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-12T00:00:54.830 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-12T00:00:54.831 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-12T00:00:54.832 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-12T00:00:54.833 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-12T00:00:54.833 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-12T00:00:54.835 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-12T00:00:54.835 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-12T00:00:54.836 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-12T00:00:54.837 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-12T00:00:54.838 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-12T00:00:54.839 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-12T00:00:54.839 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-12T00:00:54.840 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-12T00:00:54.841 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-12T00:00:54.842 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-12T00:00:54.843 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-12T00:00:54.844 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-12T00:00:54.845 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-12T00:00:54.846 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-12T00:00:54.846 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-12T00:00:54.847 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-12T00:00:54.848 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-12T00:00:54.849 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-12T00:00:54.850 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-12T00:00:54.851 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-12T00:00:54.852 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-12T00:00:54.853 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/ 2024-09-12T00:00:54.854 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-12T00:00:54.855 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-12T00:00:54.856 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-12T00:00:54.857 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-12T00:00:54.857 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-12T00:00:54.858 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-12T00:00:54.859 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-12T00:00:54.860 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-12T00:00:54.861 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-12T00:00:54.862 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-12T00:00:54.862 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-12T00:00:54.863 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-12T00:00:54.864 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-12T00:00:54.865 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-12T00:00:54.866 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-12T00:00:54.867 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-12T00:00:54.868 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-12T00:00:54.869 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-12T00:00:54.869 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-12T00:00:54.870 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-12T00:00:54.871 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-12T00:00:54.872 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-12T00:00:54.877 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-12T00:00:54.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-12T00:00:54.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-12T00:00:54.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/ 2024-09-12T00:00:54.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-12T00:00:54.878 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-12T00:00:54.879 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-12T00:00:54.880 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-12T00:00:54.881 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-12T00:00:54.881 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-12T00:00:54.882 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-12T00:00:54.883 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-12T00:00:54.884 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-12T00:00:54.885 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-12T00:00:54.886 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-12T00:00:54.886 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-12T00:00:54.887 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-12T00:00:54.888 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-12T00:00:54.889 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-12T00:00:54.890 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-12T00:00:54.891 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-12T00:00:54.892 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-12T00:00:54.893 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-12T00:00:54.894 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-12T00:00:54.894 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-12T00:00:54.895 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-12T00:00:54.896 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-12T00:00:54.897 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-12T00:00:54.898 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-12T00:00:54.899 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-12T00:00:54.900 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-12T00:00:54.901 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-12T00:00:54.901 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-12T00:00:54.902 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-12T00:00:54.903 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-12T00:00:54.904 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-12T00:00:54.905 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-12T00:00:54.905 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-12T00:00:54.906 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/ 2024-09-12T00:00:54.908 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-12T00:00:54.908 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-12T00:00:54.909 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-12T00:00:54.910 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-12T00:00:54.910 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-12T00:00:54.911 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-12T00:00:54.912 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-12T00:00:54.913 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-12T00:00:54.914 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-12T00:00:54.915 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-12T00:00:54.916 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-12T00:00:54.917 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-12T00:00:54.918 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-12T00:00:54.918 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-12T00:00:54.919 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-12T00:00:54.920 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-12T00:00:54.921 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-12T00:00:54.922 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-12T00:00:54.922 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-12T00:00:54.923 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-12T00:00:54.924 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-12T00:00:54.925 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-12T00:00:54.926 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-12T00:00:54.927 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-12T00:00:54.928 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-12T00:00:54.929 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-12T00:00:54.929 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-12T00:00:54.930 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-12T00:00:54.932 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-12T00:00:54.932 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-12T00:00:54.933 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-12T00:00:54.934 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-12T00:00:54.935 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-12T00:00:54.936 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-12T00:00:54.937 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-12T00:00:54.938 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-12T00:00:54.938 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-12T00:00:54.939 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-12T00:00:54.940 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-12T00:00:54.941 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-12T00:00:54.942 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-12T00:00:54.942 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-12T00:00:54.943 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-12T00:00:54.944 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-12T00:00:54.945 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-12T00:00:54.946 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-12T00:00:54.947 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-12T00:00:54.948 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-12T00:00:55.153 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-12T00:00:55.154 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-12T00:00:55.155 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-12T00:00:55.156 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-12T00:00:55.157 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-12T00:00:55.158 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-12T00:00:55.159 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-12T00:00:55.160 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-12T00:00:55.161 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-12T00:00:55.162 INFO:tasks.workunit.client.0.smithi060.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-12T00:00:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:54 smithi105 ceph-mon[34805]: pgmap v49: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 7.3 MiB/s wr, 58 op/s 2024-09-12T00:00:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:54 smithi105 ceph-mon[34805]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T00:00:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:54 smithi192 ceph-mon[35487]: pgmap v49: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 7.3 MiB/s wr, 58 op/s 2024-09-12T00:00:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:54 smithi192 ceph-mon[35487]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T00:00:55.330 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:54 smithi060 ceph-mon[30953]: pgmap v49: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 7.3 MiB/s wr, 58 op/s 2024-09-12T00:00:55.330 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:54 smithi060 ceph-mon[30953]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T00:00:55.359 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:00:55.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:00:55.665 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 -- 172.21.15.60:0/1666099582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec102790 msgr2=0x7feaec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 --2- 172.21.15.60:0/1666099582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec102790 0x7feaec1067e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7feae0009900 tx=0x7feae002a3f0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 -- 172.21.15.60:0/1666099582 shutdown_connections 2024-09-12T00:00:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 --2- 172.21.15.60:0/1666099582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaec106f10 0x7feaec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 --2- 172.21.15.60:0/1666099582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec102790 0x7feaec1067e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 --2- 172.21.15.60:0/1666099582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaec101de0 0x7feaec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 -- 172.21.15.60:0/1666099582 >> 172.21.15.60:0/1666099582 conn(0x7feaec0fd880 msgr2=0x7feaec0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:56.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 -- 172.21.15.60:0/1666099582 shutdown_connections 2024-09-12T00:00:56.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.161+0000 7feaf205d640 1 -- 172.21.15.60:0/1666099582 wait complete. 2024-09-12T00:00:56.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.162+0000 7feaf205d640 1 Processor -- start 2024-09-12T00:00:56.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.162+0000 7feaf205d640 1 -- start start 2024-09-12T00:00:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.162+0000 7feaf205d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaec101de0 0x7feaec19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:56.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.162+0000 7feaf205d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaec102790 0x7feaec19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.162+0000 7feaf205d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec106f10 0x7feaec19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.162+0000 7feaf205d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feaec1120e0 con 0x7feaec106f10 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.162+0000 7feaf205d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feaec111f60 con 0x7feaec101de0 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.162+0000 7feaf205d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feaec112260 con 0x7feaec102790 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec106f10 0x7feaec19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec106f10 0x7feaec19efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37496/0 (socket says 172.21.15.60:37496) 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 -- 172.21.15.60:0/2002503273 learned_addr learned my addr 172.21.15.60:0/2002503273 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaeaffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaec102790 0x7feaec19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaeb7fe640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaec101de0 0x7feaec19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 -- 172.21.15.60:0/2002503273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaec102790 msgr2=0x7feaec19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:56.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaec102790 0x7feaec19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 -- 172.21.15.60:0/2002503273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaec101de0 msgr2=0x7feaec19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaec101de0 0x7feaec19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 -- 172.21.15.60:0/2002503273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec19f6c0 con 0x7feaec106f10 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feaebfff640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec106f10 0x7feaec19efe0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feae400cce0 tx=0x7feae400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.163+0000 7feae8ff9640 1 -- 172.21.15.60:0/2002503273 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae400f450 con 0x7feaec106f10 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.164+0000 7feae8ff9640 1 -- 172.21.15.60:0/2002503273 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feae400faf0 con 0x7feaec106f10 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.164+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaec19f9b0 con 0x7feaec106f10 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.164+0000 7feae8ff9640 1 -- 172.21.15.60:0/2002503273 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4018cc0 con 0x7feaec106f10 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.164+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaec1a7290 con 0x7feaec106f10 2024-09-12T00:00:56.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.165+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaec1021c0 con 0x7feaec106f10 2024-09-12T00:00:56.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.166+0000 7feae8ff9640 1 -- 172.21.15.60:0/2002503273 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7feae400f5f0 con 0x7feaec106f10 2024-09-12T00:00:56.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.166+0000 7feae8ff9640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fead40a2cf0 0x7fead40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:56.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.167+0000 7feaeb7fe640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fead40a2cf0 0x7fead40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:56.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.167+0000 7feae8ff9640 1 -- 172.21.15.60:0/2002503273 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7feae40cf7e0 con 0x7feaec106f10 2024-09-12T00:00:56.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.167+0000 7feaeb7fe640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fead40a2cf0 0x7fead40a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feadc00bbe0 tx=0x7feadc00b390 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:56.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.171+0000 7feae8ff9640 1 -- 172.21.15.60:0/2002503273 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feae4014030 con 0x7feaec106f10 2024-09-12T00:00:56.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.388+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feaec1a74f0 con 0x7feaec106f10 2024-09-12T00:00:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.389+0000 7feae8ff9640 1 -- 172.21.15.60:0/2002503273 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11974 (secure 0 0 0) 0x7feae409c450 con 0x7feaec106f10 2024-09-12T00:00:56.388 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:00:56.389 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"btime":"2024-09-11T23:59:20:387795+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-11T23:59:20.337602+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:00:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.391+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fead40a2cf0 msgr2=0x7fead40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.391+0000 7feaf205d640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fead40a2cf0 0x7fead40a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feadc00bbe0 tx=0x7feadc00b390 comp rx=0 tx=0).stop 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec106f10 msgr2=0x7feaec19efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec106f10 0x7feaec19efe0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feae400cce0 tx=0x7feae400a620 comp rx=0 tx=0).stop 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 shutdown_connections 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fead40a2cf0 0x7fead40a51b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feaec106f10 0x7feaec19efe0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaec102790 0x7feaec19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 --2- 172.21.15.60:0/2002503273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaec101de0 0x7feaec19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 >> 172.21.15.60:0/2002503273 conn(0x7feaec0fd880 msgr2=0x7feaec0fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 shutdown_connections 2024-09-12T00:00:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:56.392+0000 7feaf205d640 1 -- 172.21.15.60:0/2002503273 wait complete. 2024-09-12T00:00:57.111 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:00:57.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:56 smithi192 ceph-mon[35487]: pgmap v50: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.3 MiB/s wr, 54 op/s 2024-09-12T00:00:57.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:56 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2002503273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:57.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:56 smithi060 ceph-mon[30953]: pgmap v50: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.3 MiB/s wr, 54 op/s 2024-09-12T00:00:57.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:56 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2002503273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:57.375 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:56 smithi105 ceph-mon[34805]: pgmap v50: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.3 MiB/s wr, 54 op/s 2024-09-12T00:00:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:56 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2002503273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:00:57.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 -- 172.21.15.60:0/3748996089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414101410 msgr2=0x7fb41410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 --2- 172.21.15.60:0/3748996089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414101410 0x7fb41410d940 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009cd0 tx=0x7fb40c02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 -- 172.21.15.60:0/3748996089 shutdown_connections 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 --2- 172.21.15.60:0/3748996089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414101410 0x7fb41410d940 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 --2- 172.21.15.60:0/3748996089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb414100a70 0x7fb414100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 --2- 172.21.15.60:0/3748996089 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb414106a70 0x7fb414106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 -- 172.21.15.60:0/3748996089 >> 172.21.15.60:0/3748996089 conn(0x7fb4140fc7d0 msgr2=0x7fb4140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 -- 172.21.15.60:0/3748996089 shutdown_connections 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.834+0000 7fb41886f640 1 -- 172.21.15.60:0/3748996089 wait complete. 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41886f640 1 Processor -- start 2024-09-12T00:00:57.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41886f640 1 -- start start 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41886f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414100a70 0x7fb4140fcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41886f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb414101410 0x7fb4140fd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41886f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb414106a70 0x7fb4140fd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41886f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb414111050 con 0x7fb414100a70 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41886f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb414110ed0 con 0x7fb414101410 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41886f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141111d0 con 0x7fb414106a70 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414100a70 0x7fb4140fcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414100a70 0x7fb4140fcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37520/0 (socket says 172.21.15.60:37520) 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41259c640 1 -- 172.21.15.60:0/864758667 learned_addr learned my addr 172.21.15.60:0/864758667 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb411d9b640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb414101410 0x7fb4140fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb412d9d640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb414106a70 0x7fb4140fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41259c640 1 -- 172.21.15.60:0/864758667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb414106a70 msgr2=0x7fb4140fd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41259c640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb414106a70 0x7fb4140fd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41259c640 1 -- 172.21.15.60:0/864758667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb414101410 msgr2=0x7fb4140fd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41259c640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb414101410 0x7fb4140fd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb41259c640 1 -- 172.21.15.60:0/864758667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4141a6ae0 con 0x7fb414100a70 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.835+0000 7fb412d9d640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb414106a70 0x7fb4140fd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.836+0000 7fb41259c640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414100a70 0x7fb4140fcdf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb40400b4a0 tx=0x7fb40400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.836+0000 7fb40b7fe640 1 -- 172.21.15.60:0/864758667 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404015020 con 0x7fb414100a70 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.836+0000 7fb40b7fe640 1 -- 172.21.15.60:0/864758667 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb404011d30 con 0x7fb414100a70 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.836+0000 7fb41886f640 1 -- 172.21.15.60:0/864758667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4141a6dd0 con 0x7fb414100a70 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.836+0000 7fb40b7fe640 1 -- 172.21.15.60:0/864758667 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40400f2e0 con 0x7fb414100a70 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.836+0000 7fb41886f640 1 -- 172.21.15.60:0/864758667 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4141a72d0 con 0x7fb414100a70 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.838+0000 7fb40b7fe640 1 -- 172.21.15.60:0/864758667 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb404018020 con 0x7fb414100a70 2024-09-12T00:00:57.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb41ac48740 1 Processor -- start 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb41ac48740 1 -- start start 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732c9b40 0x55f1732c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c85d0 0x55f1732c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732d3370 0x55f1732d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb41ac48740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f17322e2f0 con 0x55f1732c9b40 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb41ac48740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f1731d5cf0 con 0x55f1732d3370 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb41ac48740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f17322a2b0 con 0x55f1732c85d0 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb40b7fe640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4000a2d70 0x7fb4000a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732c9b40 0x55f1732c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb411d9b640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4000a2d70 0x7fb4000a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732c9b40 0x55f1732c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37522/0 (socket says 172.21.15.60:37522) 2024-09-12T00:00:57.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.839+0000 7fb412d9d640 1 -- 172.21.15.60:0/2714537800 learned_addr learned my addr 172.21.15.60:0/2714537800 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb41259c640 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c85d0 0x55f1732c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb40b7fe640 1 -- 172.21.15.60:0/864758667 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb4040ceb60 con 0x7fb414100a70 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732d3370 0x55f1732d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb412d9d640 1 -- 172.21.15.60:0/2714537800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c85d0 msgr2=0x55f1732c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c85d0 0x55f1732c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb412d9d640 1 -- 172.21.15.60:0/2714537800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732d3370 msgr2=0x55f1732d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732d3370 0x55f1732d5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb412d9d640 1 -- 172.21.15.60:0/2714537800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1731ba3a0 con 0x55f1732c9b40 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb411d9b640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4000a2d70 0x7fb4000a5230 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb4140fe880 tx=0x7fb3fc009110 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732c9b40 0x55f1732c8090 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009a60 tx=0x7fb40c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be849b5aedd749eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb408ff9640 1 -- 172.21.15.60:0/2714537800 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c031ac0 con 0x55f1732c9b40 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb408ff9640 1 -- 172.21.15.60:0/2714537800 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb40c036040 con 0x55f1732c9b40 2024-09-12T00:00:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.840+0000 7fb408ff9640 1 -- 172.21.15.60:0/2714537800 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c004640 con 0x55f1732c9b40 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 -- 172.21.15.60:0/2714537800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732c9b40 msgr2=0x55f1732c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732c9b40 0x55f1732c8090 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009a60 tx=0x7fb40c009360 comp rx=0 tx=0).stop 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 -- 172.21.15.60:0/2714537800 shutdown_connections 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732d3370 0x55f1732d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c85d0 0x55f1732c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2714537800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732c9b40 0x55f1732c8090 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 -- 172.21.15.60:0/2714537800 >> 172.21.15.60:0/2714537800 conn(0x55f173291310 msgr2=0x55f1732c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 -- 172.21.15.60:0/2714537800 shutdown_connections 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.841+0000 7fb41ac48740 1 -- 172.21.15.60:0/2714537800 wait complete. 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 1 -- start start 2024-09-12T00:00:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 1 Processor -- start 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f1732d6010 con 0x55f1732d3370 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f1731e9060 con 0x55f1732c85d0 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f1732d6190 con 0x55f1732c9b40 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41ac48740 10 client.0 _ll_register_callbacks cb 0x55f172f3c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37534/0 (socket says 172.21.15.60:37534) 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb412d9d640 1 -- 172.21.15.60:0/2055518479 learned_addr learned my addr 172.21.15.60:0/2055518479 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb41259c640 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb412d9d640 1 -- 172.21.15.60:0/2055518479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 msgr2=0x55f1732cffd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732cffd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb412d9d640 1 -- 172.21.15.60:0/2055518479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 msgr2=0x55f1732d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.842+0000 7fb412d9d640 1 -- 172.21.15.60:0/2055518479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f172f9f3c0 con 0x55f1732d3370 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d0570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb40c031960 tx=0x7fb40c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d97e085c609646 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb3f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2055518479 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c004710 con 0x55f1732d3370 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2055518479 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb40c003970 con 0x55f1732d3370 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 1 -- 172.21.15.60:0/2055518479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb40c036040 con 0x55f1732d3370 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2055518479 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb40c003b70 con 0x55f1732d3370 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 10 client.15780 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 1 -- 172.21.15.60:0/2055518479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f1732e1a90 con 0x55f1732d3370 2024-09-12T00:00:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2055518479 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb40c036040 con 0x55f1732d3370 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2055518479 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb40c030070 con 0x55f1732d3370 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 10 client.15780 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 10 client.15780 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 20 client.15780 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f1732e2de0 0x55f1732e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 4 client.15780 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.843+0000 7fb41ac48740 1 -- 172.21.15.60:0/2055518479 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f17323b860 con 0x55f1732e2de0 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.844+0000 7fb41259c640 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f1732e2de0 0x55f1732e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.844+0000 7fb3f9ffb640 10 client.15780 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.844+0000 7fb41259c640 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f1732e2de0 0x55f1732e51d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dea765948561cf4d server_cookie=8829b10cb1a8ea6 in_seq=0 out_seq=0 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2055518479 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f17323b860 con 0x55f1732e2de0 2024-09-12T00:00:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb3f9ffb640 10 client.15780 handle_command_reply: tid=0 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 client.15780 shutdown 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 -- 172.21.15.60:0/2055518479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 msgr2=0x55f1732d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d0570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb40c031960 tx=0x7fb40c005c50 comp rx=0 tx=0).stop 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 -- 172.21.15.60:0/2055518479 shutdown_connections 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d0570 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f1732e2de0 0x55f1732e51d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2055518479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb3f9ffb640 0 client.15780 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 -- 172.21.15.60:0/2055518479 >> 172.21.15.60:0/2055518479 conn(0x55f173291310 msgr2=0x55f1732ca930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 -- 172.21.15.60:0/2055518479 shutdown_connections 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 1 -- 172.21.15.60:0/2055518479 wait complete. 2024-09-12T00:00:57.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.845+0000 7fb41ac48740 20 client.15780 trim_cache size 0 max 16384 2024-09-12T00:00:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41ac48740 1 Processor -- start 2024-09-12T00:00:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41ac48740 1 -- start start 2024-09-12T00:00:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41ac48740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141afb10 con 0x55f1732d3370 2024-09-12T00:00:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41ac48740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141b1650 con 0x55f1732c85d0 2024-09-12T00:00:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41ac48740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141b01e0 con 0x55f1732c9b40 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37538/0 (socket says 172.21.15.60:37538) 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb412d9d640 1 -- 172.21.15.60:0/148192925 learned_addr learned my addr 172.21.15.60:0/148192925 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb41259c640 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.859+0000 7fb411d9b640 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb412d9d640 1 -- 172.21.15.60:0/148192925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 msgr2=0x55f1732cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb412d9d640 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb412d9d640 1 -- 172.21.15.60:0/148192925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 msgr2=0x55f1732d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb412d9d640 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb412d9d640 1 -- 172.21.15.60:0/148192925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1732c4510 con 0x55f1732d3370 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb41259c640 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb412d9d640 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732cb660 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005d40 tx=0x7fb40c030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96b24e46cdd6987 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb3fbfff640 1 -- 172.21.15.60:0/148192925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c060030 con 0x55f1732d3370 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb3fbfff640 1 -- 172.21.15.60:0/148192925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb40c036070 con 0x55f1732d3370 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.860+0000 7fb3fbfff640 1 -- 172.21.15.60:0/148192925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c0305a0 con 0x55f1732d3370 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 -- 172.21.15.60:0/148192925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 msgr2=0x55f1732cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732cb660 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb40c005d40 tx=0x7fb40c030f90 comp rx=0 tx=0).stop 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 -- 172.21.15.60:0/148192925 shutdown_connections 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732cb660 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 --2- 172.21.15.60:0/148192925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 -- 172.21.15.60:0/148192925 >> 172.21.15.60:0/148192925 conn(0x55f173291310 msgr2=0x55f1732d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 -- 172.21.15.60:0/148192925 shutdown_connections 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 -- 172.21.15.60:0/148192925 wait complete. 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 -- start start 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.861+0000 7fb41ac48740 1 Processor -- start 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732d76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41ac48740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41ac48740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141b0f80 con 0x55f1732d3370 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41ac48740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141b08b0 con 0x55f1732c85d0 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41ac48740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb4141adb10 con 0x55f1732c9b40 2024-09-12T00:00:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41ac48740 10 client.0 _ll_register_callbacks cb 0x7fb404096d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48452/0 (socket says 172.21.15.60:48452) 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41259c640 1 -- 172.21.15.60:0/2857095474 learned_addr learned my addr 172.21.15.60:0/2857095474 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb411d9b640 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732d76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb412d9d640 1 -- 172.21.15.60:0/2857095474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 msgr2=0x55f1732d76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732d76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb412d9d640 1 -- 172.21.15.60:0/2857095474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 msgr2=0x55f1732d7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb412d9d640 1 -- 172.21.15.60:0/2857095474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f17334c740 con 0x55f1732d3370 2024-09-12T00:00:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb41259c640 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb412d9d640 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d7c10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x55f1732c8550 tx=0x7fb40c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873f241e67be6297 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.862+0000 7fb3f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2857095474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c060070 con 0x55f1732d3370 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2857095474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fb40c02e030 con 0x55f1732d3370 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 1 -- 172.21.15.60:0/2857095474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb40c036070 con 0x55f1732d3370 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2857095474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb40c072050 con 0x55f1732d3370 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 10 client.15786 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 1 -- 172.21.15.60:0/2857095474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f17334da00 con 0x55f1732d3370 2024-09-12T00:00:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2857095474 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb40c069070 con 0x55f1732d3370 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2857095474 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb40c030900 con 0x55f1732d3370 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 10 client.15786 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 10 client.15786 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 20 client.15786 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f17334de30 0x55f173350250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 4 client.15786 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.863+0000 7fb41ac48740 1 -- 172.21.15.60:0/2857095474 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb40c036070 con 0x55f17334de30 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.864+0000 7fb41259c640 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f17334de30 0x55f173350250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.864+0000 7fb3f9ffb640 10 client.15786 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.864+0000 7fb41259c640 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f17334de30 0x55f173350250 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5a6ac1eec41abf6e server_cookie=367a07ebb154c966 in_seq=0 out_seq=0 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.864+0000 7fb3f9ffb640 1 -- 172.21.15.60:0/2857095474 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb40c036070 con 0x55f17334de30 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.864+0000 7fb3f9ffb640 10 client.15786 handle_command_reply: tid=0 2024-09-12T00:00:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.864+0000 7fb41ac48740 1 client.15786 shutdown 2024-09-12T00:00:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 -- 172.21.15.60:0/2857095474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 msgr2=0x55f1732d7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d7c10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x55f1732c8550 tx=0x7fb40c009b20 comp rx=0 tx=0).stop 2024-09-12T00:00:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 -- 172.21.15.60:0/2857095474 shutdown_connections 2024-09-12T00:00:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f1732d3370 0x55f1732d7c10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f1732c9b40 0x55f1732d76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55f17334de30 0x55f173350250 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 --2- 172.21.15.60:0/2857095474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f1732c85d0 0x55f1732d7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb3f9ffb640 0 client.15786 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:00:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 -- 172.21.15.60:0/2857095474 >> 172.21.15.60:0/2857095474 conn(0x55f173291310 msgr2=0x55f1732c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 -- 172.21.15.60:0/2857095474 shutdown_connections 2024-09-12T00:00:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 1 -- 172.21.15.60:0/2857095474 wait complete. 2024-09-12T00:00:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.865+0000 7fb41ac48740 20 client.15786 trim_cache size 0 max 16384 2024-09-12T00:00:57.877 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:00:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 -- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4000a2d70 msgr2=0x7fb4000a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4000a2d70 0x7fb4000a5230 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb4140fe880 tx=0x7fb3fc009110 comp rx=0 tx=0).stop 2024-09-12T00:00:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 -- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414100a70 msgr2=0x7fb4140fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414100a70 0x7fb4140fcdf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb40400b4a0 tx=0x7fb40400b8a0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 -- 172.21.15.60:0/864758667 shutdown_connections 2024-09-12T00:00:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb4000a2d70 0x7fb4000a5230 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb414106a70 0x7fb4140fd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb414101410 0x7fb4140fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 --2- 172.21.15.60:0/864758667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb414100a70 0x7fb4140fcdf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 -- 172.21.15.60:0/864758667 >> 172.21.15.60:0/864758667 conn(0x7fb4140fc7d0 msgr2=0x7fb41406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 -- 172.21.15.60:0/864758667 shutdown_connections 2024-09-12T00:00:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:57.866+0000 7fb41886f640 1 -- 172.21.15.60:0/864758667 wait complete. 2024-09-12T00:00:58.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:00:58.807 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:00:59.230 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:00:58 smithi060 ceph-mon[30953]: pgmap v51: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.3 MiB/s wr, 54 op/s 2024-09-12T00:00:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:00:58 smithi192 ceph-mon[35487]: pgmap v51: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.3 MiB/s wr, 54 op/s 2024-09-12T00:00:59.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 -- 172.21.15.60:0/595847713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681036e0 msgr2=0x7f9368107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 --2- 172.21.15.60:0/595847713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681036e0 0x7f9368107b90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9354009930 tx=0x7f935402a420 comp rx=0 tx=0).stop 2024-09-12T00:00:59.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 -- 172.21.15.60:0/595847713 shutdown_connections 2024-09-12T00:00:59.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 --2- 172.21.15.60:0/595847713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93681082a0 0x7f936810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 --2- 172.21.15.60:0/595847713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681036e0 0x7f9368107b90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 --2- 172.21.15.60:0/595847713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9368102d30 0x7f9368103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 -- 172.21.15.60:0/595847713 >> 172.21.15.60:0/595847713 conn(0x7f93680fc7d0 msgr2=0x7f93680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 -- 172.21.15.60:0/595847713 shutdown_connections 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 -- 172.21.15.60:0/595847713 wait complete. 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 Processor -- start 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.317+0000 7f936efd6640 1 -- start start 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936efd6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9368102d30 0x7f9368198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936efd6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93681036e0 0x7f9368198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936efd6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681082a0 0x7f936819cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936efd6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93681121c0 con 0x7f93681082a0 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936efd6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9368112040 con 0x7f93681036e0 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936efd6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9368112340 con 0x7f9368102d30 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681082a0 0x7f936819cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681082a0 0x7f936819cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37560/0 (socket says 172.21.15.60:37560) 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 -- 172.21.15.60:0/1394421367 learned_addr learned my addr 172.21.15.60:0/1394421367 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936cd72640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9368102d30 0x7f9368198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f9367fff640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93681036e0 0x7f9368198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 -- 172.21.15.60:0/1394421367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9368102d30 msgr2=0x7f9368198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9368102d30 0x7f9368198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 -- 172.21.15.60:0/1394421367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93681036e0 msgr2=0x7f9368198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93681036e0 0x7f9368198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 -- 172.21.15.60:0/1394421367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936819d630 con 0x7f93681082a0 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f936d573640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681082a0 0x7f936819cf50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f936000eaa0 tx=0x7f936000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.318+0000 7f9365ffb640 1 -- 172.21.15.60:0/1394421367 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936000cdb0 con 0x7f93681082a0 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.319+0000 7f936efd6640 1 -- 172.21.15.60:0/1394421367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936819d920 con 0x7f93681082a0 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.319+0000 7f9365ffb640 1 -- 172.21.15.60:0/1394421367 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9360004b20 con 0x7f93681082a0 2024-09-12T00:00:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.319+0000 7f9365ffb640 1 -- 172.21.15.60:0/1394421367 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360011760 con 0x7f93681082a0 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.319+0000 7f936efd6640 1 -- 172.21.15.60:0/1394421367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93681a5200 con 0x7f93681082a0 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.321+0000 7f9365ffb640 1 -- 172.21.15.60:0/1394421367 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9360011900 con 0x7f93681082a0 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.321+0000 7f9365ffb640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93580a2cf0 0x7f93580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.322+0000 7f936cd72640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93580a2cf0 0x7f93580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.322+0000 7f9365ffb640 1 -- 172.21.15.60:0/1394421367 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f93600cf5b0 con 0x7f93681082a0 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.322+0000 7f936cd72640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93580a2cf0 0x7f93580a51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f935c009bd0 tx=0x7f935c005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.322+0000 7f93713af740 1 Processor -- start 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.322+0000 7f93713af740 1 -- start start 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.322+0000 7f93713af740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff17d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f93713af740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff17da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f93713af740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff18a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f93713af740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b0ff0e32f0 con 0x55b0ff17d5d0 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f93713af740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b0ff08acf0 con 0x55b0ff188370 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f93713af740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b0ff0df2b0 con 0x55b0ff17eb40 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff17da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff17da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37566/0 (socket says 172.21.15.60:37566) 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 -- 172.21.15.60:0/1829371286 learned_addr learned my addr 172.21.15.60:0/1829371286 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f936d573640 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff18a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f936cd72640 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff17d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 -- 172.21.15.60:0/1829371286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 msgr2=0x55b0ff17d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff17d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 -- 172.21.15.60:0/1829371286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 msgr2=0x55b0ff18a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff18a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 -- 172.21.15.60:0/1829371286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0ff06f3a0 con 0x55b0ff17d5d0 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f936cd72640 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff17d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f936d573640 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff18a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9367fff640 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff17da10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f93680697d0 tx=0x7f9354031470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23348f1c12ab687 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9352ffd640 1 -- 172.21.15.60:0/1829371286 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935403f070 con 0x55b0ff17d5d0 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9352ffd640 1 -- 172.21.15.60:0/1829371286 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9354004030 con 0x55b0ff17d5d0 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.323+0000 7f9352ffd640 1 -- 172.21.15.60:0/1829371286 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354035070 con 0x55b0ff17d5d0 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.324+0000 7f93713af740 1 -- 172.21.15.60:0/1829371286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 msgr2=0x55b0ff17da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.324+0000 7f93713af740 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff17da10 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f93680697d0 tx=0x7f9354031470 comp rx=0 tx=0).stop 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.324+0000 7f93713af740 1 -- 172.21.15.60:0/1829371286 shutdown_connections 2024-09-12T00:00:59.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.324+0000 7f93713af740 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff18a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.324+0000 7f93713af740 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff17da10 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.324+0000 7f93713af740 1 --2- 172.21.15.60:0/1829371286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff17d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.324+0000 7f93713af740 1 -- 172.21.15.60:0/1829371286 >> 172.21.15.60:0/1829371286 conn(0x55b0ff146310 msgr2=0x55b0ff179c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.325+0000 7f93713af740 1 -- 172.21.15.60:0/1829371286 shutdown_connections 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.325+0000 7f93713af740 1 -- 172.21.15.60:0/1829371286 wait complete. 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.325+0000 7f93713af740 1 -- start start 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.325+0000 7f93713af740 1 Processor -- start 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.325+0000 7f93713af740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 0x55b0ff187da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.325+0000 7f93713af740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff17eb40 0x55b0ff185050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f93713af740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff188370 0x55b0ff1857e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f93713af740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b0ff18b010 con 0x55b0ff188370 2024-09-12T00:00:59.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f93713af740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b0ff09e060 con 0x55b0ff17eb40 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f93713af740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b0ff18b190 con 0x55b0ff17d5d0 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f93713af740 10 client.0 _ll_register_callbacks cb 0x55b0fedf18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff188370 0x55b0ff1857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff188370 0x55b0ff1857e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37578/0 (socket says 172.21.15.60:37578) 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 -- 172.21.15.60:0/3089671364 learned_addr learned my addr 172.21.15.60:0/3089671364 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936cd72640 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 0x55b0ff187da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f9367fff640 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff17eb40 0x55b0ff185050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 -- 172.21.15.60:0/3089671364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 msgr2=0x55b0ff187da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 0x55b0ff187da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 -- 172.21.15.60:0/3089671364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff17eb40 msgr2=0x55b0ff185050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff17eb40 0x55b0ff185050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 -- 172.21.15.60:0/3089671364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0fee543c0 con 0x55b0ff188370 2024-09-12T00:00:59.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f9367fff640 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff17eb40 0x55b0ff185050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f936d573640 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff188370 0x55b0ff1857e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9360097f80 tx=0x7f936009b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585fa2d1fbf7e7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f9347fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f9347fff640 1 -- 172.21.15.60:0/3089671364 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936001f050 con 0x55b0ff188370 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f9347fff640 1 -- 172.21.15.60:0/3089671364 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f93600cf110 con 0x55b0ff188370 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.326+0000 7f93713af740 1 -- 172.21.15.60:0/3089671364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9354004030 con 0x55b0ff188370 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f9347fff640 1 -- 172.21.15.60:0/3089671364 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f93600b8020 con 0x55b0ff188370 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f93713af740 10 client.15798 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f93713af740 1 -- 172.21.15.60:0/3089671364 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b0ff196ba0 con 0x55b0ff188370 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f9347fff640 1 -- 172.21.15.60:0/3089671364 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9354004030 con 0x55b0ff188370 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f9347fff640 1 -- 172.21.15.60:0/3089671364 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f936000f040 con 0x55b0ff188370 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f93713af740 10 client.15798 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:59.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f93713af740 10 client.15798 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f93713af740 20 client.15798 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f93713af740 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55b0ff198060 0x55b0ff19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f93713af740 4 client.15798 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f93713af740 1 -- 172.21.15.60:0/3089671364 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0ff0f0860 con 0x55b0ff198060 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.327+0000 7f936cd72640 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55b0ff198060 0x55b0ff19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.328+0000 7f936cd72640 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55b0ff198060 0x55b0ff19a4b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=92192d761d8ce783 server_cookie=1b14377aac3c57fc in_seq=0 out_seq=0 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.328+0000 7f9347fff640 10 client.15798 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.328+0000 7f9347fff640 1 -- 172.21.15.60:0/3089671364 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0ff0f0860 con 0x55b0ff198060 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.328+0000 7f9347fff640 10 client.15798 handle_command_reply: tid=0 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 client.15798 shutdown 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 -- 172.21.15.60:0/3089671364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff188370 msgr2=0x55b0ff1857e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff188370 0x55b0ff1857e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9360097f80 tx=0x7f936009b750 comp rx=0 tx=0).stop 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 -- 172.21.15.60:0/3089671364 shutdown_connections 2024-09-12T00:00:59.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55b0ff198060 0x55b0ff19a4b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff188370 0x55b0ff1857e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff17eb40 0x55b0ff185050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 --2- 172.21.15.60:0/3089671364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 0x55b0ff187da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 -- 172.21.15.60:0/3089671364 >> 172.21.15.60:0/3089671364 conn(0x55b0ff146310 msgr2=0x55b0ff17f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f9347fff640 0 client.15798 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 -- 172.21.15.60:0/3089671364 shutdown_connections 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 1 -- 172.21.15.60:0/3089671364 wait complete. 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.329+0000 7f93713af740 20 client.15798 trim_cache size 0 max 16384 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f93713af740 1 Processor -- start 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f93713af740 1 -- start start 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f93713af740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 0x55b0ff183f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f93713af740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17eb40 0x55b0ff186fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f93713af740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff180120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f93713af740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93681ad7f0 con 0x55b0ff17eb40 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f93713af740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f93681af330 con 0x55b0ff188370 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f93713af740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93681adec0 con 0x55b0ff17d5d0 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f9367fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17eb40 0x55b0ff186fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f9367fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17eb40 0x55b0ff186fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37582/0 (socket says 172.21.15.60:37582) 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f9367fff640 1 -- 172.21.15.60:0/2063253212 learned_addr learned my addr 172.21.15.60:0/2063253212 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f936d573640 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff180120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.342+0000 7f936cd72640 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 0x55b0ff183f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f9367fff640 1 -- 172.21.15.60:0/2063253212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 msgr2=0x55b0ff183f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f9367fff640 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 0x55b0ff183f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f9367fff640 1 -- 172.21.15.60:0/2063253212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 msgr2=0x55b0ff180120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f9367fff640 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff180120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f9367fff640 1 -- 172.21.15.60:0/2063253212 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0ff1794f0 con 0x55b0ff17eb40 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f936d573640 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff180120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f9367fff640 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17eb40 0x55b0ff186fc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f93680697d0 tx=0x7f935402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9400d81d36d7f463 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f93527fc640 1 -- 172.21.15.60:0/2063253212 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354035070 con 0x55b0ff17eb40 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f93527fc640 1 -- 172.21.15.60:0/2063253212 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f935404b070 con 0x55b0ff17eb40 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.343+0000 7f93527fc640 1 -- 172.21.15.60:0/2063253212 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935403f040 con 0x55b0ff17eb40 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.344+0000 7f93713af740 1 -- 172.21.15.60:0/2063253212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17eb40 msgr2=0x55b0ff186fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.344+0000 7f93713af740 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17eb40 0x55b0ff186fc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f93680697d0 tx=0x7f935402a420 comp rx=0 tx=0).stop 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.344+0000 7f93713af740 1 -- 172.21.15.60:0/2063253212 shutdown_connections 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.344+0000 7f93713af740 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff180120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.344+0000 7f93713af740 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17eb40 0x55b0ff186fc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.344+0000 7f93713af740 1 --2- 172.21.15.60:0/2063253212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17d5d0 0x55b0ff183f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.344+0000 7f93713af740 1 -- 172.21.15.60:0/2063253212 >> 172.21.15.60:0/2063253212 conn(0x55b0ff146310 msgr2=0x55b0ff1868b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.344+0000 7f93713af740 1 -- 172.21.15.60:0/2063253212 shutdown_connections 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.345+0000 7f93713af740 1 -- 172.21.15.60:0/2063253212 wait complete. 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.345+0000 7f93713af740 1 -- start start 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.345+0000 7f93713af740 1 Processor -- start 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f93713af740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff190bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f93713af740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff181e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f93713af740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff182370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f93713af740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93681aec60 con 0x55b0ff17d5d0 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f93713af740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f93681ae590 con 0x55b0ff188370 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f93713af740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93681ab7d0 con 0x55b0ff17eb40 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f93713af740 10 client.0 _ll_register_callbacks cb 0x7f9360005b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f936cd72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff190bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f9367fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff181e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f936cd72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff190bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37588/0 (socket says 172.21.15.60:37588) 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.346+0000 7f936cd72640 1 -- 172.21.15.60:0/3102518357 learned_addr learned my addr 172.21.15.60:0/3102518357 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f936d573640 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff182370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9367fff640 1 -- 172.21.15.60:0/3102518357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 msgr2=0x55b0ff182370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9367fff640 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff182370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9367fff640 1 -- 172.21.15.60:0/3102518357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 msgr2=0x55b0ff190bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9367fff640 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff190bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9367fff640 1 -- 172.21.15.60:0/3102518357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0ff182ba0 con 0x55b0ff17eb40 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f936cd72640 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff190bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9367fff640 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff181e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55b0ff188090 tx=0x7f9354032fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b06dffffc9cec22a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9347fff640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:00:59.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9347fff640 1 -- 172.21.15.60:0/3102518357 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354055020 con 0x55b0ff17eb40 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f93713af740 1 -- 172.21.15.60:0/3102518357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f935404b070 con 0x55b0ff17eb40 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.347+0000 7f9347fff640 1 -- 172.21.15.60:0/3102518357 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9354051850 con 0x55b0ff17eb40 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f9347fff640 1 -- 172.21.15.60:0/3102518357 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9354060050 con 0x55b0ff17eb40 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f93713af740 10 client.25324 fetch_fsmap learned FSMap version 29 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f93713af740 1 -- 172.21.15.60:0/3102518357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b0ff20b5c0 con 0x55b0ff17eb40 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f9347fff640 1 -- 172.21.15.60:0/3102518357 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f935404b070 con 0x55b0ff17eb40 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f9347fff640 1 -- 172.21.15.60:0/3102518357 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f935404f410 con 0x55b0ff17eb40 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f93713af740 10 client.25324 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f93713af740 10 client.25324 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f93713af740 20 client.25324 populate_metadata read hostname 'smithi060' 2024-09-12T00:00:59.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f93713af740 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55b0ff20b7e0 0x55b0ff20dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f93713af740 4 client.25324 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f93713af740 1 -- 172.21.15.60:0/3102518357 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0ff0ead70 con 0x55b0ff20b7e0 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.348+0000 7f936cd72640 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55b0ff20b7e0 0x55b0ff20dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f936cd72640 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55b0ff20b7e0 0x55b0ff20dbd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=931d712217697c46 server_cookie=d72886bdeead9a1c in_seq=0 out_seq=0 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f9347fff640 10 client.25324 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f9347fff640 1 -- 172.21.15.60:0/3102518357 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0ff0ead70 con 0x55b0ff20b7e0 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f9347fff640 10 client.25324 handle_command_reply: tid=0 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 client.25324 shutdown 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 -- 172.21.15.60:0/3102518357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 msgr2=0x55b0ff181e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff181e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55b0ff188090 tx=0x7f9354032fc0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 -- 172.21.15.60:0/3102518357 shutdown_connections 2024-09-12T00:00:59.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55b0ff20b7e0 0x55b0ff20dbd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b0ff188370 0x55b0ff182370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f9347fff640 0 client.25324 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0ff17eb40 0x55b0ff181e30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 --2- 172.21.15.60:0/3102518357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b0ff17d5d0 0x55b0ff190bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 -- 172.21.15.60:0/3102518357 >> 172.21.15.60:0/3102518357 conn(0x55b0ff146310 msgr2=0x55b0ff178d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 -- 172.21.15.60:0/3102518357 shutdown_connections 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 1 -- 172.21.15.60:0/3102518357 wait complete. 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.349+0000 7f93713af740 20 client.25324 trim_cache size 0 max 16384 2024-09-12T00:00:59.375 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 -- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93580a2cf0 msgr2=0x7f93580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93580a2cf0 0x7f93580a51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f935c009bd0 tx=0x7f935c005f90 comp rx=0 tx=0).stop 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 -- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681082a0 msgr2=0x7f936819cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681082a0 0x7f936819cf50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f936000eaa0 tx=0x7f936000ef60 comp rx=0 tx=0).stop 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 -- 172.21.15.60:0/1394421367 shutdown_connections 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93580a2cf0 0x7f93580a51b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93681082a0 0x7f936819cf50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93681036e0 0x7f9368198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 --2- 172.21.15.60:0/1394421367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9368102d30 0x7f9368198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:00:59.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 -- 172.21.15.60:0/1394421367 >> 172.21.15.60:0/1394421367 conn(0x7f93680fc7d0 msgr2=0x7f9368106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:00:59.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 -- 172.21.15.60:0/1394421367 shutdown_connections 2024-09-12T00:00:59.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:00:59.350+0000 7f936efd6640 1 -- 172.21.15.60:0/1394421367 wait complete. 2024-09-12T00:00:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:00:58 smithi105 ceph-mon[34805]: pgmap v51: 97 pgs: 97 active+clean; 88 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.3 MiB/s wr, 54 op/s 2024-09-12T00:01:00.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:01:00.172 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-12T00:01:00.314 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:00.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 -- 172.21.15.60:0/2456187129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1082a0 msgr2=0x7fbf9c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 --2- 172.21.15.60:0/2456187129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1082a0 0x7fbf9c10ec40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009cd0 tx=0x7fbf9402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 -- 172.21.15.60:0/2456187129 shutdown_connections 2024-09-12T00:01:00.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 --2- 172.21.15.60:0/2456187129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1082a0 0x7fbf9c10ec40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 --2- 172.21.15.60:0/2456187129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf9c1036e0 0x7fbf9c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 --2- 172.21.15.60:0/2456187129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf9c102d30 0x7fbf9c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 -- 172.21.15.60:0/2456187129 >> 172.21.15.60:0/2456187129 conn(0x7fbf9c0fc7d0 msgr2=0x7fbf9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 -- 172.21.15.60:0/2456187129 shutdown_connections 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.810+0000 7fbfa1836640 1 -- 172.21.15.60:0/2456187129 wait complete. 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbfa1836640 1 Processor -- start 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbfa1836640 1 -- start start 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbfa1836640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf9c102d30 0x7fbf9c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbfa1836640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1036e0 0x7fbf9c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbfa1836640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf9c1082a0 0x7fbf9c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbfa1836640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c1121e0 con 0x7fbf9c1036e0 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbfa1836640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c112060 con 0x7fbf9c102d30 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbfa1836640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c112360 con 0x7fbf9c1082a0 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1036e0 0x7fbf9c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1036e0 0x7fbf9c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37614/0 (socket says 172.21.15.60:37614) 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbf9a7fc640 1 -- 172.21.15.60:0/1481981449 learned_addr learned my addr 172.21.15.60:0/1481981449 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf9c1082a0 0x7fbf9c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.811+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf9c102d30 0x7fbf9c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbf9a7fc640 1 -- 172.21.15.60:0/1481981449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf9c1082a0 msgr2=0x7fbf9c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf9c1082a0 0x7fbf9c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbf9a7fc640 1 -- 172.21.15.60:0/1481981449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf9c102d30 msgr2=0x7fbf9c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf9c102d30 0x7fbf9c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbf9a7fc640 1 -- 172.21.15.60:0/1481981449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9c1a6ae0 con 0x7fbf9c1036e0 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf9c1082a0 0x7fbf9c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf9c102d30 0x7fbf9c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1036e0 0x7fbf9c100ed0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000e9f0 tx=0x7fbf9000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbfa0834640 1 -- 172.21.15.60:0/1481981449 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000ccc0 con 0x7fbf9c1036e0 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbfa0834640 1 -- 172.21.15.60:0/1481981449 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf90010930 con 0x7fbf9c1036e0 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbfa1836640 1 -- 172.21.15.60:0/1481981449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9c1a6dd0 con 0x7fbf9c1036e0 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbfa0834640 1 -- 172.21.15.60:0/1481981449 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90018a30 con 0x7fbf9c1036e0 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.812+0000 7fbfa1836640 1 -- 172.21.15.60:0/1481981449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9c1a7280 con 0x7fbf9c1036e0 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.814+0000 7fbfa0834640 1 -- 172.21.15.60:0/1481981449 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fbf90010ae0 con 0x7fbf9c1036e0 2024-09-12T00:01:00.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa3c0f740 1 Processor -- start 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa3c0f740 1 -- start start 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f58b40 0x55d0e3f57090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f57a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f64760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3ebd2f0 con 0x55d0e3f575d0 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3e64cf0 con 0x55d0e3f62370 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3eb92b0 con 0x55d0e3f58b40 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbfa0834640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbf840a2cf0 0x7fbf840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f57a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f57a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37618/0 (socket says 172.21.15.60:37618) 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f64760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbf9affd640 1 -- 172.21.15.60:0/4286717864 learned_addr learned my addr 172.21.15.60:0/4286717864 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.815+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f58b40 0x55d0e3f57090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbfa0834640 1 -- 172.21.15.60:0/1481981449 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbf900cf6d0 con 0x7fbf9c1036e0 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbf840a2cf0 0x7fbf840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9a7fc640 1 -- 172.21.15.60:0/4286717864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f58b40 msgr2=0x55d0e3f57090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f58b40 0x55d0e3f57090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9a7fc640 1 -- 172.21.15.60:0/4286717864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 msgr2=0x55d0e3f57a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f57a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9a7fc640 1 -- 172.21.15.60:0/4286717864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e3e493a0 con 0x55d0e3f62370 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9affd640 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f57a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbf840a2cf0 0x7fbf840a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbf94006010 tx=0x7fbf940095c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f64760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf900cce10 tx=0x7fbf9006ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b753052df9a8d288 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:00.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf81ffb640 1 -- 172.21.15.60:0/4286717864 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf900a4850 con 0x55d0e3f62370 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf81ffb640 1 -- 172.21.15.60:0/4286717864 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf90099f90 con 0x55d0e3f62370 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.816+0000 7fbf81ffb640 1 -- 172.21.15.60:0/4286717864 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90066930 con 0x55d0e3f62370 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/4286717864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 msgr2=0x55d0e3f64760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f64760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbf900cce10 tx=0x7fbf9006ed00 comp rx=0 tx=0).stop 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/4286717864 shutdown_connections 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f64760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f57a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/4286717864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f58b40 0x55d0e3f57090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/4286717864 >> 172.21.15.60:0/4286717864 conn(0x55d0e3f20310 msgr2=0x55d0e3f53c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/4286717864 shutdown_connections 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/4286717864 wait complete. 2024-09-12T00:01:00.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.817+0000 7fbfa3c0f740 1 -- start start 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbfa3c0f740 1 Processor -- start 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f575d0 0x55d0e3f61d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f5f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f5f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3f65070 con 0x55d0e3f58b40 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3e78060 con 0x55d0e3f62370 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d0e3f651f0 con 0x55d0e3f575d0 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbfa3c0f740 10 client.0 _ll_register_callbacks cb 0x55d0e3bcb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f5f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f5f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f575d0 0x55d0e3f61d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f575d0 0x55d0e3f61d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:50324/0 (socket says 172.21.15.60:50324) 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f5f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48572/0 (socket says 172.21.15.60:48572) 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f5f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37622/0 (socket says 172.21.15.60:37622) 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9affd640 1 -- 172.21.15.60:0/1116924857 learned_addr learned my addr 172.21.15.60:0/1116924857 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9b7fe640 1 -- 172.21.15.60:0/1116924857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f575d0 msgr2=0x55d0e3f61d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.818+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f575d0 0x55d0e3f61d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf9b7fe640 1 -- 172.21.15.60:0/1116924857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 msgr2=0x55d0e3f5f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f5f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf9b7fe640 1 -- 172.21.15.60:0/1116924857 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e3c2e3c0 con 0x55d0e3f62370 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f5f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f5f650 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbf94005e30 tx=0x7fbf9402a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9efb44c488fbd78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:00.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf7affd640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf7affd640 1 -- 172.21.15.60:0/1116924857 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf940309b0 con 0x55d0e3f62370 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1116924857 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf90099f90 con 0x55d0e3f62370 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf7affd640 1 -- 172.21.15.60:0/1116924857 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbf94030b50 con 0x55d0e3f62370 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf7affd640 1 -- 172.21.15.60:0/1116924857 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbf94030d50 con 0x55d0e3f62370 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbfa3c0f740 10 client.25403 fetch_fsmap learned FSMap version 29 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1116924857 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0e3f70b90 con 0x55d0e3f62370 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf7affd640 1 -- 172.21.15.60:0/1116924857 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf90099f90 con 0x55d0e3f62370 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbf7affd640 1 -- 172.21.15.60:0/1116924857 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbf94030070 con 0x55d0e3f62370 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.819+0000 7fbfa3c0f740 10 client.25403 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.820+0000 7fbfa3c0f740 10 client.25403 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.820+0000 7fbfa3c0f740 20 client.25403 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.820+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55d0e3f71fa0 0x55d0e3f74390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.820+0000 7fbfa3c0f740 4 client.25403 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.820+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1116924857 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0e3eca860 con 0x55d0e3f71fa0 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.820+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55d0e3f71fa0 0x55d0e3f74390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.820+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55d0e3f71fa0 0x55d0e3f74390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2329929bf00a9ad0 server_cookie=a193325587510024 in_seq=0 out_seq=0 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.820+0000 7fbf7affd640 10 client.25403 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbf7affd640 1 -- 172.21.15.60:0/1116924857 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0e3eca860 con 0x55d0e3f71fa0 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbf7affd640 10 client.25403 handle_command_reply: tid=0 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 client.25403 shutdown 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1116924857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 msgr2=0x55d0e3f5f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f5f650 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbf94005e30 tx=0x7fbf9402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1116924857 shutdown_connections 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55d0e3f71fa0 0x55d0e3f74390 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f62370 0x55d0e3f5f650 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f5f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1116924857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f575d0 0x55d0e3f61d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbf7affd640 0 client.25403 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:01:00.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1116924857 >> 172.21.15.60:0/1116924857 conn(0x55d0e3f20310 msgr2=0x55d0e3f599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:00.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.821+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1116924857 shutdown_connections 2024-09-12T00:01:00.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.822+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1116924857 wait complete. 2024-09-12T00:01:00.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.822+0000 7fbfa3c0f740 20 client.25403 trim_cache size 0 max 16384 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbfa3c0f740 1 Processor -- start 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbfa3c0f740 1 -- start start 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f60fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 0x55d0e3f79c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c1afaa0 con 0x55d0e3f58b40 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c1b15e0 con 0x55d0e3f575d0 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c1b0170 con 0x55d0e3f62370 2024-09-12T00:01:00.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f60fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f60fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37630/0 (socket says 172.21.15.60:37630) 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9a7fc640 1 -- 172.21.15.60:0/1852530869 learned_addr learned my addr 172.21.15.60:0/1852530869 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 0x55d0e3f79c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9affd640 1 -- 172.21.15.60:0/1852530869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 msgr2=0x55d0e3f79c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 0x55d0e3f79c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9affd640 1 -- 172.21.15.60:0/1852530869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 msgr2=0x55d0e3f60fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f60fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9affd640 1 -- 172.21.15.60:0/1852530869 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e3f4ea30 con 0x55d0e3f575d0 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.835+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f60fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6e310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55d0e3f60680 tx=0x7fbf8c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34b1c9613571d409 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbf817fa640 1 -- 172.21.15.60:0/1852530869 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00fc80 con 0x55d0e3f575d0 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbf817fa640 1 -- 172.21.15.60:0/1852530869 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf8c00fe20 con 0x55d0e3f575d0 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbf817fa640 1 -- 172.21.15.60:0/1852530869 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c010430 con 0x55d0e3f575d0 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1852530869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f575d0 msgr2=0x55d0e3f6e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6e310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55d0e3f60680 tx=0x7fbf8c005f90 comp rx=0 tx=0).stop 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1852530869 shutdown_connections 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 0x55d0e3f79c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f58b40 0x55d0e3f60fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.836+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1852530869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6e310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.837+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1852530869 >> 172.21.15.60:0/1852530869 conn(0x55d0e3f20310 msgr2=0x55d0e3f608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.837+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1852530869 shutdown_connections 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.837+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1852530869 wait complete. 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.837+0000 7fbfa3c0f740 1 -- start start 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.837+0000 7fbfa3c0f740 1 Processor -- start 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.837+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f58b40 0x55d0e3f6ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbfa3c0f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 0x55d0e3f669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c1b0f10 con 0x55d0e3f575d0 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c1b0840 con 0x55d0e3f58b40 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbfa3c0f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c1ada80 con 0x55d0e3f62370 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbfa3c0f740 10 client.0 _ll_register_callbacks cb 0x7fbf94009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37642/0 (socket says 172.21.15.60:37642) 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 -- 172.21.15.60:0/1745711069 learned_addr learned my addr 172.21.15.60:0/1745711069 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:00.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f58b40 0x55d0e3f6ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9b7fe640 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 0x55d0e3f669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 -- 172.21.15.60:0/1745711069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 msgr2=0x55d0e3f669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 0x55d0e3f669b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 -- 172.21.15.60:0/1745711069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f58b40 msgr2=0x55d0e3f6ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f58b40 0x55d0e3f6ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 -- 172.21.15.60:0/1745711069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e3f671e0 con 0x55d0e3f575d0 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f58b40 0x55d0e3f6ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf9affd640 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6a5e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c012780 tx=0x7fbf8c012570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3bec613f4ba907 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf7affd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf7affd640 1 -- 172.21.15.60:0/1745711069 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c038060 con 0x55d0e3f575d0 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbf7affd640 1 -- 172.21.15.60:0/1745711069 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbf8c0121d0 con 0x55d0e3f575d0 2024-09-12T00:01:00.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.838+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1745711069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf8c00fe20 con 0x55d0e3f575d0 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbf7affd640 1 -- 172.21.15.60:0/1745711069 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbf8c005230 con 0x55d0e3f575d0 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbfa3c0f740 10 client.15822 fetch_fsmap learned FSMap version 29 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1745711069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0e3fdd710 con 0x55d0e3f575d0 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbf7affd640 1 -- 172.21.15.60:0/1745711069 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf8c00fe20 con 0x55d0e3f575d0 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbf7affd640 1 -- 172.21.15.60:0/1745711069 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbf8c029610 con 0x55d0e3f575d0 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbfa3c0f740 10 client.15822 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbfa3c0f740 10 client.15822 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbfa3c0f740 20 client.15822 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55d0e3fdddd0 0x55d0e3fe01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbfa3c0f740 4 client.15822 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1745711069 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0e3ec4d70 con 0x55d0e3fdddd0 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.839+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55d0e3fdddd0 0x55d0e3fe01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbf9a7fc640 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55d0e3fdddd0 0x55d0e3fe01c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c2add44939ea37e server_cookie=44f400aecae2cb44 in_seq=0 out_seq=0 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbf7affd640 10 client.15822 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbf7affd640 1 -- 172.21.15.60:0/1745711069 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0e3ec4d70 con 0x55d0e3fdddd0 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbf7affd640 10 client.15822 handle_command_reply: tid=0 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 client.15822 shutdown 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1745711069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 msgr2=0x55d0e3f6a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6a5e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c012780 tx=0x7fbf8c012570 comp rx=0 tx=0).stop 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1745711069 shutdown_connections 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55d0e3fdddd0 0x55d0e3fe01c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e3f62370 0x55d0e3f669b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbf7affd640 0 client.15822 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d0e3f58b40 0x55d0e3f6ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 --2- 172.21.15.60:0/1745711069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d0e3f575d0 0x55d0e3f6a5e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1745711069 >> 172.21.15.60:0/1745711069 conn(0x55d0e3f20310 msgr2=0x55d0e3f610c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:00.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1745711069 shutdown_connections 2024-09-12T00:01:00.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 1 -- 172.21.15.60:0/1745711069 wait complete. 2024-09-12T00:01:00.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.840+0000 7fbfa3c0f740 20 client.15822 trim_cache size 0 max 16384 2024-09-12T00:01:00.848 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 -- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbf840a2cf0 msgr2=0x7fbf840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbf840a2cf0 0x7fbf840a51b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbf94006010 tx=0x7fbf940095c0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 -- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1036e0 msgr2=0x7fbf9c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1036e0 0x7fbf9c100ed0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000e9f0 tx=0x7fbf9000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 -- 172.21.15.60:0/1481981449 shutdown_connections 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbf840a2cf0 0x7fbf840a51b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf9c1082a0 0x7fbf9c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf9c1036e0 0x7fbf9c100ed0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 --2- 172.21.15.60:0/1481981449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf9c102d30 0x7fbf9c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:00.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 -- 172.21.15.60:0/1481981449 >> 172.21.15.60:0/1481981449 conn(0x7fbf9c0fc7d0 msgr2=0x7fbf9c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:00.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 -- 172.21.15.60:0/1481981449 shutdown_connections 2024-09-12T00:01:00.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:00.841+0000 7fbfa1836640 1 -- 172.21.15.60:0/1481981449 wait complete. 2024-09-12T00:01:01.276 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar xf doc.tar 2024-09-12T00:01:01.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:00 smithi105 ceph-mon[34805]: pgmap v52: 97 pgs: 97 active+clean; 92 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 7.7 MiB/s wr, 63 op/s 2024-09-12T00:01:01.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:00 smithi192 ceph-mon[35487]: pgmap v52: 97 pgs: 97 active+clean; 92 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 7.7 MiB/s wr, 63 op/s 2024-09-12T00:01:01.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:00 smithi060 ceph-mon[30953]: pgmap v52: 97 pgs: 97 active+clean; 92 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 7.7 MiB/s wr, 63 op/s 2024-09-12T00:01:01.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:01:01.769 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:02.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 -- 172.21.15.60:0/553150514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 msgr2=0x7f33a010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/553150514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 0x7f33a010df40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3390009900 tx=0x7f339002a410 comp rx=0 tx=0).stop 2024-09-12T00:01:02.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 -- 172.21.15.60:0/553150514 shutdown_connections 2024-09-12T00:01:02.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/553150514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33a010e480 0x7f33a0110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/553150514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 0x7f33a010df40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/553150514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33a01008d0 0x7f33a0100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 -- 172.21.15.60:0/553150514 >> 172.21.15.60:0/553150514 conn(0x7f33a00fc7a0 msgr2=0x7f33a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 -- 172.21.15.60:0/553150514 shutdown_connections 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.253+0000 7f33a7d0c640 1 -- 172.21.15.60:0/553150514 wait complete. 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a7d0c640 1 Processor -- start 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a7d0c640 1 -- start start 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a7d0c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33a01008d0 0x7f33a01a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a7d0c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 0x7f33a01a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a7d0c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33a010e480 0x7f33a019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a7d0c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01142e0 con 0x7f33a0101280 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a7d0c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0114160 con 0x7f33a010e480 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a7d0c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f33a0114460 con 0x7f33a01008d0 2024-09-12T00:01:02.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a52a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 0x7f33a01a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a52a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 0x7f33a01a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60294/0 (socket says 172.21.15.60:60294) 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a52a7640 1 -- 172.21.15.60:0/1712113590 learned_addr learned my addr 172.21.15.60:0/1712113590 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33a01008d0 0x7f33a01a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a62a9640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33a010e480 0x7f33a019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a5aa8640 1 -- 172.21.15.60:0/1712113590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33a010e480 msgr2=0x7f33a019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33a010e480 0x7f33a019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a5aa8640 1 -- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 msgr2=0x7f33a01a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 0x7f33a01a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.254+0000 7f33a5aa8640 1 -- 172.21.15.60:0/1712113590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a019ace0 con 0x7f33a01008d0 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.255+0000 7f33a52a7640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 0x7f33a01a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:02.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.255+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33a01008d0 0x7f33a01a03f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f339c005fd0 tx=0x7f339c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.255+0000 7f3396ffd640 1 -- 172.21.15.60:0/1712113590 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c009c30 con 0x7f33a01008d0 2024-09-12T00:01:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.255+0000 7f33a7d0c640 1 -- 172.21.15.60:0/1712113590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a019afd0 con 0x7f33a01008d0 2024-09-12T00:01:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.255+0000 7f3396ffd640 1 -- 172.21.15.60:0/1712113590 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f339c009dd0 con 0x7f33a01008d0 2024-09-12T00:01:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.255+0000 7f3396ffd640 1 -- 172.21.15.60:0/1712113590 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c010460 con 0x7f33a01008d0 2024-09-12T00:01:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.255+0000 7f33a7d0c640 1 -- 172.21.15.60:0/1712113590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a01a72c0 con 0x7f33a01008d0 2024-09-12T00:01:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.257+0000 7f3396ffd640 1 -- 172.21.15.60:0/1712113590 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f339c004000 con 0x7f33a01008d0 2024-09-12T00:01:02.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.257+0000 7f33aa0e5740 1 Processor -- start 2024-09-12T00:01:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33aa0e5740 1 -- start start 2024-09-12T00:01:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d117c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d117ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d1189760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e4d10e22f0 con 0x55e4d117c5d0 2024-09-12T00:01:02.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e4d1089cf0 con 0x55e4d117db40 2024-09-12T00:01:02.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e4d10de2b0 con 0x55e4d1187370 2024-09-12T00:01:02.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a5aa8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d117ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a5aa8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d117ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60310/0 (socket says 172.21.15.60:60310) 2024-09-12T00:01:02.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a5aa8640 1 -- 172.21.15.60:0/2463699390 learned_addr learned my addr 172.21.15.60:0/2463699390 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:02.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a52a7640 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d1189760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a62a9640 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d117c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f3396ffd640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f338c0a2cf0 0x7f338c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a5aa8640 1 -- 172.21.15.60:0/2463699390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 msgr2=0x55e4d1189760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:02.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d1189760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a5aa8640 1 -- 172.21.15.60:0/2463699390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 msgr2=0x55e4d117c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:02.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d117c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a5aa8640 1 -- 172.21.15.60:0/2463699390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d106e3a0 con 0x55e4d117c5d0 2024-09-12T00:01:02.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.258+0000 7f33a52a7640 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d1189760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:02.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.259+0000 7f33a62a9640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f338c0a2cf0 0x7f338c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.259+0000 7f3396ffd640 1 -- 172.21.15.60:0/1712113590 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f339c0ceeb0 con 0x7f33a01008d0 2024-09-12T00:01:02.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.259+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d117ca10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f339c0cc5c0 tx=0x7f339c0af580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f5f246ec157352 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:02.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.259+0000 7f338bfff640 1 -- 172.21.15.60:0/2463699390 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c020070 con 0x55e4d117c5d0 2024-09-12T00:01:02.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.259+0000 7f338bfff640 1 -- 172.21.15.60:0/2463699390 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f339c0973c0 con 0x55e4d117c5d0 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.259+0000 7f338bfff640 1 -- 172.21.15.60:0/2463699390 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c09ae30 con 0x55e4d117c5d0 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 -- 172.21.15.60:0/2463699390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 msgr2=0x55e4d117ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33a62a9640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f338c0a2cf0 0x7f338c0a51b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3398005c40 tx=0x7f3398004a40 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d117ca10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f339c0cc5c0 tx=0x7f339c0af580 comp rx=0 tx=0).stop 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 -- 172.21.15.60:0/2463699390 shutdown_connections 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d1189760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d117ca10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/2463699390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d117c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 -- 172.21.15.60:0/2463699390 >> 172.21.15.60:0/2463699390 conn(0x55e4d1145310 msgr2=0x55e4d1178c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 -- 172.21.15.60:0/2463699390 shutdown_connections 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 -- 172.21.15.60:0/2463699390 wait complete. 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 -- start start 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.260+0000 7f33aa0e5740 1 Processor -- start 2024-09-12T00:01:02.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117c5d0 0x55e4d1186d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d1184000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d1187370 0x55e4d11845d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e4d118a010 con 0x55e4d1187370 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e4d109d060 con 0x55e4d117db40 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e4d118a190 con 0x55e4d117c5d0 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33aa0e5740 10 client.0 _ll_register_callbacks cb 0x55e4d0df08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a62a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d1187370 0x55e4d11845d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117c5d0 0x55e4d1186d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117c5d0 0x55e4d1186d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:38556/0 (socket says 172.21.15.60:38556) 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a62a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d1187370 0x55e4d11845d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60322/0 (socket says 172.21.15.60:60322) 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 -- 172.21.15.60:0/179142159 learned_addr learned my addr 172.21.15.60:0/179142159 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:02.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a52a7640 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d1184000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 -- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 msgr2=0x55e4d1184000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d1184000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 -- 172.21.15.60:0/179142159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d1187370 msgr2=0x55e4d11845d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d1187370 0x55e4d11845d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 -- 172.21.15.60:0/179142159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4d0e533c0 con 0x55e4d117c5d0 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a62a9640 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d1187370 0x55e4d11845d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a52a7640 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d1184000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117c5d0 0x55e4d1186d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f339c09b460 tx=0x7f339c0039e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b6c605702c7020 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:02.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.261+0000 7f33897fa640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33897fa640 1 -- 172.21.15.60:0/179142159 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c020070 con 0x55e4d117c5d0 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33897fa640 1 -- 172.21.15.60:0/179142159 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f339c0cc8d0 con 0x55e4d117c5d0 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 1 -- 172.21.15.60:0/179142159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f339c0973c0 con 0x55e4d117c5d0 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33897fa640 1 -- 172.21.15.60:0/179142159 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f339c0b3030 con 0x55e4d117c5d0 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 10 client.25354 fetch_fsmap learned FSMap version 29 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 1 -- 172.21.15.60:0/179142159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e4d118a010 con 0x55e4d117c5d0 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33897fa640 1 -- 172.21.15.60:0/179142159 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f339c0973c0 con 0x55e4d117c5d0 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33897fa640 1 -- 172.21.15.60:0/179142159 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f339c0a0ba0 con 0x55e4d117c5d0 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 10 client.25354 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 10 client.25354 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 20 client.25354 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:02.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e4d1196c10 0x55e4d1199000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 4 client.25354 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33aa0e5740 1 -- 172.21.15.60:0/179142159 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4d10ef860 con 0x55e4d1196c10 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.262+0000 7f33a52a7640 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e4d1196c10 0x55e4d1199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.263+0000 7f33897fa640 10 client.25354 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.263+0000 7f33a52a7640 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e4d1196c10 0x55e4d1199000 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efcc17fe4149f32d server_cookie=4c5911a425c75a51 in_seq=0 out_seq=0 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33897fa640 1 -- 172.21.15.60:0/179142159 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4d10ef860 con 0x55e4d1196c10 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33897fa640 10 client.25354 handle_command_reply: tid=0 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 client.25354 shutdown 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 -- 172.21.15.60:0/179142159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117c5d0 msgr2=0x55e4d1186d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117c5d0 0x55e4d1186d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f339c09b460 tx=0x7f339c0039e0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 -- 172.21.15.60:0/179142159 shutdown_connections 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e4d1196c10 0x55e4d1199000 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d1187370 0x55e4d11845d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33897fa640 0 client.25354 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d1184000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/179142159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117c5d0 0x55e4d1186d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 -- 172.21.15.60:0/179142159 >> 172.21.15.60:0/179142159 conn(0x55e4d1145310 msgr2=0x55e4d117e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 -- 172.21.15.60:0/179142159 shutdown_connections 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 1 -- 172.21.15.60:0/179142159 wait complete. 2024-09-12T00:01:02.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.264+0000 7f33aa0e5740 20 client.25354 trim_cache size 0 max 16384 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33aa0e5740 1 Processor -- start 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33aa0e5740 1 -- start start 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d11932b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117db40 0x55e4d1182fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d1187370 0x55e4d119e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01afaf0 con 0x55e4d117c5d0 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01b1630 con 0x55e4d1187370 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01b01c0 con 0x55e4d117db40 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33a5aa8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d11932b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33a5aa8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d11932b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60338/0 (socket says 172.21.15.60:60338) 2024-09-12T00:01:02.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33a5aa8640 1 -- 172.21.15.60:0/555550214 learned_addr learned my addr 172.21.15.60:0/555550214 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33a62a9640 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d1187370 0x55e4d119e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.278+0000 7f33a52a7640 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117db40 0x55e4d1182fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f33a5aa8640 1 -- 172.21.15.60:0/555550214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117db40 msgr2=0x55e4d1182fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117db40 0x55e4d1182fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f33a5aa8640 1 -- 172.21.15.60:0/555550214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d1187370 msgr2=0x55e4d119e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d1187370 0x55e4d119e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f33a5aa8640 1 -- 172.21.15.60:0/555550214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4d117f120 con 0x55e4d117c5d0 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d11932b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f339c09b1d0 tx=0x7f339c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f79feb686b1740 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f338b7fe640 1 -- 172.21.15.60:0/555550214 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c020070 con 0x55e4d117c5d0 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f338b7fe640 1 -- 172.21.15.60:0/555550214 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f339c0973c0 con 0x55e4d117c5d0 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.279+0000 7f338b7fe640 1 -- 172.21.15.60:0/555550214 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c0a0960 con 0x55e4d117c5d0 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 -- 172.21.15.60:0/555550214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 msgr2=0x55e4d11932b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d11932b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f339c09b1d0 tx=0x7f339c000bc0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 -- 172.21.15.60:0/555550214 shutdown_connections 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d1187370 0x55e4d119e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d117db40 0x55e4d1182fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/555550214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d11932b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 -- 172.21.15.60:0/555550214 >> 172.21.15.60:0/555550214 conn(0x55e4d1145310 msgr2=0x55e4d11828d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 -- 172.21.15.60:0/555550214 shutdown_connections 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 -- 172.21.15.60:0/555550214 wait complete. 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 -- start start 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.280+0000 7f33aa0e5740 1 Processor -- start 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d118fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d118aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33aa0e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d118b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01b0f60 con 0x55e4d117c5d0 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01b0890 con 0x55e4d117db40 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33aa0e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f33a01adad0 con 0x55e4d1187370 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33aa0e5740 10 client.0 _ll_register_callbacks cb 0x7f3398009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a5aa8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d118fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a5aa8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d118fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60342/0 (socket says 172.21.15.60:60342) 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a5aa8640 1 -- 172.21.15.60:0/4152758819 learned_addr learned my addr 172.21.15.60:0/4152758819 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a52a7640 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d118aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a62a9640 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d118b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a52a7640 1 -- 172.21.15.60:0/4152758819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 msgr2=0x55e4d118b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a52a7640 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d118b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a52a7640 1 -- 172.21.15.60:0/4152758819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 msgr2=0x55e4d118fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a52a7640 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d118fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a52a7640 1 -- 172.21.15.60:0/4152758819 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4d118bc20 con 0x55e4d117db40 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d118fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33a52a7640 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d118aee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3390009230 tx=0x7f3390032e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=587fa7cde7c64cec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.281+0000 7f33897fa640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33897fa640 1 -- 172.21.15.60:0/4152758819 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390035040 con 0x55e4d117db40 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 1 -- 172.21.15.60:0/4152758819 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f339c0973c0 con 0x55e4d117db40 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33897fa640 1 -- 172.21.15.60:0/4152758819 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f3390004240 con 0x55e4d117db40 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33897fa640 1 -- 172.21.15.60:0/4152758819 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3390053050 con 0x55e4d117db40 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 10 client.25427 fetch_fsmap learned FSMap version 29 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 1 -- 172.21.15.60:0/4152758819 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e4d1201720 con 0x55e4d117db40 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33897fa640 1 -- 172.21.15.60:0/4152758819 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f339c0973c0 con 0x55e4d117db40 2024-09-12T00:01:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33897fa640 1 -- 172.21.15.60:0/4152758819 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3390004a10 con 0x55e4d117db40 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 10 client.25427 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 10 client.25427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 20 client.25427 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e4d1201e90 0x55e4d12042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 4 client.25427 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33aa0e5740 1 -- 172.21.15.60:0/4152758819 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e4d10e9d70 con 0x55e4d1201e90 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.282+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e4d1201e90 0x55e4d12042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33a5aa8640 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e4d1201e90 0x55e4d12042b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3328bf3c23a3b31e server_cookie=d24b993379430b96 in_seq=0 out_seq=0 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33897fa640 10 client.25427 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33897fa640 1 -- 172.21.15.60:0/4152758819 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e4d10e9d70 con 0x55e4d1201e90 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33897fa640 10 client.25427 handle_command_reply: tid=0 2024-09-12T00:01:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 client.25427 shutdown 2024-09-12T00:01:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 -- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 msgr2=0x55e4d118aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d118aee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3390009230 tx=0x7f3390032e70 comp rx=0 tx=0).stop 2024-09-12T00:01:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 -- 172.21.15.60:0/4152758819 shutdown_connections 2024-09-12T00:01:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e4d1201e90 0x55e4d12042b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e4d1187370 0x55e4d118b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e4d117db40 0x55e4d118aee0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33897fa640 0 client.25427 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:01:02.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 --2- 172.21.15.60:0/4152758819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e4d117c5d0 0x55e4d118fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 -- 172.21.15.60:0/4152758819 >> 172.21.15.60:0/4152758819 conn(0x55e4d1145310 msgr2=0x55e4d11830f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:02.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 -- 172.21.15.60:0/4152758819 shutdown_connections 2024-09-12T00:01:02.316 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:01:02.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 1 -- 172.21.15.60:0/4152758819 wait complete. 2024-09-12T00:01:02.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.283+0000 7f33aa0e5740 20 client.25427 trim_cache size 0 max 16384 2024-09-12T00:01:02.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 -- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f338c0a2cf0 msgr2=0x7f338c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f338c0a2cf0 0x7f338c0a51b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3398005c40 tx=0x7f3398004a40 comp rx=0 tx=0).stop 2024-09-12T00:01:02.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 -- 172.21.15.60:0/1712113590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33a01008d0 msgr2=0x7f33a01a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:02.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33a01008d0 0x7f33a01a03f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f339c005fd0 tx=0x7f339c00dde0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 -- 172.21.15.60:0/1712113590 shutdown_connections 2024-09-12T00:01:02.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f338c0a2cf0 0x7f338c0a51b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33a010e480 0x7f33a019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33a0101280 0x7f33a01a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 --2- 172.21.15.60:0/1712113590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33a01008d0 0x7f33a01a03f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:02.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 -- 172.21.15.60:0/1712113590 >> 172.21.15.60:0/1712113590 conn(0x7f33a00fc7a0 msgr2=0x7f33a00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:02.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 -- 172.21.15.60:0/1712113590 shutdown_connections 2024-09-12T00:01:02.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:02.284+0000 7f33a7d0c640 1 -- 172.21.15.60:0/1712113590 wait complete. 2024-09-12T00:01:03.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:01:03.278 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:03.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:02 smithi192 ceph-mon[35487]: pgmap v53: 97 pgs: 97 active+clean; 92 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 7.7 MiB/s wr, 58 op/s 2024-09-12T00:01:03.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:02 smithi060 ceph-mon[30953]: pgmap v53: 97 pgs: 97 active+clean; 92 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 7.7 MiB/s wr, 58 op/s 2024-09-12T00:01:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:02 smithi105 ceph-mon[34805]: pgmap v53: 97 pgs: 97 active+clean; 92 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 781 KiB/s rd, 7.7 MiB/s wr, 58 op/s 2024-09-12T00:01:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 -- 172.21.15.60:0/666152190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff8102d30 msgr2=0x7f9ff8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/666152190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff8102d30 0x7f9ff8103110 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009930 tx=0x7f9fe802a420 comp rx=0 tx=0).stop 2024-09-12T00:01:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 -- 172.21.15.60:0/666152190 shutdown_connections 2024-09-12T00:01:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/666152190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ff81082a0 0x7f9ff810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/666152190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff81036e0 0x7f9ff8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/666152190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff8102d30 0x7f9ff8103110 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 -- 172.21.15.60:0/666152190 >> 172.21.15.60:0/666152190 conn(0x7f9ff80fc7d0 msgr2=0x7f9ff80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 -- 172.21.15.60:0/666152190 shutdown_connections 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.755+0000 7f9ffcb51640 1 -- 172.21.15.60:0/666152190 wait complete. 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ffcb51640 1 Processor -- start 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ffcb51640 1 -- start start 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ffcb51640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff8102d30 0x7f9ff8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ffcb51640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ff81036e0 0x7f9ff8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ffcb51640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff81082a0 0x7f9ff8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ffcb51640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81121c0 con 0x7f9ff81082a0 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ffcb51640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff8112040 con 0x7f9ff81036e0 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ffcb51640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff8112340 con 0x7f9ff8102d30 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff81082a0 0x7f9ff8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff8102d30 0x7f9ff8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff5d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ff81036e0 0x7f9ff8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff8102d30 0x7f9ff8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:38606/0 (socket says 172.21.15.60:38606) 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff659c640 1 -- 172.21.15.60:0/1288111738 learned_addr learned my addr 172.21.15.60:0/1288111738 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff6d9d640 1 -- 172.21.15.60:0/1288111738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff8102d30 msgr2=0x7f9ff8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff8102d30 0x7f9ff8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff6d9d640 1 -- 172.21.15.60:0/1288111738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ff81036e0 msgr2=0x7f9ff8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ff81036e0 0x7f9ff8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff6d9d640 1 -- 172.21.15.60:0/1288111738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff81a6b40 con 0x7f9ff81082a0 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.756+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ff81036e0 0x7f9ff8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.757+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff81082a0 0x7f9ff8101410 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000ca30 tx=0x7f9ff000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.757+0000 7f9fe77fe640 1 -- 172.21.15.60:0/1288111738 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0007d90 con 0x7f9ff81082a0 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.757+0000 7f9fe77fe640 1 -- 172.21.15.60:0/1288111738 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9ff0004b20 con 0x7f9ff81082a0 2024-09-12T00:01:03.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.757+0000 7f9ffcb51640 1 -- 172.21.15.60:0/1288111738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff81a6e30 con 0x7f9ff81082a0 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.757+0000 7f9fe77fe640 1 -- 172.21.15.60:0/1288111738 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000f810 con 0x7f9ff81082a0 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.757+0000 7f9ffcb51640 1 -- 172.21.15.60:0/1288111738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff81a72f0 con 0x7f9ff81082a0 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.759+0000 7f9fe77fe640 1 -- 172.21.15.60:0/1288111738 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9ff0004cd0 con 0x7f9ff81082a0 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.760+0000 7f9fe77fe640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9fe00a2cf0 0x7f9fe00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.760+0000 7f9fe77fe640 1 -- 172.21.15.60:0/1288111738 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9ff00cf5a0 con 0x7f9ff81082a0 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.760+0000 7f9ff659c640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9fe00a2cf0 0x7f9fe00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.760+0000 7f9ffef2a740 1 Processor -- start 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.760+0000 7f9ffef2a740 1 -- start start 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74e9a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9a5d0 0x555c74e9aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74ea7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555c74e002f0 con 0x555c74e9a5d0 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555c74da7cf0 con 0x555c74ea5370 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555c74dfc2b0 con 0x555c74e9bb40 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9fe00a2cf0 0x7f9fe00a51b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8000c00 tx=0x7f9fe8009560 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74e9a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9a5d0 0x555c74e9aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74e9a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:38612/0 (socket says 172.21.15.60:38612) 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9a5d0 0x555c74e9aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60374/0 (socket says 172.21.15.60:60374) 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 -- 172.21.15.60:0/859416357 learned_addr learned my addr 172.21.15.60:0/859416357 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74ea7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 -- 172.21.15.60:0/859416357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 msgr2=0x555c74ea7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74ea7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 -- 172.21.15.60:0/859416357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9a5d0 msgr2=0x555c74e9aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9a5d0 0x555c74e9aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 -- 172.21.15.60:0/859416357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c74d8c3a0 con 0x555c74e9bb40 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9a5d0 0x555c74e9aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.761+0000 7f9ff659c640 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74e9a090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8031980 tx=0x7f9fe803d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf21659956a7bc1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9fe4ff9640 1 -- 172.21.15.60:0/859416357 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe804d070 con 0x555c74e9bb40 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9fe4ff9640 1 -- 172.21.15.60:0/859416357 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fe8031a70 con 0x555c74e9bb40 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9fe4ff9640 1 -- 172.21.15.60:0/859416357 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8035040 con 0x555c74e9bb40 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9ffef2a740 1 -- 172.21.15.60:0/859416357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 msgr2=0x555c74e9a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74e9a090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8031980 tx=0x7f9fe803d000 comp rx=0 tx=0).stop 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9ffef2a740 1 -- 172.21.15.60:0/859416357 shutdown_connections 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74ea7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9a5d0 0x555c74e9aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/859416357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74e9a090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.762+0000 7f9ffef2a740 1 -- 172.21.15.60:0/859416357 >> 172.21.15.60:0/859416357 conn(0x555c74e63310 msgr2=0x555c74e96c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:03.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.763+0000 7f9ffef2a740 1 -- 172.21.15.60:0/859416357 shutdown_connections 2024-09-12T00:01:03.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.763+0000 7f9ffef2a740 1 -- 172.21.15.60:0/859416357 wait complete. 2024-09-12T00:01:03.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.763+0000 7f9ffef2a740 1 -- start start 2024-09-12T00:01:03.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.763+0000 7f9ffef2a740 1 Processor -- start 2024-09-12T00:01:03.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74ea1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74ea5370 0x555c74ea24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555c74ea8010 con 0x555c74e9bb40 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555c74dbb060 con 0x555c74e9a5d0 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555c74ea8190 con 0x555c74ea5370 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ffef2a740 10 client.0 _ll_register_callbacks cb 0x555c74b0e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74ea1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74ea1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60388/0 (socket says 172.21.15.60:60388) 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff5d9b640 1 -- 172.21.15.60:0/1138636215 learned_addr learned my addr 172.21.15.60:0/1138636215 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74ea5370 0x555c74ea24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff659c640 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff5d9b640 1 -- 172.21.15.60:0/1138636215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74ea5370 msgr2=0x555c74ea24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74ea5370 0x555c74ea24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff5d9b640 1 -- 172.21.15.60:0/1138636215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 msgr2=0x555c74ea4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff5d9b640 1 -- 172.21.15.60:0/1138636215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c74b713c0 con 0x555c74e9bb40 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.764+0000 7f9ff659c640 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74ea1f80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80697d0 tx=0x7f9fec011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8551a88b547d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9fddffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9fddffb640 1 -- 172.21.15.60:0/1138636215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec010c60 con 0x555c74e9bb40 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9fddffb640 1 -- 172.21.15.60:0/1138636215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9fec010e00 con 0x555c74e9bb40 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 1 -- 172.21.15.60:0/1138636215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe8031a70 con 0x555c74e9bb40 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9fddffb640 1 -- 172.21.15.60:0/1138636215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9fec005020 con 0x555c74e9bb40 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 10 client.15852 fetch_fsmap learned FSMap version 29 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 1 -- 172.21.15.60:0/1138636215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c74eb3a20 con 0x555c74e9bb40 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9fddffb640 1 -- 172.21.15.60:0/1138636215 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fe8031a70 con 0x555c74e9bb40 2024-09-12T00:01:03.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9fddffb640 1 -- 172.21.15.60:0/1138636215 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9fec023410 con 0x555c74e9bb40 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 10 client.15852 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 20 client.15852 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555c74eb4f30 0x555c74eb7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 4 client.15852 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.765+0000 7f9ffef2a740 1 -- 172.21.15.60:0/1138636215 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c74e0d860 con 0x555c74eb4f30 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.766+0000 7f9ff659c640 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555c74eb4f30 0x555c74eb7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.766+0000 7f9ff659c640 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555c74eb4f30 0x555c74eb7350 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=882a0c826090bc70 server_cookie=e32f4ecd6103696d in_seq=0 out_seq=0 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.766+0000 7f9fddffb640 10 client.15852 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.769+0000 7f9fddffb640 1 -- 172.21.15.60:0/1138636215 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c74e0d860 con 0x555c74eb4f30 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.769+0000 7f9fddffb640 10 client.15852 handle_command_reply: tid=0 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.769+0000 7f9ffef2a740 1 client.15852 shutdown 2024-09-12T00:01:03.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 -- 172.21.15.60:0/1138636215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 msgr2=0x555c74ea1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74ea1f80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80697d0 tx=0x7f9fec011c90 comp rx=0 tx=0).stop 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 -- 172.21.15.60:0/1138636215 shutdown_connections 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555c74eb4f30 0x555c74eb7350 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74ea5370 0x555c74ea24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74ea1f80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/1138636215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9fddffb640 0 client.15852 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 -- 172.21.15.60:0/1138636215 >> 172.21.15.60:0/1138636215 conn(0x555c74e63310 msgr2=0x555c74e9c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 -- 172.21.15.60:0/1138636215 shutdown_connections 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 1 -- 172.21.15.60:0/1138636215 wait complete. 2024-09-12T00:01:03.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.770+0000 7f9ffef2a740 20 client.15852 trim_cache size 0 max 16384 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ffef2a740 1 Processor -- start 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ffef2a740 1 -- start start 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9a5d0 0x555c74e95bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74e9d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74e9d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81afab0 con 0x555c74e9bb40 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81b15f0 con 0x555c74ea5370 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81b0180 con 0x555c74e9a5d0 2024-09-12T00:01:03.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ff5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74e9d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9a5d0 0x555c74e95bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ff5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74e9d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60400/0 (socket says 172.21.15.60:60400) 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.783+0000 7f9ff5d9b640 1 -- 172.21.15.60:0/2738340031 learned_addr learned my addr 172.21.15.60:0/2738340031 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74e9d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff5d9b640 1 -- 172.21.15.60:0/2738340031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9a5d0 msgr2=0x555c74e95bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9a5d0 0x555c74e95bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff5d9b640 1 -- 172.21.15.60:0/2738340031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 msgr2=0x555c74e9d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74e9d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff5d9b640 1 -- 172.21.15.60:0/2738340031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c74ea5040 con 0x555c74e9bb40 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74e9d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:03.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff659c640 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9a5d0 0x555c74e95bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:03.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74e9d120 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9fec023800 tx=0x7f9fec023d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5267a5415b87a48f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:03.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9fdffff640 1 -- 172.21.15.60:0/2738340031 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec030020 con 0x555c74e9bb40 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9fdffff640 1 -- 172.21.15.60:0/2738340031 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fec0233f0 con 0x555c74e9bb40 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.784+0000 7f9fdffff640 1 -- 172.21.15.60:0/2738340031 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec005440 con 0x555c74e9bb40 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 -- 172.21.15.60:0/2738340031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 msgr2=0x555c74e9d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74e9d120 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9fec023800 tx=0x7f9fec023d00 comp rx=0 tx=0).stop 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 -- 172.21.15.60:0/2738340031 shutdown_connections 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74ea5370 0x555c74e9d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74e9bb40 0x555c74e9d120 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/2738340031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9a5d0 0x555c74e95bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 -- 172.21.15.60:0/2738340031 >> 172.21.15.60:0/2738340031 conn(0x555c74e63310 msgr2=0x555c74e954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 -- 172.21.15.60:0/2738340031 shutdown_connections 2024-09-12T00:01:03.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 -- 172.21.15.60:0/2738340031 wait complete. 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 -- start start 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.785+0000 7f9ffef2a740 1 Processor -- start 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74ea9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ffef2a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74ea5370 0x555c74ea9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81b0f20 con 0x555c74ea5370 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81b0850 con 0x555c74e9a5d0 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ffef2a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff81ada90 con 0x555c74e9bb40 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ffef2a740 10 client.0 _ll_register_callbacks cb 0x7f9fec00bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74ea5370 0x555c74ea9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff5d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74ea9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74ea5370 0x555c74ea9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60416/0 (socket says 172.21.15.60:60416) 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 -- 172.21.15.60:0/673509122 learned_addr learned my addr 172.21.15.60:0/673509122 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 -- 172.21.15.60:0/673509122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 msgr2=0x555c74ea9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74ea9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 -- 172.21.15.60:0/673509122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 msgr2=0x555c74ea9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 -- 172.21.15.60:0/673509122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c74f1ebf0 con 0x555c74ea5370 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff5d9b640 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74ea9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff659c640 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9ff6d9d640 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74ea5370 0x555c74ea9bc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0004af0 tx=0x7f9ff009bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b894cb6b7f1d9a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9fddffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.786+0000 7f9fddffb640 1 -- 172.21.15.60:0/673509122 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00b9060 con 0x555c74ea5370 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9fddffb640 1 -- 172.21.15.60:0/673509122 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9ff0098230 con 0x555c74ea5370 2024-09-12T00:01:03.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 1 -- 172.21.15.60:0/673509122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fec0233f0 con 0x555c74ea5370 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9fddffb640 1 -- 172.21.15.60:0/673509122 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9ff00b3030 con 0x555c74ea5370 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 10 client.15858 fetch_fsmap learned FSMap version 29 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 1 -- 172.21.15.60:0/673509122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c74f1ff00 con 0x555c74ea5370 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9fddffb640 1 -- 172.21.15.60:0/673509122 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fec0233f0 con 0x555c74ea5370 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9fddffb640 1 -- 172.21.15.60:0/673509122 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9ff00ba250 con 0x555c74ea5370 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 10 client.15858 fetch_fsmap finished waiting for FSMap version 29 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 20 client.15858 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555c74f20620 0x555c74f22a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 4 client.15858 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ffef2a740 1 -- 172.21.15.60:0/673509122 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c74e07d70 con 0x555c74f20620 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.787+0000 7f9ff659c640 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555c74f20620 0x555c74f22a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.788+0000 7f9fddffb640 10 client.15858 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:03.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.788+0000 7f9ff659c640 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555c74f20620 0x555c74f22a10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe2321e1f0824825 server_cookie=103239f8622f3d99 in_seq=0 out_seq=0 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9fddffb640 1 -- 172.21.15.60:0/673509122 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c74e07d70 con 0x555c74f20620 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9fddffb640 10 client.15858 handle_command_reply: tid=0 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 client.15858 shutdown 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 -- 172.21.15.60:0/673509122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74ea5370 msgr2=0x555c74ea9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74ea5370 0x555c74ea9bc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0004af0 tx=0x7f9ff009bbc0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 -- 172.21.15.60:0/673509122 shutdown_connections 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555c74f20620 0x555c74f22a10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555c74ea5370 0x555c74ea9bc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555c74e9bb40 0x555c74ea9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 --2- 172.21.15.60:0/673509122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555c74e9a5d0 0x555c74ea9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 -- 172.21.15.60:0/673509122 >> 172.21.15.60:0/673509122 conn(0x555c74e63310 msgr2=0x555c74ea4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9fddffb640 0 client.15858 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 -- 172.21.15.60:0/673509122 shutdown_connections 2024-09-12T00:01:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 1 -- 172.21.15.60:0/673509122 wait complete. 2024-09-12T00:01:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.792+0000 7f9ffef2a740 20 client.15858 trim_cache size 0 max 16384 2024-09-12T00:01:03.794 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:01:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 -- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9fe00a2cf0 msgr2=0x7f9fe00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9fe00a2cf0 0x7f9fe00a51b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8000c00 tx=0x7f9fe8009560 comp rx=0 tx=0).stop 2024-09-12T00:01:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 -- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff81082a0 msgr2=0x7f9ff8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff81082a0 0x7f9ff8101410 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000ca30 tx=0x7f9ff000cef0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 -- 172.21.15.60:0/1288111738 shutdown_connections 2024-09-12T00:01:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9fe00a2cf0 0x7f9fe00a51b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ff81082a0 0x7f9ff8101410 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ff81036e0 0x7f9ff8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 --2- 172.21.15.60:0/1288111738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ff8102d30 0x7f9ff8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:03.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 -- 172.21.15.60:0/1288111738 >> 172.21.15.60:0/1288111738 conn(0x7f9ff80fc7d0 msgr2=0x7f9ff8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:03.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 -- 172.21.15.60:0/1288111738 shutdown_connections 2024-09-12T00:01:03.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:03.793+0000 7f9ffcb51640 1 -- 172.21.15.60:0/1288111738 wait complete. 2024-09-12T00:01:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:04 smithi192 ceph-mon[35487]: pgmap v54: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.0 MiB/s wr, 113 op/s 2024-09-12T00:01:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:04 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:04 smithi060 ceph-mon[30953]: pgmap v54: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.0 MiB/s wr, 113 op/s 2024-09-12T00:01:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:04 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:05.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:04 smithi105 ceph-mon[34805]: pgmap v54: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 8.0 MiB/s wr, 113 op/s 2024-09-12T00:01:05.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:04 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:05.580 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:01:05.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:01:05.841 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:06.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 -- 172.21.15.60:0/4089223252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102570 msgr2=0x7f8a841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/4089223252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102570 0x7f8a841029b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009900 tx=0x7f8a7402a480 comp rx=0 tx=0).stop 2024-09-12T00:01:06.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 -- 172.21.15.60:0/4089223252 shutdown_connections 2024-09-12T00:01:06.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/4089223252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a84102ef0 0x7f8a8410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/4089223252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102570 0x7f8a841029b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/4089223252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a84100e20 0x7f8a84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 -- 172.21.15.60:0/4089223252 >> 172.21.15.60:0/4089223252 conn(0x7f8a840fc7d0 msgr2=0x7f8a840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:06.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 -- 172.21.15.60:0/4089223252 shutdown_connections 2024-09-12T00:01:06.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 -- 172.21.15.60:0/4089223252 wait complete. 2024-09-12T00:01:06.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.287+0000 7f8a88b8d640 1 Processor -- start 2024-09-12T00:01:06.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a88b8d640 1 -- start start 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a88b8d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a84100e20 0x7f8a84198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a88b8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a84102570 0x7f8a84198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a88b8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102ef0 0x7f8a8419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a88b8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841110a0 con 0x7f8a84102ef0 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a88b8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84110f20 con 0x7f8a84102570 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a88b8d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84111220 con 0x7f8a84100e20 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a82d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102ef0 0x7f8a8419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a84100e20 0x7f8a84198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a82d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102ef0 0x7f8a8419cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60426/0 (socket says 172.21.15.60:60426) 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a84100e20 0x7f8a84198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:38646/0 (socket says 172.21.15.60:38646) 2024-09-12T00:01:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a82d9d640 1 -- 172.21.15.60:0/3362195538 learned_addr learned my addr 172.21.15.60:0/3362195538 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a84102570 0x7f8a84198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a8259c640 1 -- 172.21.15.60:0/3362195538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a84102570 msgr2=0x7f8a84198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a8259c640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a84102570 0x7f8a84198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a8259c640 1 -- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102ef0 msgr2=0x7f8a8419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a8259c640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102ef0 0x7f8a8419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a8259c640 1 -- 172.21.15.60:0/3362195538 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8419d600 con 0x7f8a84100e20 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.288+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102ef0 0x7f8a8419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.289+0000 7f8a8259c640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a84100e20 0x7f8a84198650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005fd0 tx=0x7f8a6c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.289+0000 7f8a7b7fe640 1 -- 172.21.15.60:0/3362195538 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c009c30 con 0x7f8a84100e20 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.289+0000 7f8a88b8d640 1 -- 172.21.15.60:0/3362195538 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8419d8f0 con 0x7f8a84100e20 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.289+0000 7f8a7b7fe640 1 -- 172.21.15.60:0/3362195538 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8a6c009dd0 con 0x7f8a84100e20 2024-09-12T00:01:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.289+0000 7f8a7b7fe640 1 -- 172.21.15.60:0/3362195538 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c010460 con 0x7f8a84100e20 2024-09-12T00:01:06.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.289+0000 7f8a88b8d640 1 -- 172.21.15.60:0/3362195538 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a841a51d0 con 0x7f8a84100e20 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.292+0000 7f8a7b7fe640 1 -- 172.21.15.60:0/3362195538 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8a6c004000 con 0x7f8a84100e20 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.292+0000 7f8a8af66740 1 Processor -- start 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.292+0000 7f8a8af66740 1 -- start start 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.292+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 0x558a8171be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.292+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.292+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a8af66740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558a81681280 con 0x558a8171c360 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a8af66740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a81628b10 con 0x558a8171ba40 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a8af66740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a8167d240 con 0x558a8172b150 2024-09-12T00:01:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60430/0 (socket says 172.21.15.60:60430) 2024-09-12T00:01:06.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a81d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a8259c640 1 -- 172.21.15.60:0/381156350 learned_addr learned my addr 172.21.15.60:0/381156350 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:06.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/381156350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 0x558a8171be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a81d9b640 1 -- 172.21.15.60:0/381156350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 msgr2=0x558a8171be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:06.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/381156350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 0x558a8171be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a7b7fe640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8a700a2cf0 0x7f8a700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a81d9b640 1 -- 172.21.15.60:0/381156350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 msgr2=0x558a8172ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:06.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/381156350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a81d9b640 1 -- 172.21.15.60:0/381156350 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a816351f0 con 0x558a8172b150 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8a700a2cf0 0x7f8a700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a7b7fe640 1 -- 172.21.15.60:0/3362195538 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8a6c0ceeb0 con 0x7f8a84100e20 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.293+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/381156350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172d540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a74005940 tx=0x7f8a74005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f58425f997b6617 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a78ff9640 1 -- 172.21.15.60:0/381156350 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74040070 con 0x558a8172b150 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a78ff9640 1 -- 172.21.15.60:0/381156350 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8a74031860 con 0x558a8172b150 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a78ff9640 1 -- 172.21.15.60:0/381156350 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74035040 con 0x558a8172b150 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a8af66740 1 -- 172.21.15.60:0/381156350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 msgr2=0x558a8172d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8a700a2cf0 0x7f8a700a51b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0049d0 tx=0x7f8a7c009500 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a8af66740 1 --2- 172.21.15.60:0/381156350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172d540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a74005940 tx=0x7f8a74005c00 comp rx=0 tx=0).stop 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a8af66740 1 -- 172.21.15.60:0/381156350 shutdown_connections 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a8af66740 1 --2- 172.21.15.60:0/381156350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172d540 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a8af66740 1 --2- 172.21.15.60:0/381156350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a8af66740 1 --2- 172.21.15.60:0/381156350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 0x558a8171be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.294+0000 7f8a8af66740 1 -- 172.21.15.60:0/381156350 >> 172.21.15.60:0/381156350 conn(0x558a817180f0 msgr2=0x558a817184d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 -- 172.21.15.60:0/381156350 shutdown_connections 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 -- 172.21.15.60:0/381156350 wait complete. 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 -- start start 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 Processor -- start 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a817280b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171c360 0x558a817285f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a81728b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558a8172dd20 con 0x558a8171ba40 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a8163bf10 con 0x558a8171c360 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a8172dea0 con 0x558a8172b150 2024-09-12T00:01:06.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8af66740 10 client.0 _ll_register_callbacks cb 0x558a81604a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a817280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a817280b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60432/0 (socket says 172.21.15.60:60432) 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a82d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a81728b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a8259c640 1 -- 172.21.15.60:0/246533100 learned_addr learned my addr 172.21.15.60:0/246533100 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.295+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171c360 0x558a817285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8259c640 1 -- 172.21.15.60:0/246533100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 msgr2=0x558a81728b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8259c640 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a81728b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8259c640 1 -- 172.21.15.60:0/246533100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171c360 msgr2=0x558a817285f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8259c640 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171c360 0x558a817285f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8259c640 1 -- 172.21.15.60:0/246533100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a813f26a0 con 0x558a8171ba40 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a81728b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8259c640 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a817280b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c097930 tx=0x7f8a6c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edf447c6c964547 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:06.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:06.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a69ffb640 1 -- 172.21.15.60:0/246533100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c020070 con 0x558a8171ba40 2024-09-12T00:01:06.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8af66740 1 -- 172.21.15.60:0/246533100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a74031860 con 0x558a8171ba40 2024-09-12T00:01:06.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a69ffb640 1 -- 172.21.15.60:0/246533100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8a6c097b40 con 0x558a8171ba40 2024-09-12T00:01:06.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a69ffb640 1 -- 172.21.15.60:0/246533100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8a6c09b2a0 con 0x558a8171ba40 2024-09-12T00:01:06.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8af66740 10 client.15870 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:06.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.296+0000 7f8a8af66740 1 -- 172.21.15.60:0/246533100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558a81739a30 con 0x558a8171ba40 2024-09-12T00:01:06.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a69ffb640 1 -- 172.21.15.60:0/246533100 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8a74031860 con 0x558a8171ba40 2024-09-12T00:01:06.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a69ffb640 1 -- 172.21.15.60:0/246533100 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f8a6c0042f0 con 0x558a8171ba40 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a8af66740 10 client.15870 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a8af66740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a8af66740 20 client.15870 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a8af66740 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a8173ae40 0x558a8173d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a8af66740 4 client.15870 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a8af66740 1 -- 172.21.15.60:0/246533100 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a8168e7f0 con 0x558a8173ae40 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a8173ae40 0x558a8173d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a8173ae40 0x558a8173d270 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef23716bc34c9301 server_cookie=d6c2593307d64e85 in_seq=0 out_seq=0 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.297+0000 7f8a69ffb640 10 client.15870 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a69ffb640 1 -- 172.21.15.60:0/246533100 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a8168e7f0 con 0x558a8173ae40 2024-09-12T00:01:06.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a69ffb640 10 client.15870 handle_command_reply: tid=0 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 client.15870 shutdown 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 -- 172.21.15.60:0/246533100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 msgr2=0x558a817280b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a817280b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c097930 tx=0x7f8a6c0035f0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 -- 172.21.15.60:0/246533100 shutdown_connections 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a8173ae40 0x558a8173d270 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a81728b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a69ffb640 0 client.15870 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171c360 0x558a817285f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 --2- 172.21.15.60:0/246533100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a817280b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 -- 172.21.15.60:0/246533100 >> 172.21.15.60:0/246533100 conn(0x558a817180f0 msgr2=0x558a8171de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 -- 172.21.15.60:0/246533100 shutdown_connections 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 1 -- 172.21.15.60:0/246533100 wait complete. 2024-09-12T00:01:06.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.300+0000 7f8a8af66740 20 client.15870 trim_cache size 0 max 16384 2024-09-12T00:01:06.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8af66740 1 Processor -- start 2024-09-12T00:01:06.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8af66740 1 -- start start 2024-09-12T00:01:06.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a81742b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8171c360 0x558a81743080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8172b150 0x558a81725310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8af66740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841ab650 con 0x558a8171ba40 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8af66740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841ad1c0 con 0x558a8172b150 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8af66740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841abd20 con 0x558a8171c360 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a81742b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a81742b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60434/0 (socket says 172.21.15.60:60434) 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8259c640 1 -- 172.21.15.60:0/2031583329 learned_addr learned my addr 172.21.15.60:0/2031583329 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8171c360 0x558a81743080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8172b150 0x558a81725310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8259c640 1 -- 172.21.15.60:0/2031583329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8171c360 msgr2=0x558a81743080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8259c640 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8171c360 0x558a81743080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8259c640 1 -- 172.21.15.60:0/2031583329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8172b150 msgr2=0x558a81725310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8259c640 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8172b150 0x558a81725310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a8259c640 1 -- 172.21.15.60:0/2031583329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8173d8f0 con 0x558a8171ba40 2024-09-12T00:01:06.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.318+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8172b150 0x558a81725310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:01:06.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.319+0000 7f8a8259c640 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a81742b40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c09b460 tx=0x7f8a6c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17595f057b9da2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:06.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.319+0000 7f8a6bfff640 1 -- 172.21.15.60:0/2031583329 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c020040 con 0x558a8171ba40 2024-09-12T00:01:06.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.319+0000 7f8a6bfff640 1 -- 172.21.15.60:0/2031583329 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8a6c0b8020 con 0x558a8171ba40 2024-09-12T00:01:06.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.319+0000 7f8a6bfff640 1 -- 172.21.15.60:0/2031583329 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c09ae30 con 0x558a8171ba40 2024-09-12T00:01:06.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.319+0000 7f8a8af66740 1 -- 172.21.15.60:0/2031583329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 msgr2=0x558a81742b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.319+0000 7f8a8af66740 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a81742b40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c09b460 tx=0x7f8a6c000bc0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 -- 172.21.15.60:0/2031583329 shutdown_connections 2024-09-12T00:01:06.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8172b150 0x558a81725310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8171c360 0x558a81743080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 --2- 172.21.15.60:0/2031583329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171ba40 0x558a81742b40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 -- 172.21.15.60:0/2031583329 >> 172.21.15.60:0/2031583329 conn(0x558a817180f0 msgr2=0x558a81717270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 -- 172.21.15.60:0/2031583329 shutdown_connections 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 -- 172.21.15.60:0/2031583329 wait complete. 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 -- start start 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 Processor -- start 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 0x558a8172edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841acac0 con 0x558a8171c360 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841ac3f0 con 0x558a8171ba40 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841a9630 con 0x558a8172b150 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a8af66740 10 client.0 _ll_register_callbacks cb 0x7f8a6c0039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:06.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a81d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.320+0000 7f8a81d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60450/0 (socket says 172.21.15.60:60450) 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a81d9b640 1 -- 172.21.15.60:0/1161838827 learned_addr learned my addr 172.21.15.60:0/1161838827 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a8259c640 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 0x558a8172edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a81d9b640 1 -- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 msgr2=0x558a8172f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a81d9b640 1 -- 172.21.15.60:0/1161838827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 msgr2=0x558a8172edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 0x558a8172edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a81d9b640 1 -- 172.21.15.60:0/1161838827 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a817a4b10 con 0x558a8171c360 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a82d9d640 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a81d9b640 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172f310 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8a74006010 tx=0x7f8a74005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecf955ea1723250 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:06.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a69ffb640 1 -- 172.21.15.60:0/1161838827 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74040070 con 0x558a8171c360 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a69ffb640 1 -- 172.21.15.60:0/1161838827 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8a74004230 con 0x558a8171c360 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a8af66740 1 -- 172.21.15.60:0/1161838827 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a6c0b8020 con 0x558a8171c360 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a69ffb640 1 -- 172.21.15.60:0/1161838827 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8a74035040 con 0x558a8171c360 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a8af66740 10 client.15876 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.321+0000 7f8a8af66740 1 -- 172.21.15.60:0/1161838827 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558a817a5d90 con 0x558a8171c360 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a69ffb640 1 -- 172.21.15.60:0/1161838827 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8a6c0b8020 con 0x558a8171c360 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a69ffb640 1 -- 172.21.15.60:0/1161838827 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f8a74058070 con 0x558a8171c360 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a8af66740 10 client.15876 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a8af66740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:06.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a8af66740 20 client.15876 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:06.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a8af66740 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a817a6120 0x558a817a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:06.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a8af66740 4 client.15876 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:01:06.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a8af66740 1 -- 172.21.15.60:0/1161838827 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558a81688d00 con 0x558a817a6120 2024-09-12T00:01:06.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a8259c640 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a817a6120 0x558a817a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:06.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a8259c640 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a817a6120 0x558a817a8540 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ca14ce450fb93c2 server_cookie=87fd2f3bde5d70bb in_seq=0 out_seq=0 2024-09-12T00:01:06.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.322+0000 7f8a69ffb640 10 client.15876 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a69ffb640 1 -- 172.21.15.60:0/1161838827 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558a81688d00 con 0x558a817a6120 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a69ffb640 10 client.15876 handle_command_reply: tid=0 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 client.15876 shutdown 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 -- 172.21.15.60:0/1161838827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 msgr2=0x558a8172f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172f310 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8a74006010 tx=0x7f8a74005560 comp rx=0 tx=0).stop 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 -- 172.21.15.60:0/1161838827 shutdown_connections 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a817a6120 0x558a817a8540 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8172b150 0x558a8172f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a8171c360 0x558a8172f310 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 --2- 172.21.15.60:0/1161838827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8171ba40 0x558a8172edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 -- 172.21.15.60:0/1161838827 >> 172.21.15.60:0/1161838827 conn(0x558a817180f0 msgr2=0x558a81728070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a69ffb640 0 client.15876 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 -- 172.21.15.60:0/1161838827 shutdown_connections 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.862+0000 7f8a8af66740 1 -- 172.21.15.60:0/1161838827 wait complete. 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a8af66740 20 client.15876 trim_cache size 0 max 16384 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "2798399d-a8c5-4638-b581-61cb6dc9da9b", 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:01:06.863 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:01:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 -- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8a700a2cf0 msgr2=0x7f8a700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8a700a2cf0 0x7f8a700a51b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0049d0 tx=0x7f8a7c009500 comp rx=0 tx=0).stop 2024-09-12T00:01:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 -- 172.21.15.60:0/3362195538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a84100e20 msgr2=0x7f8a84198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a84100e20 0x7f8a84198650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005fd0 tx=0x7f8a6c00dde0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 -- 172.21.15.60:0/3362195538 shutdown_connections 2024-09-12T00:01:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8a700a2cf0 0x7f8a700a51b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a84102ef0 0x7f8a8419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a84102570 0x7f8a84198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 --2- 172.21.15.60:0/3362195538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a84100e20 0x7f8a84198650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.863+0000 7f8a88b8d640 1 -- 172.21.15.60:0/3362195538 >> 172.21.15.60:0/3362195538 conn(0x7f8a840fc7d0 msgr2=0x7f8a8406a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.864+0000 7f8a88b8d640 1 -- 172.21.15.60:0/3362195538 shutdown_connections 2024-09-12T00:01:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:06.864+0000 7f8a88b8d640 1 -- 172.21.15.60:0/3362195538 wait complete. 2024-09-12T00:01:07.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:06 smithi192 ceph-mon[35487]: pgmap v55: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 707 KiB/s wr, 64 op/s 2024-09-12T00:01:07.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:06 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:01:07.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:06 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:07.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:06 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:07.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:06 smithi060 ceph-mon[30953]: pgmap v55: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 707 KiB/s wr, 64 op/s 2024-09-12T00:01:07.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:06 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:01:07.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:06 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:07.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:06 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:06 smithi105 ceph-mon[34805]: pgmap v55: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 707 KiB/s wr, 64 op/s 2024-09-12T00:01:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:06 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:01:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:06 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:06 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:07.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:01:08.066 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.528+0000 7f074c454640 1 -- 172.21.15.60:0/1180989934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744102d90 msgr2=0x7f0744103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.528+0000 7f074c454640 1 --2- 172.21.15.60:0/1180989934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744102d90 0x7f0744103170 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0740009930 tx=0x7f074002a420 comp rx=0 tx=0).stop 2024-09-12T00:01:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.528+0000 7f074c454640 1 -- 172.21.15.60:0/1180989934 shutdown_connections 2024-09-12T00:01:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.528+0000 7f074c454640 1 --2- 172.21.15.60:0/1180989934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0744108290 0x7f074410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.528+0000 7f074c454640 1 --2- 172.21.15.60:0/1180989934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0744103740 0x7f0744107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.528+0000 7f074c454640 1 --2- 172.21.15.60:0/1180989934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744102d90 0x7f0744103170 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.528+0000 7f074c454640 1 -- 172.21.15.60:0/1180989934 >> 172.21.15.60:0/1180989934 conn(0x7f07440fc7d0 msgr2=0x7f07440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:08.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.528+0000 7f074c454640 1 -- 172.21.15.60:0/1180989934 shutdown_connections 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 -- 172.21.15.60:0/1180989934 wait complete. 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 Processor -- start 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 -- start start 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0744102d90 0x7f0744198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744103740 0x7f0744198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0744108290 0x7f074419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0744112200 con 0x7f0744103740 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0744112080 con 0x7f0744108290 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.529+0000 7f074c454640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0744112380 con 0x7f0744102d90 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744103740 0x7f0744198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f074a9f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0744108290 0x7f074419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f074a1f0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0744102d90 0x7f0744198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744103740 0x7f0744198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60470/0 (socket says 172.21.15.60:60470) 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f074a9f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0744108290 0x7f074419cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56428/0 (socket says 172.21.15.60:56428) 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 -- 172.21.15.60:0/595932043 learned_addr learned my addr 172.21.15.60:0/595932043 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 -- 172.21.15.60:0/595932043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0744102d90 msgr2=0x7f0744198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0744102d90 0x7f0744198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 -- 172.21.15.60:0/595932043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0744108290 msgr2=0x7f074419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0744108290 0x7f074419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 -- 172.21.15.60:0/595932043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074419d5f0 con 0x7f0744103740 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f074a9f1640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0744108290 0x7f074419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f07499ef640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744103740 0x7f0744198b80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f073400e9c0 tx=0x7f073400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:08.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f073b7fe640 1 -- 172.21.15.60:0/595932043 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073400cd80 con 0x7f0744103740 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f074c454640 1 -- 172.21.15.60:0/595932043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074419d8e0 con 0x7f0744103740 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f073b7fe640 1 -- 172.21.15.60:0/595932043 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0734005520 con 0x7f0744103740 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f073b7fe640 1 -- 172.21.15.60:0/595932043 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0734010690 con 0x7f0744103740 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.530+0000 7f074c454640 1 -- 172.21.15.60:0/595932043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07441a51c0 con 0x7f0744103740 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f073b7fe640 1 -- 172.21.15.60:0/595932043 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f07340046c0 con 0x7f0744103740 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f074e82d740 1 Processor -- start 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f074e82d740 1 -- start start 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f074e82d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5267654a0 0x55e526765880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f074e82d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e526770140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f074e82d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526772a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f074e82d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e5266cb2e0 con 0x55e526765dc0 2024-09-12T00:01:08.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f074e82d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e526672ce0 con 0x55e5267654a0 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.533+0000 7f074e82d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e5266c72a0 con 0x55e526770680 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f073b7fe640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f07300a2cf0 0x7f07300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a1f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e526770140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5267654a0 0x55e526765880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a1f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e526770140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60476/0 (socket says 172.21.15.60:60476) 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a1f0640 1 -- 172.21.15.60:0/2815330543 learned_addr learned my addr 172.21.15.60:0/2815330543 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5267654a0 0x55e526765880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56438/0 (socket says 172.21.15.60:56438) 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f07499ef640 1 --2- 172.21.15.60:0/2815330543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526772a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f07300a2cf0 0x7f07300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 -- 172.21.15.60:0/2815330543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 msgr2=0x55e526772a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 --2- 172.21.15.60:0/2815330543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526772a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 -- 172.21.15.60:0/2815330543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 msgr2=0x55e526770140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 --2- 172.21.15.60:0/2815330543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e526770140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 -- 172.21.15.60:0/2815330543 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e526657440 con 0x55e5267654a0 2024-09-12T00:01:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f073b7fe640 1 -- 172.21.15.60:0/595932043 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f07340cf7a0 con 0x7f0744103740 2024-09-12T00:01:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 --2- 172.21.15.60:0/2815330543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5267654a0 0x55e526765880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f073c009fd0 tx=0x7f073c00f950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1934b038bf6876fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f074a9f1640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f07300a2cf0 0x7f07300a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f073c0099e0 tx=0x7f073c022000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.534+0000 7f0738dea640 1 -- 172.21.15.60:0/2815330543 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c011900 con 0x55e5267654a0 2024-09-12T00:01:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f0738dea640 1 -- 172.21.15.60:0/2815330543 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f073c023070 con 0x55e5267654a0 2024-09-12T00:01:08.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f0738dea640 1 -- 172.21.15.60:0/2815330543 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c005020 con 0x55e5267654a0 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 -- 172.21.15.60:0/2815330543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5267654a0 msgr2=0x55e526765880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 --2- 172.21.15.60:0/2815330543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5267654a0 0x55e526765880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f073c009fd0 tx=0x7f073c00f950 comp rx=0 tx=0).stop 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 -- 172.21.15.60:0/2815330543 shutdown_connections 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 --2- 172.21.15.60:0/2815330543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526772a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 --2- 172.21.15.60:0/2815330543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e526770140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 --2- 172.21.15.60:0/2815330543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5267654a0 0x55e526765880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 -- 172.21.15.60:0/2815330543 >> 172.21.15.60:0/2815330543 conn(0x55e526761a30 msgr2=0x55e526761e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 -- 172.21.15.60:0/2815330543 shutdown_connections 2024-09-12T00:01:08.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.535+0000 7f074e82d740 1 -- 172.21.15.60:0/2815330543 wait complete. 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 1 -- start start 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 1 Processor -- start 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e52676ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e52676d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e52676d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e526773250 con 0x55e5267654a0 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e526686050 con 0x55e526765dc0 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e5267733d0 con 0x55e526770680 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074e82d740 10 client.0 _ll_register_callbacks cb 0x55e5266c6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074a1f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e52676ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f07499ef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e52676d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074a9f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e52676d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f07499ef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e52676d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56452/0 (socket says 172.21.15.60:56452) 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f07499ef640 1 -- 172.21.15.60:0/3736182589 learned_addr learned my addr 172.21.15.60:0/3736182589 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.536+0000 7f074a1f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e52676ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60492/0 (socket says 172.21.15.60:60492) 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f074a9f1640 1 -- 172.21.15.60:0/3736182589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 msgr2=0x55e52676d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f074a9f1640 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e52676d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f074a9f1640 1 -- 172.21.15.60:0/3736182589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 msgr2=0x55e52676ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f074a9f1640 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e52676ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f074a9f1640 1 -- 172.21.15.60:0/3736182589 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e52643c3c0 con 0x55e526770680 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f074a9f1640 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e52676d7f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f073c005c10 tx=0x7f073c004c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18840592a53bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f072dffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f072dffb640 1 -- 172.21.15.60:0/3736182589 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c011900 con 0x55e526770680 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f074e82d740 1 -- 172.21.15.60:0/3736182589 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073c023070 con 0x55e526770680 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.537+0000 7f072dffb640 1 -- 172.21.15.60:0/3736182589 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f073c00e990 con 0x55e526770680 2024-09-12T00:01:08.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f072dffb640 1 -- 172.21.15.60:0/3736182589 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f073c011520 con 0x55e526770680 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074e82d740 10 client.25408 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074e82d740 1 -- 172.21.15.60:0/3736182589 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e52677ec70 con 0x55e526770680 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f072dffb640 1 -- 172.21.15.60:0/3736182589 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f073c023070 con 0x55e526770680 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f072dffb640 1 -- 172.21.15.60:0/3736182589 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f073c039600 con 0x55e526770680 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074e82d740 10 client.25408 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074e82d740 10 client.25408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074e82d740 20 client.25408 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074e82d740 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55e526780080 0x55e526782470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074e82d740 4 client.25408 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074e82d740 1 -- 172.21.15.60:0/3736182589 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5266d8850 con 0x55e526780080 2024-09-12T00:01:08.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.538+0000 7f074a1f0640 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55e526780080 0x55e526782470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.539+0000 7f074a1f0640 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55e526780080 0x55e526782470 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7de5b3b6ef89b7e server_cookie=ae25676dfabfef9e in_seq=0 out_seq=0 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.539+0000 7f072dffb640 10 client.25408 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f072dffb640 1 -- 172.21.15.60:0/3736182589 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e5266d8850 con 0x55e526780080 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f072dffb640 10 client.25408 handle_command_reply: tid=0 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 client.25408 shutdown 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 -- 172.21.15.60:0/3736182589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 msgr2=0x55e52676d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e52676d7f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f073c005c10 tx=0x7f073c004c60 comp rx=0 tx=0).stop 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 -- 172.21.15.60:0/3736182589 shutdown_connections 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55e526780080 0x55e526782470 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e52676d7f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e52676d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 --2- 172.21.15.60:0/3736182589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e52676ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 -- 172.21.15.60:0/3736182589 >> 172.21.15.60:0/3736182589 conn(0x55e526761a30 msgr2=0x55e526760b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f072dffb640 0 client.25408 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 -- 172.21.15.60:0/3736182589 shutdown_connections 2024-09-12T00:01:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.540+0000 7f074e82d740 1 -- 172.21.15.60:0/3736182589 wait complete. 2024-09-12T00:01:08.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.541+0000 7f074e82d740 20 client.25408 trim_cache size 0 max 16384 2024-09-12T00:01:08.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074e82d740 1 Processor -- start 2024-09-12T00:01:08.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074e82d740 1 -- start start 2024-09-12T00:01:08.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074e82d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e5267654a0 0x55e5267822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074e82d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e52676f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074e82d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526770680 0x55e526787bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074e82d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07441ab6d0 con 0x55e526765dc0 2024-09-12T00:01:08.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074e82d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07441ad240 con 0x55e526770680 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074e82d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f07441abda0 con 0x55e5267654a0 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f07499ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e52676f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f07499ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e52676f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60508/0 (socket says 172.21.15.60:60508) 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f07499ef640 1 -- 172.21.15.60:0/3021909946 learned_addr learned my addr 172.21.15.60:0/3021909946 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074a1f0640 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e5267654a0 0x55e5267822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f074a9f1640 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526770680 0x55e526787bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f07499ef640 1 -- 172.21.15.60:0/3021909946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e5267654a0 msgr2=0x55e5267822c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f07499ef640 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e5267654a0 0x55e5267822c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f07499ef640 1 -- 172.21.15.60:0/3021909946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526770680 msgr2=0x55e526787bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f07499ef640 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526770680 0x55e526787bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.558+0000 7f07499ef640 1 -- 172.21.15.60:0/3021909946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e526765bb0 con 0x55e526765dc0 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.559+0000 7f07499ef640 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e52676f200 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f073400c6a0 tx=0x7f07340d1c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc678dec7391da4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.559+0000 7f072ffff640 1 -- 172.21.15.60:0/3021909946 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073409b850 con 0x55e526765dc0 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.559+0000 7f072ffff640 1 -- 172.21.15.60:0/3021909946 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f073409c410 con 0x55e526765dc0 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.559+0000 7f072ffff640 1 -- 172.21.15.60:0/3021909946 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073409b670 con 0x55e526765dc0 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- 172.21.15.60:0/3021909946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 msgr2=0x55e52676f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e52676f200 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f073400c6a0 tx=0x7f07340d1c80 comp rx=0 tx=0).stop 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- 172.21.15.60:0/3021909946 shutdown_connections 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526770680 0x55e526787bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e526765dc0 0x55e52676f200 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 --2- 172.21.15.60:0/3021909946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e5267654a0 0x55e5267822c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- 172.21.15.60:0/3021909946 >> 172.21.15.60:0/3021909946 conn(0x55e526761a30 msgr2=0x55e52676eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- 172.21.15.60:0/3021909946 shutdown_connections 2024-09-12T00:01:08.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- 172.21.15.60:0/3021909946 wait complete. 2024-09-12T00:01:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- start start 2024-09-12T00:01:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 Processor -- start 2024-09-12T00:01:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e526778a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e526775dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526776300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07441acb40 con 0x55e5267654a0 2024-09-12T00:01:08.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07441ac470 con 0x55e526765dc0 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.560+0000 7f074e82d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f07441a96d0 con 0x55e526770680 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074e82d740 10 client.0 _ll_register_callbacks cb 0x7f0734005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074a1f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e526778a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074a9f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526776300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f07499ef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e526775dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074a9f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526776300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:38728/0 (socket says 172.21.15.60:38728) 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074a9f1640 1 -- 172.21.15.60:0/2956310966 learned_addr learned my addr 172.21.15.60:0/2956310966 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f07499ef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e526775dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56464/0 (socket says 172.21.15.60:56464) 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074a1f0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e526778a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60514/0 (socket says 172.21.15.60:60514) 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f07499ef640 1 -- 172.21.15.60:0/2956310966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 msgr2=0x55e526776300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f07499ef640 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526776300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f07499ef640 1 -- 172.21.15.60:0/2956310966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 msgr2=0x55e526778a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f07499ef640 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e526778a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f07499ef640 1 -- 172.21.15.60:0/2956310966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e526776840 con 0x55e526765dc0 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074a1f0640 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e526778a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074a9f1640 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526776300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f07499ef640 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e526775dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07340ccff0 tx=0x7f073409b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaa96ecd08afaa81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f072dffb640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f072dffb640 1 -- 172.21.15.60:0/2956310966 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07340b8030 con 0x55e526765dc0 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f072dffb640 1 -- 172.21.15.60:0/2956310966 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f07340a44f0 con 0x55e526765dc0 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074e82d740 1 -- 172.21.15.60:0/2956310966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073409c410 con 0x55e526765dc0 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f072dffb640 1 -- 172.21.15.60:0/2956310966 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f07340cd3d0 con 0x55e526765dc0 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.561+0000 7f074e82d740 10 client.25475 fetch_fsmap learned FSMap version 30 2024-09-12T00:01:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f074e82d740 1 -- 172.21.15.60:0/2956310966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e5267ea890 con 0x55e526765dc0 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f072dffb640 1 -- 172.21.15.60:0/2956310966 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f073409c410 con 0x55e526765dc0 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f072dffb640 1 -- 172.21.15.60:0/2956310966 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f073409b2f0 con 0x55e526765dc0 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f074e82d740 10 client.25475 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f074e82d740 10 client.25475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f074e82d740 20 client.25475 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f074e82d740 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55e5267eaf90 0x55e5267ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f074e82d740 4 client.25475 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f074e82d740 1 -- 172.21.15.60:0/2956310966 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e5267829a0 con 0x55e5267eaf90 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.562+0000 7f074a1f0640 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55e5267eaf90 0x55e5267ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.563+0000 7f072dffb640 10 client.25475 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.563+0000 7f074a1f0640 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55e5267eaf90 0x55e5267ed3b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d2ad9429b90d869 server_cookie=b54939d65fc642a6 in_seq=0 out_seq=0 2024-09-12T00:01:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f072dffb640 1 -- 172.21.15.60:0/2956310966 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55e5267829a0 con 0x55e5267eaf90 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f072dffb640 10 client.25475 handle_command_reply: tid=0 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 client.25475 shutdown 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 -- 172.21.15.60:0/2956310966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 msgr2=0x55e526775dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e526775dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07340ccff0 tx=0x7f073409b950 comp rx=0 tx=0).stop 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 -- 172.21.15.60:0/2956310966 shutdown_connections 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55e5267eaf90 0x55e5267ed3b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e526770680 0x55e526776300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e526765dc0 0x55e526775dc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f072dffb640 0 client.25475 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 --2- 172.21.15.60:0/2956310966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e5267654a0 0x55e526778a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 -- 172.21.15.60:0/2956310966 >> 172.21.15.60:0/2956310966 conn(0x55e526761a30 msgr2=0x55e52676f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 -- 172.21.15.60:0/2956310966 shutdown_connections 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 1 -- 172.21.15.60:0/2956310966 wait complete. 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.565+0000 7f074e82d740 20 client.25475 trim_cache size 0 max 16384 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "scrub active (493 inodes in the stack)", 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stdout: "2798399d-a8c5-4638-b581-61cb6dc9da9b": { 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "2798399d-a8c5-4638-b581-61cb6dc9da9b", 2024-09-12T00:01:08.570 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:01:08.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:08.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:08.571 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 -- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f07300a2cf0 msgr2=0x7f07300a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f07300a2cf0 0x7f07300a51b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f073c0099e0 tx=0x7f073c022000 comp rx=0 tx=0).stop 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 -- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744103740 msgr2=0x7f0744198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744103740 0x7f0744198b80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f073400e9c0 tx=0x7f073400ee80 comp rx=0 tx=0).stop 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 -- 172.21.15.60:0/595932043 shutdown_connections 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f07300a2cf0 0x7f07300a51b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0744108290 0x7f074419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0744103740 0x7f0744198b80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 --2- 172.21.15.60:0/595932043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0744102d90 0x7f0744198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 -- 172.21.15.60:0/595932043 >> 172.21.15.60:0/595932043 conn(0x7f07440fc7d0 msgr2=0x7f0744105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:08.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 -- 172.21.15.60:0/595932043 shutdown_connections 2024-09-12T00:01:08.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:08.566+0000 7f074c454640 1 -- 172.21.15.60:0/595932043 wait complete. 2024-09-12T00:01:09.265 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:08 smithi060 ceph-mon[30953]: pgmap v56: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 707 KiB/s wr, 64 op/s 2024-09-12T00:01:09.265 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:08 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:09.265 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:08 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:09.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:08 smithi192 ceph-mon[35487]: pgmap v56: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 707 KiB/s wr, 64 op/s 2024-09-12T00:01:09.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:08 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:09.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:08 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:09.292 INFO:tasks.cephfs.filesystem:scrub status for tag:2798399d-a8c5-4638-b581-61cb6dc9da9b - {'path': '/', 'tag': '2798399d-a8c5-4638-b581-61cb6dc9da9b', 'options': 'recursive,force'} 2024-09-12T00:01:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:08 smithi105 ceph-mon[34805]: pgmap v56: 97 pgs: 97 active+clean; 96 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 707 KiB/s wr, 64 op/s 2024-09-12T00:01:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:08 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:09.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:08 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:10.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.292 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.293 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.294 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.295 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.296 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.297 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.298 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.299 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:10.299 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:10 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:10.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.345 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.346 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.347 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.348 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.350 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.351 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.352 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:10.354 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:10 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:10.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.486 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.486 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.486 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.486 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.486 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.487 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.487 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.487 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.487 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.487 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.488 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.489 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.489 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.489 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.489 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.490 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.491 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.492 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.493 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.494 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.495 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.495 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.495 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.495 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.495 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.495 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.495 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.495 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.496 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.496 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.496 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.496 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.496 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.497 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.497 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.497 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.497 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.497 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.497 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.498 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.498 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.498 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.498 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.498 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.498 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.498 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.499 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.499 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.499 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.499 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.499 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.499 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.500 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.501 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.501 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.501 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.501 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.501 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.501 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.502 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.503 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.503 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.503 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.503 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.503 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.503 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:10.503 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:10.503 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:10 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:11.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:11 smithi192 ceph-mon[35487]: pgmap v57: 97 pgs: 97 active+clean; 108 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 74 op/s 2024-09-12T00:01:11.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:11 smithi060 ceph-mon[30953]: pgmap v57: 97 pgs: 97 active+clean; 108 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 74 op/s 2024-09-12T00:01:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:11 smithi105 ceph-mon[34805]: pgmap v57: 97 pgs: 97 active+clean; 108 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 74 op/s 2024-09-12T00:01:13.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:13 smithi192 ceph-mon[35487]: pgmap v58: 97 pgs: 97 active+clean; 108 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 64 op/s 2024-09-12T00:01:13.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:13 smithi060 ceph-mon[30953]: pgmap v58: 97 pgs: 97 active+clean; 108 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 64 op/s 2024-09-12T00:01:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:13 smithi105 ceph-mon[34805]: pgmap v58: 97 pgs: 97 active+clean; 108 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 64 op/s 2024-09-12T00:01:15.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:15 smithi192 ceph-mon[35487]: pgmap v59: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 81 op/s 2024-09-12T00:01:15.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:15 smithi060 ceph-mon[30953]: pgmap v59: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 81 op/s 2024-09-12T00:01:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:15 smithi105 ceph-mon[34805]: pgmap v59: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 81 op/s 2024-09-12T00:01:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:16.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:16 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:16.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:16 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:16.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:16.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:16 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:17 smithi192 ceph-mon[35487]: pgmap v60: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2024-09-12T00:01:18.644 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:17 smithi105 ceph-mon[34805]: pgmap v60: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2024-09-12T00:01:18.644 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:17 smithi060 ceph-mon[30953]: pgmap v60: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2024-09-12T00:01:19.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:19 smithi192 ceph-mon[35487]: pgmap v61: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2024-09-12T00:01:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:19 smithi060 ceph-mon[30953]: pgmap v61: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2024-09-12T00:01:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:19 smithi105 ceph-mon[34805]: pgmap v61: 97 pgs: 97 active+clean; 113 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 26 op/s 2024-09-12T00:01:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: pgmap v62: 97 pgs: 97 active+clean; 142 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 170 op/s 2024-09-12T00:01:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:21.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:21 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: pgmap v62: 97 pgs: 97 active+clean; 142 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 170 op/s 2024-09-12T00:01:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:21.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:21 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: pgmap v62: 97 pgs: 97 active+clean; 142 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 170 op/s 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:21.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:21 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:21.891 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-12T00:01:21.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:01:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.660+0000 7f5552168640 1 -- 172.21.15.60:0/1704464118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c1036c0 msgr2=0x7f554c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.660+0000 7f5552168640 1 --2- 172.21.15.60:0/1704464118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c1036c0 0x7f554c10bbb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5534009900 tx=0x7f553402a480 comp rx=0 tx=0).stop 2024-09-12T00:01:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 -- 172.21.15.60:0/1704464118 shutdown_connections 2024-09-12T00:01:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 --2- 172.21.15.60:0/1704464118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f554c10c180 0x7f554c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 --2- 172.21.15.60:0/1704464118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c1036c0 0x7f554c10bbb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 --2- 172.21.15.60:0/1704464118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f554c102da0 0x7f554c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 -- 172.21.15.60:0/1704464118 >> 172.21.15.60:0/1704464118 conn(0x7f554c0fc7a0 msgr2=0x7f554c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 -- 172.21.15.60:0/1704464118 shutdown_connections 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 -- 172.21.15.60:0/1704464118 wait complete. 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 Processor -- start 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.661+0000 7f5552168640 1 -- start start 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f5552168640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c102da0 0x7f554c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f5552168640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f554c1036c0 0x7f554c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f5552168640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f554c10c180 0x7f554c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f5552168640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f554c112080 con 0x7f554c102da0 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f5552168640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f554c111f00 con 0x7f554c1036c0 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f5552168640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f554c112200 con 0x7f554c10c180 2024-09-12T00:01:22.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c102da0 0x7f554c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c102da0 0x7f554c198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37736/0 (socket says 172.21.15.60:37736) 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 -- 172.21.15.60:0/3832071121 learned_addr learned my addr 172.21.15.60:0/3832071121 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f5543fff640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f554c1036c0 0x7f554c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554bfff640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f554c10c180 0x7f554c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 -- 172.21.15.60:0/3832071121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f554c10c180 msgr2=0x7f554c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f554c10c180 0x7f554c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 -- 172.21.15.60:0/3832071121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f554c1036c0 msgr2=0x7f554c198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f554c1036c0 0x7f554c198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 -- 172.21.15.60:0/3832071121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c19d4b0 con 0x7f554c102da0 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554bfff640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f554c10c180 0x7f554c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f554b7fe640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c102da0 0x7f554c198500 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f553c00e9f0 tx=0x7f553c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f55497fa640 1 -- 172.21.15.60:0/3832071121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c00cd80 con 0x7f554c102da0 2024-09-12T00:01:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554c19d7a0 con 0x7f554c102da0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f55497fa640 1 -- 172.21.15.60:0/3832071121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f553c005520 con 0x7f554c102da0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.662+0000 7f55497fa640 1 -- 172.21.15.60:0/3832071121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c010690 con 0x7f554c102da0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.663+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554c1a5080 con 0x7f554c102da0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.664+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554c103180 con 0x7f554c102da0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.665+0000 7f55497fa640 1 -- 172.21.15.60:0/3832071121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f553c0046c0 con 0x7f554c102da0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.665+0000 7f55497fa640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f55380a2cf0 0x7f55380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.666+0000 7f5543fff640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f55380a2cf0 0x7f55380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.666+0000 7f55497fa640 1 -- 172.21.15.60:0/3832071121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f553c0cf8c0 con 0x7f554c102da0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.666+0000 7f5543fff640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f55380a2cf0 0x7f55380a51b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5534009230 tx=0x7f55340058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:22.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.670+0000 7f55497fa640 1 -- 172.21.15.60:0/3832071121 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f553c09c530 con 0x7f554c102da0 2024-09-12T00:01:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.884+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f554c106c30 con 0x7f554c102da0 2024-09-12T00:01:22.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.885+0000 7f55497fa640 1 -- 172.21.15.60:0/3832071121 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11981 (secure 0 0 0) 0x7f553c09be30 con 0x7f554c102da0 2024-09-12T00:01:22.886 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:01:22.886 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"btime":"2024-09-12T00:01:08:996003+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:01:08.965786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:01:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 31 2024-09-12T00:01:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f55380a2cf0 msgr2=0x7f55380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f55380a2cf0 0x7f55380a51b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5534009230 tx=0x7f55340058d0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c102da0 msgr2=0x7f554c198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c102da0 0x7f554c198500 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f553c00e9f0 tx=0x7f553c00edf0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 shutdown_connections 2024-09-12T00:01:22.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f55380a2cf0 0x7f55380a51b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f554c10c180 0x7f554c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f554c1036c0 0x7f554c198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 --2- 172.21.15.60:0/3832071121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f554c102da0 0x7f554c198500 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 >> 172.21.15.60:0/3832071121 conn(0x7f554c0fc7a0 msgr2=0x7f554c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 shutdown_connections 2024-09-12T00:01:22.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:22.887+0000 7f5552168640 1 -- 172.21.15.60:0/3832071121 wait complete. 2024-09-12T00:01:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:23 smithi192 ceph-mon[35487]: pgmap v63: 97 pgs: 97 active+clean; 142 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-09-12T00:01:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:23 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3832071121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:23.297 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:23 smithi060 ceph-mon[30953]: pgmap v63: 97 pgs: 97 active+clean; 142 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-09-12T00:01:23.297 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:23 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3832071121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:23 smithi105 ceph-mon[34805]: pgmap v63: 97 pgs: 97 active+clean; 142 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 160 op/s 2024-09-12T00:01:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:23 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3832071121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:23.725 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24496 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-12T00:01:23.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24496 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-12T00:01:23.990 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:24.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 -- 172.21.15.60:0/954905978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc101de0 msgr2=0x7f78fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 --2- 172.21.15.60:0/954905978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc101de0 0x7f78fc1021c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009900 tx=0x7f78ec02a410 comp rx=0 tx=0).stop 2024-09-12T00:01:24.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 -- 172.21.15.60:0/954905978 shutdown_connections 2024-09-12T00:01:24.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 --2- 172.21.15.60:0/954905978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78fc106f10 0x7f78fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 --2- 172.21.15.60:0/954905978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78fc102790 0x7f78fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 --2- 172.21.15.60:0/954905978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc101de0 0x7f78fc1021c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 -- 172.21.15.60:0/954905978 >> 172.21.15.60:0/954905978 conn(0x7f78fc0fd8c0 msgr2=0x7f78fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 -- 172.21.15.60:0/954905978 shutdown_connections 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.640+0000 7f79019d8640 1 -- 172.21.15.60:0/954905978 wait complete. 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f79019d8640 1 Processor -- start 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f79019d8640 1 -- start start 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f79019d8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78fc101de0 0x7f78fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f79019d8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78fc102790 0x7f78fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f79019d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc106f10 0x7f78fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f79019d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc112050 con 0x7f78fc106f10 2024-09-12T00:01:24.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f79019d8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc111ed0 con 0x7f78fc102790 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f79019d8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1121d0 con 0x7f78fc101de0 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f78fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc106f10 0x7f78fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f78fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc106f10 0x7f78fc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37746/0 (socket says 172.21.15.60:37746) 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f78fb7fe640 1 -- 172.21.15.60:0/4044605187 learned_addr learned my addr 172.21.15.60:0/4044605187 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f78faffd640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78fc101de0 0x7f78fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.641+0000 7f78f3fff640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78fc102790 0x7f78fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f78fb7fe640 1 -- 172.21.15.60:0/4044605187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78fc101de0 msgr2=0x7f78fc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f78fb7fe640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78fc101de0 0x7f78fc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f78fb7fe640 1 -- 172.21.15.60:0/4044605187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78fc102790 msgr2=0x7f78fc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f78fb7fe640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78fc102790 0x7f78fc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f78fb7fe640 1 -- 172.21.15.60:0/4044605187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc1a6990 con 0x7f78fc106f10 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f78fb7fe640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc106f10 0x7f78fc074f70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f78f400eaa0 tx=0x7f78f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f79009d6640 1 -- 172.21.15.60:0/4044605187 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f400cdb0 con 0x7f78fc106f10 2024-09-12T00:01:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f79009d6640 1 -- 172.21.15.60:0/4044605187 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78f4004b20 con 0x7f78fc106f10 2024-09-12T00:01:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f79019d8640 1 -- 172.21.15.60:0/4044605187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78fc1a6c80 con 0x7f78fc106f10 2024-09-12T00:01:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f79009d6640 1 -- 172.21.15.60:0/4044605187 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4011760 con 0x7f78fc106f10 2024-09-12T00:01:24.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.642+0000 7f79019d8640 1 -- 172.21.15.60:0/4044605187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78fc1a71c0 con 0x7f78fc106f10 2024-09-12T00:01:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f7903db1740 1 Processor -- start 2024-09-12T00:01:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f79009d6640 1 -- 172.21.15.60:0/4044605187 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f78f4011900 con 0x7f78fc106f10 2024-09-12T00:01:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f7903db1740 1 -- start start 2024-09-12T00:01:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f7903db1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c2617eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f7903db1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c26189400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f7903db1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c2618bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f7903db1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559c260e42a0 con 0x559c2617f080 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f7903db1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559c2608bb10 con 0x559c26189940 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f7903db1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559c260e0260 con 0x559c2617e760 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f78faffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c26189400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f78f3fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c2617eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f78faffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c26189400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37750/0 (socket says 172.21.15.60:37750) 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f78faffd640 1 -- 172.21.15.60:0/2621976146 learned_addr learned my addr 172.21.15.60:0/2621976146 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f78f3fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c2617eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41180/0 (socket says 172.21.15.60:41180) 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.645+0000 7f78f3fff640 1 --2- 172.21.15.60:0/2621976146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c2618bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78faffd640 1 -- 172.21.15.60:0/2621976146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 msgr2=0x559c2617eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78faffd640 1 --2- 172.21.15.60:0/2621976146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c2617eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78faffd640 1 -- 172.21.15.60:0/2621976146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 msgr2=0x559c2618bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78faffd640 1 --2- 172.21.15.60:0/2621976146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c2618bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78faffd640 1 -- 172.21.15.60:0/2621976146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c25e55b90 con 0x559c2617f080 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78faffd640 1 --2- 172.21.15.60:0/2621976146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c26189400 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009900 tx=0x7f78ec005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e664fac645a1743 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f79009d6640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f78e80a2d70 0x7f78e80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78f3fff640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f78e80a2d70 0x7f78e80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78f1ffb640 1 -- 172.21.15.60:0/2621976146 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec040070 con 0x559c2617f080 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f79009d6640 1 -- 172.21.15.60:0/4044605187 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f78f40cf1f0 con 0x7f78fc106f10 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78f1ffb640 1 -- 172.21.15.60:0/2621976146 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78ec031a00 con 0x559c2617f080 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.646+0000 7f78f1ffb640 1 -- 172.21.15.60:0/2621976146 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec035040 con 0x559c2617f080 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 -- 172.21.15.60:0/2621976146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 msgr2=0x559c26189400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f78f3fff640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f78e80a2d70 0x7f78e80a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x559c2617c070 tx=0x7f78e4004730 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 --2- 172.21.15.60:0/2621976146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c26189400 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009900 tx=0x7f78ec005c00 comp rx=0 tx=0).stop 2024-09-12T00:01:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 -- 172.21.15.60:0/2621976146 shutdown_connections 2024-09-12T00:01:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 --2- 172.21.15.60:0/2621976146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c2618bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 --2- 172.21.15.60:0/2621976146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c26189400 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 --2- 172.21.15.60:0/2621976146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c2617eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 -- 172.21.15.60:0/2621976146 >> 172.21.15.60:0/2621976146 conn(0x559c2617acf0 msgr2=0x559c2617b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 -- 172.21.15.60:0/2621976146 shutdown_connections 2024-09-12T00:01:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 -- 172.21.15.60:0/2621976146 wait complete. 2024-09-12T00:01:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.647+0000 7f7903db1740 1 -- start start 2024-09-12T00:01:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f7903db1740 1 Processor -- start 2024-09-12T00:01:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f7903db1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26189400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f7903db1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f7903db1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c26186e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f7903db1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559c2618c510 con 0x559c2617f080 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f7903db1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559c2606c6e0 con 0x559c26189940 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f7903db1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559c2618c690 con 0x559c2617e760 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f7903db1740 10 client.0 _ll_register_callbacks cb 0x559c26090a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78f3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78faffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26189400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78faffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26189400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:41192/0 (socket says 172.21.15.60:41192) 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78f3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261866b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37752/0 (socket says 172.21.15.60:37752) 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78faffd640 1 -- 172.21.15.60:0/2259989347 learned_addr learned my addr 172.21.15.60:0/2259989347 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78fb7fe640 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c26186e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78f3fff640 1 -- 172.21.15.60:0/2259989347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 msgr2=0x559c26189400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78f3fff640 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26189400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78f3fff640 1 -- 172.21.15.60:0/2259989347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 msgr2=0x559c26186e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78f3fff640 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c26186e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78f3fff640 1 -- 172.21.15.60:0/2259989347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c261959b0 con 0x559c2617f080 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.648+0000 7f78faffd640 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26189400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.649+0000 7f78f3fff640 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261866b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f78e4013fd0 tx=0x7f78e400b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59e766b966a050f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.649+0000 7f78daffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.649+0000 7f78daffd640 1 -- 172.21.15.60:0/2259989347 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e4024070 con 0x559c2617f080 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.649+0000 7f78daffd640 1 -- 172.21.15.60:0/2259989347 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f78e4004030 con 0x559c2617f080 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.649+0000 7f7903db1740 1 -- 172.21.15.60:0/2259989347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78ec031a00 con 0x559c2617f080 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.649+0000 7f78daffd640 1 -- 172.21.15.60:0/2259989347 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f78e4004250 con 0x559c2617f080 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.649+0000 7f7903db1740 10 client.15912 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.649+0000 7f7903db1740 1 -- 172.21.15.60:0/2259989347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559c261982a0 con 0x559c2617f080 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f78daffd640 1 -- 172.21.15.60:0/2259989347 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78ec031a00 con 0x559c2617f080 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f78daffd640 1 -- 172.21.15.60:0/2259989347 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f78e401d040 con 0x559c2617f080 2024-09-12T00:01:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f7903db1740 10 client.15912 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f7903db1740 10 client.15912 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f7903db1740 20 client.15912 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f7903db1740 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c26199700 0x559c2619bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f7903db1740 4 client.15912 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f7903db1740 1 -- 172.21.15.60:0/2259989347 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c260f19d0 con 0x559c26199700 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.650+0000 7f78faffd640 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c26199700 0x559c2619bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.651+0000 7f78faffd640 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c26199700 0x559c2619bbc0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d906cfa338578f4 server_cookie=b21d671488420d51 in_seq=0 out_seq=0 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.651+0000 7f78daffd640 10 client.15912 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f78daffd640 1 -- 172.21.15.60:0/2259989347 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c260f19d0 con 0x559c26199700 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f78daffd640 10 client.15912 handle_command_reply: tid=0 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 client.15912 shutdown 2024-09-12T00:01:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 -- 172.21.15.60:0/2259989347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 msgr2=0x559c261866b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261866b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f78e4013fd0 tx=0x7f78e400b5f0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 -- 172.21.15.60:0/2259989347 shutdown_connections 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c26199700 0x559c2619bbc0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c26186e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261866b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 --2- 172.21.15.60:0/2259989347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26189400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f78daffd640 0 client.15912 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 -- 172.21.15.60:0/2259989347 >> 172.21.15.60:0/2259989347 conn(0x559c2617acf0 msgr2=0x559c26179e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 -- 172.21.15.60:0/2259989347 shutdown_connections 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 1 -- 172.21.15.60:0/2259989347 wait complete. 2024-09-12T00:01:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.652+0000 7f7903db1740 20 client.15912 trim_cache size 0 max 16384 2024-09-12T00:01:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f7903db1740 1 Processor -- start 2024-09-12T00:01:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f7903db1740 1 -- start start 2024-09-12T00:01:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f7903db1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c2617e760 0x559c261a1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f7903db1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617f080 0x559c261a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f7903db1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c26189940 0x559c26183910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f7903db1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1afa90 con 0x559c26189940 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f7903db1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1b1690 con 0x559c2617e760 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f7903db1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1b0160 con 0x559c2617f080 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c26189940 0x559c26183910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c26189940 0x559c26183910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37758/0 (socket says 172.21.15.60:37758) 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78fb7fe640 1 -- 172.21.15.60:0/2547059724 learned_addr learned my addr 172.21.15.60:0/2547059724 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78f3fff640 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617f080 0x559c261a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78faffd640 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c2617e760 0x559c261a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78fb7fe640 1 -- 172.21.15.60:0/2547059724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617f080 msgr2=0x559c261a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78fb7fe640 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617f080 0x559c261a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78fb7fe640 1 -- 172.21.15.60:0/2547059724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c2617e760 msgr2=0x559c261a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.673+0000 7f78fb7fe640 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c2617e760 0x559c261a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.674+0000 7f78fb7fe640 1 -- 172.21.15.60:0/2547059724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c2617eeb0 con 0x559c26189940 2024-09-12T00:01:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.674+0000 7f78fb7fe640 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c26189940 0x559c26183910 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f78f409b6f0 tx=0x7f78f40cf100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9edd301d1e3c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.674+0000 7f78f17fa640 1 -- 172.21.15.60:0/2547059724 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f40b9070 con 0x559c26189940 2024-09-12T00:01:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.674+0000 7f78f17fa640 1 -- 172.21.15.60:0/2547059724 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78f40a43d0 con 0x559c26189940 2024-09-12T00:01:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.674+0000 7f78f17fa640 1 -- 172.21.15.60:0/2547059724 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f401f040 con 0x559c26189940 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.674+0000 7f7903db1740 1 -- 172.21.15.60:0/2547059724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c26189940 msgr2=0x559c26183910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.674+0000 7f7903db1740 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c26189940 0x559c26183910 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f78f409b6f0 tx=0x7f78f40cf100 comp rx=0 tx=0).stop 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 -- 172.21.15.60:0/2547059724 shutdown_connections 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c26189940 0x559c26183910 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617f080 0x559c261a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 --2- 172.21.15.60:0/2547059724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c2617e760 0x559c261a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 -- 172.21.15.60:0/2547059724 >> 172.21.15.60:0/2547059724 conn(0x559c2617acf0 msgr2=0x559c261857a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 -- 172.21.15.60:0/2547059724 shutdown_connections 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 -- 172.21.15.60:0/2547059724 wait complete. 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 -- start start 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 Processor -- start 2024-09-12T00:01:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.675+0000 7f7903db1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26191b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f7903db1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261920d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f7903db1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c2618c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f7903db1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1b0f00 con 0x559c2617f080 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f7903db1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1b0830 con 0x559c26189940 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f7903db1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1ada70 con 0x559c2617e760 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f7903db1740 10 client.0 _ll_register_callbacks cb 0x7f78e400bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261920d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261920d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37770/0 (socket says 172.21.15.60:37770) 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 -- 172.21.15.60:0/3905934741 learned_addr learned my addr 172.21.15.60:0/3905934741 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78faffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26191b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78fb7fe640 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c2618c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 -- 172.21.15.60:0/3905934741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 msgr2=0x559c26191b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26191b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 -- 172.21.15.60:0/3905934741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 msgr2=0x559c2618c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c2618c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 -- 172.21.15.60:0/3905934741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c2618d160 con 0x559c2617f080 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78f3fff640 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261920d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f78e400ba30 tx=0x7f78e4012db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6d7d1efeb0dd06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78daffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78daffd640 1 -- 172.21.15.60:0/3905934741 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e403f060 con 0x559c2617f080 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f78daffd640 1 -- 172.21.15.60:0/3905934741 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f78e4003cd0 con 0x559c2617f080 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.676+0000 7f7903db1740 1 -- 172.21.15.60:0/3905934741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78f40a43d0 con 0x559c2617f080 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f78daffd640 1 -- 172.21.15.60:0/3905934741 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f78e4024070 con 0x559c2617f080 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f7903db1740 10 client.15918 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f7903db1740 1 -- 172.21.15.60:0/3905934741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559c26204fc0 con 0x559c2617f080 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f78daffd640 1 -- 172.21.15.60:0/3905934741 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f78f40a43d0 con 0x559c2617f080 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f78daffd640 1 -- 172.21.15.60:0/3905934741 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f78e4020560 con 0x559c2617f080 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f7903db1740 10 client.15918 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f7903db1740 10 client.15918 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f7903db1740 20 client.15918 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f7903db1740 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c262057e0 0x559c26207c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f7903db1740 4 client.15918 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f7903db1740 1 -- 172.21.15.60:0/3905934741 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x559c260ebd20 con 0x559c262057e0 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.677+0000 7f78faffd640 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c262057e0 0x559c26207c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.678+0000 7f78faffd640 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c262057e0 0x559c26207c00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95c626dfb161cd5 server_cookie=a549fda1a42fabeb in_seq=0 out_seq=0 2024-09-12T00:01:24.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:24.678+0000 7f78daffd640 10 client.15918 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:25.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: pgmap v64: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 379 op/s 2024-09-12T00:01:25.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.286 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.287 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.288 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:25.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:25 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: pgmap v64: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 379 op/s 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.344 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:25 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: pgmap v64: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 379 op/s 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.481 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.482 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.484 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:25.485 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:25 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:27.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:27 smithi060 ceph-mon[30953]: pgmap v65: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 362 op/s 2024-09-12T00:01:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:27 smithi105 ceph-mon[34805]: pgmap v65: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 362 op/s 2024-09-12T00:01:27.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:27 smithi192 ceph-mon[35487]: pgmap v65: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 362 op/s 2024-09-12T00:01:28.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f78daffd640 1 -- 172.21.15.60:0/3905934741 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559c260ebd20 con 0x559c262057e0 2024-09-12T00:01:28.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f78daffd640 10 client.15918 handle_command_reply: tid=0 2024-09-12T00:01:28.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 client.15918 shutdown 2024-09-12T00:01:28.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 -- 172.21.15.60:0/3905934741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 msgr2=0x559c261920d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:28.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261920d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f78e400ba30 tx=0x7f78e4012db0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 -- 172.21.15.60:0/3905934741 shutdown_connections 2024-09-12T00:01:28.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c262057e0 0x559c26207c00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c26189940 0x559c2618c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c2617f080 0x559c261920d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 --2- 172.21.15.60:0/3905934741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c2617e760 0x559c26191b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 -- 172.21.15.60:0/3905934741 >> 172.21.15.60:0/3905934741 conn(0x559c2617acf0 msgr2=0x559c261801b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f78daffd640 0 client.15918 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 -- 172.21.15.60:0/3905934741 shutdown_connections 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 1 -- 172.21.15.60:0/3905934741 wait complete. 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.330+0000 7f7903db1740 20 client.15918 trim_cache size 0 max 16384 2024-09-12T00:01:28.331 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 31, 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "leader": 24496, 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "set_version": 6, 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "sets": { 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "32c929c8": { 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "version": 6, 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "age_ref": 0.0, 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "QUIESCED", 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "timeout": 90.0, 2024-09-12T00:01:28.332 INFO:teuthology.orchestra.run.smithi060.stdout: "expiration": 133.4, 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: "members": { 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: "file:/": { 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: "excluded": false, 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "QUIESCED", 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:28.333 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:01:28.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 -- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f78e80a2d70 msgr2=0x7f78e80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:28.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f78e80a2d70 0x7f78e80a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x559c2617c070 tx=0x7f78e4004730 comp rx=0 tx=0).stop 2024-09-12T00:01:28.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 -- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc106f10 msgr2=0x7f78fc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:28.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc106f10 0x7f78fc074f70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f78f400eaa0 tx=0x7f78f400ef60 comp rx=0 tx=0).stop 2024-09-12T00:01:28.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 -- 172.21.15.60:0/4044605187 shutdown_connections 2024-09-12T00:01:28.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f78e80a2d70 0x7f78e80a5230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78fc106f10 0x7f78fc074f70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78fc102790 0x7f78fc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 --2- 172.21.15.60:0/4044605187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78fc101de0 0x7f78fc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:28.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 -- 172.21.15.60:0/4044605187 >> 172.21.15.60:0/4044605187 conn(0x7f78fc0fd8c0 msgr2=0x7f78fc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:28.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 -- 172.21.15.60:0/4044605187 shutdown_connections 2024-09-12T00:01:28.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:28.331+0000 7f79019d8640 1 -- 172.21.15.60:0/4044605187 wait complete. 2024-09-12T00:01:29.008 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '32c929c8', quiesce took 7.1 seconds. Will release after: 6.300000000000001 2024-09-12T00:01:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:29 smithi060 ceph-mon[30953]: pgmap v66: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 362 op/s 2024-09-12T00:01:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:29 smithi105 ceph-mon[34805]: pgmap v66: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 362 op/s 2024-09-12T00:01:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:29 smithi192 ceph-mon[35487]: pgmap v66: 97 pgs: 97 active+clean; 156 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.7 MiB/s wr, 362 op/s 2024-09-12T00:01:31.299 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:31 smithi105 ceph-mon[34805]: pgmap v67: 97 pgs: 97 active+clean; 185 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.5 MiB/s wr, 873 op/s 2024-09-12T00:01:31.300 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:31 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:01:31.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:31 smithi060 ceph-mon[30953]: pgmap v67: 97 pgs: 97 active+clean; 185 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.5 MiB/s wr, 873 op/s 2024-09-12T00:01:31.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:31 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:01:31.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:31 smithi192 ceph-mon[35487]: pgmap v67: 97 pgs: 97 active+clean; 185 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.5 MiB/s wr, 873 op/s 2024-09-12T00:01:31.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:31 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:01:32.526 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.527 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:01:32.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:01:32.528 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:01:32.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:01:32.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:32.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:01:32.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:01:32.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:01:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:33 smithi192 ceph-mon[35487]: pgmap v68: 97 pgs: 97 active+clean; 185 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 729 op/s 2024-09-12T00:01:33.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:33 smithi060 ceph-mon[30953]: pgmap v68: 97 pgs: 97 active+clean; 185 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 729 op/s 2024-09-12T00:01:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:33 smithi105 ceph-mon[34805]: pgmap v68: 97 pgs: 97 active+clean; 185 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.0 MiB/s wr, 729 op/s 2024-09-12T00:01:34.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:34 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:01:34.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:34 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:01:34.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:34 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:01:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:34 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:01:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:34 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:01:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:34 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:01:35.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:01:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:35 smithi192 ceph-mon[35487]: pgmap v69: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 800 op/s 2024-09-12T00:01:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:35 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:01:35.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:35 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:01:35.579 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:35.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:35 smithi060 ceph-mon[30953]: pgmap v69: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 800 op/s 2024-09-12T00:01:35.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:35 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:01:35.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:35 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:01:35.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:35 smithi105 ceph-mon[34805]: pgmap v69: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.5 MiB/s wr, 800 op/s 2024-09-12T00:01:35.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:35 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:01:35.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:35 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:01:36.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 -- 172.21.15.60:0/120939908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d18100e30 msgr2=0x7f9d18104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/120939908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d18100e30 0x7f9d18104e80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009900 tx=0x7f9d0802a410 comp rx=0 tx=0).stop 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 -- 172.21.15.60:0/120939908 shutdown_connections 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/120939908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d181055b0 0x7f9d1810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/120939908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d18100e30 0x7f9d18104e80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/120939908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d18100480 0x7f9d18100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 -- 172.21.15.60:0/120939908 >> 172.21.15.60:0/120939908 conn(0x7f9d18077210 msgr2=0x7f9d180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 -- 172.21.15.60:0/120939908 shutdown_connections 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.063+0000 7f9d1fc30640 1 -- 172.21.15.60:0/120939908 wait complete. 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1fc30640 1 Processor -- start 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1fc30640 1 -- start start 2024-09-12T00:01:36.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1fc30640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d18100480 0x7f9d18198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1fc30640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d18100e30 0x7f9d18198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1fc30640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d181055b0 0x7f9d1819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1fc30640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d181120d0 con 0x7f9d181055b0 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1fc30640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d18111f50 con 0x7f9d18100e30 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1fc30640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d18112250 con 0x7f9d18100480 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1e1cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d181055b0 0x7f9d1819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1d9cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d18100480 0x7f9d18198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1d1cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d18100e30 0x7f9d18198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1d9cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d18100480 0x7f9d18198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:47068/0 (socket says 172.21.15.60:47068) 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1e1cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d181055b0 0x7f9d1819ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56912/0 (socket says 172.21.15.60:56912) 2024-09-12T00:01:36.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.064+0000 7f9d1d9cc640 1 -- 172.21.15.60:0/1753415781 learned_addr learned my addr 172.21.15.60:0/1753415781 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1d1cb640 1 -- 172.21.15.60:0/1753415781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d18100480 msgr2=0x7f9d18198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1d1cb640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d18100480 0x7f9d18198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1d1cb640 1 -- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d181055b0 msgr2=0x7f9d1819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1d1cb640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d181055b0 0x7f9d1819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1d1cb640 1 -- 172.21.15.60:0/1753415781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1819d500 con 0x7f9d18100e30 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1e1cd640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d181055b0 0x7f9d1819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1d1cb640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d18100e30 0x7f9d18198a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005940 tx=0x7f9d080042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d0effd640 1 -- 172.21.15.60:0/1753415781 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0803f030 con 0x7f9d18100e30 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1819d790 con 0x7f9d18100e30 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d0effd640 1 -- 172.21.15.60:0/1753415781 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d08003d00 con 0x7f9d18100e30 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d0effd640 1 -- 172.21.15.60:0/1753415781 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08035070 con 0x7f9d18100e30 2024-09-12T00:01:36.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.065+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d181a50d0 con 0x7f9d18100e30 2024-09-12T00:01:36.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.066+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d18100860 con 0x7f9d18100e30 2024-09-12T00:01:36.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.068+0000 7f9d0effd640 1 -- 172.21.15.60:0/1753415781 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9d08042030 con 0x7f9d18100e30 2024-09-12T00:01:36.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.068+0000 7f9d0effd640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d040a2cf0 0x7f9d040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:36.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.068+0000 7f9d0effd640 1 -- 172.21.15.60:0/1753415781 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9d080efba0 con 0x7f9d18100e30 2024-09-12T00:01:36.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.068+0000 7f9d1d9cc640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d040a2cf0 0x7f9d040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:36.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.069+0000 7f9d1d9cc640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d040a2cf0 0x7f9d040a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d140058c0 tx=0x7f9d14005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:36.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.072+0000 7f9d0effd640 1 -- 172.21.15.60:0/1753415781 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d080bc160 con 0x7f9d18100e30 2024-09-12T00:01:36.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.283+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d181998b0 con 0x7f9d18100e30 2024-09-12T00:01:36.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.284+0000 7f9d0effd640 1 -- 172.21.15.60:0/1753415781 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11981 (secure 0 0 0) 0x7f9d080c0460 con 0x7f9d18100e30 2024-09-12T00:01:36.284 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:01:36.284 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"btime":"2024-09-12T00:01:08:996003+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:01:08.965786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:01:36.284 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 31 2024-09-12T00:01:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d040a2cf0 msgr2=0x7f9d040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d040a2cf0 0x7f9d040a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d140058c0 tx=0x7f9d14005f90 comp rx=0 tx=0).stop 2024-09-12T00:01:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d18100e30 msgr2=0x7f9d18198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d18100e30 0x7f9d18198a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005940 tx=0x7f9d080042f0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 shutdown_connections 2024-09-12T00:01:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d040a2cf0 0x7f9d040a51b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d181055b0 0x7f9d1819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d18100e30 0x7f9d18198a90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 --2- 172.21.15.60:0/1753415781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d18100480 0x7f9d18198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:36.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 >> 172.21.15.60:0/1753415781 conn(0x7f9d18077210 msgr2=0x7f9d181037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:36.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 shutdown_connections 2024-09-12T00:01:36.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:36.286+0000 7f9d1fc30640 1 -- 172.21.15.60:0/1753415781 wait complete. 2024-09-12T00:01:37.085 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24496 quiesce db --set-id 32c929c8 --release --await' 2024-09-12T00:01:37.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24496 quiesce db --set-id 32c929c8 --release --await 2024-09-12T00:01:37.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:37 smithi060 ceph-mon[30953]: pgmap v70: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 581 op/s 2024-09-12T00:01:37.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:37 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1753415781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:37.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:37 smithi192 ceph-mon[35487]: pgmap v70: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 581 op/s 2024-09-12T00:01:37.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:37 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1753415781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:37.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:37 smithi105 ceph-mon[34805]: pgmap v70: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 581 op/s 2024-09-12T00:01:37.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:37 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1753415781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:37.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 -- 172.21.15.60:0/1564334178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc102da0 msgr2=0x7f49dc103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 --2- 172.21.15.60:0/1564334178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc102da0 0x7f49dc103180 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009900 tx=0x7f49d802a480 comp rx=0 tx=0).stop 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 -- 172.21.15.60:0/1564334178 shutdown_connections 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 --2- 172.21.15.60:0/1564334178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49dc10c180 0x7f49dc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 --2- 172.21.15.60:0/1564334178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1036c0 0x7f49dc10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 --2- 172.21.15.60:0/1564334178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc102da0 0x7f49dc103180 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 -- 172.21.15.60:0/1564334178 >> 172.21.15.60:0/1564334178 conn(0x7f49dc0fc7a0 msgr2=0x7f49dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 -- 172.21.15.60:0/1564334178 shutdown_connections 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.916+0000 7f49e3904640 1 -- 172.21.15.60:0/1564334178 wait complete. 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e3904640 1 Processor -- start 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e3904640 1 -- start start 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e3904640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49dc102da0 0x7f49dc100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e3904640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1036c0 0x7f49dc100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e3904640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc10c180 0x7f49dc101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e3904640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc112080 con 0x7f49dc10c180 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e3904640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc111f00 con 0x7f49dc1036c0 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e3904640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc112200 con 0x7f49dc102da0 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e1ea1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc10c180 0x7f49dc101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e1ea1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc10c180 0x7f49dc101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56930/0 (socket says 172.21.15.60:56930) 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e1ea1640 1 -- 172.21.15.60:0/2308167427 learned_addr learned my addr 172.21.15.60:0/2308167427 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e16a0640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49dc102da0 0x7f49dc100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.917+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1036c0 0x7f49dc100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e1ea1640 1 -- 172.21.15.60:0/2308167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49dc102da0 msgr2=0x7f49dc100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e1ea1640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49dc102da0 0x7f49dc100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e1ea1640 1 -- 172.21.15.60:0/2308167427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1036c0 msgr2=0x7f49dc100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e1ea1640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1036c0 0x7f49dc100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e1ea1640 1 -- 172.21.15.60:0/2308167427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49dc1a69c0 con 0x7f49dc10c180 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1036c0 0x7f49dc100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e1ea1640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc10c180 0x7f49dc101480 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f49d400eaa0 tx=0x7f49d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49d27fc640 1 -- 172.21.15.60:0/2308167427 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d400cdb0 con 0x7f49dc10c180 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e3904640 1 -- 172.21.15.60:0/2308167427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49dc1a6cb0 con 0x7f49dc10c180 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49d27fc640 1 -- 172.21.15.60:0/2308167427 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49d4004b20 con 0x7f49dc10c180 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49d27fc640 1 -- 172.21.15.60:0/2308167427 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4011760 con 0x7f49dc10c180 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.918+0000 7f49e3904640 1 -- 172.21.15.60:0/2308167427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49dc1a71a0 con 0x7f49dc10c180 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.920+0000 7f49d27fc640 1 -- 172.21.15.60:0/2308167427 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f49d4004cd0 con 0x7f49dc10c180 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e5cdd740 1 Processor -- start 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e5cdd740 1 -- start start 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9ac440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9b9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55dbbb911620 con 0x55dbbb9ac980 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55dbbb8b8e50 con 0x55dbbb9ac060 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dbbb90d5e0 con 0x55dbbb9b7240 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e16a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49d27fc640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49c80a2cf0 0x7f49c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e16a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56942/0 (socket says 172.21.15.60:56942) 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e16a0640 1 -- 172.21.15.60:0/2862707602 learned_addr learned my addr 172.21.15.60:0/2862707602 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.921+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9b9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e1ea1640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49c80a2cf0 0x7f49c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49d27fc640 1 -- 172.21.15.60:0/2308167427 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f49d40cf660 con 0x7f49dc10c180 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e16a0640 1 -- 172.21.15.60:0/2862707602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 msgr2=0x55dbbb9b9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e16a0640 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9b9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e16a0640 1 -- 172.21.15.60:0/2862707602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 msgr2=0x55dbbb9ac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e16a0640 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9ac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e16a0640 1 -- 172.21.15.60:0/2862707602 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbbb8a9d40 con 0x55dbbb9ac980 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e16a0640 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b6d00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009900 tx=0x7f49d8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d036e69a47f8ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49e1ea1640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49c80a2cf0 0x7f49c80a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49d4097fd0 tx=0x7f49d400cf50 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49c77fe640 1 -- 172.21.15.60:0/2862707602 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8040070 con 0x55dbbb9ac980 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49c77fe640 1 -- 172.21.15.60:0/2862707602 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49d8031a00 con 0x55dbbb9ac980 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.922+0000 7f49c77fe640 1 -- 172.21.15.60:0/2862707602 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8035040 con 0x55dbbb9ac980 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 -- 172.21.15.60:0/2862707602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 msgr2=0x55dbbb9b6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b6d00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009900 tx=0x7f49d8005c00 comp rx=0 tx=0).stop 2024-09-12T00:01:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 -- 172.21.15.60:0/2862707602 shutdown_connections 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9b9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b6d00 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/2862707602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 -- 172.21.15.60:0/2862707602 >> 172.21.15.60:0/2862707602 conn(0x55dbbb9a85f0 msgr2=0x55dbbb9a89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 -- 172.21.15.60:0/2862707602 shutdown_connections 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 -- 172.21.15.60:0/2862707602 wait complete. 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 -- start start 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.923+0000 7f49e5cdd740 1 Processor -- start 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55dbbb9b9e10 con 0x55dbbb9ac980 2024-09-12T00:01:37.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55dbbb899f10 con 0x55dbbb9ac060 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dbbb9b9f90 con 0x55dbbb9b7240 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e5cdd740 10 client.0 _ll_register_callbacks cb 0x55dbbb8bddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56954/0 (socket says 172.21.15.60:56954) 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 -- 172.21.15.60:0/1384798561 learned_addr learned my addr 172.21.15.60:0/1384798561 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 -- 172.21.15.60:0/1384798561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 msgr2=0x55dbbb9b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 -- 172.21.15.60:0/1384798561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 msgr2=0x55dbbb9b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 -- 172.21.15.60:0/1384798561 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbbb620580 con 0x55dbbb9ac980 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49e16a0640 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b4560 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f49d80052d0 tx=0x7f49d8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760a18bbc9951bab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.924+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1384798561 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d804d060 con 0x55dbbb9ac980 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1384798561 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f49d8004260 con 0x55dbbb9ac980 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1384798561 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49d8031a00 con 0x55dbbb9ac980 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1384798561 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f49d8040070 con 0x55dbbb9ac980 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 10 client.15936 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1384798561 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dbbb6ea960 con 0x55dbbb9ac980 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1384798561 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49d8031a00 con 0x55dbbb9ac980 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1384798561 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f49d80039c0 con 0x55dbbb9ac980 2024-09-12T00:01:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 10 client.15936 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 10 client.15936 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 20 client.15936 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55dbbb9c6b70 0x55dbbb9c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 4 client.15936 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1384798561 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbbb91eb90 con 0x55dbbb9c6b70 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.925+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55dbbb9c6b70 0x55dbbb9c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.926+0000 7f49c4ff9640 10 client.15936 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.926+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55dbbb9c6b70 0x55dbbb9c8f60 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cecdd2fb1a7ef9c server_cookie=7056607fac5aded4 in_seq=0 out_seq=0 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.926+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1384798561 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dbbb91eb90 con 0x55dbbb9c6b70 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.926+0000 7f49c4ff9640 10 client.15936 handle_command_reply: tid=0 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.926+0000 7f49e5cdd740 1 client.15936 shutdown 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1384798561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 msgr2=0x55dbbb9b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b4560 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f49d80052d0 tx=0x7f49d8005d50 comp rx=0 tx=0).stop 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1384798561 shutdown_connections 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55dbbb9c6b70 0x55dbbb9c8f60 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac980 0x55dbbb9b4560 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49c4ff9640 0 client.15936 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1384798561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1384798561 >> 172.21.15.60:0/1384798561 conn(0x55dbbb9a85f0 msgr2=0x55dbbb9a7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1384798561 shutdown_connections 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1384798561 wait complete. 2024-09-12T00:01:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.927+0000 7f49e5cdd740 20 client.15936 trim_cache size 0 max 16384 2024-09-12T00:01:37.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.944+0000 7f49e5cdd740 1 Processor -- start 2024-09-12T00:01:37.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.944+0000 7f49e5cdd740 1 -- start start 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.944+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9a7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.944+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.944+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9b7240 0x55dbbb9cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.944+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc1af9f0 con 0x55dbbb9b7240 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.944+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc1b15f0 con 0x55dbbb9ac060 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.944+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc1b00c0 con 0x55dbbb9ac980 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9b7240 0x55dbbb9cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9b7240 0x55dbbb9cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56956/0 (socket says 172.21.15.60:56956) 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 -- 172.21.15.60:0/3703998574 learned_addr learned my addr 172.21.15.60:0/3703998574 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e16a0640 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 -- 172.21.15.60:0/3703998574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9ac980 msgr2=0x55dbbb9ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 -- 172.21.15.60:0/3703998574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 msgr2=0x55dbbb9a7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9a7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 -- 172.21.15.60:0/3703998574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbbb9a8420 con 0x55dbbb9b7240 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e16a0640 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9b7240 0x55dbbb9cebc0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55dbbb9a9970 tx=0x7f49cc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4615323b1b0debf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49c6ffd640 1 -- 172.21.15.60:0/3703998574 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc004020 con 0x55dbbb9b7240 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49c6ffd640 1 -- 172.21.15.60:0/3703998574 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49cc017070 con 0x55dbbb9b7240 2024-09-12T00:01:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.945+0000 7f49c6ffd640 1 -- 172.21.15.60:0/3703998574 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc005580 con 0x55dbbb9b7240 2024-09-12T00:01:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 -- 172.21.15.60:0/3703998574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9b7240 msgr2=0x55dbbb9cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9b7240 0x55dbbb9cebc0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55dbbb9a9970 tx=0x7f49cc005850 comp rx=0 tx=0).stop 2024-09-12T00:01:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 -- 172.21.15.60:0/3703998574 shutdown_connections 2024-09-12T00:01:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9b7240 0x55dbbb9cebc0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/3703998574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac060 0x55dbbb9a7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 -- 172.21.15.60:0/3703998574 >> 172.21.15.60:0/3703998574 conn(0x55dbbb9a85f0 msgr2=0x55dbbb9a6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 -- 172.21.15.60:0/3703998574 shutdown_connections 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.946+0000 7f49e5cdd740 1 -- 172.21.15.60:0/3703998574 wait complete. 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 1 -- start start 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 1 Processor -- start 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac060 0x55dbbb9bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ba1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9ba710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc1b0e60 con 0x55dbbb9ac060 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc1b0790 con 0x55dbbb9ac980 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc1ad9f0 con 0x55dbbb9b7240 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e5cdd740 10 client.0 _ll_register_callbacks cb 0x7f49d8031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e0e9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac060 0x55dbbb9bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e0e9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac060 0x55dbbb9bfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56964/0 (socket says 172.21.15.60:56964) 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.947+0000 7f49e0e9f640 1 -- 172.21.15.60:0/1825253206 learned_addr learned my addr 172.21.15.60:0/1825253206 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e16a0640 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ba1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e0e9f640 1 -- 172.21.15.60:0/1825253206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 msgr2=0x55dbbb9ba710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9ba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e0e9f640 1 -- 172.21.15.60:0/1825253206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac980 msgr2=0x55dbbb9ba1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ba1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e0e9f640 1 -- 172.21.15.60:0/1825253206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbbb9a9130 con 0x55dbbb9ac060 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e0e9f640 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac060 0x55dbbb9bfa00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f49cc005d00 tx=0x7f49cc012470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea508bc372d1337f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1825253206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc004220 con 0x55dbbb9ac060 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1825253206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f49cc0043c0 con 0x55dbbb9ac060 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1825253206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49cc017070 con 0x55dbbb9ac060 2024-09-12T00:01:37.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1825253206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f49cc037050 con 0x55dbbb9ac060 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e5cdd740 10 client.15942 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1825253206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dbbba32520 con 0x55dbbb9ac060 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.948+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1825253206 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49cc017070 con 0x55dbbb9ac060 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1825253206 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f49cc00f040 con 0x55dbbb9ac060 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49e5cdd740 10 client.15942 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49e5cdd740 10 client.15942 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49e5cdd740 20 client.15942 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55dbbba32c40 0x55dbbba35060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49e5cdd740 4 client.15942 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "32c929c8", "release": true, "await": true}] 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1825253206 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "quiesce db", "set_id": "32c929c8", "release": true, "await": true}) -- 0x55dbbb9a3950 con 0x55dbbba32c40 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49e16a0640 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55dbbba32c40 0x55dbbba35060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:37.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49c4ff9640 10 client.15942 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:37.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:37.949+0000 7f49e16a0640 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55dbbba32c40 0x55dbbba35060 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea6dbf636cacffdd server_cookie=d3df21bdecc764bd in_seq=0 out_seq=0 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49c4ff9640 1 -- 172.21.15.60:0/1825253206 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55dbbb9a3950 con 0x55dbbba32c40 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49c4ff9640 10 client.15942 handle_command_reply: tid=0 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 client.15942 shutdown 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1825253206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac060 msgr2=0x55dbbb9bfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac060 0x55dbbb9bfa00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f49cc005d00 tx=0x7f49cc012470 comp rx=0 tx=0).stop 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1825253206 shutdown_connections 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55dbbba32c40 0x55dbbba35060 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dbbb9b7240 0x55dbbb9ba710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55dbbb9ac980 0x55dbbb9ba1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49c4ff9640 0 client.15942 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 --2- 172.21.15.60:0/1825253206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55dbbb9ac060 0x55dbbb9bfa00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1825253206 >> 172.21.15.60:0/1825253206 conn(0x55dbbb9a85f0 msgr2=0x55dbbb9b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1825253206 shutdown_connections 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.053+0000 7f49e5cdd740 1 -- 172.21.15.60:0/1825253206 wait complete. 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e5cdd740 20 client.15942 trim_cache size 0 max 16384 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 31, 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stdout: "leader": 24496, 2024-09-12T00:01:38.055 INFO:teuthology.orchestra.run.smithi060.stdout: "set_version": 8, 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "sets": { 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "32c929c8": { 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "version": 8, 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "age_ref": 0.0, 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RELEASED", 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "timeout": 90.0, 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "expiration": 133.4, 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "members": { 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "file:/": { 2024-09-12T00:01:38.056 INFO:teuthology.orchestra.run.smithi060.stdout: "excluded": false, 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RELEASED", 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:38.057 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 -- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49c80a2cf0 msgr2=0x7f49c80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49c80a2cf0 0x7f49c80a51b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49d4097fd0 tx=0x7f49d400cf50 comp rx=0 tx=0).stop 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 -- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc10c180 msgr2=0x7f49dc101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc10c180 0x7f49dc101480 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f49d400eaa0 tx=0x7f49d400ef60 comp rx=0 tx=0).stop 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 -- 172.21.15.60:0/2308167427 shutdown_connections 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49c80a2cf0 0x7f49c80a51b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49dc10c180 0x7f49dc101480 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1036c0 0x7f49dc100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 --2- 172.21.15.60:0/2308167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49dc102da0 0x7f49dc100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 -- 172.21.15.60:0/2308167427 >> 172.21.15.60:0/2308167427 conn(0x7f49dc0fc7a0 msgr2=0x7f49dc0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 -- 172.21.15.60:0/2308167427 shutdown_connections 2024-09-12T00:01:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:38.054+0000 7f49e3904640 1 -- 172.21.15.60:0/2308167427 wait complete. 2024-09-12T00:01:38.955 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '32c929c8', total seconds elapsed: 17.1 2024-09-12T00:01:39.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:01:39.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:39 smithi192 ceph-mon[35487]: pgmap v71: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 581 op/s 2024-09-12T00:01:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:39 smithi060 ceph-mon[30953]: pgmap v71: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 581 op/s 2024-09-12T00:01:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:39 smithi105 ceph-mon[34805]: pgmap v71: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 581 op/s 2024-09-12T00:01:40.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.160+0000 7f47ed121640 1 -- 172.21.15.60:0/1530778316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 msgr2=0x7f47e8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.160+0000 7f47ed121640 1 --2- 172.21.15.60:0/1530778316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 0x7f47e8103120 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009900 tx=0x7f47d002a480 comp rx=0 tx=0).stop 2024-09-12T00:01:40.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.161+0000 7f47ed121640 1 -- 172.21.15.60:0/1530778316 shutdown_connections 2024-09-12T00:01:40.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.161+0000 7f47ed121640 1 --2- 172.21.15.60:0/1530778316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47e810c170 0x7f47e810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.161+0000 7f47ed121640 1 --2- 172.21.15.60:0/1530778316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47e8103660 0x7f47e810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.161+0000 7f47ed121640 1 --2- 172.21.15.60:0/1530778316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 0x7f47e8103120 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.161+0000 7f47ed121640 1 -- 172.21.15.60:0/1530778316 >> 172.21.15.60:0/1530778316 conn(0x7f47e80fc7a0 msgr2=0x7f47e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.161+0000 7f47ed121640 1 -- 172.21.15.60:0/1530778316 shutdown_connections 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.161+0000 7f47ed121640 1 -- 172.21.15.60:0/1530778316 wait complete. 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.161+0000 7f47ed121640 1 Processor -- start 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47ed121640 1 -- start start 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47ed121640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 0x7f47e81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47ed121640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47e8103660 0x7f47e8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47ed121640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47e810c170 0x7f47e819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47ed121640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47e8112090 con 0x7f47e8102d40 2024-09-12T00:01:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47ed121640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47e8111f10 con 0x7f47e8103660 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47ed121640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47e8112210 con 0x7f47e810c170 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 0x7f47e81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 0x7f47e81985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56996/0 (socket says 172.21.15.60:56996) 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e6d9d640 1 -- 172.21.15.60:0/2489233645 learned_addr learned my addr 172.21.15.60:0/2489233645 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47dffff640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47e8103660 0x7f47e8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e759e640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47e810c170 0x7f47e819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e6d9d640 1 -- 172.21.15.60:0/2489233645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47e810c170 msgr2=0x7f47e819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47e810c170 0x7f47e819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e6d9d640 1 -- 172.21.15.60:0/2489233645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47e8103660 msgr2=0x7f47e8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47e8103660 0x7f47e8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47e6d9d640 1 -- 172.21.15.60:0/2489233645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e819d560 con 0x7f47e8102d40 2024-09-12T00:01:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.162+0000 7f47dffff640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47e8103660 0x7f47e8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.163+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 0x7f47e81985b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f47d0006010 tx=0x7f47d00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.163+0000 7f47e4d99640 1 -- 172.21.15.60:0/2489233645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d003f030 con 0x7f47e8102d40 2024-09-12T00:01:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.163+0000 7f47ed121640 1 -- 172.21.15.60:0/2489233645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e819d7f0 con 0x7f47e8102d40 2024-09-12T00:01:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.163+0000 7f47e4d99640 1 -- 172.21.15.60:0/2489233645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47d00044c0 con 0x7f47e8102d40 2024-09-12T00:01:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.163+0000 7f47e4d99640 1 -- 172.21.15.60:0/2489233645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0035070 con 0x7f47e8102d40 2024-09-12T00:01:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.163+0000 7f47ed121640 1 -- 172.21.15.60:0/2489233645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e81a5130 con 0x7f47e8102d40 2024-09-12T00:01:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.165+0000 7f47e4d99640 1 -- 172.21.15.60:0/2489233645 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f47d0042030 con 0x7f47e8102d40 2024-09-12T00:01:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.165+0000 7f47ef4fa740 1 Processor -- start 2024-09-12T00:01:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47ef4fa740 1 -- start start 2024-09-12T00:01:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3ed380 0x5646fa3ed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3fc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3fca90 0x5646fa3fee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5646fa3532e0 con 0x5646fa3ed380 2024-09-12T00:01:40.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5646fa2face0 con 0x5646fa3edca0 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5646fa34f2a0 con 0x5646fa3fca90 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47e759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3ed380 0x5646fa3ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47e6d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47e759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3ed380 0x5646fa3ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57010/0 (socket says 172.21.15.60:57010) 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47dffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3fca90 0x5646fa3fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.166+0000 7f47e759e640 1 -- 172.21.15.60:0/1780522590 learned_addr learned my addr 172.21.15.60:0/1780522590 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47e4d99640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47d40a2cf0 0x7f47d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dffff640 1 -- 172.21.15.60:0/1780522590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 msgr2=0x5646fa3fc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dffff640 1 --2- 172.21.15.60:0/1780522590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3fc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dffff640 1 -- 172.21.15.60:0/1780522590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3ed380 msgr2=0x5646fa3ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dffff640 1 --2- 172.21.15.60:0/1780522590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3ed380 0x5646fa3ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dffff640 1 -- 172.21.15.60:0/1780522590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646fa2df440 con 0x5646fa3fca90 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47e759e640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47d40a2cf0 0x7f47d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47e4d99640 1 -- 172.21.15.60:0/2489233645 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f47d00ef720 con 0x7f47e8102d40 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dffff640 1 --2- 172.21.15.60:0/1780522590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3fca90 0x5646fa3fee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009f90 tx=0x7f47d80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fba123a8b1d79e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dd7fa640 1 -- 172.21.15.60:0/1780522590 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8004310 con 0x5646fa3fca90 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dd7fa640 1 -- 172.21.15.60:0/1780522590 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47d80044b0 con 0x5646fa3fca90 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47dd7fa640 1 -- 172.21.15.60:0/1780522590 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8003850 con 0x5646fa3fca90 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.167+0000 7f47e759e640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47d40a2cf0 0x7f47d40a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47e0013620 tx=0x7f47e0004a40 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1780522590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3fca90 msgr2=0x5646fa3fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1780522590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3fca90 0x5646fa3fee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009f90 tx=0x7f47d80118d0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1780522590 shutdown_connections 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1780522590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3fca90 0x5646fa3fee80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1780522590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3fc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1780522590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3ed380 0x5646fa3ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1780522590 >> 172.21.15.60:0/1780522590 conn(0x5646fa3e9a30 msgr2=0x5646fa3e9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1780522590 shutdown_connections 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.168+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1780522590 wait complete. 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 1 -- start start 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 1 Processor -- start 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3fc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3f9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3fca90 0x5646fa3f9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5646fa3ff660 con 0x5646fa3fca90 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5646fa30e050 con 0x5646fa3edca0 2024-09-12T00:01:40.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5646fa3ff7e0 con 0x5646fa3ed380 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47ef4fa740 10 client.0 _ll_register_callbacks cb 0x5646fa34e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47dffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47e6d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47dffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3f9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56498/0 (socket says 172.21.15.60:56498) 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47dffff640 1 -- 172.21.15.60:0/4205643179 learned_addr learned my addr 172.21.15.60:0/4205643179 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.169+0000 7f47e759e640 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3fca90 0x5646fa3f9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47dffff640 1 -- 172.21.15.60:0/4205643179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 msgr2=0x5646fa3fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47dffff640 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3fc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47dffff640 1 -- 172.21.15.60:0/4205643179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3fca90 msgr2=0x5646fa3f9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47dffff640 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3fca90 0x5646fa3f9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47dffff640 1 -- 172.21.15.60:0/4205643179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646fa0c43c0 con 0x5646fa3edca0 2024-09-12T00:01:40.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47e759e640 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3fca90 0x5646fa3f9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47dffff640 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3f9680 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47d8011dd0 tx=0x7f47d80048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f17632c04826f6f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47ce7fc640 1 -- 172.21.15.60:0/4205643179 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8029070 con 0x5646fa3edca0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47ce7fc640 1 -- 172.21.15.60:0/4205643179 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f47d80052c0 con 0x5646fa3edca0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4205643179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d80044b0 con 0x5646fa3edca0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47ce7fc640 1 -- 172.21.15.60:0/4205643179 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f47d80054c0 con 0x5646fa3edca0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47ef4fa740 10 client.25529 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.170+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4205643179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5646fa40b050 con 0x5646fa3edca0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47ce7fc640 1 -- 172.21.15.60:0/4205643179 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47d8035070 con 0x5646fa3edca0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47ce7fc640 1 -- 172.21.15.60:0/4205643179 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f47d800f590 con 0x5646fa3edca0 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47ef4fa740 10 client.25529 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:40.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47ef4fa740 10 client.25529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47ef4fa740 20 client.25529 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5646fa40c450 0x5646fa40e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47ef4fa740 4 client.25529 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4205643179 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646fa360850 con 0x5646fa40c450 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.171+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5646fa40c450 0x5646fa40e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5646fa40c450 0x5646fa40e860 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88702df8d7f7d81 server_cookie=254f02bab73ce2fa in_seq=0 out_seq=0 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ce7fc640 10 client.25529 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ce7fc640 1 -- 172.21.15.60:0/4205643179 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646fa360850 con 0x5646fa40c450 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ce7fc640 10 client.25529 handle_command_reply: tid=0 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 client.25529 shutdown 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4205643179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 msgr2=0x5646fa3f9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3f9680 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47d8011dd0 tx=0x7f47d80048f0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4205643179 shutdown_connections 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5646fa40c450 0x5646fa40e860 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3fca90 0x5646fa3f9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ce7fc640 0 client.25529 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3edca0 0x5646fa3f9680 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4205643179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.172+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4205643179 >> 172.21.15.60:0/4205643179 conn(0x5646fa3e9a30 msgr2=0x5646fa3ef790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.173+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4205643179 shutdown_connections 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.173+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4205643179 wait complete. 2024-09-12T00:01:40.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.173+0000 7f47ef4fa740 20 client.25529 trim_cache size 0 max 16384 2024-09-12T00:01:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47ef4fa740 1 Processor -- start 2024-09-12T00:01:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47ef4fa740 1 -- start start 2024-09-12T00:01:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa408900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa414130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa414670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47e81ab610 con 0x5646fa3edca0 2024-09-12T00:01:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47e81ad210 con 0x5646fa3fca90 2024-09-12T00:01:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47e81abce0 con 0x5646fa3ed380 2024-09-12T00:01:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa414130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa414130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57034/0 (socket says 172.21.15.60:57034) 2024-09-12T00:01:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47dffff640 1 -- 172.21.15.60:0/4111936082 learned_addr learned my addr 172.21.15.60:0/4111936082 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa408900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47e759e640 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa414670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47dffff640 1 -- 172.21.15.60:0/4111936082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 msgr2=0x5646fa408900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:40.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.191+0000 7f47dffff640 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa408900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.192+0000 7f47dffff640 1 -- 172.21.15.60:0/4111936082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 msgr2=0x5646fa414670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:40.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.192+0000 7f47dffff640 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa414670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.192+0000 7f47dffff640 1 -- 172.21.15.60:0/4111936082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646fa3edad0 con 0x5646fa3edca0 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.192+0000 7f47dffff640 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa414130 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f47d800fad0 tx=0x7f47d8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91710060de122e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.192+0000 7f47dcff9640 1 -- 172.21.15.60:0/4111936082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8029040 con 0x5646fa3edca0 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.192+0000 7f47dcff9640 1 -- 172.21.15.60:0/4111936082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47d8035070 con 0x5646fa3edca0 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.192+0000 7f47dcff9640 1 -- 172.21.15.60:0/4111936082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8004960 con 0x5646fa3edca0 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4111936082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 msgr2=0x5646fa414130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa414130 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f47d800fad0 tx=0x7f47d8005f90 comp rx=0 tx=0).stop 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4111936082 shutdown_connections 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa414670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa414130 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/4111936082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa408900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4111936082 >> 172.21.15.60:0/4111936082 conn(0x5646fa3e9a30 msgr2=0x5646fa3f4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4111936082 shutdown_connections 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 -- 172.21.15.60:0/4111936082 wait complete. 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 -- start start 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.193+0000 7f47ef4fa740 1 Processor -- start 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa3fff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47ef4fa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa4004b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47e81aca80 con 0x5646fa3edca0 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47e81ac3b0 con 0x5646fa3fca90 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47ef4fa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47e81a95f0 con 0x5646fa3ed380 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47ef4fa740 10 client.0 _ll_register_callbacks cb 0x7f47e00099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa3fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa3fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57040/0 (socket says 172.21.15.60:57040) 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 -- 172.21.15.60:0/1708871528 learned_addr learned my addr 172.21.15.60:0/1708871528 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47e759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa4004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 -- 172.21.15.60:0/1708871528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 msgr2=0x5646fa3ffa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3ffa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 -- 172.21.15.60:0/1708871528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 msgr2=0x5646fa4004b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa4004b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 -- 172.21.15.60:0/1708871528 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646fa475340 con 0x5646fa3edca0 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47e759e640 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa4004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47dffff640 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa3fff70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f47d8030040 tx=0x7f47d8005170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17892379fb0017c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.194+0000 7f47ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ce7fc640 1 -- 172.21.15.60:0/1708871528 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8029050 con 0x5646fa3edca0 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ce7fc640 1 -- 172.21.15.60:0/1708871528 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f47d80048d0 con 0x5646fa3edca0 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1708871528 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d8035070 con 0x5646fa3edca0 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ce7fc640 1 -- 172.21.15.60:0/1708871528 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f47d8004ad0 con 0x5646fa3edca0 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 10 client.15960 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1708871528 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5646fa476630 con 0x5646fa3edca0 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ce7fc640 1 -- 172.21.15.60:0/1708871528 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47d8035070 con 0x5646fa3edca0 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ce7fc640 1 -- 172.21.15.60:0/1708871528 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f47d804b4f0 con 0x5646fa3edca0 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 10 client.15960 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 20 client.15960 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5646fa40c450 0x5646fa478cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 4 client.15960 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:01:40.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.195+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1708871528 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646fa35ad60 con 0x5646fa40c450 2024-09-12T00:01:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5646fa40c450 0x5646fa478cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ce7fc640 10 client.15960 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47e6d9d640 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5646fa40c450 0x5646fa478cc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4547ca01c3207698 server_cookie=16089652c368453f in_seq=0 out_seq=0 2024-09-12T00:01:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ce7fc640 1 -- 172.21.15.60:0/1708871528 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5646fa35ad60 con 0x5646fa40c450 2024-09-12T00:01:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ce7fc640 10 client.15960 handle_command_reply: tid=0 2024-09-12T00:01:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 client.15960 shutdown 2024-09-12T00:01:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1708871528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 msgr2=0x5646fa3fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa3fff70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f47d8030040 tx=0x7f47d8005170 comp rx=0 tx=0).stop 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1708871528 shutdown_connections 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5646fa40c450 0x5646fa478cc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5646fa3fca90 0x5646fa4004b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5646fa3edca0 0x5646fa3fff70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 --2- 172.21.15.60:0/1708871528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646fa3ed380 0x5646fa3ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1708871528 >> 172.21.15.60:0/1708871528 conn(0x5646fa3e9a30 msgr2=0x5646fa3f7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.196+0000 7f47ce7fc640 0 client.15960 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1708871528 shutdown_connections 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ef4fa740 1 -- 172.21.15.60:0/1708871528 wait complete. 2024-09-12T00:01:40.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ef4fa740 20 client.15960 trim_cache size 0 max 16384 2024-09-12T00:01:40.203 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:01:40.203 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:01:40.203 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:01:40.203 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:01:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 -- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47d40a2cf0 msgr2=0x7f47d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47d40a2cf0 0x7f47d40a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47e0013620 tx=0x7f47e0004a40 comp rx=0 tx=0).stop 2024-09-12T00:01:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 -- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 msgr2=0x7f47e81985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 0x7f47e81985b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f47d0006010 tx=0x7f47d00040c0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 -- 172.21.15.60:0/2489233645 shutdown_connections 2024-09-12T00:01:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47d40a2cf0 0x7f47d40a51b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47e810c170 0x7f47e819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47e8103660 0x7f47e8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 --2- 172.21.15.60:0/2489233645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e8102d40 0x7f47e81985b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 -- 172.21.15.60:0/2489233645 >> 172.21.15.60:0/2489233645 conn(0x7f47e80fc7a0 msgr2=0x7f47e80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 -- 172.21.15.60:0/2489233645 shutdown_connections 2024-09-12T00:01:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:40.197+0000 7f47ed121640 1 -- 172.21.15.60:0/2489233645 wait complete. 2024-09-12T00:01:41.007 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:01:41.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:01:41.280 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:41.532 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:41 smithi060 ceph-mon[30953]: pgmap v72: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 594 op/s 2024-09-12T00:01:41.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:41 smithi192 ceph-mon[35487]: pgmap v72: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 594 op/s 2024-09-12T00:01:41.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:41 smithi105 ceph-mon[34805]: pgmap v72: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 594 op/s 2024-09-12T00:01:41.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 -- 172.21.15.60:0/2142687755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc106a90 msgr2=0x7facbc106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 --2- 172.21.15.60:0/2142687755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc106a90 0x7facbc106e70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7facb4009900 tx=0x7facb402a410 comp rx=0 tx=0).stop 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 -- 172.21.15.60:0/2142687755 shutdown_connections 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 --2- 172.21.15.60:0/2142687755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facbc100860 0x7facbc1045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 --2- 172.21.15.60:0/2142687755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7facbc107440 0x7facbc100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 --2- 172.21.15.60:0/2142687755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc106a90 0x7facbc106e70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 -- 172.21.15.60:0/2142687755 >> 172.21.15.60:0/2142687755 conn(0x7facbc077230 msgr2=0x7facbc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 -- 172.21.15.60:0/2142687755 shutdown_connections 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.752+0000 7facc1427640 1 -- 172.21.15.60:0/2142687755 wait complete. 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facc1427640 1 Processor -- start 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facc1427640 1 -- start start 2024-09-12T00:01:41.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facc1427640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facbc100860 0x7facbc1a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facc1427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7facbc106a90 0x7facbc1a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facc1427640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc19e990 0x7facbc19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facc1427640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7facbc1186a0 con 0x7facbc19e990 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facc1427640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7facbc118520 con 0x7facbc106a90 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facc1427640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7facbc118820 con 0x7facbc100860 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc19e990 0x7facbc19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facba7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7facbc106a90 0x7facbc1a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facbb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc19e990 0x7facbc19ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48152/0 (socket says 172.21.15.60:48152) 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facbb7fe640 1 -- 172.21.15.60:0/458082866 learned_addr learned my addr 172.21.15.60:0/458082866 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.753+0000 7facbaffd640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facbc100860 0x7facbc1a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facbb7fe640 1 -- 172.21.15.60:0/458082866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facbc100860 msgr2=0x7facbc1a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facbb7fe640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facbc100860 0x7facbc1a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facbb7fe640 1 -- 172.21.15.60:0/458082866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7facbc106a90 msgr2=0x7facbc1a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facbb7fe640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7facbc106a90 0x7facbc1a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facbb7fe640 1 -- 172.21.15.60:0/458082866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facbc19f4b0 con 0x7facbc19e990 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facba7fc640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7facbc106a90 0x7facbc1a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facbb7fe640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc19e990 0x7facbc19ee40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7facac00eb10 tx=0x7facac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facb3fff640 1 -- 172.21.15.60:0/458082866 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac004b20 con 0x7facbc19e990 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facb3fff640 1 -- 172.21.15.60:0/458082866 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7facac004cc0 con 0x7facbc19e990 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facbc19f7a0 con 0x7facbc19e990 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facb3fff640 1 -- 172.21.15.60:0/458082866 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facac0107f0 con 0x7facbc19e990 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.754+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facbc1ab990 con 0x7facbc19e990 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.755+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facbc106e70 con 0x7facbc19e990 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.756+0000 7facb3fff640 1 -- 172.21.15.60:0/458082866 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7facac005020 con 0x7facbc19e990 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.757+0000 7facb3fff640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7faca80a2d20 0x7faca80a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:41.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.757+0000 7facbaffd640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7faca80a2d20 0x7faca80a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:41.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.757+0000 7facb3fff640 1 -- 172.21.15.60:0/458082866 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7facac0cf990 con 0x7facbc19e990 2024-09-12T00:01:41.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.758+0000 7facbaffd640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7faca80a2d20 0x7faca80a51e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facbc19fad0 tx=0x7facb40058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:41.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.761+0000 7facb3fff640 1 -- 172.21.15.60:0/458082866 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facac09c600 con 0x7facbc19e990 2024-09-12T00:01:41.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.979+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facbc107620 con 0x7facbc19e990 2024-09-12T00:01:41.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.980+0000 7facb3fff640 1 -- 172.21.15.60:0/458082866 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11981 (secure 0 0 0) 0x7facac09bf00 con 0x7facbc19e990 2024-09-12T00:01:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:01:41.980 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":31,"btime":"2024-09-12T00:01:08:996003+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:01:08.965786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:01:41.980 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 31 2024-09-12T00:01:41.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7faca80a2d20 msgr2=0x7faca80a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:41.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7faca80a2d20 0x7faca80a51e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facbc19fad0 tx=0x7facb40058d0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc19e990 msgr2=0x7facbc19ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:41.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc19e990 0x7facbc19ee40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7facac00eb10 tx=0x7facac00c2d0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 shutdown_connections 2024-09-12T00:01:41.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7faca80a2d20 0x7faca80a51e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7facbc19e990 0x7facbc19ee40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7facbc106a90 0x7facbc1a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 --2- 172.21.15.60:0/458082866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facbc100860 0x7facbc1a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:41.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 >> 172.21.15.60:0/458082866 conn(0x7facbc077230 msgr2=0x7facbc102680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:41.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 shutdown_connections 2024-09-12T00:01:41.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:41.982+0000 7facc1427640 1 -- 172.21.15.60:0/458082866 wait complete. 2024-09-12T00:01:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:42 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/458082866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:42.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:42 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/458082866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:42.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:42 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/458082866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:01:42.721 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:01:42.984 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:43.385 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:43 smithi060 ceph-mon[30953]: pgmap v73: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 599 KiB/s wr, 84 op/s 2024-09-12T00:01:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2326783609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d0102d30 msgr2=0x7fe8d0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2326783609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d0102d30 0x7fe8d0103110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009860 tx=0x7fe8c402a340 comp rx=0 tx=0).stop 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2326783609 shutdown_connections 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2326783609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d01082a0 0x7fe8d010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2326783609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8d01036e0 0x7fe8d0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2326783609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d0102d30 0x7fe8d0103110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2326783609 >> 172.21.15.60:0/2326783609 conn(0x7fe8d00fc7d0 msgr2=0x7fe8d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2326783609 shutdown_connections 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.470+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2326783609 wait complete. 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d6e64640 1 Processor -- start 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d6e64640 1 -- start start 2024-09-12T00:01:43.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d6e64640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d0102d30 0x7fe8d01986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d6e64640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d01036e0 0x7fe8d0198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d6e64640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8d01082a0 0x7fe8d019cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d6e64640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01121c0 con 0x7fe8d0102d30 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d6e64640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0112040 con 0x7fe8d01082a0 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d6e64640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0112340 con 0x7fe8d01036e0 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d0102d30 0x7fe8d01986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d0102d30 0x7fe8d01986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48170/0 (socket says 172.21.15.60:48170) 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d4c00640 1 -- 172.21.15.60:0/2148587451 learned_addr learned my addr 172.21.15.60:0/2148587451 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8d5401640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8d01082a0 0x7fe8d019cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.471+0000 7fe8cffff640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d01036e0 0x7fe8d0198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8d4c00640 1 -- 172.21.15.60:0/2148587451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d01036e0 msgr2=0x7fe8d0198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d01036e0 0x7fe8d0198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8d4c00640 1 -- 172.21.15.60:0/2148587451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8d01082a0 msgr2=0x7fe8d019cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8d01082a0 0x7fe8d019cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8d4c00640 1 -- 172.21.15.60:0/2148587451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d019d6a0 con 0x7fe8d0102d30 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d0102d30 0x7fe8d01986f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4005e00 tx=0x7fe8c40326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8cdffb640 1 -- 172.21.15.60:0/2148587451 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4037050 con 0x7fe8d0102d30 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8cdffb640 1 -- 172.21.15.60:0/2148587451 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8c4038040 con 0x7fe8d0102d30 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2148587451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d019d930 con 0x7fe8d0102d30 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8cdffb640 1 -- 172.21.15.60:0/2148587451 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4003a90 con 0x7fe8d0102d30 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.472+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2148587451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d01a5270 con 0x7fe8d0102d30 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8cdffb640 1 -- 172.21.15.60:0/2148587451 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe8c4045030 con 0x7fe8d0102d30 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d923d740 1 Processor -- start 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d923d740 1 -- start start 2024-09-12T00:01:43.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796cbb40 0x564f796ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796d5370 0x564f796d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d923d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564f796302f0 con 0x564f796ca5d0 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d923d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564f795d7cf0 con 0x564f796cbb40 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d923d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564f7962c2b0 con 0x564f796d5370 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.475+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d5401640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796cbb40 0x564f796ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796d5370 0x564f796d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48172/0 (socket says 172.21.15.60:48172) 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d4c00640 1 -- 172.21.15.60:0/2790912656 learned_addr learned my addr 172.21.15.60:0/2790912656 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:43.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8cdffb640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8c00a2d70 0x7fe8c00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d5401640 1 -- 172.21.15.60:0/2790912656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796d5370 msgr2=0x564f796d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d5401640 1 --2- 172.21.15.60:0/2790912656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796d5370 0x564f796d7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d5401640 1 -- 172.21.15.60:0/2790912656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 msgr2=0x564f796caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d5401640 1 --2- 172.21.15.60:0/2790912656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d5401640 1 -- 172.21.15.60:0/2790912656 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f795bc3a0 con 0x564f796cbb40 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8cdffb640 1 -- 172.21.15.60:0/2148587451 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe8c40eede0 con 0x7fe8d0102d30 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d5401640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8c00a2d70 0x7fe8c00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8d5401640 1 --2- 172.21.15.60:0/2790912656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796cbb40 0x564f796ca090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8000b60 tx=0x7fe8c80118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e88587868af6c106 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8baffd640 1 -- 172.21.15.60:0/2790912656 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8017050 con 0x564f796cbb40 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.476+0000 7fe8baffd640 1 -- 172.21.15.60:0/2790912656 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8c8004750 con 0x564f796cbb40 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8baffd640 1 -- 172.21.15.60:0/2790912656 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c801c6a0 con 0x564f796cbb40 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 -- 172.21.15.60:0/2790912656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796cbb40 msgr2=0x564f796ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 --2- 172.21.15.60:0/2790912656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796cbb40 0x564f796ca090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8000b60 tx=0x7fe8c80118d0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d5401640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8c00a2d70 0x7fe8c00a5230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8023000 tx=0x7fe8c8024000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 -- 172.21.15.60:0/2790912656 shutdown_connections 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 --2- 172.21.15.60:0/2790912656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796d5370 0x564f796d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 --2- 172.21.15.60:0/2790912656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 --2- 172.21.15.60:0/2790912656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796cbb40 0x564f796ca090 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 -- 172.21.15.60:0/2790912656 >> 172.21.15.60:0/2790912656 conn(0x564f79693310 msgr2=0x564f796c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 -- 172.21.15.60:0/2790912656 shutdown_connections 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.477+0000 7fe8d923d740 1 -- 172.21.15.60:0/2790912656 wait complete. 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 1 -- start start 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 1 Processor -- start 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796ca5d0 0x564f796d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 0x564f796d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796d5370 0x564f796d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564f796d8070 con 0x564f796d5370 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564f795eb060 con 0x564f796ca5d0 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564f796d81f0 con 0x564f796cbb40 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.478+0000 7fe8d923d740 10 client.0 _ll_register_callbacks cb 0x564f7933e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796d5370 0x564f796d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796d5370 0x564f796d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48174/0 (socket says 172.21.15.60:48174) 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 -- 172.21.15.60:0/689333880 learned_addr learned my addr 172.21.15.60:0/689333880 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796ca5d0 0x564f796d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8cffff640 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 0x564f796d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 -- 172.21.15.60:0/689333880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 msgr2=0x564f796d1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:43.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 0x564f796d1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 -- 172.21.15.60:0/689333880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796ca5d0 msgr2=0x564f796d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796ca5d0 0x564f796d4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 -- 172.21.15.60:0/689333880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f793a13c0 con 0x564f796d5370 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d5401640 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796d5370 0x564f796d25d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005f10 tx=0x7fe8c8005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df0c6b3bd49a786 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8affff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8affff640 1 -- 172.21.15.60:0/689333880 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8036060 con 0x564f796d5370 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8d923d740 1 -- 172.21.15.60:0/689333880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8c8004750 con 0x564f796d5370 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.479+0000 7fe8affff640 1 -- 172.21.15.60:0/689333880 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe8c8004550 con 0x564f796d5370 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8affff640 1 -- 172.21.15.60:0/689333880 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe8c801cbb0 con 0x564f796d5370 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d923d740 10 client.15978 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d923d740 1 -- 172.21.15.60:0/689333880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564f796e3b20 con 0x564f796d5370 2024-09-12T00:01:43.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8affff640 1 -- 172.21.15.60:0/689333880 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8c8004750 con 0x564f796d5370 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8affff640 1 -- 172.21.15.60:0/689333880 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fe8c8031740 con 0x564f796d5370 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d923d740 10 client.15978 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d923d740 10 client.15978 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d923d740 20 client.15978 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d923d740 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564f796e4f30 0x564f796e7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d923d740 4 client.15978 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d923d740 1 -- 172.21.15.60:0/689333880 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f7963d860 con 0x564f796e4f30 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.480+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564f796e4f30 0x564f796e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.481+0000 7fe8affff640 10 client.15978 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.481+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564f796e4f30 0x564f796e7320 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9ae212cef4fbc740 server_cookie=9e58a5d9a280ecfc in_seq=0 out_seq=0 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.481+0000 7fe8affff640 1 -- 172.21.15.60:0/689333880 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe8c40c7e50 con 0x564f796e4f30 2024-09-12T00:01:43.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.481+0000 7fe8affff640 10 client.15978 handle_command_reply: tid=0 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.481+0000 7fe8d923d740 1 client.15978 shutdown 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.481+0000 7fe8d923d740 1 -- 172.21.15.60:0/689333880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796d5370 msgr2=0x564f796d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.481+0000 7fe8d923d740 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796d5370 0x564f796d25d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005f10 tx=0x7fe8c8005f40 comp rx=0 tx=0).stop 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 1 -- 172.21.15.60:0/689333880 shutdown_connections 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796d5370 0x564f796d25d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 0x564f796d1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564f796e4f30 0x564f796e7320 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 1 --2- 172.21.15.60:0/689333880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796ca5d0 0x564f796d4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8affff640 0 client.15978 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:01:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 1 -- 172.21.15.60:0/689333880 >> 172.21.15.60:0/689333880 conn(0x564f79693310 msgr2=0x564f796cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 1 -- 172.21.15.60:0/689333880 shutdown_connections 2024-09-12T00:01:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 1 -- 172.21.15.60:0/689333880 wait complete. 2024-09-12T00:01:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.482+0000 7fe8d923d740 20 client.15978 trim_cache size 0 max 16384 2024-09-12T00:01:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d923d740 1 Processor -- start 2024-09-12T00:01:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d923d740 1 -- start start 2024-09-12T00:01:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796ca5d0 0x564f796d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796cbb40 0x564f796cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d923d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01ad7e0 con 0x564f796cbb40 2024-09-12T00:01:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d923d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01af3e0 con 0x564f796d5370 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d923d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01adeb0 con 0x564f796ca5d0 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796cbb40 0x564f796cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d5401640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796cbb40 0x564f796cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48182/0 (socket says 172.21.15.60:48182) 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796ca5d0 0x564f796d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.496+0000 7fe8cffff640 1 -- 172.21.15.60:0/4265206891 learned_addr learned my addr 172.21.15.60:0/4265206891 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8d5401640 1 -- 172.21.15.60:0/4265206891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796ca5d0 msgr2=0x564f796d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8d5401640 1 --2- 172.21.15.60:0/4265206891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796ca5d0 0x564f796d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8d5401640 1 -- 172.21.15.60:0/4265206891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796cbb40 msgr2=0x564f796cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8d5401640 1 --2- 172.21.15.60:0/4265206891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796cbb40 0x564f796cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8d5401640 1 -- 172.21.15.60:0/4265206891 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f796e78b0 con 0x564f796d5370 2024-09-12T00:01:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8cffff640 1 --2- 172.21.15.60:0/4265206891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796cbb40 0x564f796cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8d5401640 1 --2- 172.21.15.60:0/4265206891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796cd660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009b80 tx=0x7fe8c8012f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b15a4fa47dd5c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8ba7fc640 1 -- 172.21.15.60:0/4265206891 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8017030 con 0x564f796d5370 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8ba7fc640 1 -- 172.21.15.60:0/4265206891 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8c8009e10 con 0x564f796d5370 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.497+0000 7fe8ba7fc640 1 -- 172.21.15.60:0/4265206891 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8036040 con 0x564f796d5370 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 -- 172.21.15.60:0/4265206891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 msgr2=0x564f796cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 --2- 172.21.15.60:0/4265206891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796cd660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009b80 tx=0x7fe8c8012f90 comp rx=0 tx=0).stop 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 -- 172.21.15.60:0/4265206891 shutdown_connections 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 --2- 172.21.15.60:0/4265206891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796cd660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 --2- 172.21.15.60:0/4265206891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796cbb40 0x564f796cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 --2- 172.21.15.60:0/4265206891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796ca5d0 0x564f796d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 -- 172.21.15.60:0/4265206891 >> 172.21.15.60:0/4265206891 conn(0x564f79693310 msgr2=0x564f796d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 -- 172.21.15.60:0/4265206891 shutdown_connections 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 -- 172.21.15.60:0/4265206891 wait complete. 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 -- start start 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.498+0000 7fe8d923d740 1 Processor -- start 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796d9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 0x564f796d9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d923d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796d9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d923d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01aec50 con 0x564f796ca5d0 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d923d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01ae580 con 0x564f796d5370 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d923d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d01ab7e0 con 0x564f796cbb40 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d923d740 10 client.0 _ll_register_callbacks cb 0x7fe8c40b75c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796d9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796d9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48198/0 (socket says 172.21.15.60:48198) 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d4c00640 1 -- 172.21.15.60:0/75735531 learned_addr learned my addr 172.21.15.60:0/75735531 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d5401640 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796d9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8cffff640 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 0x564f796d9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d5401640 1 -- 172.21.15.60:0/75735531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 msgr2=0x564f796d9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d5401640 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 0x564f796d9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d5401640 1 -- 172.21.15.60:0/75735531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 msgr2=0x564f796d9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d5401640 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796d9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d5401640 1 -- 172.21.15.60:0/75735531 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f796c7960 con 0x564f796d5370 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.499+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796d9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d5401640 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796d9eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005b20 tx=0x7fe8c801c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e2c95f549b22cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8affff640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8affff640 1 -- 172.21.15.60:0/75735531 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8020030 con 0x564f796d5370 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8affff640 1 -- 172.21.15.60:0/75735531 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe8c802d040 con 0x564f796d5370 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 1 -- 172.21.15.60:0/75735531 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8c8009e10 con 0x564f796d5370 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8affff640 1 -- 172.21.15.60:0/75735531 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe8c8036070 con 0x564f796d5370 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 10 client.25559 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 1 -- 172.21.15.60:0/75735531 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564f7974fe10 con 0x564f796d5370 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8affff640 1 -- 172.21.15.60:0/75735531 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8c8009e10 con 0x564f796d5370 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8affff640 1 -- 172.21.15.60:0/75735531 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fe8c8005400 con 0x564f796d5370 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 10 client.25559 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 10 client.25559 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 20 client.25559 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564f79750470 0x564f79752860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 4 client.25559 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:01:43.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.500+0000 7fe8d923d740 1 -- 172.21.15.60:0/75735531 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f79637d70 con 0x564f79750470 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564f79750470 0x564f79752860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d4c00640 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564f79750470 0x564f79752860 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=55650bade430c87d server_cookie=b157aa071f5b7e1f in_seq=0 out_seq=0 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8affff640 10 client.25559 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8affff640 1 -- 172.21.15.60:0/75735531 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f79637d70 con 0x564f79750470 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8affff640 10 client.25559 handle_command_reply: tid=0 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 client.25559 shutdown 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 -- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 msgr2=0x564f796d9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796d9eb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8005b20 tx=0x7fe8c801c810 comp rx=0 tx=0).stop 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 -- 172.21.15.60:0/75735531 shutdown_connections 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564f79750470 0x564f79752860 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564f796d5370 0x564f796d9eb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f796cbb40 0x564f796d9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8affff640 0 client.25559 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:01:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 --2- 172.21.15.60:0/75735531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564f796ca5d0 0x564f796d9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.501+0000 7fe8d923d740 1 -- 172.21.15.60:0/75735531 >> 172.21.15.60:0/75735531 conn(0x564f79693310 msgr2=0x564f796c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d923d740 1 -- 172.21.15.60:0/75735531 shutdown_connections 2024-09-12T00:01:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d923d740 1 -- 172.21.15.60:0/75735531 wait complete. 2024-09-12T00:01:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d923d740 20 client.25559 trim_cache size 0 max 16384 2024-09-12T00:01:43.509 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8c00a2d70 msgr2=0x7fe8c00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8c00a2d70 0x7fe8c00a5230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8023000 tx=0x7fe8c8024000 comp rx=0 tx=0).stop 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d0102d30 msgr2=0x7fe8d01986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d0102d30 0x7fe8d01986f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4005e00 tx=0x7fe8c40326f0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2148587451 shutdown_connections 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8c00a2d70 0x7fe8c00a5230 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8d01082a0 0x7fe8d019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d01036e0 0x7fe8d0198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 --2- 172.21.15.60:0/2148587451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8d0102d30 0x7fe8d01986f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2148587451 >> 172.21.15.60:0/2148587451 conn(0x7fe8d00fc7d0 msgr2=0x7fe8d0105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:43.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.502+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2148587451 shutdown_connections 2024-09-12T00:01:43.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:43.503+0000 7fe8d6e64640 1 -- 172.21.15.60:0/2148587451 wait complete. 2024-09-12T00:01:43.537 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:43 smithi192 ceph-mon[35487]: pgmap v73: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 599 KiB/s wr, 84 op/s 2024-09-12T00:01:43.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:43 smithi105 ceph-mon[34805]: pgmap v73: 97 pgs: 97 active+clean; 192 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 599 KiB/s wr, 84 op/s 2024-09-12T00:01:44.261 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:01:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:44.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:44 smithi192 ceph-mon[35487]: pgmap v74: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-09-12T00:01:44.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:44 smithi060 ceph-mon[30953]: pgmap v74: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-09-12T00:01:44.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:44 smithi105 ceph-mon[34805]: pgmap v74: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 149 op/s 2024-09-12T00:01:45.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 -- 172.21.15.60:0/3631953230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 msgr2=0x7f003c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 --2- 172.21.15.60:0/3631953230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 0x7f003c106e60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0024009930 tx=0x7f002402a420 comp rx=0 tx=0).stop 2024-09-12T00:01:45.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 -- 172.21.15.60:0/3631953230 shutdown_connections 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 --2- 172.21.15.60:0/3631953230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f003c101420 0x7f003c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 --2- 172.21.15.60:0/3631953230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f003c100a80 0x7f003c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 --2- 172.21.15.60:0/3631953230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 0x7f003c106e60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 -- 172.21.15.60:0/3631953230 >> 172.21.15.60:0/3631953230 conn(0x7f003c0fc7a0 msgr2=0x7f003c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 -- 172.21.15.60:0/3631953230 shutdown_connections 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 -- 172.21.15.60:0/3631953230 wait complete. 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.010+0000 7f0042d79640 1 Processor -- start 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0042d79640 1 -- start start 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0042d79640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f003c100a80 0x7f003c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0042d79640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f003c101420 0x7f003c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0042d79640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 0x7f003c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0042d79640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f003c110fa0 con 0x7f003c106a80 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0042d79640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f003c110e20 con 0x7f003c101420 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0042d79640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f003c111120 con 0x7f003c100a80 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0041316640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 0x7f003c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f003bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f003c101420 0x7f003c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0041316640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 0x7f003c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48212/0 (socket says 172.21.15.60:48212) 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0041316640 1 -- 172.21.15.60:0/38246020 learned_addr learned my addr 172.21.15.60:0/38246020 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0040b15640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f003c100a80 0x7f003c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0041316640 1 -- 172.21.15.60:0/38246020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f003c100a80 msgr2=0x7f003c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0041316640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f003c100a80 0x7f003c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0041316640 1 -- 172.21.15.60:0/38246020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f003c101420 msgr2=0x7f003c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0041316640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f003c101420 0x7f003c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.011+0000 7f0041316640 1 -- 172.21.15.60:0/38246020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c19d4f0 con 0x7f003c106a80 2024-09-12T00:01:45.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.012+0000 7f0041316640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 0x7f003c19ce10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f003400e970 tx=0x7f003400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:45.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.012+0000 7f0039ffb640 1 -- 172.21.15.60:0/38246020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003400ccc0 con 0x7f003c106a80 2024-09-12T00:01:45.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.012+0000 7f0039ffb640 1 -- 172.21.15.60:0/38246020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f003400ce60 con 0x7f003c106a80 2024-09-12T00:01:45.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.012+0000 7f0042d79640 1 -- 172.21.15.60:0/38246020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c19d7e0 con 0x7f003c106a80 2024-09-12T00:01:45.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.012+0000 7f0039ffb640 1 -- 172.21.15.60:0/38246020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034010690 con 0x7f003c106a80 2024-09-12T00:01:45.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.012+0000 7f0042d79640 1 -- 172.21.15.60:0/38246020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c1a50c0 con 0x7f003c106a80 2024-09-12T00:01:45.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.015+0000 7f0039ffb640 1 -- 172.21.15.60:0/38246020 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f00340046c0 con 0x7f003c106a80 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0045152740 1 Processor -- start 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0045152740 1 -- start start 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0045152740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad15b40 0x56310ad14090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0045152740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad145d0 0x56310ad14a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0045152740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad25b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0045152740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56310ac7a2f0 con 0x56310ad15b40 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0045152740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56310ac21cf0 con 0x56310ad23780 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0045152740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56310ac762b0 con 0x56310ad145d0 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0039ffb640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f00280a2cf0 0x7f00280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0040b15640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad145d0 0x56310ad14a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0040b15640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad145d0 0x56310ad14a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:59786/0 (socket says 172.21.15.60:59786) 2024-09-12T00:01:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f0040b15640 1 -- 172.21.15.60:0/2288822029 learned_addr learned my addr 172.21.15.60:0/2288822029 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.016+0000 7f003bfff640 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad15b40 0x56310ad14090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f0041316640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f00280a2cf0 0x7f00280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f0039ffb640 1 -- 172.21.15.60:0/38246020 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f00340cf800 con 0x7f003c106a80 2024-09-12T00:01:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f003bfff640 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad25b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f003bfff640 1 -- 172.21.15.60:0/2288822029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad145d0 msgr2=0x56310ad14a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f003bfff640 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad145d0 0x56310ad14a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f003bfff640 1 -- 172.21.15.60:0/2288822029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 msgr2=0x56310ad25b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f003bfff640 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad25b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f003bfff640 1 -- 172.21.15.60:0/2288822029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56310ac063a0 con 0x56310ad15b40 2024-09-12T00:01:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f003bfff640 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad15b40 0x56310ad14090 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f003c06b7e0 tx=0x7f002c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180d9ae7ea33d963 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f0041316640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f00280a2cf0 0x7f00280a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f003409ba10 tx=0x7f0034093040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f0032ffd640 1 -- 172.21.15.60:0/2288822029 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c01a030 con 0x56310ad15b40 2024-09-12T00:01:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f0032ffd640 1 -- 172.21.15.60:0/2288822029 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f002c00fe50 con 0x56310ad15b40 2024-09-12T00:01:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.017+0000 7f0032ffd640 1 -- 172.21.15.60:0/2288822029 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c005280 con 0x56310ad15b40 2024-09-12T00:01:45.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 -- 172.21.15.60:0/2288822029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad15b40 msgr2=0x56310ad14090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad15b40 0x56310ad14090 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f003c06b7e0 tx=0x7f002c009c20 comp rx=0 tx=0).stop 2024-09-12T00:01:45.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 -- 172.21.15.60:0/2288822029 shutdown_connections 2024-09-12T00:01:45.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad25b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad145d0 0x56310ad14a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 --2- 172.21.15.60:0/2288822029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad15b40 0x56310ad14090 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 -- 172.21.15.60:0/2288822029 >> 172.21.15.60:0/2288822029 conn(0x56310acdd310 msgr2=0x56310ad10c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 -- 172.21.15.60:0/2288822029 shutdown_connections 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.018+0000 7f0045152740 1 -- 172.21.15.60:0/2288822029 wait complete. 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 1 -- start start 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 1 Processor -- start 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad145d0 0x56310ad23160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad20410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad23780 0x56310ad209e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56310ad26480 con 0x56310ad23780 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56310ac35060 con 0x56310ad145d0 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56310ad26600 con 0x56310ad15b40 2024-09-12T00:01:45.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0045152740 10 client.0 _ll_register_callbacks cb 0x56310a9888c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f003bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad145d0 0x56310ad23160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0040b15640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad20410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f003bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad145d0 0x56310ad23160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54926/0 (socket says 172.21.15.60:54926) 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f0040b15640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad20410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:59802/0 (socket says 172.21.15.60:59802) 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f003bfff640 1 -- 172.21.15.60:0/2868082214 learned_addr learned my addr 172.21.15.60:0/2868082214 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.019+0000 7f003bfff640 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad23780 0x56310ad209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0040b15640 1 -- 172.21.15.60:0/2868082214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad145d0 msgr2=0x56310ad23160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0040b15640 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad145d0 0x56310ad23160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0040b15640 1 -- 172.21.15.60:0/2868082214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad23780 msgr2=0x56310ad209e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0040b15640 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad23780 0x56310ad209e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0040b15640 1 -- 172.21.15.60:0/2868082214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56310a9eb3c0 con 0x56310ad15b40 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f003bfff640 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad23780 0x56310ad209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0040b15640 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad20410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x56310ad11ac0 tx=0x7f0024031870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70836fb448296355 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f001bfff640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f001bfff640 1 -- 172.21.15.60:0/2868082214 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024035040 con 0x56310ad15b40 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0045152740 1 -- 172.21.15.60:0/2868082214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f002c00fe50 con 0x56310ad15b40 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f001bfff640 1 -- 172.21.15.60:0/2868082214 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f0024005240 con 0x56310ad15b40 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f001bfff640 1 -- 172.21.15.60:0/2868082214 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0024031a60 con 0x56310ad15b40 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0045152740 10 client.25507 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.020+0000 7f0045152740 1 -- 172.21.15.60:0/2868082214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56310ad31f50 con 0x56310ad15b40 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f001bfff640 1 -- 172.21.15.60:0/2868082214 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f002c00fe50 con 0x56310ad15b40 2024-09-12T00:01:45.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f001bfff640 1 -- 172.21.15.60:0/2868082214 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f002403d6b0 con 0x56310ad15b40 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f0045152740 10 client.25507 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f0045152740 10 client.25507 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f0045152740 20 client.25507 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f0045152740 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56310ad333b0 0x56310ad357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f0045152740 4 client.25507 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f0045152740 1 -- 172.21.15.60:0/2868082214 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56310ac87860 con 0x56310ad333b0 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.021+0000 7f003bfff640 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56310ad333b0 0x56310ad357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f001bfff640 10 client.25507 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f003bfff640 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56310ad333b0 0x56310ad357a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=410891212ebf1fd8 server_cookie=f3dd62d2c7945646 in_seq=0 out_seq=0 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f001bfff640 1 -- 172.21.15.60:0/2868082214 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56310ac87860 con 0x56310ad333b0 2024-09-12T00:01:45.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f001bfff640 10 client.25507 handle_command_reply: tid=0 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f0045152740 1 client.25507 shutdown 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f0045152740 1 -- 172.21.15.60:0/2868082214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 msgr2=0x56310ad20410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f0045152740 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad20410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x56310ad11ac0 tx=0x7f0024031870 comp rx=0 tx=0).stop 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f0045152740 1 -- 172.21.15.60:0/2868082214 shutdown_connections 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.022+0000 7f0045152740 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56310ad333b0 0x56310ad357a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.023+0000 7f0045152740 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad23780 0x56310ad209e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.023+0000 7f0045152740 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad20410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.023+0000 7f0045152740 1 --2- 172.21.15.60:0/2868082214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad145d0 0x56310ad23160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.023+0000 7f0045152740 1 -- 172.21.15.60:0/2868082214 >> 172.21.15.60:0/2868082214 conn(0x56310acdd310 msgr2=0x56310ad16960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.023+0000 7f001bfff640 0 client.25507 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:01:45.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.023+0000 7f0045152740 1 -- 172.21.15.60:0/2868082214 shutdown_connections 2024-09-12T00:01:45.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.023+0000 7f0045152740 1 -- 172.21.15.60:0/2868082214 wait complete. 2024-09-12T00:01:45.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.023+0000 7f0045152740 20 client.25507 trim_cache size 0 max 16384 2024-09-12T00:01:45.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.037+0000 7f0045152740 1 Processor -- start 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0045152740 1 -- start start 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0045152740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad203e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0045152740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad2f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0045152740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad3b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0045152740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1ab5d0 con 0x56310ad145d0 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0045152740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1ad1d0 con 0x56310ad23780 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0045152740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1abca0 con 0x56310ad15b40 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48246/0 (socket says 172.21.15.60:48246) 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 -- 172.21.15.60:0/1793709387 learned_addr learned my addr 172.21.15.60:0/1793709387 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0040b15640 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad2f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad3b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 -- 172.21.15.60:0/1793709387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 msgr2=0x56310ad2f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad2f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 -- 172.21.15.60:0/1793709387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 msgr2=0x56310ad3b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad3b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 -- 172.21.15.60:0/1793709387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56310ad10ed0 con 0x56310ad145d0 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f0040b15640 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad2f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f003bfff640 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad203e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f002c009fd0 tx=0x7f002c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0d7f9e38357035 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:45.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.038+0000 7f00327fc640 1 -- 172.21.15.60:0/1793709387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c033030 con 0x56310ad145d0 2024-09-12T00:01:45.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f00327fc640 1 -- 172.21.15.60:0/1793709387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f002c01b040 con 0x56310ad145d0 2024-09-12T00:01:45.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f00327fc640 1 -- 172.21.15.60:0/1793709387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c01a040 con 0x56310ad145d0 2024-09-12T00:01:45.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 -- 172.21.15.60:0/1793709387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 msgr2=0x56310ad203e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad203e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f002c009fd0 tx=0x7f002c005bd0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 -- 172.21.15.60:0/1793709387 shutdown_connections 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad3b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad2f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 --2- 172.21.15.60:0/1793709387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad203e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 -- 172.21.15.60:0/1793709387 >> 172.21.15.60:0/1793709387 conn(0x56310acdd310 msgr2=0x56310ad1fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 -- 172.21.15.60:0/1793709387 shutdown_connections 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.039+0000 7f0045152740 1 -- 172.21.15.60:0/1793709387 wait complete. 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 1 -- start start 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 1 Processor -- start 2024-09-12T00:01:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad26e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad27350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad9c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1aca40 con 0x56310ad145d0 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1ac370 con 0x56310ad23780 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f003c1a95b0 con 0x56310ad15b40 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0045152740 10 client.0 _ll_register_callbacks cb 0x7f0024009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f003bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad26e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f003bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad26e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48250/0 (socket says 172.21.15.60:48250) 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f003bfff640 1 -- 172.21.15.60:0/3672016728 learned_addr learned my addr 172.21.15.60:0/3672016728 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f0040b15640 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad27350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.040+0000 7f003bfff640 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad9c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f003bfff640 1 -- 172.21.15.60:0/3672016728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 msgr2=0x56310ad27350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f003bfff640 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad27350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f003bfff640 1 -- 172.21.15.60:0/3672016728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 msgr2=0x56310ad9c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f003bfff640 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad9c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f003bfff640 1 -- 172.21.15.60:0/3672016728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56310ad9c570 con 0x56310ad145d0 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f003bfff640 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad26e10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f002c009b70 tx=0x7f002c005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52c27f7f73a3cb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f001bfff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f001bfff640 1 -- 172.21.15.60:0/3672016728 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c033040 con 0x56310ad145d0 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f001bfff640 1 -- 172.21.15.60:0/3672016728 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f002c029040 con 0x56310ad145d0 2024-09-12T00:01:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f0045152740 1 -- 172.21.15.60:0/3672016728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f002c01b040 con 0x56310ad145d0 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f001bfff640 1 -- 172.21.15.60:0/3672016728 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f002c01a040 con 0x56310ad145d0 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f0045152740 10 client.16002 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f0045152740 1 -- 172.21.15.60:0/3672016728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56310ad9d840 con 0x56310ad145d0 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.041+0000 7f001bfff640 1 -- 172.21.15.60:0/3672016728 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f002c01b040 con 0x56310ad145d0 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f001bfff640 1 -- 172.21.15.60:0/3672016728 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f002c0448e0 con 0x56310ad145d0 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0045152740 10 client.16002 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0045152740 10 client.16002 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0045152740 20 client.16002 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0045152740 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56310ad9ddc0 0x56310ada01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0045152740 4 client.16002 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:01:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0045152740 1 -- 172.21.15.60:0/3672016728 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56310ac81d70 con 0x56310ad9ddc0 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0040b15640 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56310ad9ddc0 0x56310ada01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f001bfff640 10 client.16002 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0040b15640 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56310ad9ddc0 0x56310ada01e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4ebde3de6e80112f server_cookie=619b979ed59532d in_seq=0 out_seq=0 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f001bfff640 1 -- 172.21.15.60:0/3672016728 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56310ac81d70 con 0x56310ad9ddc0 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f001bfff640 10 client.16002 handle_command_reply: tid=0 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.042+0000 7f0045152740 1 client.16002 shutdown 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 -- 172.21.15.60:0/3672016728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 msgr2=0x56310ad26e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad26e10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f002c009b70 tx=0x7f002c005890 comp rx=0 tx=0).stop 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 -- 172.21.15.60:0/3672016728 shutdown_connections 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56310ad9ddc0 0x56310ada01e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56310ad23780 0x56310ad9c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56310ad15b40 0x56310ad27350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f001bfff640 0 client.16002 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:01:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 --2- 172.21.15.60:0/3672016728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56310ad145d0 0x56310ad26e10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 -- 172.21.15.60:0/3672016728 >> 172.21.15.60:0/3672016728 conn(0x56310acdd310 msgr2=0x56310ad1ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 -- 172.21.15.60:0/3672016728 shutdown_connections 2024-09-12T00:01:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 1 -- 172.21.15.60:0/3672016728 wait complete. 2024-09-12T00:01:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0045152740 20 client.16002 trim_cache size 0 max 16384 2024-09-12T00:01:45.050 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:01:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0042d79640 1 -- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f00280a2cf0 msgr2=0x7f00280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0042d79640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f00280a2cf0 0x7f00280a51b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f003409ba10 tx=0x7f0034093040 comp rx=0 tx=0).stop 2024-09-12T00:01:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0042d79640 1 -- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 msgr2=0x7f003c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.043+0000 7f0042d79640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 0x7f003c19ce10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f003400e970 tx=0x7f003400ed70 comp rx=0 tx=0).stop 2024-09-12T00:01:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.044+0000 7f0042d79640 1 -- 172.21.15.60:0/38246020 shutdown_connections 2024-09-12T00:01:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.044+0000 7f0042d79640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f00280a2cf0 0x7f00280a51b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.044+0000 7f0042d79640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f003c106a80 0x7f003c19ce10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.044+0000 7f0042d79640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f003c101420 0x7f003c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.044+0000 7f0042d79640 1 --2- 172.21.15.60:0/38246020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f003c100a80 0x7f003c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.044+0000 7f0042d79640 1 -- 172.21.15.60:0/38246020 >> 172.21.15.60:0/38246020 conn(0x7f003c0fc7a0 msgr2=0x7f003c104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.044+0000 7f0042d79640 1 -- 172.21.15.60:0/38246020 shutdown_connections 2024-09-12T00:01:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:45.044+0000 7f0042d79640 1 -- 172.21.15.60:0/38246020 wait complete. 2024-09-12T00:01:45.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:01:46.132 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:46.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:46 smithi060 ceph-mon[30953]: pgmap v75: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 523 KiB/s wr, 78 op/s 2024-09-12T00:01:46.644 INFO:tasks.workunit.client.0.smithi060.stderr:+ sync 2024-09-12T00:01:46.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:46 smithi192 ceph-mon[35487]: pgmap v75: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 523 KiB/s wr, 78 op/s 2024-09-12T00:01:46.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:46 smithi105 ceph-mon[34805]: pgmap v75: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 523 KiB/s wr, 78 op/s 2024-09-12T00:01:47.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 -- 172.21.15.60:0/987301423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bbc10ea10 msgr2=0x7f9bbc115360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/987301423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bbc10ea10 0x7f9bbc115360 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4008840 tx=0x7f9bb400aec0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 -- 172.21.15.60:0/987301423 shutdown_connections 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/987301423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bbc10ea10 0x7f9bbc115360 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/987301423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bbc109e00 0x7f9bbc10e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/987301423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bbc109450 0x7f9bbc109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 -- 172.21.15.60:0/987301423 >> 172.21.15.60:0/987301423 conn(0x7f9bbc073660 msgr2=0x7f9bbc073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 -- 172.21.15.60:0/987301423 shutdown_connections 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.725+0000 7f9bc32d2640 1 -- 172.21.15.60:0/987301423 wait complete. 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.726+0000 7f9bc32d2640 1 Processor -- start 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.726+0000 7f9bc32d2640 1 -- start start 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.727+0000 7f9bc32d2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bbc109450 0x7f9bbc19e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.727+0000 7f9bc32d2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bbc109e00 0x7f9bbc19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.727+0000 7f9bc32d2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bbc10ea10 0x7f9bbc1a3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.727+0000 7f9bc32d2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc118480 con 0x7f9bbc109e00 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.727+0000 7f9bc32d2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc118300 con 0x7f9bbc10ea10 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.727+0000 7f9bc32d2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc118600 con 0x7f9bbc109450 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.728+0000 7f9bc2ad1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bbc10ea10 0x7f9bbc1a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.728+0000 7f9bc22d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bbc109450 0x7f9bbc19e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.728+0000 7f9bc2ad1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bbc10ea10 0x7f9bbc1a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54956/0 (socket says 172.21.15.60:54956) 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.728+0000 7f9bc22d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bbc109450 0x7f9bbc19e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:59836/0 (socket says 172.21.15.60:59836) 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.728+0000 7f9bc2ad1640 1 -- 172.21.15.60:0/2686620762 learned_addr learned my addr 172.21.15.60:0/2686620762 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.728+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bbc109e00 0x7f9bbc19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.729+0000 7f9bc2ad1640 1 -- 172.21.15.60:0/2686620762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bbc109450 msgr2=0x7f9bbc19e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.729+0000 7f9bc2ad1640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bbc109450 0x7f9bbc19e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.729+0000 7f9bc2ad1640 1 -- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bbc109e00 msgr2=0x7f9bbc19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.729+0000 7f9bc2ad1640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bbc109e00 0x7f9bbc19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.729+0000 7f9bc2ad1640 1 -- 172.21.15.60:0/2686620762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bbc1a3670 con 0x7f9bbc10ea10 2024-09-12T00:01:47.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.729+0000 7f9bc2ad1640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bbc10ea10 0x7f9bbc1a3130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4005e30 tx=0x7f9bb4008d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:47.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.732+0000 7f9bb37fe640 1 -- 172.21.15.60:0/2686620762 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4008300 con 0x7f9bbc10ea10 2024-09-12T00:01:47.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.732+0000 7f9bc32d2640 1 -- 172.21.15.60:0/2686620762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bbc1a3900 con 0x7f9bbc10ea10 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.732+0000 7f9bc32d2640 1 -- 172.21.15.60:0/2686620762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bbc1a3e60 con 0x7f9bbc10ea10 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.732+0000 7f9bb37fe640 1 -- 172.21.15.60:0/2686620762 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9bb4003970 con 0x7f9bbc10ea10 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.732+0000 7f9bb37fe640 1 -- 172.21.15.60:0/2686620762 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4004530 con 0x7f9bbc10ea10 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.738+0000 7f9bc690d740 1 Processor -- start 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.738+0000 7f9bc690d740 1 -- start start 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.739+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188afd20 0x5587188ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.739+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.739+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188bb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.739+0000 7f9bc690d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5587188142f0 con 0x5587188b9550 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.739+0000 7f9bc690d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5587187bbcf0 con 0x5587188afd20 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.739+0000 7f9bc690d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5587188102b0 con 0x5587188ae7b0 2024-09-12T00:01:47.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.739+0000 7f9bb37fe640 1 -- 172.21.15.60:0/2686620762 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9bb40046d0 con 0x7f9bbc10ea10 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.740+0000 7f9bc22d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.742+0000 7f9bc22d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:59848/0 (socket says 172.21.15.60:59848) 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.742+0000 7f9bc22d0640 1 -- 172.21.15.60:0/1523093656 learned_addr learned my addr 172.21.15.60:0/1523093656 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.742+0000 7f9bb37fe640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9ba80a2e40 0x7f9ba80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.742+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188afd20 0x5587188ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.742+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188bb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.742+0000 7f9bb37fe640 1 -- 172.21.15.60:0/2686620762 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9bb40ef880 con 0x7f9bbc10ea10 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.743+0000 7f9bc22d0640 1 -- 172.21.15.60:0/1523093656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188afd20 msgr2=0x5587188ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:47.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.743+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188afd20 0x5587188ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.743+0000 7f9bc22d0640 1 -- 172.21.15.60:0/1523093656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 msgr2=0x5587188bb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.743+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188bb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.743+0000 7f9bc22d0640 1 -- 172.21.15.60:0/1523093656 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587187a03a0 con 0x5587188ae7b0 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.743+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188aebf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8004570 tx=0x7f9bb8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68a0012d9edc5337 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.744+0000 7f9bb0ff9640 1 -- 172.21.15.60:0/1523093656 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800be00 con 0x5587188ae7b0 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.744+0000 7f9bb0ff9640 1 -- 172.21.15.60:0/1523093656 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9bb8005520 con 0x5587188ae7b0 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.744+0000 7f9bb0ff9640 1 -- 172.21.15.60:0/1523093656 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8016470 con 0x5587188ae7b0 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.746+0000 7f9bc2ad1640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9ba80a2e40 0x7f9ba80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.747+0000 7f9bc690d740 1 -- 172.21.15.60:0/1523093656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 msgr2=0x5587188aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.747+0000 7f9bc690d740 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188aebf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8004570 tx=0x7f9bb8005f90 comp rx=0 tx=0).stop 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.748+0000 7f9bc690d740 1 -- 172.21.15.60:0/1523093656 shutdown_connections 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.748+0000 7f9bc690d740 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188bb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.748+0000 7f9bc690d740 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188aebf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.748+0000 7f9bc690d740 1 --2- 172.21.15.60:0/1523093656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188afd20 0x5587188ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.748+0000 7f9bc690d740 1 -- 172.21.15.60:0/1523093656 >> 172.21.15.60:0/1523093656 conn(0x558718877310 msgr2=0x5587188aae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.748+0000 7f9bc2ad1640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9ba80a2e40 0x7f9ba80a5300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40b8870 tx=0x7f9bb400c040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.751+0000 7f9bc690d740 1 -- 172.21.15.60:0/1523093656 shutdown_connections 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.751+0000 7f9bc690d740 1 -- 172.21.15.60:0/1523093656 wait complete. 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.751+0000 7f9bc690d740 1 -- start start 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.752+0000 7f9bc690d740 1 Processor -- start 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.752+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.752+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.752+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.752+0000 7f9bc690d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5587188bc250 con 0x5587188b9550 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.752+0000 7f9bc690d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5587187cf060 con 0x5587188ae7b0 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.752+0000 7f9bc690d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5587188bc3d0 con 0x5587188afd20 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc22d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc22d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:59858/0 (socket says 172.21.15.60:59858) 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc22d0640 1 -- 172.21.15.60:0/303781263 learned_addr learned my addr 172.21.15.60:0/303781263 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc22d0640 1 -- 172.21.15.60:0/303781263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 msgr2=0x5587188b8ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc690d740 10 client.0 _ll_register_callbacks cb 0x5587185228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc22d0640 1 -- 172.21.15.60:0/303781263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 msgr2=0x5587188b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc22d0640 1 -- 172.21.15.60:0/303781263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587185853c0 con 0x5587188afd20 2024-09-12T00:01:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:01:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.753+0000 7f9bc690d740 1 -- 172.21.15.60:0/303781263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bb8005520 con 0x5587188afd20 2024-09-12T00:01:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.754+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b6180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800b3c0 tx=0x7f9bb8004920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5c294d27c6a7a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:47.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.754+0000 7f9ba5ffb640 10 client.25525 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:01:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.755+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/303781263 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8024070 con 0x5587188afd20 2024-09-12T00:01:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.755+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/303781263 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9bb8004ea0 con 0x5587188afd20 2024-09-12T00:01:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.755+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/303781263 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9bb80050e0 con 0x5587188afd20 2024-09-12T00:01:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.755+0000 7f9bc690d740 10 client.25525 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.756+0000 7f9bc690d740 1 -- 172.21.15.60:0/303781263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5587188c7c30 con 0x5587188afd20 2024-09-12T00:01:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.756+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/303781263 <== mon.1 v2:172.21.15.192:3300/0 4 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f9bb8016470 con 0x5587188afd20 2024-09-12T00:01:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.756+0000 7f9bc690d740 10 client.25525 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:47.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.756+0000 7f9bc690d740 10 client.25525 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.756+0000 7f9bc690d740 20 client.25525 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.757+0000 7f9bc690d740 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5587188c9450 0x5587188cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.757+0000 7f9bc690d740 4 client.25525 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.757+0000 7f9bc690d740 1 -- 172.21.15.60:0/303781263 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558718821860 con 0x5587188c9450 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.757+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5587188c9450 0x5587188cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.758+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5587188c9450 0x5587188cb8b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2bb8f7d54a4a52b7 server_cookie=79d7365ed90a19af in_seq=0 out_seq=0 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.758+0000 7f9ba5ffb640 10 client.25525 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/303781263 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558718821860 con 0x5587188c9450 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9ba5ffb640 10 client.25525 handle_command_reply: tid=0 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 client.25525 shutdown 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 -- 172.21.15.60:0/303781263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 msgr2=0x5587188b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b6180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800b3c0 tx=0x7f9bb8004920 comp rx=0 tx=0).stop 2024-09-12T00:01:47.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 -- 172.21.15.60:0/303781263 shutdown_connections 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5587188c9450 0x5587188cb8b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b6180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 --2- 172.21.15.60:0/303781263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.760+0000 7f9bc690d740 1 -- 172.21.15.60:0/303781263 >> 172.21.15.60:0/303781263 conn(0x558718877310 msgr2=0x5587188b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.761+0000 7f9ba5ffb640 0 client.25525 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.761+0000 7f9bc690d740 1 -- 172.21.15.60:0/303781263 shutdown_connections 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.761+0000 7f9bc690d740 1 -- 172.21.15.60:0/303781263 wait complete. 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.762+0000 7f9bc690d740 20 client.25525 trim_cache size 0 max 16384 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc690d740 1 Processor -- start 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc690d740 1 -- start start 2024-09-12T00:01:47.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188afd20 0x5587188c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188b9550 0x5587188b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc690d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba000e700 con 0x5587188afd20 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc690d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0010300 con 0x5587188b9550 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc690d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba000edd0 con 0x5587188ae7b0 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc22d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188afd20 0x5587188c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc22d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188afd20 0x5587188c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48296/0 (socket says 172.21.15.60:48296) 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc22d0640 1 -- 172.21.15.60:0/1011860969 learned_addr learned my addr 172.21.15.60:0/1011860969 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188b9550 0x5587188b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc22d0640 1 -- 172.21.15.60:0/1011860969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 msgr2=0x5587188b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:47.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc22d0640 1 -- 172.21.15.60:0/1011860969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188b9550 msgr2=0x5587188b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188b9550 0x5587188b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.793+0000 7f9bc22d0640 1 -- 172.21.15.60:0/1011860969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587188cbf30 con 0x5587188afd20 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.794+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188afd20 0x5587188c5580 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80169a0 tx=0x7f9bb801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8223172092fca1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.794+0000 7f9ba7fff640 1 -- 172.21.15.60:0/1011860969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8042070 con 0x5587188afd20 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.794+0000 7f9ba7fff640 1 -- 172.21.15.60:0/1011860969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9bb8005520 con 0x5587188afd20 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.794+0000 7f9ba7fff640 1 -- 172.21.15.60:0/1011860969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8029960 con 0x5587188afd20 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 -- 172.21.15.60:0/1011860969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188afd20 msgr2=0x5587188c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188afd20 0x5587188c5580 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80169a0 tx=0x7f9bb801b000 comp rx=0 tx=0).stop 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 -- 172.21.15.60:0/1011860969 shutdown_connections 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188b9550 0x5587188b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188afd20 0x5587188c5580 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 --2- 172.21.15.60:0/1011860969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188ae7b0 0x5587188b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 -- 172.21.15.60:0/1011860969 >> 172.21.15.60:0/1011860969 conn(0x558718877310 msgr2=0x5587188b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 -- 172.21.15.60:0/1011860969 shutdown_connections 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 -- 172.21.15.60:0/1011860969 wait complete. 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 -- start start 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.795+0000 7f9bc690d740 1 Processor -- start 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc690d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc690d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba000fb70 con 0x5587188b9550 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc690d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba000f4a0 con 0x5587188ae7b0 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc690d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba000c6e0 con 0x5587188afd20 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc690d740 10 client.0 _ll_register_callbacks cb 0x7f9bb8004470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:47.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc1acf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc1acf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48306/0 (socket says 172.21.15.60:48306) 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc1acf640 1 -- 172.21.15.60:0/4266218688 learned_addr learned my addr 172.21.15.60:0/4266218688 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.796+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc1acf640 1 -- 172.21.15.60:0/4266218688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 msgr2=0x5587188b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc1acf640 1 -- 172.21.15.60:0/4266218688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 msgr2=0x5587188c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc1acf640 1 -- 172.21.15.60:0/4266218688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587188abb40 con 0x5587188b9550 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9ba5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc1acf640 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b3260 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9bac005780 tx=0x7f9bb8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68be7ece41f5c53b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/4266218688 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bac011ea0 con 0x5587188b9550 2024-09-12T00:01:47.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/4266218688 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9bac013050 con 0x5587188b9550 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc690d740 1 -- 172.21.15.60:0/4266218688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bb8005520 con 0x5587188b9550 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/4266218688 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9bac02f050 con 0x5587188b9550 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc690d740 10 client.16017 fetch_fsmap learned FSMap version 31 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9bc690d740 1 -- 172.21.15.60:0/4266218688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5587188ae4b0 con 0x5587188b9550 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.797+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/4266218688 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9bb8005520 con 0x5587188b9550 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/4266218688 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f9bac01b260 con 0x5587188b9550 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9bc690d740 10 client.16017 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9bc690d740 10 client.16017 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9bc690d740 20 client.16017 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9bc690d740 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x558718934430 0x558718936850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9bc690d740 4 client.16017 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9bc690d740 1 -- 172.21.15.60:0/4266218688 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55871881bd70 con 0x558718934430 2024-09-12T00:01:47.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x558718934430 0x558718936850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9bc22d0640 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x558718934430 0x558718936850 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e475613d1ab40f1c server_cookie=6bb959a37c744a81 in_seq=0 out_seq=0 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.798+0000 7f9ba5ffb640 10 client.16017 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9ba5ffb640 1 -- 172.21.15.60:0/4266218688 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55871881bd70 con 0x558718934430 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9ba5ffb640 10 client.16017 handle_command_reply: tid=0 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 client.16017 shutdown 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 -- 172.21.15.60:0/4266218688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 msgr2=0x5587188b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b3260 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9bac005780 tx=0x7f9bb8004af0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 -- 172.21.15.60:0/4266218688 shutdown_connections 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x558718934430 0x558718936850 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5587188b9550 0x5587188b3260 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5587188afd20 0x5587188b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 --2- 172.21.15.60:0/4266218688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5587188ae7b0 0x5587188c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 -- 172.21.15.60:0/4266218688 >> 172.21.15.60:0/4266218688 conn(0x558718877310 msgr2=0x5587188b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:47.287 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:01:47.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9ba5ffb640 0 client.16017 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:01:47.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 -- 172.21.15.60:0/4266218688 shutdown_connections 2024-09-12T00:01:47.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.805+0000 7f9bc690d740 1 -- 172.21.15.60:0/4266218688 wait complete. 2024-09-12T00:01:47.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc690d740 20 client.16017 trim_cache size 0 max 16384 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 -- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9ba80a2e40 msgr2=0x7f9ba80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9ba80a2e40 0x7f9ba80a5300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40b8870 tx=0x7f9bb400c040 comp rx=0 tx=0).stop 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 -- 172.21.15.60:0/2686620762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bbc10ea10 msgr2=0x7f9bbc1a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bbc10ea10 0x7f9bbc1a3130 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4005e30 tx=0x7f9bb4008d90 comp rx=0 tx=0).stop 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 -- 172.21.15.60:0/2686620762 shutdown_connections 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9ba80a2e40 0x7f9ba80a5300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bbc10ea10 0x7f9bbc1a3130 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bbc109e00 0x7f9bbc19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 --2- 172.21.15.60:0/2686620762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bbc109450 0x7f9bbc19e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 -- 172.21.15.60:0/2686620762 >> 172.21.15.60:0/2686620762 conn(0x7f9bbc073660 msgr2=0x7f9bbc06d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 -- 172.21.15.60:0/2686620762 shutdown_connections 2024-09-12T00:01:47.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:46.806+0000 7f9bc32d2640 1 -- 172.21.15.60:0/2686620762 wait complete. 2024-09-12T00:01:48.126 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar c linux-4.0.5 2024-09-12T00:01:48.597 INFO:tasks.workunit.client.0.smithi060.stderr:+ rm -rf linux-4.0.5 2024-09-12T00:01:48.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:01:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:49.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:48 smithi060 ceph-mon[30953]: pgmap v76: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 523 KiB/s wr, 78 op/s 2024-09-12T00:01:49.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:48 smithi105 ceph-mon[34805]: pgmap v76: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 523 KiB/s wr, 78 op/s 2024-09-12T00:01:49.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:48 smithi192 ceph-mon[35487]: pgmap v76: 97 pgs: 97 active+clean; 198 MiB data, 903 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 523 KiB/s wr, 78 op/s 2024-09-12T00:01:49.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.532+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/1360028136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4810e4d0 msgr2=0x7f6a481108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.532+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/1360028136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4810e4d0 0x7f6a481108e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009ca0 tx=0x7f6a4002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.533+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/1360028136 shutdown_connections 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.533+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/1360028136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4810e4d0 0x7f6a481108e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.533+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/1360028136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a48101360 0x7f6a4810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.533+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/1360028136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a481009b0 0x7f6a48100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.533+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/1360028136 >> 172.21.15.60:0/1360028136 conn(0x7f6a480fc7d0 msgr2=0x7f6a480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.533+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/1360028136 shutdown_connections 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.533+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/1360028136 wait complete. 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4cbaf640 1 Processor -- start 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4cbaf640 1 -- start start 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4cbaf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a481009b0 0x7f6a481a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4cbaf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a48101360 0x7f6a481a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4cbaf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4810e4d0 0x7f6a4819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4cbaf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48114360 con 0x7f6a4810e4d0 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4cbaf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481141e0 con 0x7f6a48101360 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4cbaf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481144e0 con 0x7f6a481009b0 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a46d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4810e4d0 0x7f6a4819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a45d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a48101360 0x7f6a481a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a4659c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a481009b0 0x7f6a481a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a45d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a48101360 0x7f6a481a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:55006/0 (socket says 172.21.15.60:55006) 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a45d9b640 1 -- 172.21.15.60:0/779447528 learned_addr learned my addr 172.21.15.60:0/779447528 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a45d9b640 1 -- 172.21.15.60:0/779447528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a481009b0 msgr2=0x7f6a481a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a481009b0 0x7f6a481a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a45d9b640 1 -- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4810e4d0 msgr2=0x7f6a4819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4810e4d0 0x7f6a4819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.534+0000 7f6a45d9b640 1 -- 172.21.15.60:0/779447528 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4819ad00 con 0x7f6a48101360 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.535+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a48101360 0x7f6a481a0950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e9f0 tx=0x7f6a3c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.535+0000 7f6a377fe640 1 -- 172.21.15.60:0/779447528 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00cd80 con 0x7f6a48101360 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.535+0000 7f6a377fe640 1 -- 172.21.15.60:0/779447528 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a3c010930 con 0x7f6a48101360 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.535+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/779447528 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4819aff0 con 0x7f6a48101360 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.535+0000 7f6a377fe640 1 -- 172.21.15.60:0/779447528 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c018b00 con 0x7f6a48101360 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.535+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/779447528 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a481a72e0 con 0x7f6a48101360 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4ef88740 1 Processor -- start 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a377fe640 1 -- 172.21.15.60:0/779447528 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6a3c018ca0 con 0x7f6a48101360 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4ef88740 1 -- start start 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b404090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 0x55920b404a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b411760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55920b36a2f0 con 0x55920b405b40 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55920b311cf0 con 0x55920b40f370 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55920b3662b0 con 0x55920b4045d0 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a46d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b404090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a46d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b404090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48330/0 (socket says 172.21.15.60:48330) 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a46d9d640 1 -- 172.21.15.60:0/1357996059 learned_addr learned my addr 172.21.15.60:0/1357996059 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a4659c640 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 0x55920b404a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.538+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b411760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a46d9d640 1 -- 172.21.15.60:0/1357996059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 msgr2=0x55920b404a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a46d9d640 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 0x55920b404a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a46d9d640 1 -- 172.21.15.60:0/1357996059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 msgr2=0x55920b411760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:49.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a46d9d640 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b411760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a46d9d640 1 -- 172.21.15.60:0/1357996059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55920b2f63a0 con 0x55920b405b40 2024-09-12T00:01:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a377fe640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6a300a2cf0 0x7f6a300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a46d9d640 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b404090 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005f80 tx=0x7f6a40009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7d4d9886f14aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a4659c640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6a300a2cf0 0x7f6a300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a377fe640 1 -- 172.21.15.60:0/779447528 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6a3c0cf790 con 0x7f6a48101360 2024-09-12T00:01:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a34ff9640 1 -- 172.21.15.60:0/1357996059 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40031db0 con 0x55920b405b40 2024-09-12T00:01:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a34ff9640 1 -- 172.21.15.60:0/1357996059 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a40036040 con 0x55920b405b40 2024-09-12T00:01:49.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.539+0000 7f6a34ff9640 1 -- 172.21.15.60:0/1357996059 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40004380 con 0x55920b405b40 2024-09-12T00:01:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1357996059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 msgr2=0x55920b404090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4659c640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6a300a2cf0 0x7f6a300a51b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55920b401ac0 tx=0x7f6a38005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b404090 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6a40005f80 tx=0x7f6a40009800 comp rx=0 tx=0).stop 2024-09-12T00:01:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1357996059 shutdown_connections 2024-09-12T00:01:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b411760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 0x55920b404a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/1357996059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b404090 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1357996059 >> 172.21.15.60:0/1357996059 conn(0x55920b3cd310 msgr2=0x55920b400c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1357996059 shutdown_connections 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.540+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1357996059 wait complete. 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 1 -- start start 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 1 Processor -- start 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 0x55920b40ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b40bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b40c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55920b411e90 con 0x55920b405b40 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55920b325060 con 0x55920b40f370 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55920b412010 con 0x55920b4045d0 2024-09-12T00:01:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4ef88740 10 client.0 _ll_register_callbacks cb 0x55920b0788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a45d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b40bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a45d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b40bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48336/0 (socket says 172.21.15.60:48336) 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a45d9b640 1 -- 172.21.15.60:0/3030191982 learned_addr learned my addr 172.21.15.60:0/3030191982 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a46d9d640 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b40c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.541+0000 7f6a4659c640 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 0x55920b40ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a45d9b640 1 -- 172.21.15.60:0/3030191982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 msgr2=0x55920b40ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 0x55920b40ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a45d9b640 1 -- 172.21.15.60:0/3030191982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 msgr2=0x55920b40c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b40c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a45d9b640 1 -- 172.21.15.60:0/3030191982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55920b0db3c0 con 0x55920b405b40 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b40bfb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c09ba50 tx=0x7f6a3c097990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6425c0d244c0ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a2dffb640 1 -- 172.21.15.60:0/3030191982 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c09b6b0 con 0x55920b405b40 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a4ef88740 1 -- 172.21.15.60:0/3030191982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a40036040 con 0x55920b405b40 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a2dffb640 1 -- 172.21.15.60:0/3030191982 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6a3c0cfb80 con 0x55920b405b40 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a2dffb640 1 -- 172.21.15.60:0/3030191982 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6a3c0cd360 con 0x55920b405b40 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a4ef88740 10 client.16029 fetch_fsmap learned FSMap version 32 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a4ef88740 1 -- 172.21.15.60:0/3030191982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55920b41d910 con 0x55920b405b40 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.542+0000 7f6a2dffb640 1 -- 172.21.15.60:0/3030191982 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a40036040 con 0x55920b405b40 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a2dffb640 1 -- 172.21.15.60:0/3030191982 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f6a3c09b2c0 con 0x55920b405b40 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a4ef88740 10 client.16029 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a4ef88740 10 client.16029 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a4ef88740 20 client.16029 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55920b41ed20 0x55920b421160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a4ef88740 4 client.16029 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:49.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a4ef88740 1 -- 172.21.15.60:0/3030191982 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55920b377860 con 0x55920b41ed20 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a4659c640 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55920b41ed20 0x55920b421160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a4659c640 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55920b41ed20 0x55920b421160 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=606413fb93292451 server_cookie=96f6166e909f6dd5 in_seq=0 out_seq=0 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.543+0000 7f6a2dffb640 10 client.16029 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a2dffb640 1 -- 172.21.15.60:0/3030191982 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55920b377860 con 0x55920b41ed20 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a2dffb640 10 client.16029 handle_command_reply: tid=0 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 client.16029 shutdown 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 -- 172.21.15.60:0/3030191982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 msgr2=0x55920b40bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b40bfb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c09ba50 tx=0x7f6a3c097990 comp rx=0 tx=0).stop 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 -- 172.21.15.60:0/3030191982 shutdown_connections 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55920b41ed20 0x55920b421160 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b40c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b405b40 0x55920b40bfb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/3030191982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b4045d0 0x55920b40ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a2dffb640 0 client.16029 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:01:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 -- 172.21.15.60:0/3030191982 >> 172.21.15.60:0/3030191982 conn(0x55920b3cd310 msgr2=0x55920b406960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.544+0000 7f6a4ef88740 1 -- 172.21.15.60:0/3030191982 shutdown_connections 2024-09-12T00:01:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.545+0000 7f6a4ef88740 1 -- 172.21.15.60:0/3030191982 wait complete. 2024-09-12T00:01:49.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.545+0000 7f6a4ef88740 20 client.16029 trim_cache size 0 max 16384 2024-09-12T00:01:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4ef88740 1 Processor -- start 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4ef88740 1 -- start start 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b4045d0 0x55920b41b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 0x55920b40df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b40f370 0x55920b426a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481af970 con 0x55920b40f370 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b15d0 con 0x55920b4045d0 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b0040 con 0x55920b405b40 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b40f370 0x55920b426a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b40f370 0x55920b426a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48340/0 (socket says 172.21.15.60:48340) 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 -- 172.21.15.60:0/1251293775 learned_addr learned my addr 172.21.15.60:0/1251293775 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a4659c640 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b4045d0 0x55920b41b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 0x55920b40df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 -- 172.21.15.60:0/1251293775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 msgr2=0x55920b40df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 0x55920b40df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 -- 172.21.15.60:0/1251293775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b4045d0 msgr2=0x55920b41b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b4045d0 0x55920b41b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 -- 172.21.15.60:0/1251293775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55920b40a500 con 0x55920b40f370 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.558+0000 7f6a46d9d640 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b40f370 0x55920b426a30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6a40031a60 tx=0x7f6a4002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2d68da57caebd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a2ffff640 1 -- 172.21.15.60:0/1251293775 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40052070 con 0x55920b40f370 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a2ffff640 1 -- 172.21.15.60:0/1251293775 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a40036070 con 0x55920b40f370 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a2ffff640 1 -- 172.21.15.60:0/1251293775 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a400042a0 con 0x55920b40f370 2024-09-12T00:01:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1251293775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b40f370 msgr2=0x55920b426a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b40f370 0x55920b426a30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6a40031a60 tx=0x7f6a4002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1251293775 shutdown_connections 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b40f370 0x55920b426a30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 0x55920b40df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/1251293775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b4045d0 0x55920b41b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1251293775 >> 172.21.15.60:0/1251293775 conn(0x55920b3cd310 msgr2=0x55920b40d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.559+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1251293775 shutdown_connections 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 -- 172.21.15.60:0/1251293775 wait complete. 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 -- start start 2024-09-12T00:01:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 Processor -- start 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b4045d0 0x55920b417870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 0x55920b413bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b4140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b0e40 con 0x55920b4045d0 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b0710 con 0x55920b40f370 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481ad950 con 0x55920b405b40 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4ef88740 10 client.0 _ll_register_callbacks cb 0x7f6a3c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b4045d0 0x55920b417870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b4045d0 0x55920b417870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48348/0 (socket says 172.21.15.60:48348) 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a4659c640 1 -- 172.21.15.60:0/354393256 learned_addr learned my addr 172.21.15.60:0/354393256 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 0x55920b413bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.560+0000 7f6a46d9d640 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b4140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4659c640 1 -- 172.21.15.60:0/354393256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 msgr2=0x55920b413bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4659c640 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 0x55920b413bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4659c640 1 -- 172.21.15.60:0/354393256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 msgr2=0x55920b4140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4659c640 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b4140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4659c640 1 -- 172.21.15.60:0/354393256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55920b414790 con 0x55920b4045d0 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4659c640 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b4045d0 0x55920b417870 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55920b4219a0 tx=0x7f6a380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f81c22141db0d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a2dffb640 1 -- 172.21.15.60:0/354393256 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004430 con 0x55920b4045d0 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a2dffb640 1 -- 172.21.15.60:0/354393256 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6a38005020 con 0x55920b4045d0 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4ef88740 1 -- 172.21.15.60:0/354393256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a40036070 con 0x55920b4045d0 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a2dffb640 1 -- 172.21.15.60:0/354393256 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6a38005220 con 0x55920b4045d0 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4ef88740 10 client.16035 fetch_fsmap learned FSMap version 32 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.561+0000 7f6a4ef88740 1 -- 172.21.15.60:0/354393256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55920b48a8e0 con 0x55920b4045d0 2024-09-12T00:01:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a2dffb640 1 -- 172.21.15.60:0/354393256 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a38004ca0 con 0x55920b4045d0 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a2dffb640 1 -- 172.21.15.60:0/354393256 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f6a3802b6e0 con 0x55920b4045d0 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a4ef88740 10 client.16035 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a4ef88740 10 client.16035 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a4ef88740 20 client.16035 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55920b48b090 0x55920b48d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a4ef88740 4 client.16035 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a4ef88740 1 -- 172.21.15.60:0/354393256 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6a40036070 con 0x55920b48b090 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55920b48b090 0x55920b48d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a2dffb640 10 client.16035 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a45d9b640 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55920b48b090 0x55920b48d4b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce6c55ff9b55fe95 server_cookie=4b3ccf245d94e1d3 in_seq=0 out_seq=0 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a2dffb640 1 -- 172.21.15.60:0/354393256 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6a40036070 con 0x55920b48b090 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.562+0000 7f6a2dffb640 10 client.16035 handle_command_reply: tid=0 2024-09-12T00:01:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 client.16035 shutdown 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 -- 172.21.15.60:0/354393256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b4045d0 msgr2=0x55920b417870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b4045d0 0x55920b417870 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55920b4219a0 tx=0x7f6a380046c0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 -- 172.21.15.60:0/354393256 shutdown_connections 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55920b48b090 0x55920b48d4b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55920b40f370 0x55920b4140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55920b405b40 0x55920b413bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 --2- 172.21.15.60:0/354393256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55920b4045d0 0x55920b417870 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 -- 172.21.15.60:0/354393256 >> 172.21.15.60:0/354393256 conn(0x55920b3cd310 msgr2=0x55920b40e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a2dffb640 0 client.16035 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 -- 172.21.15.60:0/354393256 shutdown_connections 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 1 -- 172.21.15.60:0/354393256 wait complete. 2024-09-12T00:01:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4ef88740 20 client.16035 trim_cache size 0 max 16384 2024-09-12T00:01:49.569 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:01:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6a300a2cf0 msgr2=0x7f6a300a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6a300a2cf0 0x7f6a300a51b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55920b401ac0 tx=0x7f6a38005f90 comp rx=0 tx=0).stop 2024-09-12T00:01:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/779447528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a48101360 msgr2=0x7f6a481a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.563+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a48101360 0x7f6a481a0950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e9f0 tx=0x7f6a3c00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.564+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/779447528 shutdown_connections 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.564+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6a300a2cf0 0x7f6a300a51b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.564+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a4810e4d0 0x7f6a4819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.564+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a48101360 0x7f6a481a0950 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.564+0000 7f6a4cbaf640 1 --2- 172.21.15.60:0/779447528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a481009b0 0x7f6a481a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.564+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/779447528 >> 172.21.15.60:0/779447528 conn(0x7f6a480fc7d0 msgr2=0x7f6a480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.564+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/779447528 shutdown_connections 2024-09-12T00:01:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:49.564+0000 7f6a4cbaf640 1 -- 172.21.15.60:0/779447528 wait complete. 2024-09-12T00:01:50.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:49 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:50.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:49 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:50.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:49 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:50.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:01:50.716 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:51.098 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:50 smithi060 ceph-mon[30953]: pgmap v77: 97 pgs: 97 active+clean; 224 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 343 op/s 2024-09-12T00:01:51.184 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:50 smithi192 ceph-mon[35487]: pgmap v77: 97 pgs: 97 active+clean; 224 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 343 op/s 2024-09-12T00:01:51.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 -- 172.21.15.60:0/4154973875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccfc106f10 msgr2=0x7fccfc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 --2- 172.21.15.60:0/4154973875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccfc106f10 0x7fccfc10ea90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009ca0 tx=0x7fccf402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 -- 172.21.15.60:0/4154973875 shutdown_connections 2024-09-12T00:01:51.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 --2- 172.21.15.60:0/4154973875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccfc106f10 0x7fccfc10ea90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 --2- 172.21.15.60:0/4154973875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccfc102790 0x7fccfc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 --2- 172.21.15.60:0/4154973875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc101de0 0x7fccfc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 -- 172.21.15.60:0/4154973875 >> 172.21.15.60:0/4154973875 conn(0x7fccfc0fd8c0 msgr2=0x7fccfc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 -- 172.21.15.60:0/4154973875 shutdown_connections 2024-09-12T00:01:51.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.186+0000 7fcd02857640 1 -- 172.21.15.60:0/4154973875 wait complete. 2024-09-12T00:01:51.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd02857640 1 Processor -- start 2024-09-12T00:01:51.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd02857640 1 -- start start 2024-09-12T00:01:51.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd02857640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc101de0 0x7fccfc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd02857640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccfc102790 0x7fccfc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd02857640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccfc106f10 0x7fccfc19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd02857640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc112090 con 0x7fccfc106f10 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd02857640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc111f10 con 0x7fccfc102790 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd02857640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc112210 con 0x7fccfc101de0 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fccfbfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc101de0 0x7fccfc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.187+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccfc106f10 0x7fccfc19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfbfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc101de0 0x7fccfc198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:59938/0 (socket says 172.21.15.60:59938) 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccfc102790 0x7fccfc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfbfff640 1 -- 172.21.15.60:0/2571055216 learned_addr learned my addr 172.21.15.60:0/2571055216 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfbfff640 1 -- 172.21.15.60:0/2571055216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccfc102790 msgr2=0x7fccfc1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfbfff640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccfc102790 0x7fccfc1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfbfff640 1 -- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccfc106f10 msgr2=0x7fccfc19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfbfff640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccfc106f10 0x7fccfc19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfbfff640 1 -- 172.21.15.60:0/2571055216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccfc19d410 con 0x7fccfc101de0 2024-09-12T00:01:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccfbfff640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc101de0 0x7fccfc198460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccec00e9f0 tx=0x7fccec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccf97fa640 1 -- 172.21.15.60:0/2571055216 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec00cd80 con 0x7fccfc101de0 2024-09-12T00:01:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fcd02857640 1 -- 172.21.15.60:0/2571055216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccfc19d700 con 0x7fccfc101de0 2024-09-12T00:01:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccf97fa640 1 -- 172.21.15.60:0/2571055216 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fccec010930 con 0x7fccfc101de0 2024-09-12T00:01:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fcd02857640 1 -- 172.21.15.60:0/2571055216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccfc1a4fe0 con 0x7fccfc101de0 2024-09-12T00:01:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.188+0000 7fccf97fa640 1 -- 172.21.15.60:0/2571055216 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec018b00 con 0x7fccfc101de0 2024-09-12T00:01:51.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.191+0000 7fcd04c30740 1 Processor -- start 2024-09-12T00:01:51.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd04c30740 1 -- start start 2024-09-12T00:01:51.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fccf97fa640 1 -- 172.21.15.60:0/2571055216 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fccec018ca0 con 0x7fccfc101de0 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9249090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9249a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d9256760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd04c30740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5558d91af2f0 con 0x5558d9254370 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd04c30740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5558d9156cf0 con 0x5558d92495d0 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd04c30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5558d91ab2b0 con 0x5558d924ab40 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9249090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9249090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:59948/0 (socket says 172.21.15.60:59948) 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd00df4640 1 -- 172.21.15.60:0/3348338085 learned_addr learned my addr 172.21.15.60:0/3348338085 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d9256760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fccfbfff640 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9249a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd00df4640 1 -- 172.21.15.60:0/3348338085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 msgr2=0x5558d9249a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd00df4640 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9249a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd00df4640 1 -- 172.21.15.60:0/3348338085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 msgr2=0x5558d9256760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd00df4640 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d9256760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fcd00df4640 1 -- 172.21.15.60:0/3348338085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558d913b3a0 con 0x5558d924ab40 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.192+0000 7fccfbfff640 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9249a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.193+0000 7fccf97fa640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcce40a2cf0 0x7fcce40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.193+0000 7fcd00df4640 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9249090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccf4005f80 tx=0x7fccf4009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51133d1847d48c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.193+0000 7fccfbfff640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcce40a2cf0 0x7fcce40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.193+0000 7fcce27fc640 1 -- 172.21.15.60:0/3348338085 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4031db0 con 0x5558d924ab40 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.193+0000 7fcce27fc640 1 -- 172.21.15.60:0/3348338085 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fccf4036040 con 0x5558d924ab40 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.193+0000 7fcce27fc640 1 -- 172.21.15.60:0/3348338085 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf40043c0 con 0x5558d924ab40 2024-09-12T00:01:51.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.193+0000 7fccf97fa640 1 -- 172.21.15.60:0/2571055216 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fccec0cf780 con 0x7fccfc101de0 2024-09-12T00:01:51.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 -- 172.21.15.60:0/3348338085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 msgr2=0x5558d9249090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9249090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccf4005f80 tx=0x7fccf4009800 comp rx=0 tx=0).stop 2024-09-12T00:01:51.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fccfbfff640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcce40a2cf0 0x7fcce40a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fccec0ccfd0 tx=0x7fccec018520 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 -- 172.21.15.60:0/3348338085 shutdown_connections 2024-09-12T00:01:51.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d9256760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9249a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3348338085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9249090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 -- 172.21.15.60:0/3348338085 >> 172.21.15.60:0/3348338085 conn(0x5558d9212310 msgr2=0x5558d9245c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 -- 172.21.15.60:0/3348338085 shutdown_connections 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 -- 172.21.15.60:0/3348338085 wait complete. 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 -- start start 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 Processor -- start 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d92495d0 0x5558d9253d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d924ab40 0x5558d9251020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.194+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d9251610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd04c30740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5558d9256e90 con 0x5558d9254370 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd04c30740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5558d916a060 con 0x5558d924ab40 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd04c30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5558d9257010 con 0x5558d92495d0 2024-09-12T00:01:51.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd04c30740 10 client.0 _ll_register_callbacks cb 0x5558d8ebd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d9251610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d92495d0 0x5558d9253d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d92495d0 0x5558d9253d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:59952/0 (socket says 172.21.15.60:59952) 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 -- 172.21.15.60:0/3732396121 learned_addr learned my addr 172.21.15.60:0/3732396121 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d924ab40 0x5558d9251020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 -- 172.21.15.60:0/3732396121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d924ab40 msgr2=0x5558d9251020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d924ab40 0x5558d9251020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 -- 172.21.15.60:0/3732396121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 msgr2=0x5558d9251610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d9251610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 -- 172.21.15.60:0/3732396121 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558d8f203c0 con 0x5558d92495d0 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd00df4640 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d92495d0 0x5558d9253d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009620 tx=0x7fccf402a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c192b10f85057407 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fccdb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:01:51.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fccdb7fe640 1 -- 172.21.15.60:0/3732396121 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4004340 con 0x5558d92495d0 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fccdb7fe640 1 -- 172.21.15.60:0/3732396121 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fccf4003970 con 0x5558d92495d0 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.195+0000 7fcd04c30740 1 -- 172.21.15.60:0/3732396121 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccf4036040 con 0x5558d92495d0 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fccdb7fe640 1 -- 172.21.15.60:0/3732396121 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fccf4003b70 con 0x5558d92495d0 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fcd04c30740 10 client.25561 fetch_fsmap learned FSMap version 32 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fcd04c30740 1 -- 172.21.15.60:0/3732396121 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5558d9256e90 con 0x5558d92495d0 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fccdb7fe640 1 -- 172.21.15.60:0/3732396121 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fccf4036040 con 0x5558d92495d0 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fccdb7fe640 1 -- 172.21.15.60:0/3732396121 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fccf4043070 con 0x5558d92495d0 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fcd04c30740 10 client.25561 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fcd04c30740 10 client.25561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fcd04c30740 20 client.25561 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5558d9263ab0 0x5558d9265ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fcd04c30740 4 client.25561 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fcd04c30740 1 -- 172.21.15.60:0/3732396121 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558d91bc860 con 0x5558d9263ab0 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.196+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5558d9263ab0 0x5558d9265ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.197+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5558d9263ab0 0x5558d9265ea0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f836d45dd0fc4d server_cookie=489e158b62b9ede9 in_seq=0 out_seq=0 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.197+0000 7fccdb7fe640 10 client.25561 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.197+0000 7fccdb7fe640 1 -- 172.21.15.60:0/3732396121 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558d91bc860 con 0x5558d9263ab0 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.197+0000 7fccdb7fe640 10 client.25561 handle_command_reply: tid=0 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.197+0000 7fcd04c30740 1 client.25561 shutdown 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.197+0000 7fcd04c30740 1 -- 172.21.15.60:0/3732396121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d92495d0 msgr2=0x5558d9253d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.197+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d92495d0 0x5558d9253d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009620 tx=0x7fccf402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 1 -- 172.21.15.60:0/3732396121 shutdown_connections 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5558d9263ab0 0x5558d9265ea0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d9251610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d924ab40 0x5558d9251020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 1 --2- 172.21.15.60:0/3732396121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d92495d0 0x5558d9253d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fccdb7fe640 0 client.25561 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:51.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 1 -- 172.21.15.60:0/3732396121 >> 172.21.15.60:0/3732396121 conn(0x5558d9212310 msgr2=0x5558d924b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 1 -- 172.21.15.60:0/3732396121 shutdown_connections 2024-09-12T00:01:51.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 1 -- 172.21.15.60:0/3732396121 wait complete. 2024-09-12T00:01:51.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.198+0000 7fcd04c30740 20 client.25561 trim_cache size 0 max 16384 2024-09-12T00:01:51.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.212+0000 7fcd04c30740 1 Processor -- start 2024-09-12T00:01:51.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.212+0000 7fcd04c30740 1 -- start start 2024-09-12T00:01:51.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.212+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9260130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.212+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9244c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.212+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d926b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.212+0000 7fcd04c30740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1ad800 con 0x5558d9254370 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.212+0000 7fcd04c30740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1af460 con 0x5558d92495d0 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.212+0000 7fcd04c30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1aded0 con 0x5558d924ab40 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9260130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d926b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d926b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48402/0 (socket says 172.21.15.60:48402) 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 -- 172.21.15.60:0/2793621236 learned_addr learned my addr 172.21.15.60:0/2793621236 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9244c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 -- 172.21.15.60:0/2793621236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 msgr2=0x5558d9244c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9244c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 -- 172.21.15.60:0/2793621236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 msgr2=0x5558d9260130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9260130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 -- 172.21.15.60:0/2793621236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558d92540e0 con 0x5558d9254370 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9244c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcd00df4640 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d926b750 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009a60 tx=0x7fccf4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14daeecd0f7c454d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcce1ffb640 1 -- 172.21.15.60:0/2793621236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4009800 con 0x5558d9254370 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcce1ffb640 1 -- 172.21.15.60:0/2793621236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fccf4036040 con 0x5558d9254370 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.213+0000 7fcce1ffb640 1 -- 172.21.15.60:0/2793621236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4030a40 con 0x5558d9254370 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 -- 172.21.15.60:0/2793621236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 msgr2=0x5558d926b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d926b750 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009a60 tx=0x7fccf4000f40 comp rx=0 tx=0).stop 2024-09-12T00:01:51.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 -- 172.21.15.60:0/2793621236 shutdown_connections 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d9254370 0x5558d926b750 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d924ab40 0x5558d9244c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2793621236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d9260130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 -- 172.21.15.60:0/2793621236 >> 172.21.15.60:0/2793621236 conn(0x5558d9212310 msgr2=0x5558d9244500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 -- 172.21.15.60:0/2793621236 shutdown_connections 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 -- 172.21.15.60:0/2793621236 wait complete. 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.214+0000 7fcd04c30740 1 -- start start 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd04c30740 1 Processor -- start 2024-09-12T00:01:51.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d92ca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d924ab40 0x5558d92ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd04c30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d9254370 0x5558d925c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd04c30740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1aecd0 con 0x5558d924ab40 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd04c30740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1ae5a0 con 0x5558d92495d0 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd04c30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1ab7e0 con 0x5558d9254370 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd04c30740 10 client.0 _ll_register_callbacks cb 0x7fccf00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fccfb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d924ab40 0x5558d92ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fccfb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d924ab40 0x5558d92ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48408/0 (socket says 172.21.15.60:48408) 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fccfb7fe640 1 -- 172.21.15.60:0/2257870955 learned_addr learned my addr 172.21.15.60:0/2257870955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:51.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd00df4640 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d9254370 0x5558d925c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fcd00df4640 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d92ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fccfb7fe640 1 -- 172.21.15.60:0/2257870955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d9254370 msgr2=0x5558d925c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d9254370 0x5558d925c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.215+0000 7fccfb7fe640 1 -- 172.21.15.60:0/2257870955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 msgr2=0x5558d92ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d92ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fccfb7fe640 1 -- 172.21.15.60:0/2257870955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558d925cd00 con 0x5558d924ab40 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fccfb7fe640 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d924ab40 0x5558d92ca590 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fccf0004700 tx=0x7fccf0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12851cb6782c04e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fccdb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fccdb7fe640 1 -- 172.21.15.60:0/2257870955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0027430 con 0x5558d924ab40 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fccdb7fe640 1 -- 172.21.15.60:0/2257870955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fccf0010430 con 0x5558d924ab40 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fcd04c30740 1 -- 172.21.15.60:0/2257870955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccf4036040 con 0x5558d924ab40 2024-09-12T00:01:51.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fccdb7fe640 1 -- 172.21.15.60:0/2257870955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fccf0010630 con 0x5558d924ab40 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fcd04c30740 10 client.16053 fetch_fsmap learned FSMap version 32 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fcd04c30740 1 -- 172.21.15.60:0/2257870955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5558d92d7320 con 0x5558d924ab40 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.216+0000 7fccdb7fe640 1 -- 172.21.15.60:0/2257870955 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fccf4036040 con 0x5558d924ab40 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fccdb7fe640 1 -- 172.21.15.60:0/2257870955 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fccf001f9a0 con 0x5558d924ab40 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fcd04c30740 10 client.16053 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fcd04c30740 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fcd04c30740 20 client.16053 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5558d92d7a90 0x5558d92d9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:51.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fcd04c30740 4 client.16053 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fcd04c30740 1 -- 172.21.15.60:0/2257870955 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558d91b6d70 con 0x5558d92d7a90 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fcd00df4640 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5558d92d7a90 0x5558d92d9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fcd00df4640 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5558d92d7a90 0x5558d92d9eb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=189a132674569784 server_cookie=73809b2ab2959a27 in_seq=0 out_seq=0 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.217+0000 7fccdb7fe640 10 client.16053 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fccdb7fe640 1 -- 172.21.15.60:0/2257870955 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558d91b6d70 con 0x5558d92d7a90 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fccdb7fe640 10 client.16053 handle_command_reply: tid=0 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 client.16053 shutdown 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 -- 172.21.15.60:0/2257870955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d924ab40 msgr2=0x5558d92ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d924ab40 0x5558d92ca590 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fccf0004700 tx=0x7fccf0009310 comp rx=0 tx=0).stop 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 -- 172.21.15.60:0/2257870955 shutdown_connections 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5558d92d7a90 0x5558d92d9eb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fccdb7fe640 0 client.16053 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558d9254370 0x5558d925c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558d924ab40 0x5558d92ca590 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 --2- 172.21.15.60:0/2257870955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558d92495d0 0x5558d92ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 -- 172.21.15.60:0/2257870955 >> 172.21.15.60:0/2257870955 conn(0x5558d9212310 msgr2=0x5558d924b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 -- 172.21.15.60:0/2257870955 shutdown_connections 2024-09-12T00:01:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 1 -- 172.21.15.60:0/2257870955 wait complete. 2024-09-12T00:01:51.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.218+0000 7fcd04c30740 20 client.16053 trim_cache size 0 max 16384 2024-09-12T00:01:51.228 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 -- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcce40a2cf0 msgr2=0x7fcce40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcce40a2cf0 0x7fcce40a51b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fccec0ccfd0 tx=0x7fccec018520 comp rx=0 tx=0).stop 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 -- 172.21.15.60:0/2571055216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc101de0 msgr2=0x7fccfc198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc101de0 0x7fccfc198460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccec00e9f0 tx=0x7fccec00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 -- 172.21.15.60:0/2571055216 shutdown_connections 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcce40a2cf0 0x7fcce40a51b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccfc106f10 0x7fccfc19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccfc102790 0x7fccfc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 --2- 172.21.15.60:0/2571055216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc101de0 0x7fccfc198460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 -- 172.21.15.60:0/2571055216 >> 172.21.15.60:0/2571055216 conn(0x7fccfc0fd8c0 msgr2=0x7fccfc0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:51.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 -- 172.21.15.60:0/2571055216 shutdown_connections 2024-09-12T00:01:51.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:51.219+0000 7fcd02857640 1 -- 172.21.15.60:0/2571055216 wait complete. 2024-09-12T00:01:51.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:50 smithi105 ceph-mon[34805]: pgmap v77: 97 pgs: 97 active+clean; 224 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 343 op/s 2024-09-12T00:01:52.969 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:01:52.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:01:53.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:52 smithi105 ceph-mon[34805]: pgmap v78: 97 pgs: 97 active+clean; 224 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 330 op/s 2024-09-12T00:01:53.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:52 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:53.231 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:53.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:52 smithi192 ceph-mon[35487]: pgmap v78: 97 pgs: 97 active+clean; 224 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 330 op/s 2024-09-12T00:01:53.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:52 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:53.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:52 smithi060 ceph-mon[30953]: pgmap v78: 97 pgs: 97 active+clean; 224 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 330 op/s 2024-09-12T00:01:53.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:52 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.749+0000 7fe884b39640 1 -- 172.21.15.60:0/933441653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe880102d30 msgr2=0x7fe880103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.749+0000 7fe884b39640 1 --2- 172.21.15.60:0/933441653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe880102d30 0x7fe880103110 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe870009930 tx=0x7fe87002a420 comp rx=0 tx=0).stop 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.749+0000 7fe884b39640 1 -- 172.21.15.60:0/933441653 shutdown_connections 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.749+0000 7fe884b39640 1 --2- 172.21.15.60:0/933441653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8801082a0 0x7fe88010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.749+0000 7fe884b39640 1 --2- 172.21.15.60:0/933441653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8801036e0 0x7fe880107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.749+0000 7fe884b39640 1 --2- 172.21.15.60:0/933441653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe880102d30 0x7fe880103110 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.749+0000 7fe884b39640 1 -- 172.21.15.60:0/933441653 >> 172.21.15.60:0/933441653 conn(0x7fe8800fc7d0 msgr2=0x7fe8800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.750+0000 7fe884b39640 1 -- 172.21.15.60:0/933441653 shutdown_connections 2024-09-12T00:01:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.750+0000 7fe884b39640 1 -- 172.21.15.60:0/933441653 wait complete. 2024-09-12T00:01:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.750+0000 7fe884b39640 1 Processor -- start 2024-09-12T00:01:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe884b39640 1 -- start start 2024-09-12T00:01:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe884b39640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe880102d30 0x7fe880100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe884b39640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8801036e0 0x7fe880100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe884b39640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8801082a0 0x7fe880101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe884b39640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801121e0 con 0x7fe8801036e0 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe884b39640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe880112060 con 0x7fe880102d30 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe884b39640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe880112360 con 0x7fe8801082a0 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe880102d30 0x7fe880100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8801036e0 0x7fe880100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe880102d30 0x7fe880100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54370/0 (socket says 172.21.15.60:54370) 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87e59c640 1 -- 172.21.15.60:0/878913910 learned_addr learned my addr 172.21.15.60:0/878913910 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8801082a0 0x7fe880101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87e59c640 1 -- 172.21.15.60:0/878913910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8801082a0 msgr2=0x7fe880101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87e59c640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8801082a0 0x7fe880101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87e59c640 1 -- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8801036e0 msgr2=0x7fe880100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87e59c640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8801036e0 0x7fe880100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.751+0000 7fe87e59c640 1 -- 172.21.15.60:0/878913910 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8801a6bd0 con 0x7fe880102d30 2024-09-12T00:01:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.752+0000 7fe87e59c640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe880102d30 0x7fe880100990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe870009230 tx=0x7fe870004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.752+0000 7fe86f7fe640 1 -- 172.21.15.60:0/878913910 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87003f030 con 0x7fe880102d30 2024-09-12T00:01:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.752+0000 7fe86f7fe640 1 -- 172.21.15.60:0/878913910 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe870004440 con 0x7fe880102d30 2024-09-12T00:01:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.752+0000 7fe86f7fe640 1 -- 172.21.15.60:0/878913910 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870035070 con 0x7fe880102d30 2024-09-12T00:01:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.752+0000 7fe884b39640 1 -- 172.21.15.60:0/878913910 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8801a6e60 con 0x7fe880102d30 2024-09-12T00:01:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.752+0000 7fe884b39640 1 -- 172.21.15.60:0/878913910 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8801a72c0 con 0x7fe880102d30 2024-09-12T00:01:53.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.754+0000 7fe86f7fe640 1 -- 172.21.15.60:0/878913910 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe870042030 con 0x7fe880102d30 2024-09-12T00:01:53.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe886f12740 1 Processor -- start 2024-09-12T00:01:53.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe886f12740 1 -- start start 2024-09-12T00:01:53.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe886f12740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe886f12740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ec800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe886f12740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304ecd40 0x55cd304ef130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe886f12740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cd30447280 con 0x55cd304e2480 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe886f12740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cd303eeb10 con 0x55cd304e1b60 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe886f12740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd30443240 con 0x55cd304ecd40 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe87ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe87ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54376/0 (socket says 172.21.15.60:54376) 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe87ed9d640 1 -- 172.21.15.60:0/1657648493 learned_addr learned my addr 172.21.15.60:0/1657648493 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe87dd9b640 1 --2- 172.21.15.60:0/1657648493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304ecd40 0x55cd304ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.755+0000 7fe86f7fe640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8680a2d70 0x7fe8680a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe87ed9d640 1 -- 172.21.15.60:0/1657648493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304ecd40 msgr2=0x55cd304ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:53.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/1657648493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304ecd40 0x55cd304ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe87ed9d640 1 -- 172.21.15.60:0/1657648493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 msgr2=0x55cd304ec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/1657648493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ec800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe87ed9d640 1 -- 172.21.15.60:0/1657648493 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd303fb1f0 con 0x55cd304e1b60 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8680a2d70 0x7fe8680a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe86f7fe640 1 -- 172.21.15.60:0/878913910 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe8700ef6a0 con 0x7fe880102d30 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/1657648493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e1f40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe878011590 tx=0x7fe878011a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b2c1c170d20933b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe86cff9640 1 -- 172.21.15.60:0/1657648493 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878017050 con 0x55cd304e1b60 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8680a2d70 0x7fe8680a5230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe878022000 tx=0x7fe878023000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe86cff9640 1 -- 172.21.15.60:0/1657648493 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe87801bb90 con 0x55cd304e1b60 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.756+0000 7fe86cff9640 1 -- 172.21.15.60:0/1657648493 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87800e3b0 con 0x55cd304e1b60 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 -- 172.21.15.60:0/1657648493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 msgr2=0x55cd304e1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 --2- 172.21.15.60:0/1657648493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e1f40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe878011590 tx=0x7fe878011a50 comp rx=0 tx=0).stop 2024-09-12T00:01:53.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 -- 172.21.15.60:0/1657648493 shutdown_connections 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 --2- 172.21.15.60:0/1657648493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304ecd40 0x55cd304ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 --2- 172.21.15.60:0/1657648493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 --2- 172.21.15.60:0/1657648493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e1f40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 -- 172.21.15.60:0/1657648493 >> 172.21.15.60:0/1657648493 conn(0x55cd304de0f0 msgr2=0x55cd304de4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 -- 172.21.15.60:0/1657648493 shutdown_connections 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 -- 172.21.15.60:0/1657648493 wait complete. 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.757+0000 7fe886f12740 1 -- start start 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe886f12740 1 Processor -- start 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe886f12740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe886f12740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe886f12740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 0x55cd304ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe886f12740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cd304ef910 con 0x55cd304e2480 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe886f12740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cd30401f10 con 0x55cd304ecd40 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe886f12740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd304efa90 con 0x55cd304e1b60 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe886f12740 10 client.0 _ll_register_callbacks cb 0x55cd303caa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ea1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49346/0 (socket says 172.21.15.60:49346) 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 -- 172.21.15.60:0/2422717267 learned_addr learned my addr 172.21.15.60:0/2422717267 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87e59c640 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 0x55cd304ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 -- 172.21.15.60:0/2422717267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 msgr2=0x55cd304e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304e9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 -- 172.21.15.60:0/2422717267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 msgr2=0x55cd304ea6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 0x55cd304ea6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 -- 172.21.15.60:0/2422717267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd301b86a0 con 0x55cd304e2480 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe87dd9b640 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ea1b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe874012700 tx=0x7fe874012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893a1245e225728a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.758+0000 7fe865ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe865ffb640 1 -- 172.21.15.60:0/2422717267 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87400f920 con 0x55cd304e2480 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe865ffb640 1 -- 172.21.15.60:0/2422717267 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe87400fac0 con 0x55cd304e2480 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 1 -- 172.21.15.60:0/2422717267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe87801bb90 con 0x55cd304e2480 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe865ffb640 1 -- 172.21.15.60:0/2422717267 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe87400fcc0 con 0x55cd304e2480 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 10 client.16065 fetch_fsmap learned FSMap version 33 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 1 -- 172.21.15.60:0/2422717267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cd304fb5b0 con 0x55cd304e2480 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe865ffb640 1 -- 172.21.15.60:0/2422717267 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe87801bb90 con 0x55cd304e2480 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe865ffb640 1 -- 172.21.15.60:0/2422717267 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) ==== 8390+0+0 (secure 0 0 0) 0x7fe87401c420 con 0x55cd304e2480 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 10 client.16065 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 20 client.16065 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cd304fcb30 0x55cd304fef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 4 client.16065 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe886f12740 1 -- 172.21.15.60:0/2422717267 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd304547f0 con 0x55cd304fcb30 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.759+0000 7fe87e59c640 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cd304fcb30 0x55cd304fef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.760+0000 7fe87e59c640 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cd304fcb30 0x55cd304fef90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=282b6bfbd4cf95b3 server_cookie=3acc50768c3ca55d in_seq=0 out_seq=0 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.760+0000 7fe865ffb640 10 client.16065 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.760+0000 7fe865ffb640 1 -- 172.21.15.60:0/2422717267 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd304547f0 con 0x55cd304fcb30 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe865ffb640 10 client.16065 handle_command_reply: tid=0 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 client.16065 shutdown 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 -- 172.21.15.60:0/2422717267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 msgr2=0x55cd304ea1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ea1b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe874012700 tx=0x7fe874012bc0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 -- 172.21.15.60:0/2422717267 shutdown_connections 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cd304fcb30 0x55cd304fef90 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 0x55cd304ea6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304ea1b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe865ffb640 0 client.16065 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 --2- 172.21.15.60:0/2422717267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 -- 172.21.15.60:0/2422717267 >> 172.21.15.60:0/2422717267 conn(0x55cd304de0f0 msgr2=0x55cd304dd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 -- 172.21.15.60:0/2422717267 shutdown_connections 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 1 -- 172.21.15.60:0/2422717267 wait complete. 2024-09-12T00:01:53.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.761+0000 7fe886f12740 20 client.16065 trim_cache size 0 max 16384 2024-09-12T00:01:53.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.779+0000 7fe886f12740 1 Processor -- start 2024-09-12T00:01:53.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.779+0000 7fe886f12740 1 -- start start 2024-09-12T00:01:53.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe886f12740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe886f12740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e2480 0x55cd304e8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe886f12740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304ecd40 0x55cd30504860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe886f12740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801afb10 con 0x55cd304ecd40 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe886f12740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801b1770 con 0x55cd304e1b60 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe886f12740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801b01e0 con 0x55cd304e2480 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304ecd40 0x55cd30504860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54390/0 (socket says 172.21.15.60:54390) 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87e59c640 1 -- 172.21.15.60:0/1095025868 learned_addr learned my addr 172.21.15.60:0/1095025868 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87dd9b640 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e2480 0x55cd304e8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87e59c640 1 -- 172.21.15.60:0/1095025868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e2480 msgr2=0x55cd304e8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:53.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87e59c640 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e2480 0x55cd304e8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87e59c640 1 -- 172.21.15.60:0/1095025868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304ecd40 msgr2=0x55cd30504860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:53.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87e59c640 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304ecd40 0x55cd30504860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87e59c640 1 -- 172.21.15.60:0/1095025868 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd304ec540 con 0x55cd304e1b60 2024-09-12T00:01:53.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.780+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304ecd40 0x55cd30504860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:53.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.781+0000 7fe87e59c640 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e4610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe8700b8690 tx=0x7fe8700b8090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29049265b23cef36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:53.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.781+0000 7fe867fff640 1 -- 172.21.15.60:0/1095025868 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870049040 con 0x55cd304e1b60 2024-09-12T00:01:53.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.781+0000 7fe867fff640 1 -- 172.21.15.60:0/1095025868 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8700bffc0 con 0x55cd304e1b60 2024-09-12T00:01:53.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.781+0000 7fe867fff640 1 -- 172.21.15.60:0/1095025868 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8700c43f0 con 0x55cd304e1b60 2024-09-12T00:01:53.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.781+0000 7fe886f12740 1 -- 172.21.15.60:0/1095025868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 msgr2=0x55cd304e4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.781+0000 7fe886f12740 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e4610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe8700b8690 tx=0x7fe8700b8090 comp rx=0 tx=0).stop 2024-09-12T00:01:53.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.782+0000 7fe886f12740 1 -- 172.21.15.60:0/1095025868 shutdown_connections 2024-09-12T00:01:53.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.782+0000 7fe886f12740 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304ecd40 0x55cd30504860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.782+0000 7fe886f12740 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e2480 0x55cd304e8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.782+0000 7fe886f12740 1 --2- 172.21.15.60:0/1095025868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304e1b60 0x55cd304e4610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.782+0000 7fe886f12740 1 -- 172.21.15.60:0/1095025868 >> 172.21.15.60:0/1095025868 conn(0x55cd304de0f0 msgr2=0x55cd304e8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.782+0000 7fe886f12740 1 -- 172.21.15.60:0/1095025868 shutdown_connections 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.782+0000 7fe886f12740 1 -- 172.21.15.60:0/1095025868 wait complete. 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.782+0000 7fe886f12740 1 -- start start 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe886f12740 1 Processor -- start 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe886f12740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe886f12740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe886f12740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 0x55cd304f1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe886f12740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801b0fe0 con 0x55cd304e2480 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe886f12740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801b08b0 con 0x55cd304ecd40 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe886f12740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801adb10 con 0x55cd304e1b60 2024-09-12T00:01:53.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe886f12740 10 client.0 _ll_register_callbacks cb 0x7fe874009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:53.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe87dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe87e59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304f0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:33158/0 (socket says 172.21.15.60:33158) 2024-09-12T00:01:53.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.783+0000 7fe87e59c640 1 -- 172.21.15.60:0/99708974 learned_addr learned my addr 172.21.15.60:0/99708974 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:53.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.784+0000 7fe87ed9d640 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 0x55cd304f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.784+0000 7fe87dd9b640 1 -- 172.21.15.60:0/99708974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 msgr2=0x55cd304f0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:53.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.784+0000 7fe87dd9b640 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304f0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.784+0000 7fe87dd9b640 1 -- 172.21.15.60:0/99708974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 msgr2=0x55cd304f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:53.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.784+0000 7fe87dd9b640 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 0x55cd304f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.784+0000 7fe87dd9b640 1 -- 172.21.15.60:0/99708974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3056f290 con 0x55cd304e2480 2024-09-12T00:01:53.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.784+0000 7fe87dd9b640 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304f11f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe87401ca50 tx=0x7fe87400fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8a82eaab0ae88b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:53.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.784+0000 7fe865ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:53.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.785+0000 7fe865ffb640 1 -- 172.21.15.60:0/99708974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874029040 con 0x55cd304e2480 2024-09-12T00:01:53.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.785+0000 7fe865ffb640 1 -- 172.21.15.60:0/99708974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe87401c5e0 con 0x55cd304e2480 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.785+0000 7fe886f12740 1 -- 172.21.15.60:0/99708974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8700bffc0 con 0x55cd304e2480 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.785+0000 7fe865ffb640 1 -- 172.21.15.60:0/99708974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe874035050 con 0x55cd304e2480 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.785+0000 7fe886f12740 10 client.16071 fetch_fsmap learned FSMap version 33 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.785+0000 7fe886f12740 1 -- 172.21.15.60:0/99708974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cd305705d0 con 0x55cd304e2480 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.786+0000 7fe865ffb640 1 -- 172.21.15.60:0/99708974 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe8700bffc0 con 0x55cd304e2480 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.786+0000 7fe865ffb640 1 -- 172.21.15.60:0/99708974 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) ==== 8390+0+0 (secure 0 0 0) 0x7fe8740035f0 con 0x55cd304e2480 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.786+0000 7fe886f12740 10 client.16071 fetch_fsmap finished waiting for FSMap version 33 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.786+0000 7fe886f12740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.786+0000 7fe886f12740 20 client.16071 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.786+0000 7fe886f12740 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cd30570e30 0x55cd30573250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.786+0000 7fe886f12740 4 client.16071 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:01:53.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.786+0000 7fe886f12740 1 -- 172.21.15.60:0/99708974 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cd3044ed00 con 0x55cd30570e30 2024-09-12T00:01:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.787+0000 7fe87e59c640 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cd30570e30 0x55cd30573250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.788+0000 7fe865ffb640 10 client.16071 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.788+0000 7fe87e59c640 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cd30570e30 0x55cd30573250 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e2a7228b0b1c483 server_cookie=df1a9b1f9b15ac97 in_seq=0 out_seq=0 2024-09-12T00:01:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.789+0000 7fe865ffb640 1 -- 172.21.15.60:0/99708974 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cd3044ed00 con 0x55cd30570e30 2024-09-12T00:01:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.789+0000 7fe865ffb640 10 client.16071 handle_command_reply: tid=0 2024-09-12T00:01:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.789+0000 7fe886f12740 1 client.16071 shutdown 2024-09-12T00:01:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.789+0000 7fe886f12740 1 -- 172.21.15.60:0/99708974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 msgr2=0x55cd304f11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.789+0000 7fe886f12740 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304f11f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe87401ca50 tx=0x7fe87400fee0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.789+0000 7fe886f12740 1 -- 172.21.15.60:0/99708974 shutdown_connections 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.790+0000 7fe886f12740 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cd30570e30 0x55cd30573250 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.790+0000 7fe886f12740 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cd304ecd40 0x55cd304f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.790+0000 7fe886f12740 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cd304e2480 0x55cd304f11f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.790+0000 7fe886f12740 1 --2- 172.21.15.60:0/99708974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd304e1b60 0x55cd304f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.790+0000 7fe865ffb640 0 client.16071 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.790+0000 7fe886f12740 1 -- 172.21.15.60:0/99708974 >> 172.21.15.60:0/99708974 conn(0x55cd304de0f0 msgr2=0x55cd304dd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.790+0000 7fe886f12740 1 -- 172.21.15.60:0/99708974 shutdown_connections 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.790+0000 7fe886f12740 1 -- 172.21.15.60:0/99708974 wait complete. 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.791+0000 7fe886f12740 20 client.16071 trim_cache size 0 max 16384 2024-09-12T00:01:53.794 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:01:53.795 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:01:53.795 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "835316b1-ef9c-4e92-93d9-542c3b654b11", 2024-09-12T00:01:53.795 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:01:53.795 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:01:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.791+0000 7fe884b39640 1 -- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8680a2d70 msgr2=0x7fe8680a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.791+0000 7fe884b39640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8680a2d70 0x7fe8680a5230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe878022000 tx=0x7fe878023000 comp rx=0 tx=0).stop 2024-09-12T00:01:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.791+0000 7fe884b39640 1 -- 172.21.15.60:0/878913910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe880102d30 msgr2=0x7fe880100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.791+0000 7fe884b39640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe880102d30 0x7fe880100990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe870009230 tx=0x7fe870004040 comp rx=0 tx=0).stop 2024-09-12T00:01:53.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.792+0000 7fe884b39640 1 -- 172.21.15.60:0/878913910 shutdown_connections 2024-09-12T00:01:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.792+0000 7fe884b39640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe8680a2d70 0x7fe8680a5230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.792+0000 7fe884b39640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8801082a0 0x7fe880101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.792+0000 7fe884b39640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8801036e0 0x7fe880100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.792+0000 7fe884b39640 1 --2- 172.21.15.60:0/878913910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe880102d30 0x7fe880100990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.792+0000 7fe884b39640 1 -- 172.21.15.60:0/878913910 >> 172.21.15.60:0/878913910 conn(0x7fe8800fc7d0 msgr2=0x7fe880105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.792+0000 7fe884b39640 1 -- 172.21.15.60:0/878913910 shutdown_connections 2024-09-12T00:01:53.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:53.792+0000 7fe884b39640 1 -- 172.21.15.60:0/878913910 wait complete. 2024-09-12T00:01:54.622 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:01:54.910 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:01:55.182 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: pgmap v79: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 457 op/s 2024-09-12T00:01:55.182 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:01:55.182 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.182 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.183 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:54 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: pgmap v79: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 457 op/s 2024-09-12T00:01:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:01:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:54 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: pgmap v79: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 457 op/s 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:01:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:54 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:55.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.401+0000 7f38d16c6640 1 -- 172.21.15.60:0/549917037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc102d30 msgr2=0x7f38cc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.401+0000 7f38d16c6640 1 --2- 172.21.15.60:0/549917037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc102d30 0x7f38cc103110 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009900 tx=0x7f38bc02a480 comp rx=0 tx=0).stop 2024-09-12T00:01:55.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.401+0000 7f38d16c6640 1 -- 172.21.15.60:0/549917037 shutdown_connections 2024-09-12T00:01:55.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.401+0000 7f38d16c6640 1 --2- 172.21.15.60:0/549917037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38cc10c160 0x7f38cc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.401+0000 7f38d16c6640 1 --2- 172.21.15.60:0/549917037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38cc103650 0x7f38cc10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.401+0000 7f38d16c6640 1 --2- 172.21.15.60:0/549917037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc102d30 0x7f38cc103110 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.401+0000 7f38d16c6640 1 -- 172.21.15.60:0/549917037 >> 172.21.15.60:0/549917037 conn(0x7f38cc0fc7d0 msgr2=0x7f38cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:55.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 -- 172.21.15.60:0/549917037 shutdown_connections 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 -- 172.21.15.60:0/549917037 wait complete. 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 Processor -- start 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 -- start start 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38cc102d30 0x7f38cc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc103650 0x7f38cc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38cc10c160 0x7f38cc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc112080 con 0x7f38cc103650 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc111f00 con 0x7f38cc102d30 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.402+0000 7f38d16c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc112200 con 0x7f38cc10c160 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc103650 0x7f38cc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc103650 0x7f38cc100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49390/0 (socket says 172.21.15.60:49390) 2024-09-12T00:01:55.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 -- 172.21.15.60:0/3460164091 learned_addr learned my addr 172.21.15.60:0/3460164091 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38cb7fe640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38cc10c160 0x7f38cc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38caffd640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38cc102d30 0x7f38cc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 -- 172.21.15.60:0/3460164091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38cc10c160 msgr2=0x7f38cc101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38cc10c160 0x7f38cc101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 -- 172.21.15.60:0/3460164091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38cc102d30 msgr2=0x7f38cc100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38cc102d30 0x7f38cc100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 -- 172.21.15.60:0/3460164091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc1a69f0 con 0x7f38cc103650 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c3fff640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc103650 0x7f38cc100ed0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f38b400e9f0 tx=0x7f38b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c8ff9640 1 -- 172.21.15.60:0/3460164091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b400ccc0 con 0x7f38cc103650 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c8ff9640 1 -- 172.21.15.60:0/3460164091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b400ce60 con 0x7f38cc103650 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38d16c6640 1 -- 172.21.15.60:0/3460164091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38cc1a6ce0 con 0x7f38cc103650 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38c8ff9640 1 -- 172.21.15.60:0/3460164091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4010690 con 0x7f38cc103650 2024-09-12T00:01:55.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.403+0000 7f38d16c6640 1 -- 172.21.15.60:0/3460164091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38cc1a71c0 con 0x7f38cc103650 2024-09-12T00:01:55.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.406+0000 7f38c8ff9640 1 -- 172.21.15.60:0/3460164091 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f38b40046c0 con 0x7f38cc103650 2024-09-12T00:01:55.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.406+0000 7f38d3a9f740 1 Processor -- start 2024-09-12T00:01:55.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38d3a9f740 1 -- start start 2024-09-12T00:01:55.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38c8ff9640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38b80a2d70 0x7f38b80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38c8ff9640 1 -- 172.21.15.60:0/3460164091 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f38b40cf6b0 con 0x7f38cc103650 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38cb7fe640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38b80a2d70 0x7f38b80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743dcb0 0x55d8e743e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7448950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d8e739b2e0 con 0x55d8e743e5d0 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d8e7342ce0 con 0x55d8e743dcb0 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.407+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d8e73972a0 con 0x55d8e7448e90 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743dcb0 0x55d8e743e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743dcb0 0x55d8e743e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54424/0 (socket says 172.21.15.60:54424) 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 -- 172.21.15.60:0/502787798 learned_addr learned my addr 172.21.15.60:0/502787798 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38cb7fe640 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38c3fff640 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7448950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38cb7fe640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38b80a2d70 0x7f38b80a5230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005fd0 tx=0x7f38c4011810 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 -- 172.21.15.60:0/502787798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 msgr2=0x55d8e744b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 -- 172.21.15.60:0/502787798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 msgr2=0x55d8e7448950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7448950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 -- 172.21.15.60:0/502787798 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8e7327440 con 0x55d8e743dcb0 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38c3fff640 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7448950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38caffd640 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743dcb0 0x55d8e743e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009900 tx=0x7f38bc005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb08b88726f5ccc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.408+0000 7f38c17fa640 1 -- 172.21.15.60:0/502787798 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc040070 con 0x55d8e743dcb0 2024-09-12T00:01:55.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38c17fa640 1 -- 172.21.15.60:0/502787798 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38bc031900 con 0x55d8e743dcb0 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38c17fa640 1 -- 172.21.15.60:0/502787798 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc035040 con 0x55d8e743dcb0 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 -- 172.21.15.60:0/502787798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743dcb0 msgr2=0x55d8e743e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743dcb0 0x55d8e743e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009900 tx=0x7f38bc005bd0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 -- 172.21.15.60:0/502787798 shutdown_connections 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7448950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/502787798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743dcb0 0x55d8e743e090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 -- 172.21.15.60:0/502787798 >> 172.21.15.60:0/502787798 conn(0x55d8e743a240 msgr2=0x55d8e743a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 -- 172.21.15.60:0/502787798 shutdown_connections 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.409+0000 7f38d3a9f740 1 -- 172.21.15.60:0/502787798 wait complete. 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 1 -- start start 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 1 Processor -- start 2024-09-12T00:01:55.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7448710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e74459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e7448e90 0x55d8e7445f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d8e744ba60 con 0x55d8e7448e90 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d8e7356050 con 0x55d8e743e5d0 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d8e744bbe0 con 0x55d8e743dcb0 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38d3a9f740 10 client.0 _ll_register_callbacks cb 0x55d8e7396160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e74459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38caffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7448710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38cb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e7448e90 0x55d8e7445f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e74459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54436/0 (socket says 172.21.15.60:54436) 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38c3fff640 1 -- 172.21.15.60:0/170667630 learned_addr learned my addr 172.21.15.60:0/170667630 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:55.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.410+0000 7f38caffd640 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7448710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:33194/0 (socket says 172.21.15.60:33194) 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38c3fff640 1 -- 172.21.15.60:0/170667630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 msgr2=0x55d8e7448710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38c3fff640 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7448710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38c3fff640 1 -- 172.21.15.60:0/170667630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e7448e90 msgr2=0x55d8e7445f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38c3fff640 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e7448e90 0x55d8e7445f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38c3fff640 1 -- 172.21.15.60:0/170667630 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8e710c3c0 con 0x55d8e743e5d0 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38c3fff640 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e74459c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38b409b920 tx=0x7f38b409b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452c9ac452185635 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38b27fc640 1 -- 172.21.15.60:0/170667630 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b409ffd0 con 0x55d8e743e5d0 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38d3a9f740 1 -- 172.21.15.60:0/170667630 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38bc031900 con 0x55d8e743e5d0 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38b27fc640 1 -- 172.21.15.60:0/170667630 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f38b40a4400 con 0x55d8e743e5d0 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38b27fc640 1 -- 172.21.15.60:0/170667630 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f38b40a4890 con 0x55d8e743e5d0 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38d3a9f740 10 client.25658 fetch_fsmap learned FSMap version 34 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38d3a9f740 1 -- 172.21.15.60:0/170667630 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d8e74573c0 con 0x55d8e743e5d0 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.411+0000 7f38b27fc640 1 -- 172.21.15.60:0/170667630 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38bc031900 con 0x55d8e743e5d0 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38b27fc640 1 -- 172.21.15.60:0/170667630 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 34) ==== 8398+0+0 (secure 0 0 0) 0x7f38b40cf160 con 0x55d8e743e5d0 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38d3a9f740 10 client.25658 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38d3a9f740 10 client.25658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38d3a9f740 20 client.25658 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d8e7458d90 0x55d8e745b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38d3a9f740 4 client.25658 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38d3a9f740 1 -- 172.21.15.60:0/170667630 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8e73a8850 con 0x55d8e7458d90 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38caffd640 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d8e7458d90 0x55d8e745b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38b27fc640 10 client.25658 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.412+0000 7f38caffd640 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d8e7458d90 0x55d8e745b250 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68353057d71e72ed server_cookie=edd178026ef9be4d in_seq=0 out_seq=0 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38b27fc640 1 -- 172.21.15.60:0/170667630 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8e73a8850 con 0x55d8e7458d90 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38b27fc640 10 client.25658 handle_command_reply: tid=0 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 client.25658 shutdown 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 -- 172.21.15.60:0/170667630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 msgr2=0x55d8e74459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e74459c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f38b409b920 tx=0x7f38b409b870 comp rx=0 tx=0).stop 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 -- 172.21.15.60:0/170667630 shutdown_connections 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d8e7458d90 0x55d8e745b250 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e7448e90 0x55d8e7445f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e74459c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38b27fc640 0 client.25658 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/170667630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7448710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 -- 172.21.15.60:0/170667630 >> 172.21.15.60:0/170667630 conn(0x55d8e743a240 msgr2=0x55d8e7430b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 -- 172.21.15.60:0/170667630 shutdown_connections 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.413+0000 7f38d3a9f740 1 -- 172.21.15.60:0/170667630 wait complete. 2024-09-12T00:01:55.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.414+0000 7f38d3a9f740 20 client.25658 trim_cache size 0 max 16384 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.431+0000 7f38d3a9f740 1 Processor -- start 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.431+0000 7f38d3a9f740 1 -- start start 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7454cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7460b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e7448e90 0x55d8e74610a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc1ab5c0 con 0x55d8e743e5d0 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc1ad280 con 0x55d8e7448e90 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc1abc90 con 0x55d8e743dcb0 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38caffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7454cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7460b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38caffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7454cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:33202/0 (socket says 172.21.15.60:33202) 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38caffd640 1 -- 172.21.15.60:0/1667276481 learned_addr learned my addr 172.21.15.60:0/1667276481 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38cb7fe640 1 --2- 172.21.15.60:0/1667276481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e7448e90 0x55d8e74610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38c3fff640 1 -- 172.21.15.60:0/1667276481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 msgr2=0x55d8e7454cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38c3fff640 1 --2- 172.21.15.60:0/1667276481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7454cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38c3fff640 1 -- 172.21.15.60:0/1667276481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e7448e90 msgr2=0x55d8e74610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38c3fff640 1 --2- 172.21.15.60:0/1667276481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e7448e90 0x55d8e74610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38c3fff640 1 -- 172.21.15.60:0/1667276481 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8e743a070 con 0x55d8e743e5d0 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.432+0000 7f38c3fff640 1 --2- 172.21.15.60:0/1667276481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7460b60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f38b400d010 tx=0x7f38b4004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6efcd9977b1313 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.433+0000 7f38c0ff9640 1 -- 172.21.15.60:0/1667276481 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b409ffd0 con 0x55d8e743e5d0 2024-09-12T00:01:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.433+0000 7f38c0ff9640 1 -- 172.21.15.60:0/1667276481 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b40a4400 con 0x55d8e743e5d0 2024-09-12T00:01:55.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.433+0000 7f38c0ff9640 1 -- 172.21.15.60:0/1667276481 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b409aae0 con 0x55d8e743e5d0 2024-09-12T00:01:55.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.433+0000 7f38d3a9f740 1 -- 172.21.15.60:0/1667276481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 msgr2=0x55d8e7460b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.433+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/1667276481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7460b60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f38b400d010 tx=0x7f38b4004ba0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 -- 172.21.15.60:0/1667276481 shutdown_connections 2024-09-12T00:01:55.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/1667276481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e7448e90 0x55d8e74610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/1667276481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743e5d0 0x55d8e7460b60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/1667276481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e743dcb0 0x55d8e7454cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 -- 172.21.15.60:0/1667276481 >> 172.21.15.60:0/1667276481 conn(0x55d8e743a240 msgr2=0x55d8e7444290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 -- 172.21.15.60:0/1667276481 shutdown_connections 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 -- 172.21.15.60:0/1667276481 wait complete. 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 -- start start 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 Processor -- start 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743dcb0 0x55d8e7451450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e744c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc1acaf0 con 0x55d8e743dcb0 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc1ac360 con 0x55d8e743e5d0 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc1a95c0 con 0x55d8e7448e90 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38d3a9f740 10 client.0 _ll_register_callbacks cb 0x7f38b4004aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.434+0000 7f38caffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743dcb0 0x55d8e7451450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38cb7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38caffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743dcb0 0x55d8e7451450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49442/0 (socket says 172.21.15.60:49442) 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38caffd640 1 -- 172.21.15.60:0/2797199786 learned_addr learned my addr 172.21.15.60:0/2797199786 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:01:55.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38c3fff640 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e744c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38caffd640 1 -- 172.21.15.60:0/2797199786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 msgr2=0x55d8e744cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38caffd640 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38caffd640 1 -- 172.21.15.60:0/2797199786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 msgr2=0x55d8e744c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38caffd640 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e744c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38caffd640 1 -- 172.21.15.60:0/2797199786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8e744d400 con 0x55d8e743dcb0 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38cb7fe640 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38c3fff640 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e744c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38caffd640 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743dcb0 0x55d8e7451450 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f38bc02aa60 tx=0x7f38bc005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfce74c5579d1af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:01:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38b27fc640 1 -- 172.21.15.60:0/2797199786 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc040050 con 0x55d8e743dcb0 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38b27fc640 1 -- 172.21.15.60:0/2797199786 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f38bc004240 con 0x55d8e743dcb0 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38d3a9f740 1 -- 172.21.15.60:0/2797199786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b40a4400 con 0x55d8e743dcb0 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38b27fc640 1 -- 172.21.15.60:0/2797199786 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f38bc035040 con 0x55d8e743dcb0 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.435+0000 7f38d3a9f740 10 client.16089 fetch_fsmap learned FSMap version 34 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38d3a9f740 1 -- 172.21.15.60:0/2797199786 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d8e74c3a60 con 0x55d8e743dcb0 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38b27fc640 1 -- 172.21.15.60:0/2797199786 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b40a4400 con 0x55d8e743dcb0 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38b27fc640 1 -- 172.21.15.60:0/2797199786 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 34) ==== 8398+0+0 (secure 0 0 0) 0x7f38bc004ce0 con 0x55d8e743dcb0 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38d3a9f740 10 client.16089 fetch_fsmap finished waiting for FSMap version 34 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38d3a9f740 10 client.16089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38d3a9f740 20 client.16089 populate_metadata read hostname 'smithi060' 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d8e74c3e10 0x55d8e74c6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38d3a9f740 4 client.16089 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:01:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38d3a9f740 1 -- 172.21.15.60:0/2797199786 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d8e73a2d60 con 0x55d8e74c3e10 2024-09-12T00:01:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38c3fff640 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d8e74c3e10 0x55d8e74c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:01:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38c3fff640 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d8e74c3e10 0x55d8e74c6200 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93ebef587dafdc5b server_cookie=549e7b6b0ef8cb53 in_seq=0 out_seq=0 2024-09-12T00:01:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.436+0000 7f38b27fc640 10 client.16089 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38b27fc640 1 -- 172.21.15.60:0/2797199786 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d8e73a2d60 con 0x55d8e74c3e10 2024-09-12T00:01:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38b27fc640 10 client.16089 handle_command_reply: tid=0 2024-09-12T00:01:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 client.16089 shutdown 2024-09-12T00:01:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 -- 172.21.15.60:0/2797199786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743dcb0 msgr2=0x55d8e7451450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743dcb0 0x55d8e7451450 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f38bc02aa60 tx=0x7f38bc005d50 comp rx=0 tx=0).stop 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 -- 172.21.15.60:0/2797199786 shutdown_connections 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d8e74c3e10 0x55d8e74c6200 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d8e7448e90 0x55d8e744cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d8e743e5d0 0x55d8e744c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38b27fc640 0 client.16089 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 --2- 172.21.15.60:0/2797199786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d8e743dcb0 0x55d8e7451450 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 -- 172.21.15.60:0/2797199786 >> 172.21.15.60:0/2797199786 conn(0x55d8e743a240 msgr2=0x55d8e7443e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 -- 172.21.15.60:0/2797199786 shutdown_connections 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 1 -- 172.21.15.60:0/2797199786 wait complete. 2024-09-12T00:01:55.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.437+0000 7f38d3a9f740 20 client.16089 trim_cache size 0 max 16384 2024-09-12T00:01:55.446 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:01:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:01:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:01:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "835316b1-ef9c-4e92-93d9-542c3b654b11": { 2024-09-12T00:01:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:01:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "835316b1-ef9c-4e92-93d9-542c3b654b11", 2024-09-12T00:01:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:01:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:01:55.447 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:01:55.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 -- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38b80a2d70 msgr2=0x7f38b80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38b80a2d70 0x7f38b80a5230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005fd0 tx=0x7f38c4011810 comp rx=0 tx=0).stop 2024-09-12T00:01:55.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 -- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc103650 msgr2=0x7f38cc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:01:55.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc103650 0x7f38cc100ed0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f38b400e9f0 tx=0x7f38b400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 -- 172.21.15.60:0/3460164091 shutdown_connections 2024-09-12T00:01:55.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38b80a2d70 0x7f38b80a5230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38cc10c160 0x7f38cc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38cc103650 0x7f38cc100ed0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 --2- 172.21.15.60:0/3460164091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38cc102d30 0x7f38cc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:01:55.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 -- 172.21.15.60:0/3460164091 >> 172.21.15.60:0/3460164091 conn(0x7f38cc0fc7d0 msgr2=0x7f38cc0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:01:55.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 -- 172.21.15.60:0/3460164091 shutdown_connections 2024-09-12T00:01:55.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:01:55.438+0000 7f38d16c6640 1 -- 172.21.15.60:0/3460164091 wait complete. 2024-09-12T00:01:56.122 INFO:tasks.cephfs.filesystem:scrub status for tag:835316b1-ef9c-4e92-93d9-542c3b654b11 - {'path': '/', 'tag': '835316b1-ef9c-4e92-93d9-542c3b654b11', 'options': 'recursive,force'} 2024-09-12T00:01:56.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:55 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:56.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:55 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:56.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:55 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:01:57.232 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:56 smithi105 ceph-mon[34805]: pgmap v80: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 392 op/s 2024-09-12T00:01:57.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:56 smithi192 ceph-mon[35487]: pgmap v80: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 392 op/s 2024-09-12T00:01:57.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:56 smithi060 ceph-mon[30953]: pgmap v80: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 392 op/s 2024-09-12T00:01:58.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:57 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:58.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:57 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:58.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:57 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:01:59.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:58 smithi105 ceph-mon[34805]: pgmap v81: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 392 op/s 2024-09-12T00:01:59.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:58 smithi192 ceph-mon[35487]: pgmap v81: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 392 op/s 2024-09-12T00:01:59.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:58 smithi060 ceph-mon[30953]: pgmap v81: 97 pgs: 97 active+clean; 230 MiB data, 968 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 392 op/s 2024-09-12T00:02:00.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:01:59 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:00.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:01:59 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:00.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:01:59 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:01.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:00 smithi105 ceph-mon[34805]: pgmap v82: 97 pgs: 97 active+clean; 233 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 549 op/s 2024-09-12T00:02:01.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:00 smithi192 ceph-mon[35487]: pgmap v82: 97 pgs: 97 active+clean; 233 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 549 op/s 2024-09-12T00:02:01.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:00 smithi060 ceph-mon[30953]: pgmap v82: 97 pgs: 97 active+clean; 233 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 549 op/s 2024-09-12T00:02:03.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:02 smithi105 ceph-mon[34805]: pgmap v83: 97 pgs: 97 active+clean; 233 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 284 op/s 2024-09-12T00:02:03.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:02 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:03.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:02 smithi192 ceph-mon[35487]: pgmap v83: 97 pgs: 97 active+clean; 233 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 284 op/s 2024-09-12T00:02:03.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:02 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:02 smithi060 ceph-mon[30953]: pgmap v83: 97 pgs: 97 active+clean; 233 MiB data, 955 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 284 op/s 2024-09-12T00:02:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:02 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:03.843 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.7 2024-09-12T00:02:03.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:02:04.114 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:04.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 -- 172.21.15.60:0/1937125755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 msgr2=0x7fe480103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1937125755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 0x7fe480103180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe470009900 tx=0x7fe47002a480 comp rx=0 tx=0).stop 2024-09-12T00:02:04.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 -- 172.21.15.60:0/1937125755 shutdown_connections 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1937125755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48010c180 0x7fe48010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1937125755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4801036c0 0x7fe48010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1937125755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 0x7fe480103180 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 -- 172.21.15.60:0/1937125755 >> 172.21.15.60:0/1937125755 conn(0x7fe4800fc7a0 msgr2=0x7fe4800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 -- 172.21.15.60:0/1937125755 shutdown_connections 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.599+0000 7fe485b9f640 1 -- 172.21.15.60:0/1937125755 wait complete. 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe485b9f640 1 Processor -- start 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe485b9f640 1 -- start start 2024-09-12T00:02:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe485b9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 0x7fe480198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe485b9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801036c0 0x7fe480198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe485b9f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48010c180 0x7fe48019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe485b9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe480112080 con 0x7fe480102da0 2024-09-12T00:02:04.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe485b9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe480111f00 con 0x7fe4801036c0 2024-09-12T00:02:04.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe485b9f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe480112200 con 0x7fe48010c180 2024-09-12T00:02:04.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe47f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 0x7fe480198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe47f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 0x7fe480198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44206/0 (socket says 172.21.15.60:44206) 2024-09-12T00:02:04.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe47f7fe640 1 -- 172.21.15.60:0/1468106095 learned_addr learned my addr 172.21.15.60:0/1468106095 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe47ffff640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48010c180 0x7fe48019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.600+0000 7fe47effd640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801036c0 0x7fe480198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47f7fe640 1 -- 172.21.15.60:0/1468106095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48010c180 msgr2=0x7fe48019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47f7fe640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48010c180 0x7fe48019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47f7fe640 1 -- 172.21.15.60:0/1468106095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801036c0 msgr2=0x7fe480198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47f7fe640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801036c0 0x7fe480198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47f7fe640 1 -- 172.21.15.60:0/1468106095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48019d4b0 con 0x7fe480102da0 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47effd640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801036c0 0x7fe480198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47f7fe640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 0x7fe480198500 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe470006010 tx=0x7fe4700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:04.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47cff9640 1 -- 172.21.15.60:0/1468106095 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47003f030 con 0x7fe480102da0 2024-09-12T00:02:04.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47cff9640 1 -- 172.21.15.60:0/1468106095 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe470003d00 con 0x7fe480102da0 2024-09-12T00:02:04.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe47cff9640 1 -- 172.21.15.60:0/1468106095 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470035070 con 0x7fe480102da0 2024-09-12T00:02:04.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48019d740 con 0x7fe480102da0 2024-09-12T00:02:04.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.601+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4801a5080 con 0x7fe480102da0 2024-09-12T00:02:04.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.602+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48006b010 con 0x7fe480102da0 2024-09-12T00:02:04.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.603+0000 7fe47cff9640 1 -- 172.21.15.60:0/1468106095 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe470042030 con 0x7fe480102da0 2024-09-12T00:02:04.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.604+0000 7fe47cff9640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4680a2cf0 0x7fe4680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:04.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.604+0000 7fe47effd640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4680a2cf0 0x7fe4680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:04.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.604+0000 7fe47cff9640 1 -- 172.21.15.60:0/1468106095 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe4700efa70 con 0x7fe480102da0 2024-09-12T00:02:04.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.604+0000 7fe47effd640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4680a2cf0 0x7fe4680a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4740058c0 tx=0x7fe474005850 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:04.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.608+0000 7fe47cff9640 1 -- 172.21.15.60:0/1468106095 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4700bc740 con 0x7fe480102da0 2024-09-12T00:02:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.840+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4801071c0 con 0x7fe480102da0 2024-09-12T00:02:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.841+0000 7fe47cff9640 1 -- 172.21.15.60:0/1468106095 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+12003 (secure 0 0 0) 0x7fe4700bc040 con 0x7fe480102da0 2024-09-12T00:02:04.842 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:02:04.842 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T00:02:03:951610+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:02:03.584094+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:02:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T00:02:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.843+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4680a2cf0 msgr2=0x7fe4680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.843+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4680a2cf0 0x7fe4680a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4740058c0 tx=0x7fe474005850 comp rx=0 tx=0).stop 2024-09-12T00:02:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.843+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 msgr2=0x7fe480198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.843+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 0x7fe480198500 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe470006010 tx=0x7fe4700042f0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.843+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 shutdown_connections 2024-09-12T00:02:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.843+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4680a2cf0 0x7fe4680a51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.843+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48010c180 0x7fe48019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.844+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4801036c0 0x7fe480198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.844+0000 7fe485b9f640 1 --2- 172.21.15.60:0/1468106095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe480102da0 0x7fe480198500 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.844+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 >> 172.21.15.60:0/1468106095 conn(0x7fe4800fc7a0 msgr2=0x7fe4800fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.844+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 shutdown_connections 2024-09-12T00:02:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:04.844+0000 7fe485b9f640 1 -- 172.21.15.60:0/1468106095 wait complete. 2024-09-12T00:02:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:04 smithi105 ceph-mon[34805]: pgmap v84: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 399 op/s 2024-09-12T00:02:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:04 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:04 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:04 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:04 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:04 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:04 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:05.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:04 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1468106095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:05.249 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:04 smithi060 ceph-mon[30953]: pgmap v84: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 399 op/s 2024-09-12T00:02:05.249 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:04 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:05.249 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:04 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:05.249 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:04 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:05.250 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:04 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:05.250 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:04 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:05.250 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:04 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:05.250 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:04 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1468106095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:04 smithi192 ceph-mon[35487]: pgmap v84: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 399 op/s 2024-09-12T00:02:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:04 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:04 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:04 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:04 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:05.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:04 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:05.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:04 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:05.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:04 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1468106095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:05.592 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24496 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0' 2024-09-12T00:02:05.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24496 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0 2024-09-12T00:02:05.888 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.378+0000 7f5af737c640 1 -- 172.21.15.60:0/42800972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0102790 msgr2=0x7f5af01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.378+0000 7f5af737c640 1 --2- 172.21.15.60:0/42800972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0102790 0x7f5af01067e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009900 tx=0x7f5ae002a410 comp rx=0 tx=0).stop 2024-09-12T00:02:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.378+0000 7f5af737c640 1 -- 172.21.15.60:0/42800972 shutdown_connections 2024-09-12T00:02:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.378+0000 7f5af737c640 1 --2- 172.21.15.60:0/42800972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5af0106f10 0x7f5af010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.378+0000 7f5af737c640 1 --2- 172.21.15.60:0/42800972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0102790 0x7f5af01067e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.378+0000 7f5af737c640 1 --2- 172.21.15.60:0/42800972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5af0101de0 0x7f5af01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.378+0000 7f5af737c640 1 -- 172.21.15.60:0/42800972 >> 172.21.15.60:0/42800972 conn(0x7f5af00fd8c0 msgr2=0x7f5af00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.378+0000 7f5af737c640 1 -- 172.21.15.60:0/42800972 shutdown_connections 2024-09-12T00:02:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 -- 172.21.15.60:0/42800972 wait complete. 2024-09-12T00:02:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 Processor -- start 2024-09-12T00:02:06.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 -- start start 2024-09-12T00:02:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5af0101de0 0x7f5af0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5af0102790 0x7f5af01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0106f10 0x7f5af019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0112090 con 0x7f5af0106f10 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0111f10 con 0x7f5af0101de0 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.379+0000 7f5af737c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5af0112210 con 0x7f5af0102790 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5118640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5af0101de0 0x7f5af0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0106f10 0x7f5af019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af4917640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5af0102790 0x7f5af01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0106f10 0x7f5af019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44224/0 (socket says 172.21.15.60:44224) 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5118640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5af0101de0 0x7f5af0198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39036/0 (socket says 172.21.15.60:39036) 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 -- 172.21.15.60:0/3039658761 learned_addr learned my addr 172.21.15.60:0/3039658761 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 -- 172.21.15.60:0/3039658761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5af0102790 msgr2=0x7f5af01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5af0102790 0x7f5af01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 -- 172.21.15.60:0/3039658761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5af0101de0 msgr2=0x7f5af0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5af0101de0 0x7f5af0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 -- 172.21.15.60:0/3039658761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af019d420 con 0x7f5af0106f10 2024-09-12T00:02:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5118640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5af0101de0 0x7f5af0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af5919640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0106f10 0x7f5af019cd40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800cce0 tx=0x7f5ae800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5ae67fc640 1 -- 172.21.15.60:0/3039658761 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800f450 con 0x7f5af0106f10 2024-09-12T00:02:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5ae67fc640 1 -- 172.21.15.60:0/3039658761 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ae800faf0 con 0x7f5af0106f10 2024-09-12T00:02:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5af737c640 1 -- 172.21.15.60:0/3039658761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af019d710 con 0x7f5af0106f10 2024-09-12T00:02:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.380+0000 7f5ae67fc640 1 -- 172.21.15.60:0/3039658761 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8018cc0 con 0x7f5af0106f10 2024-09-12T00:02:06.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.381+0000 7f5af737c640 1 -- 172.21.15.60:0/3039658761 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af01a4ff0 con 0x7f5af0106f10 2024-09-12T00:02:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.383+0000 7f5ae67fc640 1 -- 172.21.15.60:0/3039658761 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5ae800f5f0 con 0x7f5af0106f10 2024-09-12T00:02:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af9755740 1 Processor -- start 2024-09-12T00:02:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af9755740 1 -- start start 2024-09-12T00:02:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5ae67fc640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5adc0a2cf0 0x7f5adc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af9755740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af9755740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e67400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af9755740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e67940 0x564b27e69d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af9755740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564b27dc22a0 con 0x564b27e5d080 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af9755740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564b27d69b10 con 0x564b27e67940 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af9755740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564b27dbe260 con 0x564b27e5c760 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af5118640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af5118640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:46092/0 (socket says 172.21.15.60:46092) 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af5118640 1 -- 172.21.15.60:0/3553101114 learned_addr learned my addr 172.21.15.60:0/3553101114 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5ae67fc640 1 -- 172.21.15.60:0/3039658761 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5ae80cf7e0 con 0x7f5af0106f10 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af4917640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5adc0a2cf0 0x7f5adc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af5919640 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e67940 0x564b27e69d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.384+0000 7f5af4917640 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e67400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5af5118640 1 -- 172.21.15.60:0/3553101114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e67940 msgr2=0x564b27e69d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5af5118640 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e67940 0x564b27e69d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5af5118640 1 -- 172.21.15.60:0/3553101114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 msgr2=0x564b27e67400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5af5118640 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e67400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5af5118640 1 -- 172.21.15.60:0/3553101114 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b27b33b90 con 0x564b27e5c760 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5af4917640 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e67400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5af5118640 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5cb40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0115f0 tx=0x7f5aec0119f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a48fd7d92d12d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5af4917640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5adc0a2cf0 0x7f5adc0a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009230 tx=0x7f5ae0000bc0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5adb7fe640 1 -- 172.21.15.60:0/3553101114 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec01e070 con 0x564b27e5c760 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5adb7fe640 1 -- 172.21.15.60:0/3553101114 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aec00fa60 con 0x564b27e5c760 2024-09-12T00:02:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.385+0000 7f5adb7fe640 1 -- 172.21.15.60:0/3553101114 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec019c60 con 0x564b27e5c760 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 -- 172.21.15.60:0/3553101114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 msgr2=0x564b27e5cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5cb40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0115f0 tx=0x7f5aec0119f0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 -- 172.21.15.60:0/3553101114 shutdown_connections 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e67940 0x564b27e69d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e67400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 --2- 172.21.15.60:0/3553101114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5cb40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 -- 172.21.15.60:0/3553101114 >> 172.21.15.60:0/3553101114 conn(0x564b27e58cf0 msgr2=0x564b27e590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 -- 172.21.15.60:0/3553101114 shutdown_connections 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 -- 172.21.15.60:0/3553101114 wait complete. 2024-09-12T00:02:06.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 -- start start 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.386+0000 7f5af9755740 1 Processor -- start 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af9755740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e648b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af9755740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e64df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af9755740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e67940 0x564b27e65330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af9755740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564b27e6a510 con 0x564b27e5d080 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af9755740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564b27d4a6e0 con 0x564b27e5c760 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af9755740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564b27e6a690 con 0x564b27e67940 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af9755740 10 client.0 _ll_register_callbacks cb 0x564b27d6ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af4917640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e64df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af5118640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af4917640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e64df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44236/0 (socket says 172.21.15.60:44236) 2024-09-12T00:02:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af4917640 1 -- 172.21.15.60:0/2175573164 learned_addr learned my addr 172.21.15.60:0/2175573164 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af5919640 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e67940 0x564b27e65330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af5118640 1 -- 172.21.15.60:0/2175573164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e67940 msgr2=0x564b27e65330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af5118640 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e67940 0x564b27e65330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af5118640 1 -- 172.21.15.60:0/2175573164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 msgr2=0x564b27e64df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af5118640 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e64df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af5118640 1 -- 172.21.15.60:0/2175573164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b27e73a80 con 0x564b27e5c760 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.387+0000 7f5af4917640 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e64df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af5118640 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e648b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5aec011ef0 tx=0x7f5aec00fe40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=811cfef5a8dba372 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5ad8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/2175573164 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec01e040 con 0x564b27e5c760 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 1 -- 172.21.15.60:0/2175573164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aec00fa60 con 0x564b27e5c760 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/2175573164 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5aec00f620 con 0x564b27e5c760 2024-09-12T00:02:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/2175573164 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5aec00f820 con 0x564b27e5c760 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 10 client.25679 fetch_fsmap learned FSMap version 38 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 1 -- 172.21.15.60:0/2175573164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564b27e763f0 con 0x564b27e5c760 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/2175573164 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aec00fa60 con 0x564b27e5c760 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/2175573164 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 38) ==== 8430+0+0 (secure 0 0 0) 0x7f5aec021070 con 0x564b27e5c760 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 10 client.25679 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 10 client.25679 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 20 client.25679 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b27e77800 0x564b27e79bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 4 client.25679 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.388+0000 7f5af9755740 1 -- 172.21.15.60:0/2175573164 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b27dcf9d0 con 0x564b27e77800 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.389+0000 7f5af4917640 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b27e77800 0x564b27e79bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.389+0000 7f5af4917640 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b27e77800 0x564b27e79bf0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ecce7e72207a35 server_cookie=501f24cd98d724af in_seq=0 out_seq=0 2024-09-12T00:02:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.389+0000 7f5ad8ff9640 10 client.25679 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/2175573164 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b27dcf9d0 con 0x564b27e77800 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5ad8ff9640 10 client.25679 handle_command_reply: tid=0 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 client.25679 shutdown 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 -- 172.21.15.60:0/2175573164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 msgr2=0x564b27e648b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e648b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5aec011ef0 tx=0x7f5aec00fe40 comp rx=0 tx=0).stop 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 -- 172.21.15.60:0/2175573164 shutdown_connections 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b27e77800 0x564b27e79bf0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e67940 0x564b27e65330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e5d080 0x564b27e64df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5ad8ff9640 0 client.25679 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 --2- 172.21.15.60:0/2175573164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e648b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.390+0000 7f5af9755740 1 -- 172.21.15.60:0/2175573164 >> 172.21.15.60:0/2175573164 conn(0x564b27e58cf0 msgr2=0x564b27e57e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.391+0000 7f5af9755740 1 -- 172.21.15.60:0/2175573164 shutdown_connections 2024-09-12T00:02:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.391+0000 7f5af9755740 1 -- 172.21.15.60:0/2175573164 wait complete. 2024-09-12T00:02:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.391+0000 7f5af9755740 20 client.25679 trim_cache size 0 max 16384 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af9755740 1 Processor -- start 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af9755740 1 -- start start 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af9755740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af9755740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5d080 0x564b27e7f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af9755740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e7fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af9755740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01ad800 con 0x564b27e67940 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af9755740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01af5b0 con 0x564b27e5d080 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af9755740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01adf00 con 0x564b27e5c760 2024-09-12T00:02:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5919640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e7fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5118640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5118640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:46098/0 (socket says 172.21.15.60:46098) 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af4917640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5d080 0x564b27e7f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5118640 1 -- 172.21.15.60:0/2119640762 learned_addr learned my addr 172.21.15.60:0/2119640762 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5118640 1 -- 172.21.15.60:0/2119640762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5d080 msgr2=0x564b27e7f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5118640 1 --2- 172.21.15.60:0/2119640762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5d080 0x564b27e7f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5118640 1 -- 172.21.15.60:0/2119640762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 msgr2=0x564b27e7fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5118640 1 --2- 172.21.15.60:0/2119640762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e7fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5118640 1 -- 172.21.15.60:0/2119640762 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b27e5c590 con 0x564b27e5c760 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.408+0000 7f5af5919640 1 --2- 172.21.15.60:0/2119640762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e7fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.409+0000 7f5af5118640 1 --2- 172.21.15.60:0/2119640762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5f130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5aec000c00 tx=0x7f5aec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21e27e58b2207523 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.409+0000 7f5adaffd640 1 -- 172.21.15.60:0/2119640762 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec015070 con 0x564b27e5c760 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.409+0000 7f5adaffd640 1 -- 172.21.15.60:0/2119640762 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aec0039c0 con 0x564b27e5c760 2024-09-12T00:02:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.409+0000 7f5adaffd640 1 -- 172.21.15.60:0/2119640762 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec01e040 con 0x564b27e5c760 2024-09-12T00:02:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 -- 172.21.15.60:0/2119640762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 msgr2=0x564b27e5f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 --2- 172.21.15.60:0/2119640762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5f130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5aec000c00 tx=0x7f5aec009b50 comp rx=0 tx=0).stop 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 -- 172.21.15.60:0/2119640762 shutdown_connections 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 --2- 172.21.15.60:0/2119640762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e7fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 --2- 172.21.15.60:0/2119640762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5d080 0x564b27e7f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 --2- 172.21.15.60:0/2119640762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5c760 0x564b27e5f130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 -- 172.21.15.60:0/2119640762 >> 172.21.15.60:0/2119640762 conn(0x564b27e58cf0 msgr2=0x564b27e66930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 -- 172.21.15.60:0/2119640762 shutdown_connections 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 -- 172.21.15.60:0/2119640762 wait complete. 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 -- start start 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.410+0000 7f5af9755740 1 Processor -- start 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af9755740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e6b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af9755740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5d080 0x564b27e6be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af9755740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e6c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af9755740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01aee20 con 0x564b27e67940 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af9755740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01ae690 con 0x564b27e5c760 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af9755740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5af01ab7e0 con 0x564b27e5d080 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af9755740 10 client.0 _ll_register_callbacks cb 0x7f5aec0056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e6b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af4917640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5d080 0x564b27e6be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5919640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e6c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e6b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39078/0 (socket says 172.21.15.60:39078) 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 -- 172.21.15.60:0/464985330 learned_addr learned my addr 172.21.15.60:0/464985330 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af4917640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5d080 0x564b27e6be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:46112/0 (socket says 172.21.15.60:46112) 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 -- 172.21.15.60:0/464985330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5d080 msgr2=0x564b27e6be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5d080 0x564b27e6be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 -- 172.21.15.60:0/464985330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 msgr2=0x564b27e6c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e6c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 -- 172.21.15.60:0/464985330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b27e54260 con 0x564b27e5c760 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5919640 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e6c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5af5118640 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e6b940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5aec001e90 tx=0x7f5aec0096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00f491316d289dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.411+0000 7f5ad8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.412+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/464985330 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec015040 con 0x564b27e5c760 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.412+0000 7f5af9755740 1 -- 172.21.15.60:0/464985330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aec0039c0 con 0x564b27e5c760 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.412+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/464985330 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5aec011280 con 0x564b27e5c760 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.412+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/464985330 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5aec01e040 con 0x564b27e5c760 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.412+0000 7f5af9755740 10 client.25685 fetch_fsmap learned FSMap version 38 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.412+0000 7f5af9755740 1 -- 172.21.15.60:0/464985330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564b27ee2890 con 0x564b27e5c760 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.412+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/464985330 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aec0039c0 con 0x564b27e5c760 2024-09-12T00:02:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/464985330 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 38) ==== 8430+0+0 (secure 0 0 0) 0x7f5aec032030 con 0x564b27e5c760 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5af9755740 10 client.25685 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5af9755740 10 client.25685 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5af9755740 20 client.25685 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5af9755740 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b27ee30a0 0x564b27ee54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5af9755740 4 client.25685 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}] 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5af9755740 1 -- 172.21.15.60:0/464985330 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}) -- 0x564b27dc9d20 con 0x564b27ee30a0 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5af4917640 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b27ee30a0 0x564b27ee54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5ad8ff9640 10 client.25685 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.413+0000 7f5af4917640 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b27ee30a0 0x564b27ee54c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55645e4c0b458428 server_cookie=3400723642939fe5 in_seq=0 out_seq=0 2024-09-12T00:02:06.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5ad8ff9640 1 -- 172.21.15.60:0/464985330 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564b27dc9d20 con 0x564b27ee30a0 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5ad8ff9640 10 client.25685 handle_command_reply: tid=0 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 client.25685 shutdown 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 -- 172.21.15.60:0/464985330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 msgr2=0x564b27e6b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e6b940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5aec001e90 tx=0x7f5aec0096c0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 -- 172.21.15.60:0/464985330 shutdown_connections 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b27ee30a0 0x564b27ee54c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b27e67940 0x564b27e6c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b27e5d080 0x564b27e6be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5ad8ff9640 0 client.25685 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 --2- 172.21.15.60:0/464985330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b27e5c760 0x564b27e6b940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 -- 172.21.15.60:0/464985330 >> 172.21.15.60:0/464985330 conn(0x564b27e58cf0 msgr2=0x564b27e57650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 -- 172.21.15.60:0/464985330 shutdown_connections 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 1 -- 172.21.15.60:0/464985330 wait complete. 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.477+0000 7f5af9755740 20 client.25685 trim_cache size 0 max 16384 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 38, 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stdout: "leader": 24496, 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stdout: "set_version": 10, 2024-09-12T00:02:06.479 INFO:teuthology.orchestra.run.smithi060.stdout: "sets": { 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "79ec49b4": { 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "version": 10, 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "age_ref": 0.0, 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "QUIESCED", 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "timeout": 90.0, 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "expiration": 144.7, 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "members": { 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "file:/": { 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "excluded": false, 2024-09-12T00:02:06.480 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:02:06.481 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "QUIESCED", 2024-09-12T00:02:06.481 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:02:06.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:06.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:06.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:06.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:06.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:06.481 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 -- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5adc0a2cf0 msgr2=0x7f5adc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5adc0a2cf0 0x7f5adc0a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009230 tx=0x7f5ae0000bc0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 -- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0106f10 msgr2=0x7f5af019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0106f10 0x7f5af019cd40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800cce0 tx=0x7f5ae800a620 comp rx=0 tx=0).stop 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 -- 172.21.15.60:0/3039658761 shutdown_connections 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5adc0a2cf0 0x7f5adc0a51b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5af0106f10 0x7f5af019cd40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5af0102790 0x7f5af01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 --2- 172.21.15.60:0/3039658761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5af0101de0 0x7f5af0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 -- 172.21.15.60:0/3039658761 >> 172.21.15.60:0/3039658761 conn(0x7f5af00fd8c0 msgr2=0x7f5af00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 -- 172.21.15.60:0/3039658761 shutdown_connections 2024-09-12T00:02:06.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:06.478+0000 7f5af737c640 1 -- 172.21.15.60:0/3039658761 wait complete. 2024-09-12T00:02:07.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:06 smithi105 ceph-mon[34805]: pgmap v85: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 271 op/s 2024-09-12T00:02:07.241 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:06 smithi060 ceph-mon[30953]: pgmap v85: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 271 op/s 2024-09-12T00:02:07.269 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '79ec49b4', quiesce took 3.4 seconds. Will release after: 21.3 2024-09-12T00:02:07.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:06 smithi192 ceph-mon[35487]: pgmap v85: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 271 op/s 2024-09-12T00:02:08.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:07 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:08.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:07 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:08.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:07 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:02:09.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:08 smithi105 ceph-mon[34805]: pgmap v86: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 271 op/s 2024-09-12T00:02:09.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:08 smithi192 ceph-mon[35487]: pgmap v86: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 271 op/s 2024-09-12T00:02:09.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:08 smithi060 ceph-mon[30953]: pgmap v86: 97 pgs: 97 active+clean; 230 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 271 op/s 2024-09-12T00:02:11.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:10 smithi105 ceph-mon[34805]: pgmap v87: 97 pgs: 97 active+clean; 234 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 382 op/s 2024-09-12T00:02:11.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:10 smithi192 ceph-mon[35487]: pgmap v87: 97 pgs: 97 active+clean; 234 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 382 op/s 2024-09-12T00:02:11.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:10 smithi060 ceph-mon[30953]: pgmap v87: 97 pgs: 97 active+clean; 234 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 382 op/s 2024-09-12T00:02:13.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:12 smithi105 ceph-mon[34805]: pgmap v88: 97 pgs: 97 active+clean; 234 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 956 KiB/s wr, 225 op/s 2024-09-12T00:02:13.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:12 smithi192 ceph-mon[35487]: pgmap v88: 97 pgs: 97 active+clean; 234 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 956 KiB/s wr, 225 op/s 2024-09-12T00:02:13.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:12 smithi060 ceph-mon[30953]: pgmap v88: 97 pgs: 97 active+clean; 234 MiB data, 925 MiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 956 KiB/s wr, 225 op/s 2024-09-12T00:02:15.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:14 smithi192 ceph-mon[35487]: pgmap v89: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 977 KiB/s wr, 232 op/s 2024-09-12T00:02:15.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:14 smithi060 ceph-mon[30953]: pgmap v89: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 977 KiB/s wr, 232 op/s 2024-09-12T00:02:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:14 smithi105 ceph-mon[34805]: pgmap v89: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 977 KiB/s wr, 232 op/s 2024-09-12T00:02:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:16 smithi192 ceph-mon[35487]: pgmap v90: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 519 KiB/s wr, 118 op/s 2024-09-12T00:02:17.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:16 smithi060 ceph-mon[30953]: pgmap v90: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 519 KiB/s wr, 118 op/s 2024-09-12T00:02:17.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:16 smithi105 ceph-mon[34805]: pgmap v90: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 519 KiB/s wr, 118 op/s 2024-09-12T00:02:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:18 smithi192 ceph-mon[35487]: pgmap v91: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 519 KiB/s wr, 118 op/s 2024-09-12T00:02:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:18 smithi060 ceph-mon[30953]: pgmap v91: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 519 KiB/s wr, 118 op/s 2024-09-12T00:02:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:18 smithi105 ceph-mon[34805]: pgmap v91: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 519 KiB/s wr, 118 op/s 2024-09-12T00:02:21.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:20 smithi192 ceph-mon[35487]: pgmap v92: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 523 KiB/s wr, 125 op/s 2024-09-12T00:02:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:20 smithi060 ceph-mon[30953]: pgmap v92: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 523 KiB/s wr, 125 op/s 2024-09-12T00:02:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:20 smithi105 ceph-mon[34805]: pgmap v92: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 523 KiB/s wr, 125 op/s 2024-09-12T00:02:23.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:22 smithi192 ceph-mon[35487]: pgmap v93: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-12T00:02:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:22 smithi060 ceph-mon[30953]: pgmap v93: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-12T00:02:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:22 smithi105 ceph-mon[34805]: pgmap v93: 97 pgs: 97 active+clean; 234 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-12T00:02:25.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:24 smithi192 ceph-mon[35487]: pgmap v94: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-12T00:02:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:24 smithi060 ceph-mon[30953]: pgmap v94: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-12T00:02:25.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:24 smithi105 ceph-mon[34805]: pgmap v94: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-12T00:02:26.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:02:26.395 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1935154117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 msgr2=0x7fee74100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1935154117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 0x7fee74100ee0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fee64009930 tx=0x7fee6402a420 comp rx=0 tx=0).stop 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1935154117 shutdown_connections 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1935154117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee74101420 0x7fee7410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1935154117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 0x7fee74100ee0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1935154117 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee74106a80 0x7fee74106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1935154117 >> 172.21.15.60:0/1935154117 conn(0x7fee740fc7a0 msgr2=0x7fee740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1935154117 shutdown_connections 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1935154117 wait complete. 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 Processor -- start 2024-09-12T00:02:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.864+0000 7fee7ae4f640 1 -- start start 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee7ae4f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 0x7fee74197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee7ae4f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee74101420 0x7fee741979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee7ae4f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee74106a80 0x7fee7419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee7ae4f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee74110fe0 con 0x7fee74100a80 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee7ae4f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee74110e60 con 0x7fee74101420 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee7ae4f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee74111160 con 0x7fee74106a80 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 0x7fee74197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 0x7fee74197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47070/0 (socket says 172.21.15.60:47070) 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 -- 172.21.15.60:0/1682752672 learned_addr learned my addr 172.21.15.60:0/1682752672 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee6bfff640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee74101420 0x7fee741979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 -- 172.21.15.60:0/1682752672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee74106a80 msgr2=0x7fee7419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee74106a80 0x7fee7419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 -- 172.21.15.60:0/1682752672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee74101420 msgr2=0x7fee741979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee74101420 0x7fee741979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 -- 172.21.15.60:0/1682752672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7419c430 con 0x7fee74100a80 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee6bfff640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee74101420 0x7fee741979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee78beb640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 0x7fee74197480 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fee7000d950 tx=0x7fee7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee69ffb640 1 -- 172.21.15.60:0/1682752672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70017030 con 0x7fee74100a80 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1682752672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7419c720 con 0x7fee74100a80 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee69ffb640 1 -- 172.21.15.60:0/1682752672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee70004020 con 0x7fee74100a80 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.865+0000 7fee69ffb640 1 -- 172.21.15.60:0/1682752672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70004a00 con 0x7fee74100a80 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.866+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1682752672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee741a4000 con 0x7fee74100a80 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee69ffb640 1 -- 172.21.15.60:0/1682752672 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fee700041d0 con 0x7fee74100a80 2024-09-12T00:02:26.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee7d228740 1 Processor -- start 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee7d228740 1 -- start start 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee69ffb640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee5c0a2cf0 0x7fee5c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee7d228740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e5e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee7d228740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e6b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee7d228740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e6e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee7d228740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bbe2dc22e0 con 0x55bbe2e5e570 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.868+0000 7fee7d228740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55bbe2d69ce0 con 0x55bbe2e6bc80 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee7d228740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bbe2dbe2a0 con 0x55bbe2e5ee90 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee793ec640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee5c0a2cf0 0x7fee5c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee69ffb640 1 -- 172.21.15.60:0/1682752672 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fee700ceed0 con 0x7fee74100a80 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e5e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e5e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47080/0 (socket says 172.21.15.60:47080) 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 -- 172.21.15.60:0/3667021648 learned_addr learned my addr 172.21.15.60:0/3667021648 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee793ec640 1 --2- 172.21.15.60:0/3667021648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e6e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 -- 172.21.15.60:0/3667021648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 msgr2=0x55bbe2e6b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 --2- 172.21.15.60:0/3667021648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e6b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 -- 172.21.15.60:0/3667021648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 msgr2=0x55bbe2e6e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 --2- 172.21.15.60:0/3667021648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e6e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 -- 172.21.15.60:0/3667021648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe2d4e440 con 0x55bbe2e5e570 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee793ec640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee5c0a2cf0 0x7fee5c0a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00af30 tx=0x7fee6c00e7e0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee78beb640 1 --2- 172.21.15.60:0/3667021648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e5e950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fee700a3b80 tx=0x7fee700970e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf567afdf0279f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee5affd640 1 -- 172.21.15.60:0/3667021648 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7000ee30 con 0x55bbe2e5e570 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee5affd640 1 -- 172.21.15.60:0/3667021648 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee7009bb40 con 0x55bbe2e5e570 2024-09-12T00:02:26.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.869+0000 7fee5affd640 1 -- 172.21.15.60:0/3667021648 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee700a40b0 con 0x55bbe2e5e570 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 -- 172.21.15.60:0/3667021648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 msgr2=0x55bbe2e5e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 --2- 172.21.15.60:0/3667021648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e5e950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fee700a3b80 tx=0x7fee700970e0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 -- 172.21.15.60:0/3667021648 shutdown_connections 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 --2- 172.21.15.60:0/3667021648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e6e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 --2- 172.21.15.60:0/3667021648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e6b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 --2- 172.21.15.60:0/3667021648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e5e950 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 -- 172.21.15.60:0/3667021648 >> 172.21.15.60:0/3667021648 conn(0x55bbe2e5ac40 msgr2=0x55bbe2e5b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 -- 172.21.15.60:0/3667021648 shutdown_connections 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 -- 172.21.15.60:0/3667021648 wait complete. 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.870+0000 7fee7d228740 1 -- start start 2024-09-12T00:02:26.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee7d228740 1 Processor -- start 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee7d228740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e6b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee7d228740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e68900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee7d228740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e68ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee7d228740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bbe2e6e670 con 0x55bbe2e5e570 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee7d228740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55bbe2d7d050 con 0x55bbe2e6bc80 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee7d228740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bbe2e6e7f0 con 0x55bbe2e5ee90 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee7d228740 10 client.0 _ll_register_callbacks cb 0x55bbe2dbd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee78beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e6b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee78beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e6b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47096/0 (socket says 172.21.15.60:47096) 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee78beb640 1 -- 172.21.15.60:0/3267489108 learned_addr learned my addr 172.21.15.60:0/3267489108 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee6bfff640 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e68900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee793ec640 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e68ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee78beb640 1 -- 172.21.15.60:0/3267489108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 msgr2=0x55bbe2e68900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee78beb640 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e68900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee78beb640 1 -- 172.21.15.60:0/3267489108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 msgr2=0x55bbe2e68ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.871+0000 7fee78beb640 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e68ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee78beb640 1 -- 172.21.15.60:0/3267489108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe2b333c0 con 0x55bbe2e5e570 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee793ec640 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e68ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee78beb640 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e6b650 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fee70012fd0 tx=0x7fee700052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34388fd789f593a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee53fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee53fff640 1 -- 172.21.15.60:0/3267489108 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee700b3070 con 0x55bbe2e5e570 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 1 -- 172.21.15.60:0/3267489108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee7009bb40 con 0x55bbe2e5e570 2024-09-12T00:02:26.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee53fff640 1 -- 172.21.15.60:0/3267489108 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fee70097ab0 con 0x55bbe2e5e570 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee53fff640 1 -- 172.21.15.60:0/3267489108 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fee7000edf0 con 0x55bbe2e5e570 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 10 client.16125 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 1 -- 172.21.15.60:0/3267489108 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bbe2e7a0e0 con 0x55bbe2e5e570 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee53fff640 1 -- 172.21.15.60:0/3267489108 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee7009bb40 con 0x55bbe2e5e570 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee53fff640 1 -- 172.21.15.60:0/3267489108 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fee700a3c20 con 0x55bbe2e5e570 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 10 client.16125 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 20 client.16125 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bbe2e7b430 0x55bbe2e7d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 4 client.16125 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.872+0000 7fee7d228740 1 -- 172.21.15.60:0/3267489108 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbe2dcf850 con 0x55bbe2e7b430 2024-09-12T00:02:26.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.873+0000 7fee6bfff640 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bbe2e7b430 0x55bbe2e7d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.873+0000 7fee53fff640 10 client.16125 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.873+0000 7fee6bfff640 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bbe2e7b430 0x55bbe2e7d820 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e30c596c7357d83f server_cookie=3e158f8ffab2f29b in_seq=0 out_seq=0 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee53fff640 1 -- 172.21.15.60:0/3267489108 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbe2dcf850 con 0x55bbe2e7b430 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee53fff640 10 client.16125 handle_command_reply: tid=0 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 client.16125 shutdown 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 -- 172.21.15.60:0/3267489108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 msgr2=0x55bbe2e6b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e6b650 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fee70012fd0 tx=0x7fee700052d0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 -- 172.21.15.60:0/3267489108 shutdown_connections 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bbe2e7b430 0x55bbe2e7d820 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e68ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e68900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee53fff640 0 client.16125 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:26.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 --2- 172.21.15.60:0/3267489108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e6b650 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 -- 172.21.15.60:0/3267489108 >> 172.21.15.60:0/3267489108 conn(0x55bbe2e5ac40 msgr2=0x55bbe2e609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:26.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 -- 172.21.15.60:0/3267489108 shutdown_connections 2024-09-12T00:02:26.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 1 -- 172.21.15.60:0/3267489108 wait complete. 2024-09-12T00:02:26.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.874+0000 7fee7d228740 20 client.16125 trim_cache size 0 max 16384 2024-09-12T00:02:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee7d228740 1 Processor -- start 2024-09-12T00:02:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee7d228740 1 -- start start 2024-09-12T00:02:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee7d228740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee7d228740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e80840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee7d228740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e80d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee7d228740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee741ab6f0 con 0x55bbe2e5e570 2024-09-12T00:02:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee7d228740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee741ad530 con 0x55bbe2e5ee90 2024-09-12T00:02:26.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee7d228740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee741abe80 con 0x55bbe2e6bc80 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee78beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee78beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e688d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47112/0 (socket says 172.21.15.60:47112) 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee78beb640 1 -- 172.21.15.60:0/1900570040 learned_addr learned my addr 172.21.15.60:0/1900570040 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee6bfff640 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e80840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee78beb640 1 -- 172.21.15.60:0/1900570040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 msgr2=0x55bbe2e80d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee793ec640 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e80d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.892+0000 7fee78beb640 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e80d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.893+0000 7fee78beb640 1 -- 172.21.15.60:0/1900570040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5ee90 msgr2=0x55bbe2e80840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.893+0000 7fee78beb640 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e80840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.893+0000 7fee78beb640 1 -- 172.21.15.60:0/1900570040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe2e59f10 con 0x55bbe2e5e570 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.893+0000 7fee6bfff640 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e80840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.893+0000 7fee78beb640 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e688d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fee700ccc70 tx=0x7fee70099950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f30e97f6ba21bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:26.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.893+0000 7fee5a7fc640 1 -- 172.21.15.60:0/1900570040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee700b3040 con 0x55bbe2e5e570 2024-09-12T00:02:26.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.893+0000 7fee5a7fc640 1 -- 172.21.15.60:0/1900570040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee7009bb40 con 0x55bbe2e5e570 2024-09-12T00:02:26.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.893+0000 7fee5a7fc640 1 -- 172.21.15.60:0/1900570040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee700a3c20 con 0x55bbe2e5e570 2024-09-12T00:02:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 -- 172.21.15.60:0/1900570040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 msgr2=0x55bbe2e688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e688d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fee700ccc70 tx=0x7fee70099950 comp rx=0 tx=0).stop 2024-09-12T00:02:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 -- 172.21.15.60:0/1900570040 shutdown_connections 2024-09-12T00:02:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e80d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e80840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 --2- 172.21.15.60:0/1900570040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5e570 0x55bbe2e688d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 -- 172.21.15.60:0/1900570040 >> 172.21.15.60:0/1900570040 conn(0x55bbe2e5ac40 msgr2=0x55bbe2e681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 -- 172.21.15.60:0/1900570040 shutdown_connections 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 -- 172.21.15.60:0/1900570040 wait complete. 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 -- start start 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.894+0000 7fee7d228740 1 Processor -- start 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee7d228740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5e570 0x55bbe2e80cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee7d228740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e7e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee7d228740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e7e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee7d228740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee741acda0 con 0x55bbe2e5ee90 2024-09-12T00:02:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee7d228740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee741ac610 con 0x55bbe2e5e570 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee7d228740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee741a96f0 con 0x55bbe2e6bc80 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee7d228740 10 client.0 _ll_register_callbacks cb 0x7fee700bb040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e7e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e7e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47116/0 (socket says 172.21.15.60:47116) 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 -- 172.21.15.60:0/2446391759 learned_addr learned my addr 172.21.15.60:0/2446391759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee793ec640 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e7e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee78beb640 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5e570 0x55bbe2e80cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 -- 172.21.15.60:0/2446391759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 msgr2=0x55bbe2e7e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e7e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 -- 172.21.15.60:0/2446391759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5e570 msgr2=0x55bbe2e80cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5e570 0x55bbe2e80cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 -- 172.21.15.60:0/2446391759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe2e69260 con 0x55bbe2e5ee90 2024-09-12T00:02:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee6bfff640 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e7e000 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fee64005ab0 tx=0x7fee640040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3063e0551b2a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee53fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.895+0000 7fee53fff640 1 -- 172.21.15.60:0/2446391759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64035040 con 0x55bbe2e5ee90 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee53fff640 1 -- 172.21.15.60:0/2446391759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fee64005040 con 0x55bbe2e5ee90 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 1 -- 172.21.15.60:0/2446391759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee7009bb40 con 0x55bbe2e5ee90 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee53fff640 1 -- 172.21.15.60:0/2446391759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fee64051050 con 0x55bbe2e5ee90 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 10 client.16131 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 1 -- 172.21.15.60:0/2446391759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bbe2ee5950 con 0x55bbe2e5ee90 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee53fff640 1 -- 172.21.15.60:0/2446391759 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee7009bb40 con 0x55bbe2e5ee90 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee53fff640 1 -- 172.21.15.60:0/2446391759 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fee64031640 con 0x55bbe2e5ee90 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 10 client.16131 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:02:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 20 client.16131 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bbe2ee61c0 0x55bbe2ee85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 4 client.16131 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee7d228740 1 -- 172.21.15.60:0/2446391759 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bbe2dc9d60 con 0x55bbe2ee61c0 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.896+0000 7fee78beb640 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bbe2ee61c0 0x55bbe2ee85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee78beb640 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bbe2ee61c0 0x55bbe2ee85e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90216089be0ea3a1 server_cookie=cc4c603923545d86 in_seq=0 out_seq=0 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee53fff640 10 client.16131 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee53fff640 1 -- 172.21.15.60:0/2446391759 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bbe2dc9d60 con 0x55bbe2ee61c0 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee53fff640 10 client.16131 handle_command_reply: tid=0 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 client.16131 shutdown 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 -- 172.21.15.60:0/2446391759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5ee90 msgr2=0x55bbe2e7e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e7e000 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fee64005ab0 tx=0x7fee640040d0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 -- 172.21.15.60:0/2446391759 shutdown_connections 2024-09-12T00:02:26.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bbe2ee61c0 0x55bbe2ee85e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bbe2e6bc80 0x55bbe2e7e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee53fff640 0 client.16131 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bbe2e5ee90 0x55bbe2e7e000 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 --2- 172.21.15.60:0/2446391759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bbe2e5e570 0x55bbe2e80cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 -- 172.21.15.60:0/2446391759 >> 172.21.15.60:0/2446391759 conn(0x55bbe2e5ac40 msgr2=0x55bbe2e60940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 -- 172.21.15.60:0/2446391759 shutdown_connections 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 1 -- 172.21.15.60:0/2446391759 wait complete. 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.897+0000 7fee7d228740 20 client.16131 trim_cache size 0 max 16384 2024-09-12T00:02:26.905 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:02:26.906 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:02:26.906 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:02:26.906 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:02:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee5c0a2cf0 msgr2=0x7fee5c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee5c0a2cf0 0x7fee5c0a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00af30 tx=0x7fee6c00e7e0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 msgr2=0x7fee74197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 0x7fee74197480 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fee7000d950 tx=0x7fee7000de10 comp rx=0 tx=0).stop 2024-09-12T00:02:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1682752672 shutdown_connections 2024-09-12T00:02:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fee5c0a2cf0 0x7fee5c0a51b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee74106a80 0x7fee7419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee74101420 0x7fee741979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 --2- 172.21.15.60:0/1682752672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee74100a80 0x7fee74197480 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:26.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1682752672 >> 172.21.15.60:0/1682752672 conn(0x7fee740fc7a0 msgr2=0x7fee740fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:26.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1682752672 shutdown_connections 2024-09-12T00:02:26.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:26.898+0000 7fee7ae4f640 1 -- 172.21.15.60:0/1682752672 wait complete. 2024-09-12T00:02:27.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:26 smithi060 ceph-mon[30953]: pgmap v95: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-12T00:02:27.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:26 smithi192 ceph-mon[35487]: pgmap v95: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-12T00:02:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:26 smithi105 ceph-mon[34805]: pgmap v95: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-12T00:02:27.801 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:02:27.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:02:28.061 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.507+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3100824348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201036e0 msgr2=0x7f0b20107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.507+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3100824348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201036e0 0x7f0b20107b90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009930 tx=0x7f0b1002a420 comp rx=0 tx=0).stop 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3100824348 shutdown_connections 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3100824348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b201082a0 0x7f0b2010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3100824348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201036e0 0x7f0b20107b90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3100824348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b20102d30 0x7f0b20103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3100824348 >> 172.21.15.60:0/3100824348 conn(0x7f0b200fc7d0 msgr2=0x7f0b200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3100824348 shutdown_connections 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3100824348 wait complete. 2024-09-12T00:02:28.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 Processor -- start 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.508+0000 7f0b27e1c640 1 -- start start 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b27e1c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b20102d30 0x7f0b201986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b27e1c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b201036e0 0x7f0b20198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b27e1c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201082a0 0x7f0b2019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b27e1c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201121c0 con 0x7f0b201082a0 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b27e1c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20112040 con 0x7f0b201036e0 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b27e1c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20112340 con 0x7f0b20102d30 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201082a0 0x7f0b2019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201082a0 0x7f0b2019cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47136/0 (socket says 172.21.15.60:47136) 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 -- 172.21.15.60:0/3702071155 learned_addr learned my addr 172.21.15.60:0/3702071155 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b25bb8640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b20102d30 0x7f0b201986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:28.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b253b7640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b201036e0 0x7f0b20198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 -- 172.21.15.60:0/3702071155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b20102d30 msgr2=0x7f0b201986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b20102d30 0x7f0b201986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 -- 172.21.15.60:0/3702071155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b201036e0 msgr2=0x7f0b20198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b201036e0 0x7f0b20198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 -- 172.21.15.60:0/3702071155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2019d650 con 0x7f0b201082a0 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.509+0000 7f0b263b9640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201082a0 0x7f0b2019cf70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800eaa0 tx=0x7f0b1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.510+0000 7f0b16ffd640 1 -- 172.21.15.60:0/3702071155 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800cdb0 con 0x7f0b201082a0 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.510+0000 7f0b16ffd640 1 -- 172.21.15.60:0/3702071155 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0b18004b20 con 0x7f0b201082a0 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.510+0000 7f0b16ffd640 1 -- 172.21.15.60:0/3702071155 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18011760 con 0x7f0b201082a0 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.510+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2019d940 con 0x7f0b201082a0 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.510+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b201a5220 con 0x7f0b201082a0 2024-09-12T00:02:28.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.511+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b20103110 con 0x7f0b201082a0 2024-09-12T00:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.512+0000 7f0b16ffd640 1 -- 172.21.15.60:0/3702071155 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0b18004cd0 con 0x7f0b201082a0 2024-09-12T00:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.513+0000 7f0b16ffd640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0b0c0a2d70 0x7f0b0c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.513+0000 7f0b25bb8640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0b0c0a2d70 0x7f0b0c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.513+0000 7f0b16ffd640 1 -- 172.21.15.60:0/3702071155 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f0b180cf4b0 con 0x7f0b201082a0 2024-09-12T00:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.513+0000 7f0b25bb8640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0b0c0a2d70 0x7f0b0c0a5230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009bd0 tx=0x7f0b1c005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:28.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.517+0000 7f0b16ffd640 1 -- 172.21.15.60:0/3702071155 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b18016030 con 0x7f0b201082a0 2024-09-12T00:02:28.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:02:28.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.729+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b2010a2b0 con 0x7f0b201082a0 2024-09-12T00:02:28.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.731+0000 7f0b16ffd640 1 -- 172.21.15.60:0/3702071155 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12009 (secure 0 0 0) 0x7f0b1809bad0 con 0x7f0b201082a0 2024-09-12T00:02:28.734 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:02:28.734 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"btime":"2024-09-12T00:02:06:958968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:02:06.347465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 39 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0b0c0a2d70 msgr2=0x7f0b0c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0b0c0a2d70 0x7f0b0c0a5230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c009bd0 tx=0x7f0b1c005f90 comp rx=0 tx=0).stop 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201082a0 msgr2=0x7f0b2019cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201082a0 0x7f0b2019cf70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800eaa0 tx=0x7f0b1800ef60 comp rx=0 tx=0).stop 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 shutdown_connections 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0b0c0a2d70 0x7f0b0c0a5230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b201082a0 0x7f0b2019cf70 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b201036e0 0x7f0b20198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 --2- 172.21.15.60:0/3702071155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b20102d30 0x7f0b201986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:28.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 >> 172.21.15.60:0/3702071155 conn(0x7f0b200fc7d0 msgr2=0x7f0b20105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:28.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 shutdown_connections 2024-09-12T00:02:28.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:28.733+0000 7f0b27e1c640 1 -- 172.21.15.60:0/3702071155 wait complete. 2024-09-12T00:02:29.058 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:29 smithi192 ceph-mon[35487]: pgmap v96: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-12T00:02:29.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:29 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3702071155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:29.323 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:29 smithi060 ceph-mon[30953]: pgmap v96: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-12T00:02:29.324 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:29 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3702071155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:29 smithi105 ceph-mon[34805]: pgmap v96: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-09-12T00:02:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:29 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3702071155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:29.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 -- 172.21.15.60:0/4278124458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100101420 msgr2=0x7fd10010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:29.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 --2- 172.21.15.60:0/4278124458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100101420 0x7fd10010d950 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009cd0 tx=0x7fd0f802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 -- 172.21.15.60:0/4278124458 shutdown_connections 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 --2- 172.21.15.60:0/4278124458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100101420 0x7fd10010d950 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 --2- 172.21.15.60:0/4278124458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd100100a80 0x7fd100100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 --2- 172.21.15.60:0/4278124458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd100106a80 0x7fd100106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 -- 172.21.15.60:0/4278124458 >> 172.21.15.60:0/4278124458 conn(0x7fd1000fc7a0 msgr2=0x7fd1000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 -- 172.21.15.60:0/4278124458 shutdown_connections 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.546+0000 7fd1086a2640 1 -- 172.21.15.60:0/4278124458 wait complete. 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd1086a2640 1 Processor -- start 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd1086a2640 1 -- start start 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd1086a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100100a80 0x7fd1001984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd1086a2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd100101420 0x7fd100198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd1086a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd100106a80 0x7fd10019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:29.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd1086a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd100110fa0 con 0x7fd100100a80 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd1086a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd100110e20 con 0x7fd100106a80 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd1086a2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd100111120 con 0x7fd100101420 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd10643e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100100a80 0x7fd1001984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.547+0000 7fd10643e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100100a80 0x7fd1001984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47150/0 (socket says 172.21.15.60:47150) 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd10643e640 1 -- 172.21.15.60:0/3076698372 learned_addr learned my addr 172.21.15.60:0/3076698372 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd106c3f640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd100106a80 0x7fd10019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd105c3d640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd100101420 0x7fd100198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd10643e640 1 -- 172.21.15.60:0/3076698372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd100101420 msgr2=0x7fd100198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd10643e640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd100101420 0x7fd100198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd10643e640 1 -- 172.21.15.60:0/3076698372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd100106a80 msgr2=0x7fd10019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd10643e640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd100106a80 0x7fd10019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd10643e640 1 -- 172.21.15.60:0/3076698372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10019d480 con 0x7fd100100a80 2024-09-12T00:02:29.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd10643e640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100100a80 0x7fd1001984d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c920 tx=0x7fd0fc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd0f77fe640 1 -- 172.21.15.60:0/3076698372 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc007c70 con 0x7fd100100a80 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10019d770 con 0x7fd100100a80 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd0f77fe640 1 -- 172.21.15.60:0/3076698372 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd0fc007e10 con 0x7fd100100a80 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd0f77fe640 1 -- 172.21.15.60:0/3076698372 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc018940 con 0x7fd100100a80 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.548+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1001a5050 con 0x7fd100100a80 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.549+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd100100ee0 con 0x7fd100100a80 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.550+0000 7fd0f77fe640 1 -- 172.21.15.60:0/3076698372 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd0fc018b20 con 0x7fd100100a80 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.551+0000 7fd0f77fe640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd0ec0a2cf0 0x7fd0ec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.551+0000 7fd0f77fe640 1 -- 172.21.15.60:0/3076698372 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd0fc0cf450 con 0x7fd100100a80 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.551+0000 7fd105c3d640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd0ec0a2cf0 0x7fd0ec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.552+0000 7fd105c3d640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd0ec0a2cf0 0x7fd0ec0a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd100105140 tx=0x7fd0f000b410 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.555+0000 7fd0f77fe640 1 -- 172.21.15.60:0/3076698372 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0fc014030 con 0x7fd100100a80 2024-09-12T00:02:29.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.772+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd10010a000 con 0x7fd100100a80 2024-09-12T00:02:29.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.772+0000 7fd0f77fe640 1 -- 172.21.15.60:0/3076698372 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12009 (secure 0 0 0) 0x7fd0fc09c0c0 con 0x7fd100100a80 2024-09-12T00:02:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:02:29.772 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"btime":"2024-09-12T00:02:06:958968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:02:06.347465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:02:29.772 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 39 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.774+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd0ec0a2cf0 msgr2=0x7fd0ec0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.774+0000 7fd1086a2640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd0ec0a2cf0 0x7fd0ec0a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd100105140 tx=0x7fd0f000b410 comp rx=0 tx=0).stop 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100100a80 msgr2=0x7fd1001984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100100a80 0x7fd1001984d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c920 tx=0x7fd0fc00cde0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 shutdown_connections 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd0ec0a2cf0 0x7fd0ec0a51b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd100106a80 0x7fd10019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd100101420 0x7fd100198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 --2- 172.21.15.60:0/3076698372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd100100a80 0x7fd1001984d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 >> 172.21.15.60:0/3076698372 conn(0x7fd1000fc7a0 msgr2=0x7fd10006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:29.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 shutdown_connections 2024-09-12T00:02:29.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:29.775+0000 7fd1086a2640 1 -- 172.21.15.60:0/3076698372 wait complete. 2024-09-12T00:02:30.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:02:30.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:30 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3076698372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:30.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:30 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3076698372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:30.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:30 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3076698372' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:30.776 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24496 quiesce db --set-id 79ec49b4 --release --await' 2024-09-12T00:02:30.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24496 quiesce db --set-id 79ec49b4 --release --await 2024-09-12T00:02:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:31.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:31 smithi192 ceph-mon[35487]: pgmap v97: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 KiB/s wr, 17 op/s 2024-09-12T00:02:31.312 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:31 smithi060 ceph-mon[30953]: pgmap v97: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 KiB/s wr, 17 op/s 2024-09-12T00:02:31.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.312+0000 7f5ee82ab640 1 -- 172.21.15.60:0/2999961750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee0102d40 msgr2=0x7f5ee0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.312+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/2999961750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee0102d40 0x7f5ee0103120 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009900 tx=0x7f5edc02a480 comp rx=0 tx=0).stop 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.312+0000 7f5ee82ab640 1 -- 172.21.15.60:0/2999961750 shutdown_connections 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.312+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/2999961750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ee010c170 0x7f5ee010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.312+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/2999961750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee0103660 0x7f5ee010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.312+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/2999961750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee0102d40 0x7f5ee0103120 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.312+0000 7f5ee82ab640 1 -- 172.21.15.60:0/2999961750 >> 172.21.15.60:0/2999961750 conn(0x7f5ee00fc7a0 msgr2=0x7f5ee00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.312+0000 7f5ee82ab640 1 -- 172.21.15.60:0/2999961750 shutdown_connections 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.313+0000 7f5ee82ab640 1 -- 172.21.15.60:0/2999961750 wait complete. 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.313+0000 7f5ee82ab640 1 Processor -- start 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.313+0000 7f5ee82ab640 1 -- start start 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.313+0000 7f5ee82ab640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee0102d40 0x7f5ee01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.313+0000 7f5ee82ab640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ee0103660 0x7f5ee0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee82ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee010c170 0x7f5ee0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee82ab640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0112090 con 0x7f5ee010c170 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee82ab640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0111f10 con 0x7f5ee0103660 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee82ab640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0112210 con 0x7f5ee0102d40 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee010c170 0x7f5ee0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee010c170 0x7f5ee0101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47168/0 (socket says 172.21.15.60:47168) 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 -- 172.21.15.60:0/3213644425 learned_addr learned my addr 172.21.15.60:0/3213644425 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee5846640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ee0103660 0x7f5ee0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6047640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee0102d40 0x7f5ee01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 -- 172.21.15.60:0/3213644425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee0102d40 msgr2=0x7f5ee01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee0102d40 0x7f5ee01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 -- 172.21.15.60:0/3213644425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ee0103660 msgr2=0x7f5ee0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ee0103660 0x7f5ee0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 -- 172.21.15.60:0/3213644425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee01a6a20 con 0x7f5ee010c170 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6047640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee0102d40 0x7f5ee01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee6848640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee010c170 0x7f5ee0101420 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800eaa0 tx=0x7f5ed800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ed77fe640 1 -- 172.21.15.60:0/3213644425 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800cdb0 con 0x7f5ee010c170 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ed77fe640 1 -- 172.21.15.60:0/3213644425 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ed8004b20 con 0x7f5ee010c170 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ed77fe640 1 -- 172.21.15.60:0/3213644425 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8011760 con 0x7f5ee010c170 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee82ab640 1 -- 172.21.15.60:0/3213644425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee01a6d10 con 0x7f5ee010c170 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.314+0000 7f5ee82ab640 1 -- 172.21.15.60:0/3213644425 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee01a7250 con 0x7f5ee010c170 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.317+0000 7f5ed77fe640 1 -- 172.21.15.60:0/3213644425 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5ed8004cd0 con 0x7f5ee010c170 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.317+0000 7f5eea684740 1 Processor -- start 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.317+0000 7f5eea684740 1 -- start start 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5eea684740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1bb40 0x55b594c1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5eea684740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c1aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5eea684740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c25370 0x55b594c27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5eea684740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b594b802f0 con 0x55b594c1a5d0 2024-09-12T00:02:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5eea684740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b594b27cf0 con 0x55b594c25370 2024-09-12T00:02:31.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5eea684740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b594b7c2b0 con 0x55b594c1bb40 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ed77fe640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5ecc0a2d70 0x7f5ecc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6047640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c1aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6047640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c1aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47178/0 (socket says 172.21.15.60:47178) 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6047640 1 -- 172.21.15.60:0/527615302 learned_addr learned my addr 172.21.15.60:0/527615302 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee5846640 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c25370 0x55b594c27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6848640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5ecc0a2d70 0x7f5ecc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee5846640 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1bb40 0x55b594c1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ed77fe640 1 -- 172.21.15.60:0/3213644425 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5ed80cf6c0 con 0x7f5ee010c170 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6047640 1 -- 172.21.15.60:0/527615302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1bb40 msgr2=0x55b594c1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6047640 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1bb40 0x55b594c1a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6047640 1 -- 172.21.15.60:0/527615302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c25370 msgr2=0x55b594c27760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:31.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6047640 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c25370 0x55b594c27760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.318+0000 7f5ee6047640 1 -- 172.21.15.60:0/527615302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b594b0c3a0 con 0x55b594c1a5d0 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.319+0000 7f5ee6848640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5ecc0a2d70 0x7f5ecc0a5230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ed806ec10 tx=0x7f5ed80c6760 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.319+0000 7f5ee6047640 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c1aa10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5edc000c00 tx=0x7f5edc032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378070dcc4e2731d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.319+0000 7f5ed4dea640 1 -- 172.21.15.60:0/527615302 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc03f070 con 0x55b594c1a5d0 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.319+0000 7f5ed4dea640 1 -- 172.21.15.60:0/527615302 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5edc031840 con 0x55b594c1a5d0 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.319+0000 7f5ed4dea640 1 -- 172.21.15.60:0/527615302 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc035070 con 0x55b594c1a5d0 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 -- 172.21.15.60:0/527615302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 msgr2=0x55b594c1aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c1aa10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5edc000c00 tx=0x7f5edc032c80 comp rx=0 tx=0).stop 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 -- 172.21.15.60:0/527615302 shutdown_connections 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c25370 0x55b594c27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c1aa10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 --2- 172.21.15.60:0/527615302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1bb40 0x55b594c1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 -- 172.21.15.60:0/527615302 >> 172.21.15.60:0/527615302 conn(0x55b594be3310 msgr2=0x55b594c16c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 -- 172.21.15.60:0/527615302 shutdown_connections 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 -- 172.21.15.60:0/527615302 wait complete. 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 -- start start 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.320+0000 7f5eea684740 1 Processor -- start 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5eea684740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1a5d0 0x55b594c24d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5eea684740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1bb40 0x55b594c21fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5eea684740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 0x55b594c22530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5eea684740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b594c28010 con 0x55b594c1bb40 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5eea684740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b594b3b060 con 0x55b594c1a5d0 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5eea684740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b594c28190 con 0x55b594c25370 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5eea684740 10 client.0 _ll_register_callbacks cb 0x55b59488e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1bb40 0x55b594c21fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1bb40 0x55b594c21fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47186/0 (socket says 172.21.15.60:47186) 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 -- 172.21.15.60:0/1712388196 learned_addr learned my addr 172.21.15.60:0/1712388196 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee5846640 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1a5d0 0x55b594c24d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 -- 172.21.15.60:0/1712388196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 msgr2=0x55b594c22530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 0x55b594c22530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 -- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1a5d0 msgr2=0x55b594c24d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1a5d0 0x55b594c24d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 -- 172.21.15.60:0/1712388196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5948f13c0 con 0x55b594c1bb40 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee5846640 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1a5d0 0x55b594c24d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ee6047640 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1bb40 0x55b594c21fb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5edc004620 tx=0x7f5edc02abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d04afc24986f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:31.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/1712388196 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc03f050 con 0x55b594c1bb40 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/1712388196 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5edc0048c0 con 0x55b594c1bb40 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.321+0000 7f5eea684740 1 -- 172.21.15.60:0/1712388196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5edc031840 con 0x55b594c1bb40 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/1712388196 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5edc035040 con 0x55b594c1bb40 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5eea684740 10 client.16155 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5eea684740 1 -- 172.21.15.60:0/1712388196 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b594c33a70 con 0x55b594c1bb40 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/1712388196 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5edc031840 con 0x55b594c1bb40 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/1712388196 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f5edc04dba0 con 0x55b594c1bb40 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5eea684740 10 client.16155 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5eea684740 10 client.16155 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5eea684740 20 client.16155 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5eea684740 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b594c34dc0 0x55b594c371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5eea684740 4 client.16155 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:31.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5eea684740 1 -- 172.21.15.60:0/1712388196 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b594b8d860 con 0x55b594c34dc0 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.322+0000 7f5ee5846640 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b594c34dc0 0x55b594c371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.323+0000 7f5ee5846640 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b594c34dc0 0x55b594c371b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ecc70437c8b3638d server_cookie=29dcc19f10e50333 in_seq=0 out_seq=0 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.323+0000 7f5ec9ffb640 10 client.16155 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.323+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/1712388196 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b594b8d860 con 0x55b594c34dc0 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.323+0000 7f5ec9ffb640 10 client.16155 handle_command_reply: tid=0 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.323+0000 7f5eea684740 1 client.16155 shutdown 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.323+0000 7f5eea684740 1 -- 172.21.15.60:0/1712388196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1bb40 msgr2=0x55b594c21fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.323+0000 7f5eea684740 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1bb40 0x55b594c21fb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5edc004620 tx=0x7f5edc02abf0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 1 -- 172.21.15.60:0/1712388196 shutdown_connections 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 0x55b594c22530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1bb40 0x55b594c21fb0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b594c34dc0 0x55b594c371b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 1 --2- 172.21.15.60:0/1712388196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1a5d0 0x55b594c24d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5ec9ffb640 0 client.16155 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:02:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 1 -- 172.21.15.60:0/1712388196 >> 172.21.15.60:0/1712388196 conn(0x55b594be3310 msgr2=0x55b594c1c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 1 -- 172.21.15.60:0/1712388196 shutdown_connections 2024-09-12T00:02:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 1 -- 172.21.15.60:0/1712388196 wait complete. 2024-09-12T00:02:31.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.324+0000 7f5eea684740 20 client.16155 trim_cache size 0 max 16384 2024-09-12T00:02:31.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5eea684740 1 Processor -- start 2024-09-12T00:02:31.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5eea684740 1 -- start start 2024-09-12T00:02:31.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5eea684740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1a5d0 0x55b594c312e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5eea684740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c26760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5eea684740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c25370 0x55b594c26ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5eea684740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01afaa0 con 0x55b594c25370 2024-09-12T00:02:31.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5eea684740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01b18e0 con 0x55b594c1bb40 2024-09-12T00:02:31.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5eea684740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01b0230 con 0x55b594c1a5d0 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5ee5846640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c25370 0x55b594c26ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5ee5846640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c25370 0x55b594c26ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47196/0 (socket says 172.21.15.60:47196) 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.337+0000 7f5ee5846640 1 -- 172.21.15.60:0/2684125140 learned_addr learned my addr 172.21.15.60:0/2684125140 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee6047640 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c26760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee5846640 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1a5d0 0x55b594c312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee5846640 1 -- 172.21.15.60:0/2684125140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1a5d0 msgr2=0x55b594c312e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee5846640 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1a5d0 0x55b594c312e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee5846640 1 -- 172.21.15.60:0/2684125140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 msgr2=0x55b594c26760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee5846640 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c26760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee5846640 1 -- 172.21.15.60:0/2684125140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b594c27ba0 con 0x55b594c25370 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee6047640 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c26760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:31.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ee5846640 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c25370 0x55b594c26ca0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55b594c1b070 tx=0x7f5ed0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c351a7373e2ed3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ecbfff640 1 -- 172.21.15.60:0/2684125140 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0004020 con 0x55b594c25370 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ecbfff640 1 -- 172.21.15.60:0/2684125140 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ed00041c0 con 0x55b594c25370 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.338+0000 7f5ecbfff640 1 -- 172.21.15.60:0/2684125140 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0010ab0 con 0x55b594c25370 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- 172.21.15.60:0/2684125140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c25370 msgr2=0x55b594c26ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c25370 0x55b594c26ca0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x55b594c1b070 tx=0x7f5ed0004730 comp rx=0 tx=0).stop 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- 172.21.15.60:0/2684125140 shutdown_connections 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c25370 0x55b594c26ca0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c26760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 --2- 172.21.15.60:0/2684125140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c1a5d0 0x55b594c312e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- 172.21.15.60:0/2684125140 >> 172.21.15.60:0/2684125140 conn(0x55b594be3310 msgr2=0x55b594c16700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- 172.21.15.60:0/2684125140 shutdown_connections 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- 172.21.15.60:0/2684125140 wait complete. 2024-09-12T00:02:31.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- start start 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 Processor -- start 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c3c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c3c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 0x55b594c3cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01b1150 con 0x55b594c1a5d0 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01b09c0 con 0x55b594c1bb40 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.339+0000 7f5eea684740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01adaa0 con 0x55b594c25370 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5eea684740 10 client.0 _ll_register_callbacks cb 0x7f5ee006b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c3c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c3c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47202/0 (socket says 172.21.15.60:47202) 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 -- 172.21.15.60:0/3576495393 learned_addr learned my addr 172.21.15.60:0/3576495393 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee6047640 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c3c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 0x55b594c3cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 -- 172.21.15.60:0/3576495393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 msgr2=0x55b594c3cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 0x55b594c3cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 -- 172.21.15.60:0/3576495393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 msgr2=0x55b594c3c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c3c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 -- 172.21.15.60:0/3576495393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b594c2ba90 con 0x55b594c1a5d0 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ee5846640 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c3c440 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000b450 tx=0x7f5ed0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c660111b00891ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/3576495393 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed002f060 con 0x55b594c1a5d0 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/3576495393 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5ed0003800 con 0x55b594c1a5d0 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.340+0000 7f5eea684740 1 -- 172.21.15.60:0/3576495393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ed00041c0 con 0x55b594c1a5d0 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/3576495393 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5ed0003a00 con 0x55b594c1a5d0 2024-09-12T00:02:31.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5eea684740 10 client.16161 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5eea684740 1 -- 172.21.15.60:0/3576495393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b594c9fb00 con 0x55b594c1a5d0 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/3576495393 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ed00041c0 con 0x55b594c1a5d0 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/3576495393 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f5ed0028040 con 0x55b594c1a5d0 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5eea684740 10 client.16161 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5eea684740 10 client.16161 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5eea684740 20 client.16161 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5eea684740 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b594ca0170 0x55b594ca2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5eea684740 4 client.16161 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5eea684740 1 -- 172.21.15.60:0/3576495393 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b594b87d70 con 0x55b594ca0170 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.341+0000 7f5ee6047640 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b594ca0170 0x55b594ca2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5ee6047640 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b594ca0170 0x55b594ca2590 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d60b364c9c0a43a8 server_cookie=573943fa0457f455 in_seq=0 out_seq=0 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5ec9ffb640 10 client.16161 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:02:31.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5ec9ffb640 1 -- 172.21.15.60:0/3576495393 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b594b87d70 con 0x55b594ca0170 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5ec9ffb640 10 client.16161 handle_command_reply: tid=0 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 client.16161 shutdown 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 -- 172.21.15.60:0/3576495393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 msgr2=0x55b594c3c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c3c440 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000b450 tx=0x7f5ed0001e50 comp rx=0 tx=0).stop 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 -- 172.21.15.60:0/3576495393 shutdown_connections 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b594c25370 0x55b594c3cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b594ca0170 0x55b594ca2590 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b594c1bb40 0x55b594c3c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 --2- 172.21.15.60:0/3576495393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b594c1a5d0 0x55b594c3c440 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5ec9ffb640 0 client.16161 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 -- 172.21.15.60:0/3576495393 >> 172.21.15.60:0/3576495393 conn(0x55b594be3310 msgr2=0x55b594c23810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 -- 172.21.15.60:0/3576495393 shutdown_connections 2024-09-12T00:02:31.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 1 -- 172.21.15.60:0/3576495393 wait complete. 2024-09-12T00:02:31.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.342+0000 7f5eea684740 20 client.16161 trim_cache size 0 max 16384 2024-09-12T00:02:31.351 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:02:31.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 -- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5ecc0a2d70 msgr2=0x7f5ecc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5ecc0a2d70 0x7f5ecc0a5230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ed806ec10 tx=0x7f5ed80c6760 comp rx=0 tx=0).stop 2024-09-12T00:02:31.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 -- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee010c170 msgr2=0x7f5ee0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:31.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee010c170 0x7f5ee0101420 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800eaa0 tx=0x7f5ed800ef60 comp rx=0 tx=0).stop 2024-09-12T00:02:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 -- 172.21.15.60:0/3213644425 shutdown_connections 2024-09-12T00:02:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5ecc0a2d70 0x7f5ecc0a5230 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ee010c170 0x7f5ee0101420 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ee0103660 0x7f5ee0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 --2- 172.21.15.60:0/3213644425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ee0102d40 0x7f5ee01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 -- 172.21.15.60:0/3213644425 >> 172.21.15.60:0/3213644425 conn(0x7f5ee00fc7a0 msgr2=0x7f5ee00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 -- 172.21.15.60:0/3213644425 shutdown_connections 2024-09-12T00:02:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:31.343+0000 7f5ee82ab640 1 -- 172.21.15.60:0/3213644425 wait complete. 2024-09-12T00:02:31.380 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:31 smithi105 ceph-mon[34805]: pgmap v97: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 KiB/s wr, 17 op/s 2024-09-12T00:02:32.124 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:32.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:02:32.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:32 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:02:32.294 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:32 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:02:32.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:32 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:02:32.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 -- 172.21.15.60:0/3153649089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102ef0 msgr2=0x7f727c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 --2- 172.21.15.60:0/3153649089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102ef0 0x7f727c10da40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7274009ca0 tx=0x7f727402a950 comp rx=0 tx=0).stop 2024-09-12T00:02:32.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 -- 172.21.15.60:0/3153649089 shutdown_connections 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 --2- 172.21.15.60:0/3153649089 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c102ef0 0x7f727c10da40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 --2- 172.21.15.60:0/3153649089 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c102570 0x7f727c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 --2- 172.21.15.60:0/3153649089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c100e20 0x7f727c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 -- 172.21.15.60:0/3153649089 >> 172.21.15.60:0/3153649089 conn(0x7f727c0fc7d0 msgr2=0x7f727c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 -- 172.21.15.60:0/3153649089 shutdown_connections 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.638+0000 7f7281139640 1 -- 172.21.15.60:0/3153649089 wait complete. 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.639+0000 7f7281139640 1 Processor -- start 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.639+0000 7f7281139640 1 -- start start 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.639+0000 7f7281139640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c100e20 0x7f727c1a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.639+0000 7f7281139640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c102570 0x7f727c1a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.639+0000 7f7281139640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c102ef0 0x7f727c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.639+0000 7f7281139640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f727c1110a0 con 0x7f727c100e20 2024-09-12T00:02:32.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.639+0000 7f7281139640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f727c110f20 con 0x7f727c102570 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.639+0000 7f7281139640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f727c111220 con 0x7f727c102ef0 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c100e20 0x7f727c1a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c100e20 0x7f727c1a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59886/0 (socket says 172.21.15.60:59886) 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 -- 172.21.15.60:0/1443666227 learned_addr learned my addr 172.21.15.60:0/1443666227 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727a59c640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c102570 0x7f727c1a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727b59e640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c102ef0 0x7f727c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 -- 172.21.15.60:0/1443666227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c102ef0 msgr2=0x7f727c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c102ef0 0x7f727c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 -- 172.21.15.60:0/1443666227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c102570 msgr2=0x7f727c1a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c102570 0x7f727c1a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 -- 172.21.15.60:0/1443666227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c19acc0 con 0x7f727c100e20 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f727ad9d640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c100e20 0x7f727c1a03d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f726c00e9f0 tx=0x7f726c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:32.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.640+0000 7f7273fff640 1 -- 172.21.15.60:0/1443666227 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c00cd80 con 0x7f727c100e20 2024-09-12T00:02:32.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.641+0000 7f7273fff640 1 -- 172.21.15.60:0/1443666227 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f726c005520 con 0x7f727c100e20 2024-09-12T00:02:32.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.641+0000 7f7273fff640 1 -- 172.21.15.60:0/1443666227 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c010690 con 0x7f727c100e20 2024-09-12T00:02:32.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.641+0000 7f7281139640 1 -- 172.21.15.60:0/1443666227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c19afb0 con 0x7f727c100e20 2024-09-12T00:02:32.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.641+0000 7f7281139640 1 -- 172.21.15.60:0/1443666227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c1a72a0 con 0x7f727c100e20 2024-09-12T00:02:32.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.643+0000 7f7273fff640 1 -- 172.21.15.60:0/1443666227 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f726c0046c0 con 0x7f727c100e20 2024-09-12T00:02:32.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.644+0000 7f7273fff640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72680a2d70 0x7f72680a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.644+0000 7f727a59c640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72680a2d70 0x7f72680a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.644+0000 7f7273fff640 1 -- 172.21.15.60:0/1443666227 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f726c0cf920 con 0x7f727c100e20 2024-09-12T00:02:32.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f7283512740 1 Processor -- start 2024-09-12T00:02:32.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f7283512740 1 -- start start 2024-09-12T00:02:32.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f727a59c640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72680a2d70 0x7f72680a5230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7264005fd0 tx=0x7f7264005850 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:32.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f7283512740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf35870 0x56428cf35c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f7283512740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf40510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f7283512740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf40a50 0x56428cf42e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f7283512740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56428ce92620 con 0x56428cf36190 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f7283512740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56428ce39e50 con 0x56428cf40a50 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f7283512740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56428ce8e5e0 con 0x56428cf35870 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f727a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf40510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf35870 0x56428cf35c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf35870 0x56428cf35c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:38670/0 (socket says 172.21.15.60:38670) 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f727ad9d640 1 -- 172.21.15.60:0/2764904555 learned_addr learned my addr 172.21.15.60:0/2764904555 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.645+0000 7f727b59e640 1 --2- 172.21.15.60:0/2764904555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf40a50 0x56428cf42e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f727ad9d640 1 -- 172.21.15.60:0/2764904555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf40a50 msgr2=0x56428cf42e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f727ad9d640 1 --2- 172.21.15.60:0/2764904555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf40a50 0x56428cf42e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f727ad9d640 1 -- 172.21.15.60:0/2764904555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 msgr2=0x56428cf40510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:32.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f727ad9d640 1 --2- 172.21.15.60:0/2764904555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf40510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f727ad9d640 1 -- 172.21.15.60:0/2764904555 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428ce2ad40 con 0x56428cf35870 2024-09-12T00:02:32.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f727ad9d640 1 --2- 172.21.15.60:0/2764904555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf35870 0x56428cf35c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f726c0a45d0 tx=0x7f726c09b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4985258062aeeaa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:32.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f72717fa640 1 -- 172.21.15.60:0/2764904555 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0a0240 con 0x56428cf35870 2024-09-12T00:02:32.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f72717fa640 1 -- 172.21.15.60:0/2764904555 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f726c0a4b00 con 0x56428cf35870 2024-09-12T00:02:32.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.646+0000 7f72717fa640 1 -- 172.21.15.60:0/2764904555 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0a48d0 con 0x56428cf35870 2024-09-12T00:02:32.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 -- 172.21.15.60:0/2764904555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf35870 msgr2=0x56428cf35c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 --2- 172.21.15.60:0/2764904555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf35870 0x56428cf35c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f726c0a45d0 tx=0x7f726c09b7f0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 -- 172.21.15.60:0/2764904555 shutdown_connections 2024-09-12T00:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 --2- 172.21.15.60:0/2764904555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf40a50 0x56428cf42e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 --2- 172.21.15.60:0/2764904555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf40510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 --2- 172.21.15.60:0/2764904555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf35870 0x56428cf35c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 -- 172.21.15.60:0/2764904555 >> 172.21.15.60:0/2764904555 conn(0x56428cf31e00 msgr2=0x56428cf321e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:32.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 -- 172.21.15.60:0/2764904555 shutdown_connections 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 -- 172.21.15.60:0/2764904555 wait complete. 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.647+0000 7f7283512740 1 -- start start 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f7283512740 1 Processor -- start 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f7283512740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf3d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f7283512740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf3deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f7283512740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf3e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f7283512740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56428cf435c0 con 0x56428cf40a50 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f7283512740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56428ce1af10 con 0x56428cf35870 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f7283512740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56428cf43740 con 0x56428cf36190 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f7283512740 10 client.0 _ll_register_callbacks cb 0x56428ce3edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf3d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727a59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf3deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf3d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38556/0 (socket says 172.21.15.60:38556) 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727ad9d640 1 -- 172.21.15.60:0/3978157628 learned_addr learned my addr 172.21.15.60:0/3978157628 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727b59e640 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf3e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727ad9d640 1 -- 172.21.15.60:0/3978157628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 msgr2=0x56428cf3deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727ad9d640 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf3deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727ad9d640 1 -- 172.21.15.60:0/3978157628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 msgr2=0x56428cf3e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727ad9d640 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf3e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727ad9d640 1 -- 172.21.15.60:0/3978157628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428cba1580 con 0x56428cf35870 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.648+0000 7f727a59c640 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf3deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:32.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f727ad9d640 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf3d970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f726c098860 tx=0x7f726c09bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e7f0fbdd5f3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f72627fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f72627fc640 1 -- 172.21.15.60:0/3978157628 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0a0240 con 0x56428cf35870 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f72627fc640 1 -- 172.21.15.60:0/3978157628 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f726c09a190 con 0x56428cf35870 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f7283512740 1 -- 172.21.15.60:0/3978157628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f726c0a4b00 con 0x56428cf35870 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f72627fc640 1 -- 172.21.15.60:0/3978157628 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f726c0a4880 con 0x56428cf35870 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f7283512740 10 client.25736 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f7283512740 1 -- 172.21.15.60:0/3978157628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56428cc6b960 con 0x56428cf35870 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f72627fc640 1 -- 172.21.15.60:0/3978157628 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f726c0a4b00 con 0x56428cf35870 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.649+0000 7f72627fc640 1 -- 172.21.15.60:0/3978157628 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f726c09ad50 con 0x56428cf35870 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f7283512740 10 client.25736 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f7283512740 10 client.25736 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:02:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f7283512740 20 client.25736 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f7283512740 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56428cf50420 0x56428cf52810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f7283512740 4 client.25736 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f7283512740 1 -- 172.21.15.60:0/3978157628 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56428ce9fb90 con 0x56428cf50420 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f727a59c640 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56428cf50420 0x56428cf52810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f72627fc640 10 client.25736 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.650+0000 7f727a59c640 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56428cf50420 0x56428cf52810 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db54665596c70854 server_cookie=6417adcd0cc9d32c in_seq=0 out_seq=0 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f72627fc640 1 -- 172.21.15.60:0/3978157628 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56428ce9fb90 con 0x56428cf50420 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f72627fc640 10 client.25736 handle_command_reply: tid=0 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f7283512740 1 client.25736 shutdown 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f7283512740 1 -- 172.21.15.60:0/3978157628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 msgr2=0x56428cf3d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f7283512740 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf3d970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f726c098860 tx=0x7f726c09bf50 comp rx=0 tx=0).stop 2024-09-12T00:02:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f7283512740 1 -- 172.21.15.60:0/3978157628 shutdown_connections 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f7283512740 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56428cf50420 0x56428cf52810 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f72627fc640 0 client.25736 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.651+0000 7f7283512740 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf3e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.652+0000 7f7283512740 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf3deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.652+0000 7f7283512740 1 --2- 172.21.15.60:0/3978157628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf3d970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.652+0000 7f7283512740 1 -- 172.21.15.60:0/3978157628 >> 172.21.15.60:0/3978157628 conn(0x56428cf31e00 msgr2=0x56428cf37b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.652+0000 7f7283512740 1 -- 172.21.15.60:0/3978157628 shutdown_connections 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.652+0000 7f7283512740 1 -- 172.21.15.60:0/3978157628 wait complete. 2024-09-12T00:02:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.652+0000 7f7283512740 20 client.25736 trim_cache size 0 max 16384 2024-09-12T00:02:32.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f7283512740 1 Processor -- start 2024-09-12T00:02:32.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f7283512740 1 -- start start 2024-09-12T00:02:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f7283512740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f7283512740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf57db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f7283512740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f7283512740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f727c1ab7a0 con 0x56428cf40a50 2024-09-12T00:02:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f7283512740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f727c1ad5e0 con 0x56428cf35870 2024-09-12T00:02:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f7283512740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f727c1abf30 con 0x56428cf36190 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf285a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38562/0 (socket says 172.21.15.60:38562) 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f727ad9d640 1 -- 172.21.15.60:0/2106151396 learned_addr learned my addr 172.21.15.60:0/2106151396 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f727a59c640 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf57db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.670+0000 7f727b59e640 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f727a59c640 1 -- 172.21.15.60:0/2106151396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 msgr2=0x56428cf285a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f727a59c640 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf285a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f727a59c640 1 -- 172.21.15.60:0/2106151396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 msgr2=0x56428cf582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f727a59c640 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f727a59c640 1 -- 172.21.15.60:0/2106151396 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428cf35fc0 con 0x56428cf36190 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f727b59e640 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f727a59c640 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf57db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f726400bfd0 tx=0x7f7264012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba2ec2e3bf41ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f7270ff9640 1 -- 172.21.15.60:0/2106151396 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726401f4f0 con 0x56428cf36190 2024-09-12T00:02:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f7270ff9640 1 -- 172.21.15.60:0/2106151396 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f726401fb90 con 0x56428cf36190 2024-09-12T00:02:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.671+0000 7f7270ff9640 1 -- 172.21.15.60:0/2106151396 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264033d30 con 0x56428cf36190 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 -- 172.21.15.60:0/2106151396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 msgr2=0x56428cf57db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf57db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f726400bfd0 tx=0x7f7264012000 comp rx=0 tx=0).stop 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 -- 172.21.15.60:0/2106151396 shutdown_connections 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf40a50 0x56428cf582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf36190 0x56428cf57db0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 --2- 172.21.15.60:0/2106151396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf285a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 -- 172.21.15.60:0/2106151396 >> 172.21.15.60:0/2106151396 conn(0x56428cf31e00 msgr2=0x56428cf37ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 -- 172.21.15.60:0/2106151396 shutdown_connections 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.672+0000 7f7283512740 1 -- 172.21.15.60:0/2106151396 wait complete. 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 1 -- start start 2024-09-12T00:02:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 1 Processor -- start 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf48c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf49160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf40a50 0x56428cf45980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f727c1ace50 con 0x56428cf36190 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f727c1ac6c0 con 0x56428cf35870 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f727c1a97c0 con 0x56428cf40a50 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f7283512740 10 client.0 _ll_register_callbacks cb 0x7f726c09bd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f727a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf49160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f727a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf49160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59918/0 (socket says 172.21.15.60:59918) 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f727a59c640 1 -- 172.21.15.60:0/3553845730 learned_addr learned my addr 172.21.15.60:0/3553845730 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f727ad9d640 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf48c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.673+0000 7f727b59e640 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf40a50 0x56428cf45980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f727a59c640 1 -- 172.21.15.60:0/3553845730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf40a50 msgr2=0x56428cf45980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f727a59c640 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf40a50 0x56428cf45980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f727a59c640 1 -- 172.21.15.60:0/3553845730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 msgr2=0x56428cf48c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f727a59c640 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf48c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f727a59c640 1 -- 172.21.15.60:0/3553845730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428cf461b0 con 0x56428cf36190 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f727ad9d640 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf48c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f727a59c640 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf49160 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7264030040 tx=0x7f726400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b272c1afce4bd11c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f72627fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f72627fc640 1 -- 172.21.15.60:0/3553845730 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264042060 con 0x56428cf36190 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f72627fc640 1 -- 172.21.15.60:0/3553845730 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7264033630 con 0x56428cf36190 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f7283512740 1 -- 172.21.15.60:0/3553845730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f726401fb90 con 0x56428cf36190 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f72627fc640 1 -- 172.21.15.60:0/3553845730 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7264033a70 con 0x56428cf36190 2024-09-12T00:02:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f7283512740 10 client.16179 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.674+0000 7f7283512740 1 -- 172.21.15.60:0/3553845730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56428cfbb910 con 0x56428cf36190 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f72627fc640 1 -- 172.21.15.60:0/3553845730 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f726401fb90 con 0x56428cf36190 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f72627fc640 1 -- 172.21.15.60:0/3553845730 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f72640053f0 con 0x56428cf36190 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f7283512740 10 client.16179 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f7283512740 10 client.16179 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f7283512740 20 client.16179 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f7283512740 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56428cf50420 0x56428cfbe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f7283512740 4 client.16179 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "79ec49b4", "release": true, "await": true}] 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f7283512740 1 -- 172.21.15.60:0/3553845730 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "quiesce db", "set_id": "79ec49b4", "release": true, "await": true}) -- 0x56428ce9a0a0 con 0x56428cf50420 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.675+0000 7f727ad9d640 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56428cf50420 0x56428cfbe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.676+0000 7f727ad9d640 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56428cf50420 0x56428cfbe140 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18a6c627779bd8db server_cookie=dbcfa23cca0d8e98 in_seq=0 out_seq=0 2024-09-12T00:02:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.676+0000 7f72627fc640 10 client.16179 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:32.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f72627fc640 1 -- 172.21.15.60:0/3553845730 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56428ce9a0a0 con 0x56428cf50420 2024-09-12T00:02:32.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f72627fc640 10 client.16179 handle_command_reply: tid=0 2024-09-12T00:02:32.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 client.16179 shutdown 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 -- 172.21.15.60:0/3553845730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 msgr2=0x56428cf49160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf49160 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7264030040 tx=0x7f726400fc30 comp rx=0 tx=0).stop 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 -- 172.21.15.60:0/3553845730 shutdown_connections 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56428cf50420 0x56428cfbe140 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56428cf40a50 0x56428cf45980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56428cf36190 0x56428cf49160 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 --2- 172.21.15.60:0/3553845730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56428cf35870 0x56428cf48c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 -- 172.21.15.60:0/3553845730 >> 172.21.15.60:0/3553845730 conn(0x56428cf31e00 msgr2=0x56428cf37230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f72627fc640 0 client.16179 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.679+0000 7f7283512740 1 -- 172.21.15.60:0/3553845730 shutdown_connections 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.680+0000 7f7283512740 1 -- 172.21.15.60:0/3553845730 wait complete. 2024-09-12T00:02:32.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.680+0000 7f7283512740 20 client.16179 trim_cache size 0 max 16384 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 39, 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "leader": 24496, 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "set_version": 12, 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "sets": { 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "79ec49b4": { 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "version": 12, 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "age_ref": 0.0, 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:02:32.681 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RELEASED", 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "timeout": 90.0, 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "expiration": 144.7, 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "members": { 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "file:/": { 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "excluded": false, 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "state": { 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RELEASED", 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:32.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:32.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:32.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:32.683 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:02:32.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.680+0000 7f7281139640 1 -- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72680a2d70 msgr2=0x7f72680a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.680+0000 7f7281139640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72680a2d70 0x7f72680a5230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7264005fd0 tx=0x7f7264005850 comp rx=0 tx=0).stop 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.680+0000 7f7281139640 1 -- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c100e20 msgr2=0x7f727c1a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.680+0000 7f7281139640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c100e20 0x7f727c1a03d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f726c00e9f0 tx=0x7f726c00edf0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.681+0000 7f7281139640 1 -- 172.21.15.60:0/1443666227 shutdown_connections 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.681+0000 7f7281139640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72680a2d70 0x7f72680a5230 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.681+0000 7f7281139640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f727c102ef0 0x7f727c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.681+0000 7f7281139640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f727c102570 0x7f727c1a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.681+0000 7f7281139640 1 --2- 172.21.15.60:0/1443666227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f727c100e20 0x7f727c1a03d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.681+0000 7f7281139640 1 -- 172.21.15.60:0/1443666227 >> 172.21.15.60:0/1443666227 conn(0x7f727c0fc7d0 msgr2=0x7f727c06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.681+0000 7f7281139640 1 -- 172.21.15.60:0/1443666227 shutdown_connections 2024-09-12T00:02:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:32.681+0000 7f7281139640 1 -- 172.21.15.60:0/1443666227 wait complete. 2024-09-12T00:02:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:32.805 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar xf doc.tar 2024-09-12T00:02:33.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:33 smithi192 ceph-mon[35487]: pgmap v98: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-09-12T00:02:33.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:02:33.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:02:33.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:02:33.337 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:33 smithi060 ceph-mon[30953]: pgmap v98: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-09-12T00:02:33.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:02:33.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:02:33.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:02:33.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 -- 172.21.15.60:0/586034001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c101440 msgr2=0x7f5c8c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 --2- 172.21.15.60:0/586034001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c101440 0x7f5c8c10df30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009900 tx=0x7f5c7c02a410 comp rx=0 tx=0).stop 2024-09-12T00:02:33.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 -- 172.21.15.60:0/586034001 shutdown_connections 2024-09-12T00:02:33.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 --2- 172.21.15.60:0/586034001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c8c10e500 0x7f5c8c110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 --2- 172.21.15.60:0/586034001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c101440 0x7f5c8c10df30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 --2- 172.21.15.60:0/586034001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c8c100b20 0x7f5c8c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 -- 172.21.15.60:0/586034001 >> 172.21.15.60:0/586034001 conn(0x7f5c8c0fc7d0 msgr2=0x7f5c8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 -- 172.21.15.60:0/586034001 shutdown_connections 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 -- 172.21.15.60:0/586034001 wait complete. 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 Processor -- start 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.422+0000 7f5c94791640 1 -- start start 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c94791640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c100b20 0x7f5c8c1a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c94791640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c8c101440 0x7f5c8c1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c94791640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c8c10e500 0x7f5c8c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c94791640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c1143b0 con 0x7f5c8c100b20 2024-09-12T00:02:33.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c94791640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c114230 con 0x7f5c8c10e500 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c94791640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c114530 con 0x7f5c8c101440 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c100b20 0x7f5c8c1a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c100b20 0x7f5c8c1a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59936/0 (socket says 172.21.15.60:59936) 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 -- 172.21.15.60:0/2834635982 learned_addr learned my addr 172.21.15.60:0/2834635982 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c92d2e640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c8c10e500 0x7f5c8c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c8c101440 0x7f5c8c1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 -- 172.21.15.60:0/2834635982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c8c101440 msgr2=0x7f5c8c1a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c8c101440 0x7f5c8c1a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 -- 172.21.15.60:0/2834635982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c8c10e500 msgr2=0x7f5c8c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c8c10e500 0x7f5c8c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 -- 172.21.15.60:0/2834635982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c19af30 con 0x7f5c8c100b20 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c8c101440 0x7f5c8c1a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:33.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c9252d640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c100b20 0x7f5c8c1a05f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800d770 tx=0x7f5c8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.423+0000 7f5c837fe640 1 -- 172.21.15.60:0/2834635982 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88017070 con 0x7f5c8c100b20 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.424+0000 7f5c94791640 1 -- 172.21.15.60:0/2834635982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8c19b220 con 0x7f5c8c100b20 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.424+0000 7f5c837fe640 1 -- 172.21.15.60:0/2834635982 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c88005520 con 0x7f5c8c100b20 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.424+0000 7f5c837fe640 1 -- 172.21.15.60:0/2834635982 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88010460 con 0x7f5c8c100b20 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.424+0000 7f5c94791640 1 -- 172.21.15.60:0/2834635982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c8c1a7570 con 0x7f5c8c100b20 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.426+0000 7f5c837fe640 1 -- 172.21.15.60:0/2834635982 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5c88004ea0 con 0x7f5c8c100b20 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.426+0000 7f5c96b6a740 1 Processor -- start 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.426+0000 7f5c96b6a740 1 -- start start 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142928b40 0x557142927090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142927a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142934760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55714288d2f0 con 0x5571429275d0 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557142834cf0 con 0x557142932370 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5571428892b0 con 0x557142928b40 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c9252d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142927a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c9252d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142927a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59944/0 (socket says 172.21.15.60:59944) 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c9252d640 1 -- 172.21.15.60:0/652699908 learned_addr learned my addr 172.21.15.60:0/652699908 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c837fe640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5c780a2cf0 0x7f5c780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142934760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c92d2e640 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142928b40 0x557142927090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c92d2e640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5c780a2cf0 0x7f5c780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c837fe640 1 -- 172.21.15.60:0/2834635982 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5c880cef90 con 0x7f5c8c100b20 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c91d2c640 1 -- 172.21.15.60:0/652699908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142928b40 msgr2=0x557142927090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142928b40 0x557142927090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c91d2c640 1 -- 172.21.15.60:0/652699908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 msgr2=0x557142927a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142927a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.427+0000 7f5c91d2c640 1 -- 172.21.15.60:0/652699908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571428193a0 con 0x557142932370 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.428+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142934760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006010 tx=0x7f5c7c032c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55dc40f106e77755 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.428+0000 7f5c92d2e640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5c780a2cf0 0x7f5c780a51b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c069760 tx=0x7f5c84009600 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.428+0000 7f5c80ff9640 1 -- 172.21.15.60:0/652699908 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c03f070 con 0x557142932370 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.428+0000 7f5c80ff9640 1 -- 172.21.15.60:0/652699908 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c7c031840 con 0x557142932370 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.428+0000 7f5c80ff9640 1 -- 172.21.15.60:0/652699908 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c035070 con 0x557142932370 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.428+0000 7f5c96b6a740 1 -- 172.21.15.60:0/652699908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 msgr2=0x557142934760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.428+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142934760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c006010 tx=0x7f5c7c032c80 comp rx=0 tx=0).stop 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 -- 172.21.15.60:0/652699908 shutdown_connections 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142934760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142927a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/652699908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142928b40 0x557142927090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 -- 172.21.15.60:0/652699908 >> 172.21.15.60:0/652699908 conn(0x5571428f0310 msgr2=0x557142923c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 -- 172.21.15.60:0/652699908 shutdown_connections 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 -- 172.21.15.60:0/652699908 wait complete. 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 -- start start 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 Processor -- start 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5571429275d0 0x557142931ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x55714292efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 0x55714292f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557142935010 con 0x557142928b40 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557142848060 con 0x5571429275d0 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557142935190 con 0x557142932370 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c96b6a740 10 client.0 _ll_register_callbacks cb 0x55714259b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:33.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.429+0000 7f5c91d2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x55714292efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c9252d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5571429275d0 0x557142931ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c91d2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x55714292efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59958/0 (socket says 172.21.15.60:59958) 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c91d2c640 1 -- 172.21.15.60:0/1508680353 learned_addr learned my addr 172.21.15.60:0/1508680353 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c92d2e640 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 0x55714292f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c91d2c640 1 -- 172.21.15.60:0/1508680353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 msgr2=0x55714292f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 0x55714292f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c91d2c640 1 -- 172.21.15.60:0/1508680353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5571429275d0 msgr2=0x557142931ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5571429275d0 0x557142931ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c91d2c640 1 -- 172.21.15.60:0/1508680353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571425fe3c0 con 0x557142928b40 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x55714292efe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009900 tx=0x7f5c7c0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64799a7ac5350637 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c75ffb640 1 -- 172.21.15.60:0/1508680353 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c04a020 con 0x557142928b40 2024-09-12T00:02:33.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c75ffb640 1 -- 172.21.15.60:0/1508680353 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5c7c004450 con 0x557142928b40 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1508680353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c7c031840 con 0x557142928b40 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c75ffb640 1 -- 172.21.15.60:0/1508680353 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5c7c055050 con 0x557142928b40 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c96b6a740 10 client.16191 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.430+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1508680353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557142940a60 con 0x557142928b40 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c75ffb640 1 -- 172.21.15.60:0/1508680353 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c7c031840 con 0x557142928b40 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c75ffb640 1 -- 172.21.15.60:0/1508680353 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f5c7c004b00 con 0x557142928b40 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c96b6a740 10 client.16191 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c96b6a740 10 client.16191 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c96b6a740 20 client.16191 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x557142941db0 0x5571429441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c96b6a740 4 client.16191 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1508680353 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55714289a860 con 0x557142941db0 2024-09-12T00:02:33.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.431+0000 7f5c9252d640 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x557142941db0 0x5571429441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.432+0000 7f5c9252d640 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x557142941db0 0x5571429441a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7471140f85f88e8 server_cookie=3f9a12f4ba3d9e5c in_seq=0 out_seq=0 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.432+0000 7f5c75ffb640 10 client.16191 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.432+0000 7f5c75ffb640 1 -- 172.21.15.60:0/1508680353 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55714289a860 con 0x557142941db0 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.432+0000 7f5c75ffb640 10 client.16191 handle_command_reply: tid=0 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.432+0000 7f5c96b6a740 1 client.16191 shutdown 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.432+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1508680353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 msgr2=0x55714292efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.432+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x55714292efe0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c009900 tx=0x7f5c7c0095e0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1508680353 shutdown_connections 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x557142941db0 0x5571429441a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 0x55714292f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x55714292efe0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c75ffb640 0 client.16191 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:02:33.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1508680353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5571429275d0 0x557142931ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1508680353 >> 172.21.15.60:0/1508680353 conn(0x5571428f0310 msgr2=0x557142929960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:33.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1508680353 shutdown_connections 2024-09-12T00:02:33.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1508680353 wait complete. 2024-09-12T00:02:33.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.433+0000 7f5c96b6a740 20 client.16191 trim_cache size 0 max 16384 2024-09-12T00:02:33.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c96b6a740 1 Processor -- start 2024-09-12T00:02:33.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c96b6a740 1 -- start start 2024-09-12T00:02:33.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142923e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142928b40 0x55714293e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 0x55714292e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c1af9c0 con 0x5571429275d0 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c1b1800 con 0x557142928b40 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c1b0150 con 0x557142932370 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c9252d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142923e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c9252d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142923e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59962/0 (socket says 172.21.15.60:59962) 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.446+0000 7f5c9252d640 1 -- 172.21.15.60:0/1517564035 learned_addr learned my addr 172.21.15.60:0/1517564035 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c92d2e640 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 0x55714292e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142928b40 0x55714293e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c9252d640 1 -- 172.21.15.60:0/1517564035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 msgr2=0x55714292e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c9252d640 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 0x55714292e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c9252d640 1 -- 172.21.15.60:0/1517564035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142928b40 msgr2=0x55714293e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c9252d640 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142928b40 0x55714293e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c9252d640 1 -- 172.21.15.60:0/1517564035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557142935180 con 0x5571429275d0 2024-09-12T00:02:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142928b40 0x55714293e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c9252d640 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142923e10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800d740 tx=0x7f5c880d13e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda6b1c3ff2a7490 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c77fff640 1 -- 172.21.15.60:0/1517564035 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88082030 con 0x5571429275d0 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c77fff640 1 -- 172.21.15.60:0/1517564035 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c8809b4a0 con 0x5571429275d0 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.447+0000 7f5c77fff640 1 -- 172.21.15.60:0/1517564035 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88020040 con 0x5571429275d0 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1517564035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 msgr2=0x557142923e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142923e10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800d740 tx=0x7f5c880d13e0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1517564035 shutdown_connections 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557142932370 0x55714292e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142928b40 0x55714293e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/1517564035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5571429275d0 0x557142923e10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1517564035 >> 172.21.15.60:0/1517564035 conn(0x5571428f0310 msgr2=0x557142923700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1517564035 shutdown_connections 2024-09-12T00:02:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 -- 172.21.15.60:0/1517564035 wait complete. 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 -- start start 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.448+0000 7f5c96b6a740 1 Processor -- start 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571429275d0 0x55714293a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x557142935d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c96b6a740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142936260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c1b1070 con 0x557142928b40 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c1b08e0 con 0x557142932370 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c96b6a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c1ad9a0 con 0x5571429275d0 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c96b6a740 10 client.0 _ll_register_callbacks cb 0x7f5c88004840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x557142935d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x557142935d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59978/0 (socket says 172.21.15.60:59978) 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 -- 172.21.15.60:0/180684440 learned_addr learned my addr 172.21.15.60:0/180684440 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:33.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c9252d640 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571429275d0 0x55714293a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c92d2e640 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142936260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 -- 172.21.15.60:0/180684440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571429275d0 msgr2=0x55714293a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571429275d0 0x55714293a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 -- 172.21.15.60:0/180684440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 msgr2=0x557142936260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142936260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 -- 172.21.15.60:0/180684440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557142924960 con 0x557142928b40 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c91d2c640 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x557142935d20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c005070 tx=0x7f5c7c0050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7d1edbacf903b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.449+0000 7f5c75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c75ffb640 1 -- 172.21.15.60:0/180684440 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c05e060 con 0x557142928b40 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c75ffb640 1 -- 172.21.15.60:0/180684440 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5c7c004450 con 0x557142928b40 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 1 -- 172.21.15.60:0/180684440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c8809b4a0 con 0x557142928b40 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c75ffb640 1 -- 172.21.15.60:0/180684440 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5c7c04a040 con 0x557142928b40 2024-09-12T00:02:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 10 client.16197 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 1 -- 172.21.15.60:0/180684440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5571429ac470 con 0x557142928b40 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c75ffb640 1 -- 172.21.15.60:0/180684440 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c8809b4a0 con 0x557142928b40 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c75ffb640 1 -- 172.21.15.60:0/180684440 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f5c7c003a00 con 0x557142928b40 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 10 client.16197 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 10 client.16197 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 20 client.16197 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5571429acbf0 0x5571429af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 4 client.16197 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.450+0000 7f5c96b6a740 1 -- 172.21.15.60:0/180684440 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557142894d70 con 0x5571429acbf0 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c9252d640 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5571429acbf0 0x5571429af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c9252d640 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5571429acbf0 0x5571429af010 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8662ad4fd7381cde server_cookie=2c402ce7a188221b in_seq=0 out_seq=0 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c75ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c75ffb640 1 -- 172.21.15.60:0/180684440 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557142894d70 con 0x5571429acbf0 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c75ffb640 10 client.16197 handle_command_reply: tid=0 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 client.16197 shutdown 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 -- 172.21.15.60:0/180684440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 msgr2=0x557142935d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x557142935d20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c005070 tx=0x7f5c7c0050f0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 -- 172.21.15.60:0/180684440 shutdown_connections 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5571429acbf0 0x5571429af010 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c75ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557142932370 0x557142936260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557142928b40 0x557142935d20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 --2- 172.21.15.60:0/180684440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571429275d0 0x55714293a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.451+0000 7f5c96b6a740 1 -- 172.21.15.60:0/180684440 >> 172.21.15.60:0/180684440 conn(0x5571428f0310 msgr2=0x557142930840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:33.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c96b6a740 1 -- 172.21.15.60:0/180684440 shutdown_connections 2024-09-12T00:02:33.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c96b6a740 1 -- 172.21.15.60:0/180684440 wait complete. 2024-09-12T00:02:33.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c96b6a740 20 client.16197 trim_cache size 0 max 16384 2024-09-12T00:02:33.459 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:02:33.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 -- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5c780a2cf0 msgr2=0x7f5c780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5c780a2cf0 0x7f5c780a51b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c069760 tx=0x7f5c84009600 comp rx=0 tx=0).stop 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 -- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c100b20 msgr2=0x7f5c8c1a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c100b20 0x7f5c8c1a05f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800d770 tx=0x7f5c8800dc30 comp rx=0 tx=0).stop 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 -- 172.21.15.60:0/2834635982 shutdown_connections 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f5c780a2cf0 0x7f5c780a51b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c8c10e500 0x7f5c8c19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c8c101440 0x7f5c8c1a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 --2- 172.21.15.60:0/2834635982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c8c100b20 0x7f5c8c1a05f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.452+0000 7f5c94791640 1 -- 172.21.15.60:0/2834635982 >> 172.21.15.60:0/2834635982 conn(0x7f5c8c0fc7d0 msgr2=0x7f5c8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.453+0000 7f5c94791640 1 -- 172.21.15.60:0/2834635982 shutdown_connections 2024-09-12T00:02:33.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:33.453+0000 7f5c94791640 1 -- 172.21.15.60:0/2834635982 wait complete. 2024-09-12T00:02:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:33 smithi105 ceph-mon[34805]: pgmap v98: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-09-12T00:02:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:02:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:02:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:02:34.313 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '79ec49b4', total seconds elapsed: 30.5 2024-09-12T00:02:34.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:02:35.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:35 smithi060 ceph-mon[30953]: pgmap v99: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T00:02:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:35.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:35 smithi192 ceph-mon[35487]: pgmap v99: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T00:02:35.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:35 smithi105 ceph-mon[34805]: pgmap v99: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T00:02:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.591+0000 7f13e9693640 1 -- 172.21.15.60:0/286172376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 msgr2=0x7f13e4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.591+0000 7f13e9693640 1 --2- 172.21.15.60:0/286172376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 0x7f13e4107b90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009930 tx=0x7f13cc02a420 comp rx=0 tx=0).stop 2024-09-12T00:02:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.591+0000 7f13e9693640 1 -- 172.21.15.60:0/286172376 shutdown_connections 2024-09-12T00:02:35.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 --2- 172.21.15.60:0/286172376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e41082a0 0x7f13e410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 --2- 172.21.15.60:0/286172376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 0x7f13e4107b90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 --2- 172.21.15.60:0/286172376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13e4102d30 0x7f13e4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 -- 172.21.15.60:0/286172376 >> 172.21.15.60:0/286172376 conn(0x7f13e40fc7d0 msgr2=0x7f13e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 -- 172.21.15.60:0/286172376 shutdown_connections 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 -- 172.21.15.60:0/286172376 wait complete. 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 Processor -- start 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 -- start start 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e4102d30 0x7f13e4198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.592+0000 7f13e9693640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 0x7f13e4198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e9693640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13e41082a0 0x7f13e419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e9693640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41121c0 con 0x7f13e41036e0 2024-09-12T00:02:35.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e9693640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4112040 con 0x7f13e41082a0 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e9693640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4112340 con 0x7f13e4102d30 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 0x7f13e4198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 0x7f13e4198bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59996/0 (socket says 172.21.15.60:59996) 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13dbfff640 1 -- 172.21.15.60:0/1701502156 learned_addr learned my addr 172.21.15.60:0/1701502156 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e4102d30 0x7f13e4198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e37fe640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13e41082a0 0x7f13e419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e2ffd640 1 -- 172.21.15.60:0/1701502156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13e41082a0 msgr2=0x7f13e419cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13e41082a0 0x7f13e419cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e2ffd640 1 -- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 msgr2=0x7f13e4198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 0x7f13e4198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e2ffd640 1 -- 172.21.15.60:0/1701502156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e419d630 con 0x7f13e4102d30 2024-09-12T00:02:35.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13dbfff640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 0x7f13e4198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e4102d30 0x7f13e4198680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c970 tx=0x7f13d400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e0ff9640 1 -- 172.21.15.60:0/1701502156 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4007bb0 con 0x7f13e4102d30 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e9693640 1 -- 172.21.15.60:0/1701502156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e419d920 con 0x7f13e4102d30 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e0ff9640 1 -- 172.21.15.60:0/1701502156 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13d4007d50 con 0x7f13e4102d30 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.593+0000 7f13e0ff9640 1 -- 172.21.15.60:0/1701502156 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d400f450 con 0x7f13e4102d30 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.594+0000 7f13e9693640 1 -- 172.21.15.60:0/1701502156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41a5200 con 0x7f13e4102d30 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.596+0000 7f13e0ff9640 1 -- 172.21.15.60:0/1701502156 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f13d4004f80 con 0x7f13e4102d30 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.596+0000 7f13eba6c740 1 Processor -- start 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.596+0000 7f13eba6c740 1 -- start start 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac9b40 0x55b5edac8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edac8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 0x55b5edad5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13eba6c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b5eda2e2f0 con 0x55b5edac85d0 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13eba6c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b5ed9d5cf0 con 0x55b5edad3370 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13eba6c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b5eda2a2b0 con 0x55b5edac9b40 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edac8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e37fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac9b40 0x55b5edac8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edac8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60004/0 (socket says 172.21.15.60:60004) 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e2ffd640 1 -- 172.21.15.60:0/2241173519 learned_addr learned my addr 172.21.15.60:0/2241173519 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e0ff9640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13d00a2cf0 0x7f13d00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13dbfff640 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 0x55b5edad5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e37fe640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13d00a2cf0 0x7f13d00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e37fe640 1 -- 172.21.15.60:0/2241173519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 msgr2=0x55b5edad5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e37fe640 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 0x55b5edad5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e37fe640 1 -- 172.21.15.60:0/2241173519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 msgr2=0x55b5edac8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:35.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e0ff9640 1 -- 172.21.15.60:0/1701502156 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f13d40cf160 con 0x7f13e4102d30 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e37fe640 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edac8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e37fe640 1 -- 172.21.15.60:0/2241173519 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ed9ba3a0 con 0x55b5edac9b40 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.597+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edac8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.598+0000 7f13e37fe640 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac9b40 0x55b5edac8090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13dc005fd0 tx=0x7f13dc012de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3f2b6285762790b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.598+0000 7f13d97fa640 1 -- 172.21.15.60:0/2241173519 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc023020 con 0x55b5edac9b40 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.598+0000 7f13d97fa640 1 -- 172.21.15.60:0/2241173519 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13dc004530 con 0x55b5edac9b40 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.598+0000 7f13d97fa640 1 -- 172.21.15.60:0/2241173519 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc01f9c0 con 0x55b5edac9b40 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.598+0000 7f13eba6c740 1 -- 172.21.15.60:0/2241173519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac9b40 msgr2=0x55b5edac8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.598+0000 7f13eba6c740 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac9b40 0x55b5edac8090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13dc005fd0 tx=0x7f13dc012de0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.598+0000 7f13e37fe640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13d00a2cf0 0x7f13d00a51b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f13dc021000 tx=0x7f13dc020000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 -- 172.21.15.60:0/2241173519 shutdown_connections 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 0x55b5edad5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edac8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 --2- 172.21.15.60:0/2241173519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac9b40 0x55b5edac8090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 -- 172.21.15.60:0/2241173519 >> 172.21.15.60:0/2241173519 conn(0x55b5eda91310 msgr2=0x55b5edac4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 -- 172.21.15.60:0/2241173519 shutdown_connections 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 -- 172.21.15.60:0/2241173519 wait complete. 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 -- start start 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 Processor -- start 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edad2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 0x55b5edad0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edad3370 0x55b5edad0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b5edad6070 con 0x55b5edad3370 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b5ed9e9060 con 0x55b5edac9b40 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b5edad61f0 con 0x55b5edac85d0 2024-09-12T00:02:35.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13eba6c740 10 client.0 _ll_register_callbacks cb 0x55b5ed73c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13e37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edad3370 0x55b5edad0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13e37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edad3370 0x55b5edad0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60008/0 (socket says 172.21.15.60:60008) 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13e37fe640 1 -- 172.21.15.60:0/1400493186 learned_addr learned my addr 172.21.15.60:0/1400493186 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.599+0000 7f13e2ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edad2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13dbfff640 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 0x55b5edad0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13e37fe640 1 -- 172.21.15.60:0/1400493186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 msgr2=0x55b5edad2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13e37fe640 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edad2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13e37fe640 1 -- 172.21.15.60:0/1400493186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 msgr2=0x55b5edad0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13e37fe640 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 0x55b5edad0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13e37fe640 1 -- 172.21.15.60:0/1400493186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ed79f3c0 con 0x55b5edad3370 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13e37fe640 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edad3370 0x55b5edad0690 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00e720 tx=0x7f13dc014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7f078e9d987659 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:35.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13ca7fc640 1 -- 172.21.15.60:0/1400493186 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc023040 con 0x55b5edad3370 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13ca7fc640 1 -- 172.21.15.60:0/1400493186 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f13dc0046e0 con 0x55b5edad3370 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13eba6c740 1 -- 172.21.15.60:0/1400493186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13dc004530 con 0x55b5edad3370 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13ca7fc640 1 -- 172.21.15.60:0/1400493186 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f13dc01f9a0 con 0x55b5edad3370 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13eba6c740 10 client.16209 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13eba6c740 1 -- 172.21.15.60:0/1400493186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b5edae1b10 con 0x55b5edad3370 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.600+0000 7f13ca7fc640 1 -- 172.21.15.60:0/1400493186 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13dc004530 con 0x55b5edad3370 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13ca7fc640 1 -- 172.21.15.60:0/1400493186 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f13dc01e070 con 0x55b5edad3370 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13eba6c740 10 client.16209 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13eba6c740 10 client.16209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13eba6c740 20 client.16209 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13eba6c740 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b5edae2ec0 0x55b5edae52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13eba6c740 4 client.16209 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:35.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13eba6c740 1 -- 172.21.15.60:0/1400493186 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5eda3b860 con 0x55b5edae2ec0 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b5edae2ec0 0x55b5edae52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13ca7fc640 10 client.16209 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.601+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b5edae2ec0 0x55b5edae52f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8be7b045802edfa4 server_cookie=3f681d671b253ac2 in_seq=0 out_seq=0 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13ca7fc640 1 -- 172.21.15.60:0/1400493186 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5eda3b860 con 0x55b5edae2ec0 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13ca7fc640 10 client.16209 handle_command_reply: tid=0 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 client.16209 shutdown 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 -- 172.21.15.60:0/1400493186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edad3370 msgr2=0x55b5edad0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edad3370 0x55b5edad0690 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00e720 tx=0x7f13dc014f90 comp rx=0 tx=0).stop 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 -- 172.21.15.60:0/1400493186 shutdown_connections 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b5edae2ec0 0x55b5edae52f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edad3370 0x55b5edad0690 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 0x55b5edad0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 --2- 172.21.15.60:0/1400493186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edad2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 -- 172.21.15.60:0/1400493186 >> 172.21.15.60:0/1400493186 conn(0x55b5eda91310 msgr2=0x55b5edaca960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:35.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13ca7fc640 0 client.16209 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:02:35.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 -- 172.21.15.60:0/1400493186 shutdown_connections 2024-09-12T00:02:35.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 1 -- 172.21.15.60:0/1400493186 wait complete. 2024-09-12T00:02:35.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.602+0000 7f13eba6c740 20 client.16209 trim_cache size 0 max 16384 2024-09-12T00:02:35.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.616+0000 7f13eba6c740 1 Processor -- start 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.616+0000 7f13eba6c740 1 -- start start 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edadf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac9b40 0x55b5edacb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 0x55b5edacb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13eba6c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41ad930 con 0x55b5edac9b40 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13eba6c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41af770 con 0x55b5edad3370 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13eba6c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41ae0c0 con 0x55b5edac85d0 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac9b40 0x55b5edacb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac9b40 0x55b5edacb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60016/0 (socket says 172.21.15.60:60016) 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 -- 172.21.15.60:0/3185631743 learned_addr learned my addr 172.21.15.60:0/3185631743 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edadf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13e37fe640 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 0x55b5edacb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 -- 172.21.15.60:0/3185631743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 msgr2=0x55b5edadf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edadf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 -- 172.21.15.60:0/3185631743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 msgr2=0x55b5edacb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 0x55b5edacb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 -- 172.21.15.60:0/3185631743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5edace580 con 0x55b5edac9b40 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edadf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.617+0000 7f13dbfff640 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac9b40 0x55b5edacb120 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009230 tx=0x7f13cc031a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194c536c5ec0fe77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13d8ff9640 1 -- 172.21.15.60:0/3185631743 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc035040 con 0x55b5edac9b40 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13d8ff9640 1 -- 172.21.15.60:0/3185631743 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13cc005520 con 0x55b5edac9b40 2024-09-12T00:02:35.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13d8ff9640 1 -- 172.21.15.60:0/3185631743 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0035f0 con 0x55b5edac9b40 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13eba6c740 1 -- 172.21.15.60:0/3185631743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac9b40 msgr2=0x55b5edacb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13eba6c740 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac9b40 0x55b5edacb120 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009230 tx=0x7f13cc031a80 comp rx=0 tx=0).stop 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13eba6c740 1 -- 172.21.15.60:0/3185631743 shutdown_connections 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13eba6c740 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edad3370 0x55b5edacb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13eba6c740 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac9b40 0x55b5edacb120 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13eba6c740 1 --2- 172.21.15.60:0/3185631743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edac85d0 0x55b5edadf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13eba6c740 1 -- 172.21.15.60:0/3185631743 >> 172.21.15.60:0/3185631743 conn(0x55b5eda91310 msgr2=0x55b5edacfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.618+0000 7f13eba6c740 1 -- 172.21.15.60:0/3185631743 shutdown_connections 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 -- 172.21.15.60:0/3185631743 wait complete. 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 -- start start 2024-09-12T00:02:35.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 Processor -- start 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edadb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 0x55b5edadbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edad3370 0x55b5edad6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41aefe0 con 0x55b5edac85d0 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41ae850 con 0x55b5edac9b40 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13e41ab910 con 0x55b5edad3370 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13eba6c740 10 client.0 _ll_register_callbacks cb 0x7f13d4097990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13e2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edadb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13e2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edadb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60032/0 (socket says 172.21.15.60:60032) 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13e37fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edad3370 0x55b5edad6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13e2ffd640 1 -- 172.21.15.60:0/590564515 learned_addr learned my addr 172.21.15.60:0/590564515 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.619+0000 7f13dbfff640 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 0x55b5edadbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13e2ffd640 1 -- 172.21.15.60:0/590564515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edad3370 msgr2=0x55b5edad6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edad3370 0x55b5edad6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13e2ffd640 1 -- 172.21.15.60:0/590564515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 msgr2=0x55b5edadbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 0x55b5edadbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13e2ffd640 1 -- 172.21.15.60:0/590564515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5edad7590 con 0x55b5edac85d0 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13e37fe640 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edad3370 0x55b5edad6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13e2ffd640 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edadb7e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c940 tx=0x7f13d4097a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2155020ca29fa29a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13ca7fc640 1 -- 172.21.15.60:0/590564515 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d401d040 con 0x55b5edac85d0 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13ca7fc640 1 -- 172.21.15.60:0/590564515 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f13d4097ce0 con 0x55b5edac85d0 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13eba6c740 1 -- 172.21.15.60:0/590564515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13cc005520 con 0x55b5edac85d0 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13ca7fc640 1 -- 172.21.15.60:0/590564515 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f13d40b8030 con 0x55b5edac85d0 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13eba6c740 10 client.16215 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:35.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13eba6c740 1 -- 172.21.15.60:0/590564515 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b5edb4d7b0 con 0x55b5edac85d0 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.620+0000 7f13ca7fc640 1 -- 172.21.15.60:0/590564515 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13cc005520 con 0x55b5edac85d0 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13ca7fc640 1 -- 172.21.15.60:0/590564515 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f13dc01fce0 con 0x55b5edac85d0 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13eba6c740 10 client.16215 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13eba6c740 10 client.16215 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13eba6c740 20 client.16215 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13eba6c740 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b5edb4df90 0x55b5edb503b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13eba6c740 4 client.16215 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13eba6c740 1 -- 172.21.15.60:0/590564515 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b5eda35d70 con 0x55b5edb4df90 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13dbfff640 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b5edb4df90 0x55b5edb503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13dbfff640 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b5edb4df90 0x55b5edb503b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8c40c341aecdd55 server_cookie=d89fb615d85b530d in_seq=0 out_seq=0 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.621+0000 7f13ca7fc640 10 client.16215 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13ca7fc640 1 -- 172.21.15.60:0/590564515 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b5eda35d70 con 0x55b5edb4df90 2024-09-12T00:02:35.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13ca7fc640 10 client.16215 handle_command_reply: tid=0 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 client.16215 shutdown 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 -- 172.21.15.60:0/590564515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 msgr2=0x55b5edadb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edadb7e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c940 tx=0x7f13d4097a40 comp rx=0 tx=0).stop 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 -- 172.21.15.60:0/590564515 shutdown_connections 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55b5edb4df90 0x55b5edb503b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5edad3370 0x55b5edad6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b5edac9b40 0x55b5edadbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 --2- 172.21.15.60:0/590564515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b5edac85d0 0x55b5edadb7e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 -- 172.21.15.60:0/590564515 >> 172.21.15.60:0/590564515 conn(0x55b5eda91310 msgr2=0x55b5edad1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13ca7fc640 0 client.16215 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 -- 172.21.15.60:0/590564515 shutdown_connections 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 1 -- 172.21.15.60:0/590564515 wait complete. 2024-09-12T00:02:35.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13eba6c740 20 client.16215 trim_cache size 0 max 16384 2024-09-12T00:02:35.627 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:02:35.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13e9693640 1 -- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13d00a2cf0 msgr2=0x7f13d00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13e9693640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13d00a2cf0 0x7f13d00a51b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f13dc021000 tx=0x7f13dc020000 comp rx=0 tx=0).stop 2024-09-12T00:02:35.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.622+0000 7f13e9693640 1 -- 172.21.15.60:0/1701502156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e4102d30 msgr2=0x7f13e4198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e4102d30 0x7f13e4198680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c970 tx=0x7f13d400ce30 comp rx=0 tx=0).stop 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 -- 172.21.15.60:0/1701502156 shutdown_connections 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13d00a2cf0 0x7f13d00a51b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13e41082a0 0x7f13e419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13e41036e0 0x7f13e4198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 --2- 172.21.15.60:0/1701502156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13e4102d30 0x7f13e4198680 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 -- 172.21.15.60:0/1701502156 >> 172.21.15.60:0/1701502156 conn(0x7f13e40fc7d0 msgr2=0x7f13e4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 -- 172.21.15.60:0/1701502156 shutdown_connections 2024-09-12T00:02:35.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:35.623+0000 7f13e9693640 1 -- 172.21.15.60:0/1701502156 wait complete. 2024-09-12T00:02:36.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:02:36.668 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:37.056 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:37 smithi060 ceph-mon[30953]: pgmap v100: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-12T00:02:37.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 -- 172.21.15.60:0/3399470763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac109120 msgr2=0x7f69ac110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 --2- 172.21.15.60:0/3399470763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac109120 0x7f69ac110ca0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009ca0 tx=0x7f69a402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 -- 172.21.15.60:0/3399470763 shutdown_connections 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 --2- 172.21.15.60:0/3399470763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac109120 0x7f69ac110ca0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 --2- 172.21.15.60:0/3399470763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69ac1049a0 0x7f69ac1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 --2- 172.21.15.60:0/3399470763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69ac103ff0 0x7f69ac1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 -- 172.21.15.60:0/3399470763 >> 172.21.15.60:0/3399470763 conn(0x7f69ac0ffa90 msgr2=0x7f69ac101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 -- 172.21.15.60:0/3399470763 shutdown_connections 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.145+0000 7f69b3094640 1 -- 172.21.15.60:0/3399470763 wait complete. 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b3094640 1 Processor -- start 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b3094640 1 -- start start 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b3094640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac103ff0 0x7f69ac19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b3094640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69ac1049a0 0x7f69ac19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b3094640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69ac109120 0x7f69ac19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b3094640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1142a0 con 0x7f69ac103ff0 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b3094640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac114120 con 0x7f69ac1049a0 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b3094640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac114420 con 0x7f69ac109120 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b0e30640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac103ff0 0x7f69ac19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b0e30640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac103ff0 0x7f69ac19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60048/0 (socket says 172.21.15.60:60048) 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b0e30640 1 -- 172.21.15.60:0/2009787217 learned_addr learned my addr 172.21.15.60:0/2009787217 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b1631640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69ac109120 0x7f69ac19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69a3fff640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69ac1049a0 0x7f69ac19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b0e30640 1 -- 172.21.15.60:0/2009787217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69ac109120 msgr2=0x7f69ac19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b0e30640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69ac109120 0x7f69ac19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b0e30640 1 -- 172.21.15.60:0/2009787217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69ac1049a0 msgr2=0x7f69ac19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b0e30640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69ac1049a0 0x7f69ac19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.146+0000 7f69b0e30640 1 -- 172.21.15.60:0/2009787217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac19f6b0 con 0x7f69ac103ff0 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.147+0000 7f69b0e30640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac103ff0 0x7f69ac19a700 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f69a800e9f0 tx=0x7f69a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.147+0000 7f69a1ffb640 1 -- 172.21.15.60:0/2009787217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a800cd80 con 0x7f69ac103ff0 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.147+0000 7f69a1ffb640 1 -- 172.21.15.60:0/2009787217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69a8005520 con 0x7f69ac103ff0 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.147+0000 7f69b3094640 1 -- 172.21.15.60:0/2009787217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ac19f9a0 con 0x7f69ac103ff0 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.147+0000 7f69a1ffb640 1 -- 172.21.15.60:0/2009787217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a8010690 con 0x7f69ac103ff0 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.147+0000 7f69b3094640 1 -- 172.21.15.60:0/2009787217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ac1a7280 con 0x7f69ac103ff0 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.149+0000 7f69a1ffb640 1 -- 172.21.15.60:0/2009787217 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f69a80046c0 con 0x7f69ac103ff0 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b546d740 1 Processor -- start 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b546d740 1 -- start start 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b546d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69a1ffb640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f69940a2cf0 0x7f69940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b546d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 0x5627d1d6ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b546d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 0x5627d1d78760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b546d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5627d1cd12f0 con 0x5627d1d6cb40 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b546d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5627d1c78cf0 con 0x5627d1d6b5d0 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b546d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5627d1ccd2b0 con 0x5627d1d76370 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b1631640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b0e30640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f69940a2cf0 0x7f69940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b1631640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60062/0 (socket says 172.21.15.60:60062) 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b1631640 1 -- 172.21.15.60:0/161757034 learned_addr learned my addr 172.21.15.60:0/161757034 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.150+0000 7f69b1631640 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 0x5627d1d78760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69a1ffb640 1 -- 172.21.15.60:0/2009787217 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f69a80cf870 con 0x7f69ac103ff0 2024-09-12T00:02:37.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69a3fff640 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 0x5627d1d6ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69b1631640 1 -- 172.21.15.60:0/161757034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 msgr2=0x5627d1d78760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:37.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69b1631640 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 0x5627d1d78760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69b1631640 1 -- 172.21.15.60:0/161757034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 msgr2=0x5627d1d6ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:37.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69b1631640 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 0x5627d1d6ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69b1631640 1 -- 172.21.15.60:0/161757034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627d1c5d3a0 con 0x5627d1d6cb40 2024-09-12T00:02:37.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69b0e30640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f69940a2cf0 0x7f69940a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69a809bd10 tx=0x7f69a80868b0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:37.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f69b1631640 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6b090 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f69a402f540 tx=0x7f69a4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffc5f54e3bf83d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f6992ffd640 1 -- 172.21.15.60:0/161757034 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4003970 con 0x5627d1d6cb40 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f6992ffd640 1 -- 172.21.15.60:0/161757034 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69a4036040 con 0x5627d1d6cb40 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.151+0000 7f6992ffd640 1 -- 172.21.15.60:0/161757034 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a402fd60 con 0x5627d1d6cb40 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 -- 172.21.15.60:0/161757034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 msgr2=0x5627d1d6b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6b090 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f69a402f540 tx=0x7f69a4009360 comp rx=0 tx=0).stop 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 -- 172.21.15.60:0/161757034 shutdown_connections 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 0x5627d1d78760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 0x5627d1d6ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 --2- 172.21.15.60:0/161757034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6b090 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 -- 172.21.15.60:0/161757034 >> 172.21.15.60:0/161757034 conn(0x5627d1d34310 msgr2=0x5627d1d67c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 -- 172.21.15.60:0/161757034 shutdown_connections 2024-09-12T00:02:37.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 -- 172.21.15.60:0/161757034 wait complete. 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.152+0000 7f69b546d740 1 -- start start 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b546d740 1 Processor -- start 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b546d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 0x5627d1d75de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b546d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d73090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b546d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d737d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b546d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5627d1d78e90 con 0x5627d1d6cb40 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b546d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5627d1c8c060 con 0x5627d1d76370 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b546d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5627d1d79010 con 0x5627d1d6b5d0 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d73090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d73090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60070/0 (socket says 172.21.15.60:60070) 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69a3fff640 1 -- 172.21.15.60:0/4230572337 learned_addr learned my addr 172.21.15.60:0/4230572337 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b1631640 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 0x5627d1d75de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b546d740 10 client.0 _ll_register_callbacks cb 0x5627d19df8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69b1631640 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69a3fff640 1 -- 172.21.15.60:0/4230572337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 msgr2=0x5627d1d75de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69a3fff640 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 0x5627d1d75de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69a3fff640 1 -- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 msgr2=0x5627d1d737d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69a3fff640 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d737d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.153+0000 7f69a3fff640 1 -- 172.21.15.60:0/4230572337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627d1a423c0 con 0x5627d1d6cb40 2024-09-12T00:02:37.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f69b1631640 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f69a3fff640 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d73090 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f699c00bf00 tx=0x7f699c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db86cdc37061671 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f698bfff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f698bfff640 1 -- 172.21.15.60:0/4230572337 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c004020 con 0x5627d1d6cb40 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f698bfff640 1 -- 172.21.15.60:0/4230572337 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f699c0041c0 con 0x5627d1d6cb40 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f69b546d740 1 -- 172.21.15.60:0/4230572337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a4036040 con 0x5627d1d6cb40 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f698bfff640 1 -- 172.21.15.60:0/4230572337 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f699c0043c0 con 0x5627d1d6cb40 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f69b546d740 10 client.16227 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f69b546d740 1 -- 172.21.15.60:0/4230572337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5627d1d84980 con 0x5627d1d6cb40 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f698bfff640 1 -- 172.21.15.60:0/4230572337 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69a4036040 con 0x5627d1d6cb40 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.154+0000 7f698bfff640 1 -- 172.21.15.60:0/4230572337 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f699c003ac0 con 0x5627d1d6cb40 2024-09-12T00:02:37.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f69b546d740 10 client.16227 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f69b546d740 10 client.16227 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f69b546d740 20 client.16227 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f69b546d740 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627d1d85ec0 0x5627d1d88300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f69b546d740 4 client.16227 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f69b546d740 1 -- 172.21.15.60:0/4230572337 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627d1cde860 con 0x5627d1d85ec0 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f69b1631640 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627d1d85ec0 0x5627d1d88300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f69b1631640 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627d1d85ec0 0x5627d1d88300 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d69b9997a898248 server_cookie=3569be3d0ceaeeb8 in_seq=0 out_seq=0 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.155+0000 7f698bfff640 10 client.16227 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f698bfff640 1 -- 172.21.15.60:0/4230572337 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627d1cde860 con 0x5627d1d85ec0 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f698bfff640 10 client.16227 handle_command_reply: tid=0 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 client.16227 shutdown 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 -- 172.21.15.60:0/4230572337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 msgr2=0x5627d1d73090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d73090 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f699c00bf00 tx=0x7f699c011810 comp rx=0 tx=0).stop 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 -- 172.21.15.60:0/4230572337 shutdown_connections 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627d1d85ec0 0x5627d1d88300 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d73090 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 --2- 172.21.15.60:0/4230572337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 0x5627d1d75de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 -- 172.21.15.60:0/4230572337 >> 172.21.15.60:0/4230572337 conn(0x5627d1d34310 msgr2=0x5627d1d6d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f698bfff640 0 client.16227 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 -- 172.21.15.60:0/4230572337 shutdown_connections 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 1 -- 172.21.15.60:0/4230572337 wait complete. 2024-09-12T00:02:37.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.156+0000 7f69b546d740 20 client.16227 trim_cache size 0 max 16384 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b546d740 1 Processor -- start 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b546d740 1 -- start start 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b546d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 0x5627d1d82130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b546d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b546d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 0x5627d1d6e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b546d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1afa90 con 0x5627d1d6cb40 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b546d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1b18d0 con 0x5627d1d6b5d0 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b546d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1b0220 con 0x5627d1d76370 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60078/0 (socket says 172.21.15.60:60078) 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69a3fff640 1 -- 172.21.15.60:0/1505420031 learned_addr learned my addr 172.21.15.60:0/1505420031 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b1631640 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 0x5627d1d6e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69b1631640 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 0x5627d1d82130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69a3fff640 1 -- 172.21.15.60:0/1505420031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 msgr2=0x5627d1d6e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69a3fff640 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 0x5627d1d6e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69a3fff640 1 -- 172.21.15.60:0/1505420031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 msgr2=0x5627d1d82130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69a3fff640 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 0x5627d1d82130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.170+0000 7f69a3fff640 1 -- 172.21.15.60:0/1505420031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627d1d82670 con 0x5627d1d6cb40 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.171+0000 7f69a3fff640 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6e120 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f699c000c00 tx=0x7f699c004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118c078fba593347 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.171+0000 7f69927fc640 1 -- 172.21.15.60:0/1505420031 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0235f0 con 0x5627d1d6cb40 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.171+0000 7f69927fc640 1 -- 172.21.15.60:0/1505420031 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f699c023e00 con 0x5627d1d6cb40 2024-09-12T00:02:37.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.171+0000 7f69927fc640 1 -- 172.21.15.60:0/1505420031 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0055f0 con 0x5627d1d6cb40 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.171+0000 7f69b546d740 1 -- 172.21.15.60:0/1505420031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 msgr2=0x5627d1d6e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.171+0000 7f69b546d740 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6e120 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f699c000c00 tx=0x7f699c004560 comp rx=0 tx=0).stop 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 -- 172.21.15.60:0/1505420031 shutdown_connections 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d76370 0x5627d1d6e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d6e120 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 --2- 172.21.15.60:0/1505420031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d6b5d0 0x5627d1d82130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 -- 172.21.15.60:0/1505420031 >> 172.21.15.60:0/1505420031 conn(0x5627d1d34310 msgr2=0x5627d1d75110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 -- 172.21.15.60:0/1505420031 shutdown_connections 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 -- 172.21.15.60:0/1505420031 wait complete. 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 -- start start 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.172+0000 7f69b546d740 1 Processor -- start 2024-09-12T00:02:37.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b546d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 0x5627d1d7eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b546d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d79e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b546d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d7a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b546d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1b1140 con 0x5627d1d6cb40 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b546d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1b09b0 con 0x5627d1d76370 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b546d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac1ada70 con 0x5627d1d6b5d0 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b546d740 10 client.0 _ll_register_callbacks cb 0x7f699c00bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d79e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d79e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60080/0 (socket says 172.21.15.60:60080) 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 -- 172.21.15.60:0/3440420899 learned_addr learned my addr 172.21.15.60:0/3440420899 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b1631640 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 0x5627d1d7eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b1631640 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d7a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 -- 172.21.15.60:0/3440420899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 msgr2=0x5627d1d7eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:37.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 0x5627d1d7eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 -- 172.21.15.60:0/3440420899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 msgr2=0x5627d1d7a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:37.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d7a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 -- 172.21.15.60:0/3440420899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627d1d7ac10 con 0x5627d1d6cb40 2024-09-12T00:02:37.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69a3fff640 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d79e40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f699c003ee0 tx=0x7f699c005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31188143bb6984c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:37.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f698bfff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:37.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f698bfff640 1 -- 172.21.15.60:0/3440420899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0238c0 con 0x5627d1d6cb40 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f69b546d740 1 -- 172.21.15.60:0/3440420899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f699c023e00 con 0x5627d1d6cb40 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.173+0000 7f698bfff640 1 -- 172.21.15.60:0/3440420899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f699c023a60 con 0x5627d1d6cb40 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f698bfff640 1 -- 172.21.15.60:0/3440420899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f699c023c60 con 0x5627d1d6cb40 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b546d740 10 client.16233 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b546d740 1 -- 172.21.15.60:0/3440420899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5627d1df0c70 con 0x5627d1d6cb40 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f698bfff640 1 -- 172.21.15.60:0/3440420899 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f699c023e00 con 0x5627d1d6cb40 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f698bfff640 1 -- 172.21.15.60:0/3440420899 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f699c010c70 con 0x5627d1d6cb40 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b546d740 10 client.16233 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b546d740 10 client.16233 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b546d740 20 client.16233 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b546d740 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627d1df1390 0x5627d1df37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:37.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b546d740 4 client.16233 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b546d740 1 -- 172.21.15.60:0/3440420899 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5627d1cd8d70 con 0x5627d1df1390 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.174+0000 7f69b1631640 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627d1df1390 0x5627d1df37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b1631640 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627d1df1390 0x5627d1df37b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5e095da8f9a3f4e8 server_cookie=f921de83d8abafd7 in_seq=0 out_seq=0 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f698bfff640 10 client.16233 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f698bfff640 1 -- 172.21.15.60:0/3440420899 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5627d1cd8d70 con 0x5627d1df1390 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f698bfff640 10 client.16233 handle_command_reply: tid=0 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 client.16233 shutdown 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 -- 172.21.15.60:0/3440420899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 msgr2=0x5627d1d79e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d79e40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f699c003ee0 tx=0x7f699c005600 comp rx=0 tx=0).stop 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 -- 172.21.15.60:0/3440420899 shutdown_connections 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5627d1df1390 0x5627d1df37b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5627d1d76370 0x5627d1d7a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5627d1d6cb40 0x5627d1d79e40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f698bfff640 0 client.16233 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:02:37.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 --2- 172.21.15.60:0/3440420899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5627d1d6b5d0 0x5627d1d7eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 -- 172.21.15.60:0/3440420899 >> 172.21.15.60:0/3440420899 conn(0x5627d1d34310 msgr2=0x5627d1d71830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:37.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 -- 172.21.15.60:0/3440420899 shutdown_connections 2024-09-12T00:02:37.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.175+0000 7f69b546d740 1 -- 172.21.15.60:0/3440420899 wait complete. 2024-09-12T00:02:37.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b546d740 20 client.16233 trim_cache size 0 max 16384 2024-09-12T00:02:37.189 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 -- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f69940a2cf0 msgr2=0x7f69940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f69940a2cf0 0x7f69940a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69a809bd10 tx=0x7f69a80868b0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 -- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac103ff0 msgr2=0x7f69ac19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac103ff0 0x7f69ac19a700 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f69a800e9f0 tx=0x7f69a800edf0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 -- 172.21.15.60:0/2009787217 shutdown_connections 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f69940a2cf0 0x7f69940a51b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69ac109120 0x7f69ac19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69ac1049a0 0x7f69ac19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 --2- 172.21.15.60:0/2009787217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69ac103ff0 0x7f69ac19a700 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 -- 172.21.15.60:0/2009787217 >> 172.21.15.60:0/2009787217 conn(0x7f69ac0ffa90 msgr2=0x7f69ac100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 -- 172.21.15.60:0/2009787217 shutdown_connections 2024-09-12T00:02:37.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:37.176+0000 7f69b3094640 1 -- 172.21.15.60:0/2009787217 wait complete. 2024-09-12T00:02:37.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:37 smithi192 ceph-mon[35487]: pgmap v100: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-12T00:02:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:37 smithi105 ceph-mon[34805]: pgmap v100: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-12T00:02:37.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:02:38.141 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:38.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 -- 172.21.15.60:0/532944533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8112b90 msgr2=0x7fe4d8114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 --2- 172.21.15.60:0/532944533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8112b90 0x7fe4d8114f80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009ca0 tx=0x7fe4d002a950 comp rx=0 tx=0).stop 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 -- 172.21.15.60:0/532944533 shutdown_connections 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 --2- 172.21.15.60:0/532944533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8112b90 0x7fe4d8114f80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 --2- 172.21.15.60:0/532944533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4d8074eb0 0x7fe4d8112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 --2- 172.21.15.60:0/532944533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d8074590 0x7fe4d8074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 -- 172.21.15.60:0/532944533 >> 172.21.15.60:0/532944533 conn(0x7fe4d80fd8c0 msgr2=0x7fe4d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 -- 172.21.15.60:0/532944533 shutdown_connections 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.627+0000 7fe4e0757640 1 -- 172.21.15.60:0/532944533 wait complete. 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.628+0000 7fe4e0757640 1 Processor -- start 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.628+0000 7fe4e0757640 1 -- start start 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4e0757640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4d8074590 0x7fe4d81a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4e0757640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8074eb0 0x7fe4d81a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4e0757640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d8112b90 0x7fe4d819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4e0757640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d81186b0 con 0x7fe4d8074eb0 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4e0757640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8118530 con 0x7fe4d8074590 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4e0757640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d8118830 con 0x7fe4d8112b90 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8074eb0 0x7fe4d81a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8074eb0 0x7fe4d81a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60094/0 (socket says 172.21.15.60:60094) 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/1303170291 learned_addr learned my addr 172.21.15.60:0/1303170291 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4decf4640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d8112b90 0x7fe4d819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4d8074590 0x7fe4d81a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/1303170291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d8112b90 msgr2=0x7fe4d819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d8112b90 0x7fe4d819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/1303170291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4d8074590 msgr2=0x7fe4d81a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4d8074590 0x7fe4d81a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/1303170291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d819f070 con 0x7fe4d8074eb0 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8074eb0 0x7fe4d81a4cc0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e9f0 tx=0x7fe4c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4cf7fe640 1 -- 172.21.15.60:0/1303170291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800cd80 con 0x7fe4d8074eb0 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.629+0000 7fe4e0757640 1 -- 172.21.15.60:0/1303170291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d819f360 con 0x7fe4d8074eb0 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.630+0000 7fe4cf7fe640 1 -- 172.21.15.60:0/1303170291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4c8010930 con 0x7fe4d8074eb0 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.630+0000 7fe4cf7fe640 1 -- 172.21.15.60:0/1303170291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8018b00 con 0x7fe4d8074eb0 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.630+0000 7fe4e0757640 1 -- 172.21.15.60:0/1303170291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d81ab650 con 0x7fe4d8074eb0 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.632+0000 7fe4cf7fe640 1 -- 172.21.15.60:0/1303170291 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe4c8018ca0 con 0x7fe4d8074eb0 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.632+0000 7fe4e2b30740 1 Processor -- start 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.632+0000 7fe4e2b30740 1 -- start start 2024-09-12T00:02:38.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.632+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429142090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x565429142a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5654290a82f0 con 0x56542914d370 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56542904fcf0 con 0x5654291425d0 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5654290a42b0 con 0x565429143b40 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4cf7fe640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4c40a2cf0 0x7fe4c40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60096/0 (socket says 172.21.15.60:60096) 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/363220561 learned_addr learned my addr 172.21.15.60:0/363220561 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x565429142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4decf4640 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4cf7fe640 1 -- 172.21.15.60:0/1303170291 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe4c80cf790 con 0x7fe4d8074eb0 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4decf4640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4c40a2cf0 0x7fe4c40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/363220561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 msgr2=0x565429142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/363220561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 msgr2=0x565429142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x565429142a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/363220561 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654290343a0 con 0x56542914d370 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x565429142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.633+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914f760 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e9c0 tx=0x7fe4c801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977132b3b3ad2aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4ccff9640 1 -- 172.21.15.60:0/363220561 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80a0050 con 0x56542914d370 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4ccff9640 1 -- 172.21.15.60:0/363220561 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4c80a4910 con 0x56542914d370 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4ccff9640 1 -- 172.21.15.60:0/363220561 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8010ae0 con 0x56542914d370 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4decf4640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4c40a2cf0 0x7fe4c40a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0005fe0 tx=0x7fe4d00095c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:38.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4e2b30740 1 -- 172.21.15.60:0/363220561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 msgr2=0x56542914f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914f760 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e9c0 tx=0x7fe4c801f000 comp rx=0 tx=0).stop 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4e2b30740 1 -- 172.21.15.60:0/363220561 shutdown_connections 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914f760 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x565429142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/363220561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4e2b30740 1 -- 172.21.15.60:0/363220561 >> 172.21.15.60:0/363220561 conn(0x56542910b310 msgr2=0x56542913ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.634+0000 7fe4e2b30740 1 -- 172.21.15.60:0/363220561 shutdown_connections 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 -- 172.21.15.60:0/363220561 wait complete. 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 -- start start 2024-09-12T00:02:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 Processor -- start 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x56542914cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x56542914a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56542914ffb0 con 0x56542914d370 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x565429063060 con 0x5654291425d0 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x565429150130 con 0x565429143b40 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4e2b30740 10 client.0 _ll_register_callbacks cb 0x565428db68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.635+0000 7fe4decf4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4decf4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60104/0 (socket says 172.21.15.60:60104) 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4decf4640 1 -- 172.21.15.60:0/2575684444 learned_addr learned my addr 172.21.15.60:0/2575684444 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x56542914a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x56542914cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4decf4640 1 -- 172.21.15.60:0/2575684444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 msgr2=0x56542914a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4decf4640 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x56542914a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4decf4640 1 -- 172.21.15.60:0/2575684444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 msgr2=0x56542914cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4decf4640 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x56542914cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4decf4640 1 -- 172.21.15.60:0/2575684444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565428e193c0 con 0x56542914d370 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x56542914cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4decf4640 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914a7e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009a60 tx=0x7fe4d002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18542a5c9a01eed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/2575684444 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d004d030 con 0x56542914d370 2024-09-12T00:02:38.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/2575684444 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe4d0004040 con 0x56542914d370 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4e2b30740 1 -- 172.21.15.60:0/2575684444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4c80a4910 con 0x56542914d370 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/2575684444 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe4d0056020 con 0x56542914d370 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4e2b30740 10 client.16245 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.636+0000 7fe4e2b30740 1 -- 172.21.15.60:0/2575684444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56542915bae0 con 0x56542914d370 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/2575684444 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4c80a4910 con 0x56542914d370 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/2575684444 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fe4d0048040 con 0x56542914d370 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4e2b30740 10 client.16245 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4e2b30740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:02:38.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4e2b30740 20 client.16245 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56542915cf70 0x56542915f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4e2b30740 4 client.16245 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4e2b30740 1 -- 172.21.15.60:0/2575684444 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654290b5860 con 0x56542915cf70 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.637+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56542915cf70 0x56542915f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56542915cf70 0x56542915f3d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae33e8e2eb303a7f server_cookie=774a074edd254c71 in_seq=0 out_seq=0 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4c1ffb640 10 client.16245 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/2575684444 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654290b5860 con 0x56542915cf70 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4c1ffb640 10 client.16245 handle_command_reply: tid=0 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 client.16245 shutdown 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 -- 172.21.15.60:0/2575684444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 msgr2=0x56542914a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914a7e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009a60 tx=0x7fe4d002a950 comp rx=0 tx=0).stop 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 -- 172.21.15.60:0/2575684444 shutdown_connections 2024-09-12T00:02:38.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56542915cf70 0x56542915f3d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56542914d370 0x56542914a7e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x56542914a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/2575684444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5654291425d0 0x56542914cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4c1ffb640 0 client.16245 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 -- 172.21.15.60:0/2575684444 >> 172.21.15.60:0/2575684444 conn(0x56542910b310 msgr2=0x565429144990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 -- 172.21.15.60:0/2575684444 shutdown_connections 2024-09-12T00:02:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.638+0000 7fe4e2b30740 1 -- 172.21.15.60:0/2575684444 wait complete. 2024-09-12T00:02:38.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.639+0000 7fe4e2b30740 20 client.16245 trim_cache size 0 max 16384 2024-09-12T00:02:38.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4e2b30740 1 Processor -- start 2024-09-12T00:02:38.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4e2b30740 1 -- start start 2024-09-12T00:02:38.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x56542914a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565429143b40 0x565429149910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56542914d370 0x56542914bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d81b3eb0 con 0x5654291425d0 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d81b5cf0 con 0x565429143b40 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d81b4640 con 0x56542914d370 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4de4f3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x56542914a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4de4f3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x56542914a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60120/0 (socket says 172.21.15.60:60120) 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4de4f3640 1 -- 172.21.15.60:0/3538458393 learned_addr learned my addr 172.21.15.60:0/3538458393 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4decf4640 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56542914d370 0x56542914bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565429143b40 0x565429149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4de4f3640 1 -- 172.21.15.60:0/3538458393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56542914d370 msgr2=0x56542914bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56542914d370 0x56542914bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4de4f3640 1 -- 172.21.15.60:0/3538458393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565429143b40 msgr2=0x565429149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:38.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565429143b40 0x565429149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4de4f3640 1 -- 172.21.15.60:0/3538458393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565429150120 con 0x5654291425d0 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.652+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565429143b40 0x565429149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x56542914a760 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x56542915fc40 tx=0x7fe4d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1196cb253f8b3d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4c3fff640 1 -- 172.21.15.60:0/3538458393 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4010430 con 0x5654291425d0 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4c3fff640 1 -- 172.21.15.60:0/3538458393 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4d4010ad0 con 0x5654291425d0 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4c3fff640 1 -- 172.21.15.60:0/3538458393 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d401eb90 con 0x5654291425d0 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4e2b30740 1 -- 172.21.15.60:0/3538458393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 msgr2=0x56542914a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x56542914a760 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x56542915fc40 tx=0x7fe4d40046c0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4e2b30740 1 -- 172.21.15.60:0/3538458393 shutdown_connections 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56542914d370 0x56542914bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565429143b40 0x565429149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/3538458393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x56542914a760 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4e2b30740 1 -- 172.21.15.60:0/3538458393 >> 172.21.15.60:0/3538458393 conn(0x56542910b310 msgr2=0x56542914b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:38.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.653+0000 7fe4e2b30740 1 -- 172.21.15.60:0/3538458393 shutdown_connections 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 -- 172.21.15.60:0/3538458393 wait complete. 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 -- start start 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 Processor -- start 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x5654291559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429146c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56542914d370 0x565429147190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d81b5560 con 0x5654291425d0 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d81b4dd0 con 0x56542914d370 2024-09-12T00:02:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d81b1e90 con 0x565429143b40 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4e2b30740 10 client.0 _ll_register_callbacks cb 0x7fe4d4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4de4f3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x5654291559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4ddcf2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4ddcf2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:38974/0 (socket says 172.21.15.60:38974) 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4de4f3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x5654291559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60136/0 (socket says 172.21.15.60:60136) 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/1599886531 learned_addr learned my addr 172.21.15.60:0/1599886531 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.654+0000 7fe4decf4640 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56542914d370 0x565429147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/1599886531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56542914d370 msgr2=0x565429147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56542914d370 0x565429147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/1599886531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 msgr2=0x5654291559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x5654291559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4ddcf2640 1 -- 172.21.15.60:0/1599886531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565429147880 con 0x565429143b40 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x5654291559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4ddcf2640 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429146c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4c809a000 tx=0x7fe4c8097ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dafe3d64e6ebdf51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/1599886531 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80a4910 con 0x565429143b40 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/1599886531 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe4c8010ae0 con 0x565429143b40 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4e2b30740 1 -- 172.21.15.60:0/1599886531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4d4010ad0 con 0x565429143b40 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/1599886531 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe4c8010d00 con 0x565429143b40 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4e2b30740 10 client.25738 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4e2b30740 1 -- 172.21.15.60:0/1599886531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5654291c7ac0 con 0x565429143b40 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.655+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/1599886531 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4d4010ad0 con 0x565429143b40 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/1599886531 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fe4c8097aa0 con 0x565429143b40 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4e2b30740 10 client.25738 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4e2b30740 10 client.25738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:02:38.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4e2b30740 20 client.25738 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5654291c7e40 0x5654291ca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4e2b30740 4 client.25738 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4e2b30740 1 -- 172.21.15.60:0/1599886531 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654290afd70 con 0x5654291c7e40 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5654291c7e40 0x5654291ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4de4f3640 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5654291c7e40 0x5654291ca230 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49b0af5636cd030b server_cookie=4010287d4964f371 in_seq=0 out_seq=0 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.656+0000 7fe4c1ffb640 10 client.25738 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4c1ffb640 1 -- 172.21.15.60:0/1599886531 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654290afd70 con 0x5654291c7e40 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4c1ffb640 10 client.25738 handle_command_reply: tid=0 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 client.25738 shutdown 2024-09-12T00:02:38.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 -- 172.21.15.60:0/1599886531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 msgr2=0x565429146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429146c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4c809a000 tx=0x7fe4c8097ff0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 -- 172.21.15.60:0/1599886531 shutdown_connections 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5654291c7e40 0x5654291ca230 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56542914d370 0x565429147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565429143b40 0x565429146c50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4c1ffb640 0 client.25738 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 --2- 172.21.15.60:0/1599886531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5654291425d0 0x5654291559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 -- 172.21.15.60:0/1599886531 >> 172.21.15.60:0/1599886531 conn(0x56542910b310 msgr2=0x56542914c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 -- 172.21.15.60:0/1599886531 shutdown_connections 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 1 -- 172.21.15.60:0/1599886531 wait complete. 2024-09-12T00:02:38.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e2b30740 20 client.25738 trim_cache size 0 max 16384 2024-09-12T00:02:38.665 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:02:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e0757640 1 -- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4c40a2cf0 msgr2=0x7fe4c40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e0757640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4c40a2cf0 0x7fe4c40a51b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0005fe0 tx=0x7fe4d00095c0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e0757640 1 -- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8074eb0 msgr2=0x7fe4d81a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.657+0000 7fe4e0757640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8074eb0 0x7fe4d81a4cc0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e9f0 tx=0x7fe4c800eeb0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.658+0000 7fe4e0757640 1 -- 172.21.15.60:0/1303170291 shutdown_connections 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.658+0000 7fe4e0757640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4c40a2cf0 0x7fe4c40a51b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.658+0000 7fe4e0757640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4d8112b90 0x7fe4d819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.658+0000 7fe4e0757640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4d8074eb0 0x7fe4d81a4cc0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.658+0000 7fe4e0757640 1 --2- 172.21.15.60:0/1303170291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4d8074590 0x7fe4d81a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.658+0000 7fe4e0757640 1 -- 172.21.15.60:0/1303170291 >> 172.21.15.60:0/1303170291 conn(0x7fe4d80fd8c0 msgr2=0x7fe4d80fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.658+0000 7fe4e0757640 1 -- 172.21.15.60:0/1303170291 shutdown_connections 2024-09-12T00:02:38.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:38.658+0000 7fe4e0757640 1 -- 172.21.15.60:0/1303170291 wait complete. 2024-09-12T00:02:39.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:39 smithi192 ceph-mon[35487]: pgmap v101: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-12T00:02:39.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:39 smithi060 ceph-mon[30953]: pgmap v101: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-12T00:02:39.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:39 smithi105 ceph-mon[34805]: pgmap v101: 97 pgs: 97 active+clean; 235 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-12T00:02:40.450 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:02:40.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:02:40.711 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:41.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:41 smithi060 ceph-mon[30953]: pgmap v102: 97 pgs: 97 active+clean; 240 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 542 KiB/s wr, 24 op/s 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 -- 172.21.15.60:0/2268261355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102ef0 msgr2=0x7f960010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 --2- 172.21.15.60:0/2268261355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102ef0 0x7f960010da40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009ca0 tx=0x7f95f802a950 comp rx=0 tx=0).stop 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 -- 172.21.15.60:0/2268261355 shutdown_connections 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 --2- 172.21.15.60:0/2268261355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102ef0 0x7f960010da40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 --2- 172.21.15.60:0/2268261355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9600102570 0x7f96001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 --2- 172.21.15.60:0/2268261355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9600100e20 0x7f9600101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 -- 172.21.15.60:0/2268261355 >> 172.21.15.60:0/2268261355 conn(0x7f96000fc7d0 msgr2=0x7f96000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 -- 172.21.15.60:0/2268261355 shutdown_connections 2024-09-12T00:02:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.204+0000 7f960812c640 1 -- 172.21.15.60:0/2268261355 wait complete. 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f960812c640 1 Processor -- start 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f960812c640 1 -- start start 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f960812c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9600100e20 0x7f9600198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f960812c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102570 0x7f9600198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f960812c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9600102ef0 0x7f960019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f960812c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96001110a0 con 0x7f9600102570 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f960812c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9600110f20 con 0x7f9600100e20 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f960812c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9600111220 con 0x7f9600102ef0 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96056c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102570 0x7f9600198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96056c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102570 0x7f9600198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60148/0 (socket says 172.21.15.60:60148) 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96056c7640 1 -- 172.21.15.60:0/4234180711 learned_addr learned my addr 172.21.15.60:0/4234180711 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f9605ec8640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9600100e20 0x7f9600198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96066c9640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9600102ef0 0x7f960019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96056c7640 1 -- 172.21.15.60:0/4234180711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9600102ef0 msgr2=0x7f960019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96056c7640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9600102ef0 0x7f960019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96056c7640 1 -- 172.21.15.60:0/4234180711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9600100e20 msgr2=0x7f9600198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96056c7640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9600100e20 0x7f9600198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96056c7640 1 -- 172.21.15.60:0/4234180711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960019d500 con 0x7f9600102570 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f96066c9640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9600102ef0 0x7f960019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.205+0000 7f9605ec8640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9600100e20 0x7f9600198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.206+0000 7f96056c7640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102570 0x7f9600198a90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f95f000e9f0 tx=0x7f95f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:41.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.206+0000 7f95f6ffd640 1 -- 172.21.15.60:0/4234180711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f000cd80 con 0x7f9600102570 2024-09-12T00:02:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.206+0000 7f95f6ffd640 1 -- 172.21.15.60:0/4234180711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95f0010930 con 0x7f9600102570 2024-09-12T00:02:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.206+0000 7f960812c640 1 -- 172.21.15.60:0/4234180711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960019d7f0 con 0x7f9600102570 2024-09-12T00:02:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.206+0000 7f95f6ffd640 1 -- 172.21.15.60:0/4234180711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0018b00 con 0x7f9600102570 2024-09-12T00:02:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.206+0000 7f960812c640 1 -- 172.21.15.60:0/4234180711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96001a50d0 con 0x7f9600102570 2024-09-12T00:02:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.208+0000 7f95f6ffd640 1 -- 172.21.15.60:0/4234180711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f95f0018ca0 con 0x7f9600102570 2024-09-12T00:02:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f960a505740 1 Processor -- start 2024-09-12T00:02:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f960a505740 1 -- start start 2024-09-12T00:02:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f960a505740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cef9df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f960a505740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9e480 0x5577cefa8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f960a505740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cefa8d40 0x5577cefab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f960a505740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5577cef03280 con 0x5577cef9db60 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f960a505740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5577ceeaab10 con 0x5577cefa8d40 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f960a505740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5577ceeff240 con 0x5577cef9e480 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f96066c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cef9df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f96066c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cef9df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60154/0 (socket says 172.21.15.60:60154) 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f96066c9640 1 -- 172.21.15.60:0/148710774 learned_addr learned my addr 172.21.15.60:0/148710774 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f95f6ffd640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95ec0a2d70 0x7f95ec0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f9605ec8640 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9e480 0x5577cefa8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.209+0000 7f96056c7640 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cefa8d40 0x5577cefab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f96066c9640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95ec0a2d70 0x7f95ec0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f95f6ffd640 1 -- 172.21.15.60:0/4234180711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f95f00cf910 con 0x7f9600102570 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f9605ec8640 1 -- 172.21.15.60:0/148710774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cefa8d40 msgr2=0x5577cefab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f9605ec8640 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cefa8d40 0x5577cefab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f9605ec8640 1 -- 172.21.15.60:0/148710774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 msgr2=0x5577cef9df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f9605ec8640 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cef9df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f9605ec8640 1 -- 172.21.15.60:0/148710774 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577ceeb71f0 con 0x5577cef9e480 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f96066c9640 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cef9df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f9605ec8640 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9e480 0x5577cefa8800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009c30 tx=0x7f95fc0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b3ace9956cd994 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f96066c9640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95ec0a2d70 0x7f95ec0a5230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f95f8030040 tx=0x7f95f802a950 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f95ebfff640 1 -- 172.21.15.60:0/148710774 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc005020 con 0x5577cef9e480 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f95ebfff640 1 -- 172.21.15.60:0/148710774 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95fc0047a0 con 0x5577cef9e480 2024-09-12T00:02:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.210+0000 7f95ebfff640 1 -- 172.21.15.60:0/148710774 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0127f0 con 0x5577cef9e480 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 -- 172.21.15.60:0/148710774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9e480 msgr2=0x5577cefa8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9e480 0x5577cefa8800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009c30 tx=0x7f95fc0117b0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 -- 172.21.15.60:0/148710774 shutdown_connections 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cefa8d40 0x5577cefab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9e480 0x5577cefa8800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 --2- 172.21.15.60:0/148710774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cef9df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 -- 172.21.15.60:0/148710774 >> 172.21.15.60:0/148710774 conn(0x5577cef9a0f0 msgr2=0x5577cef9a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 -- 172.21.15.60:0/148710774 shutdown_connections 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 -- 172.21.15.60:0/148710774 wait complete. 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.211+0000 7f960a505740 1 -- start start 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f960a505740 1 Processor -- start 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f960a505740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefa5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f960a505740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefa6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f960a505740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cefa6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f960a505740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5577cefafd20 con 0x5577cef9db60 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f960a505740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5577ceebdf10 con 0x5577cef9e480 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f960a505740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5577cefafea0 con 0x5577cefa8d40 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f960a505740 10 client.0 _ll_register_callbacks cb 0x5577cee86a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f9605ec8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefa5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f96066c9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cefa6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f9605ec8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefa5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60156/0 (socket says 172.21.15.60:60156) 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f9605ec8640 1 -- 172.21.15.60:0/3176715842 learned_addr learned my addr 172.21.15.60:0/3176715842 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f96056c7640 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefa6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f96066c9640 1 -- 172.21.15.60:0/3176715842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 msgr2=0x5577cefa6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f96066c9640 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefa6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f96066c9640 1 -- 172.21.15.60:0/3176715842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 msgr2=0x5577cefa5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f96066c9640 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefa5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f96066c9640 1 -- 172.21.15.60:0/3176715842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577cec746a0 con 0x5577cefa8d40 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.212+0000 7f9605ec8640 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefa5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f96066c9640 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cefa6650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009ca0 tx=0x7f95f80095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c21508255d42a143 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f95e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f95e97fa640 1 -- 172.21.15.60:0/3176715842 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8034040 con 0x5577cefa8d40 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 1 -- 172.21.15.60:0/3176715842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95fc0047a0 con 0x5577cefa8d40 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f95e97fa640 1 -- 172.21.15.60:0/3176715842 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f95f8004450 con 0x5577cefa8d40 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f95e97fa640 1 -- 172.21.15.60:0/3176715842 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f95f8059050 con 0x5577cefa8d40 2024-09-12T00:02:41.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 10 client.25750 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 1 -- 172.21.15.60:0/3176715842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5577cefbb920 con 0x5577cefa8d40 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f95e97fa640 1 -- 172.21.15.60:0/3176715842 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95fc0047a0 con 0x5577cefa8d40 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f95e97fa640 1 -- 172.21.15.60:0/3176715842 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f95f8049040 con 0x5577cefa8d40 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 10 client.25750 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 10 client.25750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 20 client.25750 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5577cefbce80 0x5577cefbf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 4 client.25750 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.213+0000 7f960a505740 1 -- 172.21.15.60:0/3176715842 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577cef107f0 con 0x5577cefbce80 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.214+0000 7f9605ec8640 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5577cefbce80 0x5577cefbf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.214+0000 7f9605ec8640 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5577cefbce80 0x5577cefbf300 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7090b0d51451d847 server_cookie=2c18b3a1631041b7 in_seq=0 out_seq=0 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.214+0000 7f95e97fa640 10 client.25750 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f95e97fa640 1 -- 172.21.15.60:0/3176715842 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577cef107f0 con 0x5577cefbce80 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f95e97fa640 10 client.25750 handle_command_reply: tid=0 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 client.25750 shutdown 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 -- 172.21.15.60:0/3176715842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 msgr2=0x5577cefa6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cefa6650 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009ca0 tx=0x7f95f80095c0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 -- 172.21.15.60:0/3176715842 shutdown_connections 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5577cefbce80 0x5577cefbf300 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cefa6650 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefa6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f95e97fa640 0 client.25750 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:41.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 --2- 172.21.15.60:0/3176715842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefa5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 -- 172.21.15.60:0/3176715842 >> 172.21.15.60:0/3176715842 conn(0x5577cef9a0f0 msgr2=0x5577cef99270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:41.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 -- 172.21.15.60:0/3176715842 shutdown_connections 2024-09-12T00:02:41.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 1 -- 172.21.15.60:0/3176715842 wait complete. 2024-09-12T00:02:41.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.215+0000 7f960a505740 20 client.25750 trim_cache size 0 max 16384 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f960a505740 1 Processor -- start 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f960a505740 1 -- start start 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f960a505740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9db60 0x5577cefa7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f960a505740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefc4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f960a505740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cefa8d40 0x5577cefc5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f960a505740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96001ab560 con 0x5577cefa8d40 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f960a505740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96001ad3a0 con 0x5577cef9e480 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f960a505740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f96001abcf0 con 0x5577cef9db60 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cefa8d40 0x5577cefc5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cefa8d40 0x5577cefc5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60166/0 (socket says 172.21.15.60:60166) 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 -- 172.21.15.60:0/2634513860 learned_addr learned my addr 172.21.15.60:0/2634513860 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:41.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f9605ec8640 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9db60 0x5577cefa7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 -- 172.21.15.60:0/2634513860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9db60 msgr2=0x5577cefa7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96056c7640 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefc4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9db60 0x5577cefa7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 -- 172.21.15.60:0/2634513860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 msgr2=0x5577cefc4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefc4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 -- 172.21.15.60:0/2634513860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577cefa84a0 con 0x5577cefa8d40 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96056c7640 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefc4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.233+0000 7f96066c9640 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cefa8d40 0x5577cefc5110 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f95f802ae70 tx=0x7f95f802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7afdeaa17f746e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f95eb7fe640 1 -- 172.21.15.60:0/2634513860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f803a430 con 0x5577cefa8d40 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f95eb7fe640 1 -- 172.21.15.60:0/2634513860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95f8004750 con 0x5577cefa8d40 2024-09-12T00:02:41.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f95eb7fe640 1 -- 172.21.15.60:0/2634513860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8030440 con 0x5577cefa8d40 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 -- 172.21.15.60:0/2634513860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cefa8d40 msgr2=0x5577cefc5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cefa8d40 0x5577cefc5110 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f95f802ae70 tx=0x7f95f802f710 comp rx=0 tx=0).stop 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 -- 172.21.15.60:0/2634513860 shutdown_connections 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cefa8d40 0x5577cefc5110 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefc4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 --2- 172.21.15.60:0/2634513860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cef9db60 0x5577cefa7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 -- 172.21.15.60:0/2634513860 >> 172.21.15.60:0/2634513860 conn(0x5577cef9a0f0 msgr2=0x5577cefa7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 -- 172.21.15.60:0/2634513860 shutdown_connections 2024-09-12T00:02:41.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.234+0000 7f960a505740 1 -- 172.21.15.60:0/2634513860 wait complete. 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 1 -- start start 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 1 Processor -- start 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefb14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefb19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cf026ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96001acc10 con 0x5577cef9db60 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96001ac480 con 0x5577cef9e480 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f96001a9540 con 0x5577cefa8d40 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f960a505740 10 client.0 _ll_register_callbacks cb 0x7f95fc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f9605ec8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefb14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f9605ec8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefb14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60182/0 (socket says 172.21.15.60:60182) 2024-09-12T00:02:41.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.235+0000 7f9605ec8640 1 -- 172.21.15.60:0/1693501259 learned_addr learned my addr 172.21.15.60:0/1693501259 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f96066c9640 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cf026ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f96056c7640 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefb19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f9605ec8640 1 -- 172.21.15.60:0/1693501259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 msgr2=0x5577cf026ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f9605ec8640 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cf026ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f9605ec8640 1 -- 172.21.15.60:0/1693501259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 msgr2=0x5577cefb19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f9605ec8640 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefb19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f9605ec8640 1 -- 172.21.15.60:0/1693501259 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577cf0270e0 con 0x5577cef9db60 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f96056c7640 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefb19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f9605ec8640 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefb14b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009570 tx=0x7f95fc0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45b6bf12aacf0fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f95e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f95e97fa640 1 -- 172.21.15.60:0/1693501259 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0097e0 con 0x5577cef9db60 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f95e97fa640 1 -- 172.21.15.60:0/1693501259 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f95fc01f040 con 0x5577cef9db60 2024-09-12T00:02:41.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f960a505740 1 -- 172.21.15.60:0/1693501259 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f8004750 con 0x5577cef9db60 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f95e97fa640 1 -- 172.21.15.60:0/1693501259 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f95fc03a050 con 0x5577cef9db60 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f960a505740 10 client.16269 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.236+0000 7f960a505740 1 -- 172.21.15.60:0/1693501259 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5577cf0282a0 con 0x5577cef9db60 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f95e97fa640 1 -- 172.21.15.60:0/1693501259 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95f8004750 con 0x5577cef9db60 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f95e97fa640 1 -- 172.21.15.60:0/1693501259 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f95fc0124c0 con 0x5577cef9db60 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f960a505740 10 client.16269 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f960a505740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f960a505740 20 client.16269 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f960a505740 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5577cefbce80 0x5577cf02a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f960a505740 4 client.16269 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f960a505740 1 -- 172.21.15.60:0/1693501259 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5577cef0ad00 con 0x5577cefbce80 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.237+0000 7f96056c7640 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5577cefbce80 0x5577cf02a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.238+0000 7f96056c7640 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5577cefbce80 0x5577cf02a970 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aca1912a94262d0 server_cookie=308d221ec1426f10 in_seq=0 out_seq=0 2024-09-12T00:02:41.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.238+0000 7f95e97fa640 10 client.16269 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:41.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.238+0000 7f95e97fa640 1 -- 172.21.15.60:0/1693501259 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5577cef0ad00 con 0x5577cefbce80 2024-09-12T00:02:41.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.238+0000 7f95e97fa640 10 client.16269 handle_command_reply: tid=0 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.238+0000 7f960a505740 1 client.16269 shutdown 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 -- 172.21.15.60:0/1693501259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 msgr2=0x5577cefb14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefb14b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009570 tx=0x7f95fc0058d0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 -- 172.21.15.60:0/1693501259 shutdown_connections 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5577cefbce80 0x5577cf02a970 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5577cefa8d40 0x5577cf026ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5577cef9e480 0x5577cefb19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 --2- 172.21.15.60:0/1693501259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577cef9db60 0x5577cefb14b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f95e97fa640 0 client.16269 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 -- 172.21.15.60:0/1693501259 >> 172.21.15.60:0/1693501259 conn(0x5577cef9a0f0 msgr2=0x5577cefa63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 -- 172.21.15.60:0/1693501259 shutdown_connections 2024-09-12T00:02:41.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 1 -- 172.21.15.60:0/1693501259 wait complete. 2024-09-12T00:02:41.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.239+0000 7f960a505740 20 client.16269 trim_cache size 0 max 16384 2024-09-12T00:02:41.243 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:02:41.243 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:02:41.243 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "a93a6fa3-5310-4292-9845-28c7a17418cf", 2024-09-12T00:02:41.243 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:02:41.243 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:02:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 -- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95ec0a2d70 msgr2=0x7f95ec0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95ec0a2d70 0x7f95ec0a5230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f95f8030040 tx=0x7f95f802a950 comp rx=0 tx=0).stop 2024-09-12T00:02:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 -- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102570 msgr2=0x7f9600198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102570 0x7f9600198a90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f95f000e9f0 tx=0x7f95f000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 -- 172.21.15.60:0/4234180711 shutdown_connections 2024-09-12T00:02:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95ec0a2d70 0x7f95ec0a5230 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9600102ef0 0x7f960019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9600102570 0x7f9600198a90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 --2- 172.21.15.60:0/4234180711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9600100e20 0x7f9600198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 -- 172.21.15.60:0/4234180711 >> 172.21.15.60:0/4234180711 conn(0x7f96000fc7d0 msgr2=0x7f960006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 -- 172.21.15.60:0/4234180711 shutdown_connections 2024-09-12T00:02:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:41.240+0000 7f960812c640 1 -- 172.21.15.60:0/4234180711 wait complete. 2024-09-12T00:02:41.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:41 smithi192 ceph-mon[35487]: pgmap v102: 97 pgs: 97 active+clean; 240 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 542 KiB/s wr, 24 op/s 2024-09-12T00:02:41.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:41 smithi105 ceph-mon[34805]: pgmap v102: 97 pgs: 97 active+clean; 240 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 542 KiB/s wr, 24 op/s 2024-09-12T00:02:41.968 INFO:tasks.workunit.client.0.smithi060.stderr:+ sync 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.285 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:02:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:02:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:02:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:02:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:02:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:02:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:42.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:02:42.963 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:43.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:43 smithi192 ceph-mon[35487]: pgmap v103: 97 pgs: 97 active+clean; 240 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 540 KiB/s wr, 18 op/s 2024-09-12T00:02:43.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:43 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:43.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:43 smithi060 ceph-mon[30953]: pgmap v103: 97 pgs: 97 active+clean; 240 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 540 KiB/s wr, 18 op/s 2024-09-12T00:02:43.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:43 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:43.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 -- 172.21.15.60:0/938079725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66341009d0 msgr2=0x7f6634100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 --2- 172.21.15.60:0/938079725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66341009d0 0x7f6634100db0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6624009ca0 tx=0x7f662402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 -- 172.21.15.60:0/938079725 shutdown_connections 2024-09-12T00:02:43.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 --2- 172.21.15.60:0/938079725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f663410e4f0 0x7f6634110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 --2- 172.21.15.60:0/938079725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6634101380 0x7f663410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 --2- 172.21.15.60:0/938079725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66341009d0 0x7f6634100db0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 -- 172.21.15.60:0/938079725 >> 172.21.15.60:0/938079725 conn(0x7f66340fc7d0 msgr2=0x7f66340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 -- 172.21.15.60:0/938079725 shutdown_connections 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 -- 172.21.15.60:0/938079725 wait complete. 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 Processor -- start 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.441+0000 7f66393de640 1 -- start start 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66393de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66341009d0 0x7f66341a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66393de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6634101380 0x7f66341a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66393de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f663410e4f0 0x7f663419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66393de640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6634114380 con 0x7f663410e4f0 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66393de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6634114200 con 0x7f66341009d0 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66393de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6634114500 con 0x7f6634101380 2024-09-12T00:02:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f663410e4f0 0x7f663419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f663410e4f0 0x7f663419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35234/0 (socket says 172.21.15.60:35234) 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 -- 172.21.15.60:0/209697154 learned_addr learned my addr 172.21.15.60:0/209697154 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f6632ffd640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66341009d0 0x7f66341a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66327fc640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6634101380 0x7f66341a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 -- 172.21.15.60:0/209697154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6634101380 msgr2=0x7f66341a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6634101380 0x7f66341a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 -- 172.21.15.60:0/209697154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66341009d0 msgr2=0x7f66341a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66341009d0 0x7f66341a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 -- 172.21.15.60:0/209697154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663419aea0 con 0x7f663410e4f0 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f66337fe640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f663410e4f0 0x7f663419a630 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f662c00d720 tx=0x7f662c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.442+0000 7f661bfff640 1 -- 172.21.15.60:0/209697154 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c017070 con 0x7f663410e4f0 2024-09-12T00:02:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.443+0000 7f66393de640 1 -- 172.21.15.60:0/209697154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663419b190 con 0x7f663410e4f0 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.443+0000 7f661bfff640 1 -- 172.21.15.60:0/209697154 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f662c00de30 con 0x7f663410e4f0 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.443+0000 7f66393de640 1 -- 172.21.15.60:0/209697154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66341a74e0 con 0x7f663410e4f0 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.443+0000 7f661bfff640 1 -- 172.21.15.60:0/209697154 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662c020060 con 0x7f663410e4f0 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.445+0000 7f661bfff640 1 -- 172.21.15.60:0/209697154 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f662c005020 con 0x7f663410e4f0 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.445+0000 7f663b7b7740 1 Processor -- start 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.445+0000 7f663b7b7740 1 -- start start 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.445+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 0x55a0bbf93880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f663b7b7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a0bbef92e0 con 0x55a0bbf93dc0 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f663b7b7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a0bbea0ce0 con 0x55a0bbf9e680 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f663b7b7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a0bbef52a0 con 0x55a0bbf934a0 2024-09-12T00:02:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f6632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f661bfff640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f661c0a2cf0 0x7f661c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f6632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35244/0 (socket says 172.21.15.60:35244) 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f6632ffd640 1 -- 172.21.15.60:0/779146061 learned_addr learned my addr 172.21.15.60:0/779146061 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f66327fc640 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f66327fc640 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 0x55a0bbf93880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f66337fe640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f661c0a2cf0 0x7f661c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f661bfff640 1 -- 172.21.15.60:0/209697154 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f662c0ced20 con 0x7f663410e4f0 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f6632ffd640 1 -- 172.21.15.60:0/779146061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 msgr2=0x55a0bbf93880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f6632ffd640 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 0x55a0bbf93880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f6632ffd640 1 -- 172.21.15.60:0/779146061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 msgr2=0x55a0bbfa0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f6632ffd640 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f6632ffd640 1 -- 172.21.15.60:0/779146061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0bbe85440 con 0x55a0bbf93dc0 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f66327fc640 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.446+0000 7f66337fe640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f661c0a2cf0 0x7f661c0a51b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f662c009610 tx=0x7f662c094040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.447+0000 7f6632ffd640 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9e140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6624035000 tx=0x7f6624009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5414d6a0fb8f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.447+0000 7f66197fa640 1 -- 172.21.15.60:0/779146061 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624049070 con 0x55a0bbf93dc0 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.447+0000 7f66197fa640 1 -- 172.21.15.60:0/779146061 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6624036040 con 0x55a0bbf93dc0 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.447+0000 7f66197fa640 1 -- 172.21.15.60:0/779146061 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662402fb10 con 0x55a0bbf93dc0 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 -- 172.21.15.60:0/779146061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 msgr2=0x55a0bbf9e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9e140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6624035000 tx=0x7f6624009800 comp rx=0 tx=0).stop 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 -- 172.21.15.60:0/779146061 shutdown_connections 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9e140 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 --2- 172.21.15.60:0/779146061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 0x55a0bbf93880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 -- 172.21.15.60:0/779146061 >> 172.21.15.60:0/779146061 conn(0x55a0bbf8fa30 msgr2=0x55a0bbf8fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 -- 172.21.15.60:0/779146061 shutdown_connections 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 -- 172.21.15.60:0/779146061 wait complete. 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 -- start start 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.448+0000 7f663b7b7740 1 Processor -- start 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 0x55a0bbf9df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 0x55a0bbf9b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f663b7b7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a0bbfa10d0 con 0x55a0bbf93dc0 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f663b7b7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a0bbeb4050 con 0x55a0bbf934a0 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f663b7b7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a0bbfa1250 con 0x55a0bbf9e680 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f663b7b7740 10 client.0 _ll_register_callbacks cb 0x55a0bbef4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35256/0 (socket says 172.21.15.60:35256) 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 -- 172.21.15.60:0/1986989486 learned_addr learned my addr 172.21.15.60:0/1986989486 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 -- 172.21.15.60:0/1986989486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 msgr2=0x55a0bbf9b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 0x55a0bbf9b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 -- 172.21.15.60:0/1986989486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 msgr2=0x55a0bbf9df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 0x55a0bbf9df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 -- 172.21.15.60:0/1986989486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0bbc6a3c0 con 0x55a0bbf93dc0 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6632ffd640 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9b210 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6624047040 tx=0x7f6624031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492be0769a8c95d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.449+0000 7f6616ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f6616ff5640 1 -- 172.21.15.60:0/1986989486 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624054060 con 0x55a0bbf93dc0 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f6616ff5640 1 -- 172.21.15.60:0/1986989486 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f662402f850 con 0x55a0bbf93dc0 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 1 -- 172.21.15.60:0/1986989486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6624036040 con 0x55a0bbf93dc0 2024-09-12T00:02:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f6616ff5640 1 -- 172.21.15.60:0/1986989486 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6624049070 con 0x55a0bbf93dc0 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 10 client.16281 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 1 -- 172.21.15.60:0/1986989486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a0bbfa10d0 con 0x55a0bbf93dc0 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f6616ff5640 1 -- 172.21.15.60:0/1986989486 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6624036040 con 0x55a0bbf93dc0 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f6616ff5640 1 -- 172.21.15.60:0/1986989486 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f6624030b50 con 0x55a0bbf93dc0 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 10 client.16281 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 20 client.16281 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a0bbfadbf0 0x55a0bbfb0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 4 client.16281 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.450+0000 7f663b7b7740 1 -- 172.21.15.60:0/1986989486 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0bbf06850 con 0x55a0bbfadbf0 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.451+0000 7f66327fc640 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a0bbfadbf0 0x55a0bbfb0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.451+0000 7f6616ff5640 10 client.16281 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.451+0000 7f66327fc640 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a0bbfadbf0 0x55a0bbfb0000 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954e24ba256578c server_cookie=2d0e0a02352e9c17 in_seq=0 out_seq=0 2024-09-12T00:02:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f6616ff5640 1 -- 172.21.15.60:0/1986989486 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0bbf06850 con 0x55a0bbfadbf0 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f6616ff5640 10 client.16281 handle_command_reply: tid=0 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 client.16281 shutdown 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 -- 172.21.15.60:0/1986989486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 msgr2=0x55a0bbf9b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9b210 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6624047040 tx=0x7f6624031a40 comp rx=0 tx=0).stop 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 -- 172.21.15.60:0/1986989486 shutdown_connections 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a0bbfadbf0 0x55a0bbfb0000 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 0x55a0bbf9b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbf9b210 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1986989486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 0x55a0bbf9df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f6616ff5640 0 client.16281 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 -- 172.21.15.60:0/1986989486 >> 172.21.15.60:0/1986989486 conn(0x55a0bbf8fa30 msgr2=0x55a0bbf95710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 -- 172.21.15.60:0/1986989486 shutdown_connections 2024-09-12T00:02:43.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 1 -- 172.21.15.60:0/1986989486 wait complete. 2024-09-12T00:02:43.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.452+0000 7f663b7b7740 20 client.16281 trim_cache size 0 max 16384 2024-09-12T00:02:43.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.470+0000 7f663b7b7740 1 Processor -- start 2024-09-12T00:02:43.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.470+0000 7f663b7b7740 1 -- start start 2024-09-12T00:02:43.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.470+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 0x55a0bbfb5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.470+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfb5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.470+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 0x55a0bbf98470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.470+0000 7f663b7b7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66341afad0 con 0x55a0bbf93dc0 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.470+0000 7f663b7b7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66341b1910 con 0x55a0bbf934a0 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.470+0000 7f663b7b7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66341b0260 con 0x55a0bbf9e680 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfb5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfb5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35260/0 (socket says 172.21.15.60:35260) 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 -- 172.21.15.60:0/2204698345 learned_addr learned my addr 172.21.15.60:0/2204698345 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f66327fc640 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 0x55a0bbfb5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f66327fc640 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 0x55a0bbf98470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 -- 172.21.15.60:0/2204698345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 msgr2=0x55a0bbf98470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 0x55a0bbf98470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 -- 172.21.15.60:0/2204698345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 msgr2=0x55a0bbfb5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 0x55a0bbfb5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 -- 172.21.15.60:0/2204698345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0bbf93220 con 0x55a0bbf93dc0 2024-09-12T00:02:43.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6632ffd640 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfb5e60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6624005e30 tx=0x7f662402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa4311d0a9961ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6618ff9640 1 -- 172.21.15.60:0/2204698345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624054070 con 0x55a0bbf93dc0 2024-09-12T00:02:43.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6618ff9640 1 -- 172.21.15.60:0/2204698345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6624036040 con 0x55a0bbf93dc0 2024-09-12T00:02:43.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.471+0000 7f6618ff9640 1 -- 172.21.15.60:0/2204698345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624030c00 con 0x55a0bbf93dc0 2024-09-12T00:02:43.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 -- 172.21.15.60:0/2204698345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 msgr2=0x55a0bbfb5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfb5e60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6624005e30 tx=0x7f662402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 -- 172.21.15.60:0/2204698345 shutdown_connections 2024-09-12T00:02:43.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf9e680 0x55a0bbf98470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfb5e60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 --2- 172.21.15.60:0/2204698345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf934a0 0x55a0bbfb5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 -- 172.21.15.60:0/2204698345 >> 172.21.15.60:0/2204698345 conn(0x55a0bbf8fa30 msgr2=0x55a0bbf9d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 -- 172.21.15.60:0/2204698345 shutdown_connections 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 -- 172.21.15.60:0/2204698345 wait complete. 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 -- start start 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.472+0000 7f663b7b7740 1 Processor -- start 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 0x55a0bbfa4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfa49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f663b7b7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f663b7b7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66341b1180 con 0x55a0bbf93dc0 2024-09-12T00:02:43.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f663b7b7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66341b09f0 con 0x55a0bbf9e680 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f663b7b7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66341adab0 con 0x55a0bbf934a0 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f663b7b7740 10 client.0 _ll_register_callbacks cb 0x7f6624047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfa49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f66327fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfa49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35270/0 (socket says 172.21.15.60:35270) 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 -- 172.21.15.60:0/1633222100 learned_addr learned my addr 172.21.15.60:0/1633222100 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f66327fc640 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 0x55a0bbfa4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 -- 172.21.15.60:0/1633222100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 msgr2=0x55a0bbfa4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 0x55a0bbfa4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 -- 172.21.15.60:0/1633222100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 msgr2=0x55a0bbfa4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 -- 172.21.15.60:0/1633222100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0bc017b50 con 0x55a0bbf93dc0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6632ffd640 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfa49b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6624009a60 tx=0x7f6624005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f69893595b9b414 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6616ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.473+0000 7f6616ff5640 1 -- 172.21.15.60:0/1633222100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662403f020 con 0x55a0bbf93dc0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f6616ff5640 1 -- 172.21.15.60:0/1633222100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6624003970 con 0x55a0bbf93dc0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 1 -- 172.21.15.60:0/1633222100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6624036040 con 0x55a0bbf93dc0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f6616ff5640 1 -- 172.21.15.60:0/1633222100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6624054040 con 0x55a0bbf93dc0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 10 client.16287 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 1 -- 172.21.15.60:0/1633222100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a0bc018e20 con 0x55a0bbf93dc0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f6616ff5640 1 -- 172.21.15.60:0/1633222100 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6624036040 con 0x55a0bbf93dc0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f6616ff5640 1 -- 172.21.15.60:0/1633222100 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f662402f720 con 0x55a0bbf93dc0 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 10 client.16287 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:02:43.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 20 client.16287 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a0bc019390 0x55a0bc01b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 4 client.16287 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.474+0000 7f663b7b7740 1 -- 172.21.15.60:0/1633222100 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0bbf00d60 con 0x55a0bc019390 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f66327fc640 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a0bc019390 0x55a0bc01b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f66327fc640 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a0bc019390 0x55a0bc01b7b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6efab6e4601185a2 server_cookie=c9d0aef09fdb0285 in_seq=0 out_seq=0 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f6616ff5640 10 client.16287 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f6616ff5640 1 -- 172.21.15.60:0/1633222100 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a0bbf00d60 con 0x55a0bc019390 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f6616ff5640 10 client.16287 handle_command_reply: tid=0 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 client.16287 shutdown 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 -- 172.21.15.60:0/1633222100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 msgr2=0x55a0bbfa49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfa49b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6624009a60 tx=0x7f6624005be0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 -- 172.21.15.60:0/1633222100 shutdown_connections 2024-09-12T00:02:43.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a0bc019390 0x55a0bc01b7b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f6616ff5640 0 client.16287 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a0bbf9e680 0x55a0bbfa4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a0bbf93dc0 0x55a0bbfa49b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 --2- 172.21.15.60:0/1633222100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a0bbf934a0 0x55a0bbfa4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 -- 172.21.15.60:0/1633222100 >> 172.21.15.60:0/1633222100 conn(0x55a0bbf8fa30 msgr2=0x55a0bbf8e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 -- 172.21.15.60:0/1633222100 shutdown_connections 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.475+0000 7f663b7b7740 1 -- 172.21.15.60:0/1633222100 wait complete. 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f663b7b7740 20 client.16287 trim_cache size 0 max 16384 2024-09-12T00:02:43.480 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "a93a6fa3-5310-4292-9845-28c7a17418cf": { 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "a93a6fa3-5310-4292-9845-28c7a17418cf", 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:02:43.481 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:02:43.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 -- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f661c0a2cf0 msgr2=0x7f661c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f661c0a2cf0 0x7f661c0a51b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f662c009610 tx=0x7f662c094040 comp rx=0 tx=0).stop 2024-09-12T00:02:43.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 -- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f663410e4f0 msgr2=0x7f663419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:43.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f663410e4f0 0x7f663419a630 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f662c00d720 tx=0x7f662c00dbe0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 -- 172.21.15.60:0/209697154 shutdown_connections 2024-09-12T00:02:43.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f661c0a2cf0 0x7f661c0a51b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f663410e4f0 0x7f663419a630 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6634101380 0x7f66341a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 --2- 172.21.15.60:0/209697154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66341009d0 0x7f66341a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:43.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 -- 172.21.15.60:0/209697154 >> 172.21.15.60:0/209697154 conn(0x7f66340fc7d0 msgr2=0x7f66340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:43.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.476+0000 7f66393de640 1 -- 172.21.15.60:0/209697154 shutdown_connections 2024-09-12T00:02:43.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:43.477+0000 7f66393de640 1 -- 172.21.15.60:0/209697154 wait complete. 2024-09-12T00:02:43.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:43 smithi105 ceph-mon[34805]: pgmap v103: 97 pgs: 97 active+clean; 240 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 540 KiB/s wr, 18 op/s 2024-09-12T00:02:43.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:43 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:02:43.697 INFO:tasks.workunit.client.0.smithi060.stderr:+ tar c linux-4.0.5 2024-09-12T00:02:44.065 INFO:tasks.workunit.client.0.smithi060.stdout:Ok 2024-09-12T00:02:44.066 INFO:tasks.workunit.client.0.smithi060.stderr:+ echo Ok 2024-09-12T00:02:44.067 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:02:44.067 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:02:44.465 INFO:tasks.cephfs.filesystem:scrub status for tag:a93a6fa3-5310-4292-9845-28c7a17418cf - {'path': '/', 'tag': 'a93a6fa3-5310-4292-9845-28c7a17418cf', 'options': 'recursive,force'} 2024-09-12T00:02:45.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:45 smithi192 ceph-mon[35487]: pgmap v104: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 295 op/s 2024-09-12T00:02:45.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:45 smithi060 ceph-mon[30953]: pgmap v104: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 295 op/s 2024-09-12T00:02:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:45 smithi105 ceph-mon[34805]: pgmap v104: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 295 op/s 2024-09-12T00:02:47.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:47 smithi192 ceph-mon[35487]: pgmap v105: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-09-12T00:02:47.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:47 smithi060 ceph-mon[30953]: pgmap v105: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-09-12T00:02:47.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:47 smithi105 ceph-mon[34805]: pgmap v105: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-09-12T00:02:49.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:49 smithi060 ceph-mon[30953]: pgmap v106: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-09-12T00:02:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:49 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:49.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:49 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:49 smithi105 ceph-mon[34805]: pgmap v106: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-09-12T00:02:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:49 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:49 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:49.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:49 smithi192 ceph-mon[35487]: pgmap v106: 97 pgs: 97 active+clean; 261 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 291 op/s 2024-09-12T00:02:49.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:49 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:49.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:49 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:50.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:50 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:50.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:50 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:50.342 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:50 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:02:50.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:50 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:50.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:50 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:50.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:50 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:02:50.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:50 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:50.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:50 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:50.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:50 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:02:51.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:51 smithi060 ceph-mon[30953]: pgmap v107: 97 pgs: 97 active+clean; 278 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 446 op/s 2024-09-12T00:02:51.435 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:51 smithi192 ceph-mon[35487]: pgmap v107: 97 pgs: 97 active+clean; 278 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 446 op/s 2024-09-12T00:02:51.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:51 smithi105 ceph-mon[34805]: pgmap v107: 97 pgs: 97 active+clean; 278 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 446 op/s 2024-09-12T00:02:53.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:53 smithi060 ceph-mon[30953]: pgmap v108: 97 pgs: 97 active+clean; 278 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 431 op/s 2024-09-12T00:02:53.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:53 smithi105 ceph-mon[34805]: pgmap v108: 97 pgs: 97 active+clean; 278 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 431 op/s 2024-09-12T00:02:53.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:53 smithi192 ceph-mon[35487]: pgmap v108: 97 pgs: 97 active+clean; 278 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 431 op/s 2024-09-12T00:02:55.027 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-12T00:02:55.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:02:55.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:55 smithi060 ceph-mon[30953]: pgmap v109: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 594 op/s 2024-09-12T00:02:55.348 DEBUG:teuthology.parallel:result is None 2024-09-12T00:02:55.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:02:55.385 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:02:55.385 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T00:02:55.445 INFO:tasks.quiescer:joining Quiescers 2024-09-12T00:02:55.445 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T00:02:55.446 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:02:55.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:55 smithi105 ceph-mon[34805]: pgmap v109: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 594 op/s 2024-09-12T00:02:55.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:55 smithi192 ceph-mon[35487]: pgmap v109: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 594 op/s 2024-09-12T00:02:55.716 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:56.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 -- 172.21.15.60:0/2392530442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88101b40 msgr2=0x7fde8810da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2392530442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88101b40 0x7fde8810da00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fde80009ca0 tx=0x7fde8002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 -- 172.21.15.60:0/2392530442 shutdown_connections 2024-09-12T00:02:56.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2392530442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88101b40 0x7fde8810da00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2392530442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde881011a0 0x7fde88101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2392530442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde88106c30 0x7fde88107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 -- 172.21.15.60:0/2392530442 >> 172.21.15.60:0/2392530442 conn(0x7fde88077210 msgr2=0x7fde880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 -- 172.21.15.60:0/2392530442 shutdown_connections 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.207+0000 7fde8e86c640 1 -- 172.21.15.60:0/2392530442 wait complete. 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8e86c640 1 Processor -- start 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8e86c640 1 -- start start 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8e86c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde881011a0 0x7fde88198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8e86c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde88101b40 0x7fde88198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8e86c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88106c30 0x7fde8819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8e86c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fde88112200 con 0x7fde88106c30 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8e86c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde88112080 con 0x7fde881011a0 2024-09-12T00:02:56.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8e86c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fde88112380 con 0x7fde88101b40 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8ce09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88106c30 0x7fde8819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8ce09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88106c30 0x7fde8819cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59654/0 (socket says 172.21.15.60:59654) 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde8ce09640 1 -- 172.21.15.60:0/2003134181 learned_addr learned my addr 172.21.15.60:0/2003134181 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.208+0000 7fde877fe640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde88101b40 0x7fde88198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde87fff640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde881011a0 0x7fde88198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde8ce09640 1 -- 172.21.15.60:0/2003134181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde88101b40 msgr2=0x7fde88198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde8ce09640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde88101b40 0x7fde88198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde8ce09640 1 -- 172.21.15.60:0/2003134181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde881011a0 msgr2=0x7fde88198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde8ce09640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde881011a0 0x7fde88198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde8ce09640 1 -- 172.21.15.60:0/2003134181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8819d5d0 con 0x7fde88106c30 2024-09-12T00:02:56.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde8ce09640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88106c30 0x7fde8819cef0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fde80006010 tx=0x7fde800319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde857fa640 1 -- 172.21.15.60:0/2003134181 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8002fa20 con 0x7fde88106c30 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde857fa640 1 -- 172.21.15.60:0/2003134181 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde8002fbc0 con 0x7fde88106c30 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde857fa640 1 -- 172.21.15.60:0/2003134181 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80046860 con 0x7fde88106c30 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8819d860 con 0x7fde88106c30 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.209+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881a51a0 con 0x7fde88106c30 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.210+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde88101600 con 0x7fde88106c30 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.211+0000 7fde857fa640 1 -- 172.21.15.60:0/2003134181 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fde80046a00 con 0x7fde88106c30 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.212+0000 7fde857fa640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde700a2cf0 0x7fde700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.212+0000 7fde87fff640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde700a2cf0 0x7fde700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.212+0000 7fde857fa640 1 -- 172.21.15.60:0/2003134181 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fde800f0880 con 0x7fde88106c30 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.212+0000 7fde87fff640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde700a2cf0 0x7fde700a51b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde78009890 tx=0x7fde78008040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:56.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.216+0000 7fde857fa640 1 -- 172.21.15.60:0/2003134181 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde800bd630 con 0x7fde88106c30 2024-09-12T00:02:56.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.429+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde881a5370 con 0x7fde88106c30 2024-09-12T00:02:56.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.430+0000 7fde857fa640 1 -- 172.21.15.60:0/2003134181 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12009 (secure 0 0 0) 0x7fde800bcf30 con 0x7fde88106c30 2024-09-12T00:02:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:02:56.430 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"btime":"2024-09-12T00:02:06:958968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:02:06.347465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:02:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 39 2024-09-12T00:02:56.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde700a2cf0 msgr2=0x7fde700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde700a2cf0 0x7fde700a51b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde78009890 tx=0x7fde78008040 comp rx=0 tx=0).stop 2024-09-12T00:02:56.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88106c30 msgr2=0x7fde8819cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:56.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88106c30 0x7fde8819cef0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fde80006010 tx=0x7fde800319f0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 shutdown_connections 2024-09-12T00:02:56.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde700a2cf0 0x7fde700a51b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde88106c30 0x7fde8819cef0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde88101b40 0x7fde88198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 --2- 172.21.15.60:0/2003134181 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde881011a0 0x7fde88198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 >> 172.21.15.60:0/2003134181 conn(0x7fde88077210 msgr2=0x7fde880fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 shutdown_connections 2024-09-12T00:02:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:56.433+0000 7fde8e86c640 1 -- 172.21.15.60:0/2003134181 wait complete. 2024-09-12T00:02:57.219 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:57 smithi060 ceph-mon[30953]: pgmap v110: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-09-12T00:02:57.219 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:57 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2003134181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:57.253 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24496 quiesce db --cancel --all' 2024-09-12T00:02:57.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24496 quiesce db --cancel --all 2024-09-12T00:02:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:57 smithi105 ceph-mon[34805]: pgmap v110: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-09-12T00:02:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:57 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2003134181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:57.516 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:02:57.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:57 smithi192 ceph-mon[35487]: pgmap v110: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-09-12T00:02:57.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:57 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2003134181' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:02:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 -- 172.21.15.60:0/1215110274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34106f10 msgr2=0x7f7f3410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/1215110274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34106f10 0x7f7f3410ea90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009ca0 tx=0x7f7f2402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 -- 172.21.15.60:0/1215110274 shutdown_connections 2024-09-12T00:02:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/1215110274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34106f10 0x7f7f3410ea90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/1215110274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f34102790 0x7f7f341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/1215110274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f34101de0 0x7f7f341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 -- 172.21.15.60:0/1215110274 >> 172.21.15.60:0/1215110274 conn(0x7f7f340fd8c0 msgr2=0x7f7f340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 -- 172.21.15.60:0/1215110274 shutdown_connections 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.529+0000 7f7f3b89f640 1 -- 172.21.15.60:0/1215110274 wait complete. 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3b89f640 1 Processor -- start 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3b89f640 1 -- start start 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3b89f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34101de0 0x7f7f341983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3b89f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f34102790 0x7f7f34198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3b89f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f34106f10 0x7f7f3419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3b89f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34112090 con 0x7f7f34101de0 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3b89f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34111f10 con 0x7f7f34102790 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3b89f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34112210 con 0x7f7f34106f10 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.530+0000 7f7f3963b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34101de0 0x7f7f341983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3963b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34101de0 0x7f7f341983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59668/0 (socket says 172.21.15.60:59668) 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3963b640 1 -- 172.21.15.60:0/569933394 learned_addr learned my addr 172.21.15.60:0/569933394 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f34102790 0x7f7f34198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f34106f10 0x7f7f3419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3963b640 1 -- 172.21.15.60:0/569933394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f34106f10 msgr2=0x7f7f3419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3963b640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f34106f10 0x7f7f3419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3963b640 1 -- 172.21.15.60:0/569933394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f34102790 msgr2=0x7f7f34198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3963b640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f34102790 0x7f7f34198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3963b640 1 -- 172.21.15.60:0/569933394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3419d380 con 0x7f7f34101de0 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f34106f10 0x7f7f3419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3963b640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34101de0 0x7f7f341983d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00c920 tx=0x7f7f2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f327fc640 1 -- 172.21.15.60:0/569933394 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c007c70 con 0x7f7f34101de0 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3b89f640 1 -- 172.21.15.60:0/569933394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3419d670 con 0x7f7f34101de0 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f327fc640 1 -- 172.21.15.60:0/569933394 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f2c007e10 con 0x7f7f34101de0 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f327fc640 1 -- 172.21.15.60:0/569933394 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c018940 con 0x7f7f34101de0 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.531+0000 7f7f3b89f640 1 -- 172.21.15.60:0/569933394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f341a4f50 con 0x7f7f34101de0 2024-09-12T00:02:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f327fc640 1 -- 172.21.15.60:0/569933394 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7f2c018b20 con 0x7f7f34101de0 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f3dc78740 1 Processor -- start 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f3dc78740 1 -- start start 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab08d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab17ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab1a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d24aa6d200 con 0x55d24ab09240 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d24aa13dc0 con 0x55d24ab08920 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.534+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d24aa691c0 con 0x55d24ab17ff0 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab17ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab17ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59682/0 (socket says 172.21.15.60:59682) 2024-09-12T00:02:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 -- 172.21.15.60:0/337425516 learned_addr learned my addr 172.21.15.60:0/337425516 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab08d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab1a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 -- 172.21.15.60:0/337425516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 msgr2=0x55d24ab1a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab1a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 -- 172.21.15.60:0/337425516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 msgr2=0x55d24ab08d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab08d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 -- 172.21.15.60:0/337425516 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24a7de620 con 0x55d24ab09240 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab1a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab08d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f327fc640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f1c0a2cf0 0x7f7f1c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f3963b640 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab17ab0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0ccc50 tx=0x7f7f2c0d57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47b8dc12544273b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.535+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f1c0a2cf0 0x7f7f1c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.536+0000 7f7f327fc640 1 -- 172.21.15.60:0/569933394 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7f2c0cf540 con 0x7f7f34101de0 2024-09-12T00:02:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.536+0000 7f7f1b7fe640 1 -- 172.21.15.60:0/337425516 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c097d50 con 0x55d24ab09240 2024-09-12T00:02:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.536+0000 7f7f1b7fe640 1 -- 172.21.15.60:0/337425516 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f2c09c1b0 con 0x55d24ab09240 2024-09-12T00:02:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.536+0000 7f7f1b7fe640 1 -- 172.21.15.60:0/337425516 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c09b410 con 0x55d24ab09240 2024-09-12T00:02:58.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.536+0000 7f7f3dc78740 1 -- 172.21.15.60:0/337425516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 msgr2=0x55d24ab17ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.536+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f1c0a2cf0 0x7f7f1c0a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7f24005cc0 tx=0x7f7f24005c30 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:58.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.536+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab17ab0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0ccc50 tx=0x7f7f2c0d57e0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 -- 172.21.15.60:0/337425516 shutdown_connections 2024-09-12T00:02:58.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab1a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab17ab0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/337425516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab08d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 -- 172.21.15.60:0/337425516 >> 172.21.15.60:0/337425516 conn(0x55d24ab04f90 msgr2=0x55d24ab05370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 -- 172.21.15.60:0/337425516 shutdown_connections 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 -- 172.21.15.60:0/337425516 wait complete. 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 -- start start 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.537+0000 7f7f3dc78740 1 Processor -- start 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab08920 0x55d24ab179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab09240 0x55d24ab14c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab15250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d24ab1ab60 con 0x55d24ab08920 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d24aa07c50 con 0x55d24ab09240 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d24ab1ace0 con 0x55d24ab17ff0 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3dc78740 10 client.0 _ll_register_callbacks cb 0x55d24aa19ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:58.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab08920 0x55d24ab179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab08920 0x55d24ab179d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59684/0 (socket says 172.21.15.60:59684) 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 -- 172.21.15.60:0/2481483573 learned_addr learned my addr 172.21.15.60:0/2481483573 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab15250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab09240 0x55d24ab14c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 -- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 msgr2=0x55d24ab15250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab15250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 -- 172.21.15.60:0/2481483573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab09240 msgr2=0x55d24ab14c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab09240 0x55d24ab14c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 -- 172.21.15.60:0/2481483573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d24ab15a80 con 0x55d24ab08920 2024-09-12T00:02:58.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab15250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab09240 0x55d24ab14c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3963b640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab08920 0x55d24ab179d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c097f10 tx=0x7f7f2c09fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06bc6a785d1d4a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f18ff9640 1 -- 172.21.15.60:0/2481483573 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0d2e60 con 0x55d24ab08920 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f18ff9640 1 -- 172.21.15.60:0/2481483573 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7f2c00fbe0 con 0x55d24ab08920 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.538+0000 7f7f3dc78740 1 -- 172.21.15.60:0/2481483573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f2c09c1b0 con 0x55d24ab08920 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f18ff9640 1 -- 172.21.15.60:0/2481483573 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7f2c0b8020 con 0x55d24ab08920 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f3dc78740 10 client.16305 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f3dc78740 1 -- 172.21.15.60:0/2481483573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d24ab1ab60 con 0x55d24ab08920 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f18ff9640 1 -- 172.21.15.60:0/2481483573 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f2c09c1b0 con 0x55d24ab08920 2024-09-12T00:02:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f18ff9640 1 -- 172.21.15.60:0/2481483573 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f7f2c0ba2c0 con 0x55d24ab08920 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f3dc78740 10 client.16305 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f3dc78740 10 client.16305 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f3dc78740 20 client.16305 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d24ab27940 0x55d24ab29d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f3dc78740 4 client.16305 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f3dc78740 1 -- 172.21.15.60:0/2481483573 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d24aa7a770 con 0x55d24ab27940 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.539+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d24ab27940 0x55d24ab29d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.540+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d24ab27940 0x55d24ab29d30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=305a69d43e4ac82d server_cookie=478d175461ba0a45 in_seq=0 out_seq=0 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.540+0000 7f7f18ff9640 10 client.16305 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f18ff9640 1 -- 172.21.15.60:0/2481483573 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d24aa7a770 con 0x55d24ab27940 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f18ff9640 10 client.16305 handle_command_reply: tid=0 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 client.16305 shutdown 2024-09-12T00:02:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 -- 172.21.15.60:0/2481483573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab08920 msgr2=0x55d24ab179d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab08920 0x55d24ab179d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c097f10 tx=0x7f7f2c09fe60 comp rx=0 tx=0).stop 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 -- 172.21.15.60:0/2481483573 shutdown_connections 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d24ab27940 0x55d24ab29d30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab17ff0 0x55d24ab15250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab09240 0x55d24ab14c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/2481483573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab08920 0x55d24ab179d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 -- 172.21.15.60:0/2481483573 >> 172.21.15.60:0/2481483573 conn(0x55d24ab04f90 msgr2=0x55d24ab041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f18ff9640 0 client.16305 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 -- 172.21.15.60:0/2481483573 shutdown_connections 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 1 -- 172.21.15.60:0/2481483573 wait complete. 2024-09-12T00:02:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.541+0000 7f7f3dc78740 20 client.16305 trim_cache size 0 max 16384 2024-09-12T00:02:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.558+0000 7f7f3dc78740 1 Processor -- start 2024-09-12T00:02:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.558+0000 7f7f3dc78740 1 -- start start 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.558+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab04f90 0x55d24ab174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.558+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab2f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.558+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab2f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.558+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341ab5e0 con 0x55d24ab09240 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.558+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341ad420 con 0x55d24ab08920 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.558+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341abd70 con 0x55d24ab04f90 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab2f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab2f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59692/0 (socket says 172.21.15.60:59692) 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 -- 172.21.15.60:0/782258335 learned_addr learned my addr 172.21.15.60:0/782258335 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f3963b640 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab04f90 0x55d24ab174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab2f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 -- 172.21.15.60:0/782258335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab04f90 msgr2=0x55d24ab174f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab04f90 0x55d24ab174f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 -- 172.21.15.60:0/782258335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 msgr2=0x55d24ab2f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab2f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 -- 172.21.15.60:0/782258335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d24ab131d0 con 0x55d24ab09240 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f3963b640 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab04f90 0x55d24ab174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab2f920 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7f24005f30 tx=0x7f7f24040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f5f92feda1c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f1affd640 1 -- 172.21.15.60:0/782258335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24003e00 con 0x55d24ab09240 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f1affd640 1 -- 172.21.15.60:0/782258335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f24036040 con 0x55d24ab09240 2024-09-12T00:02:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.559+0000 7f7f1affd640 1 -- 172.21.15.60:0/782258335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2402fd10 con 0x55d24ab09240 2024-09-12T00:02:58.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 -- 172.21.15.60:0/782258335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 msgr2=0x55d24ab2f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab2f920 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7f24005f30 tx=0x7f7f24040000 comp rx=0 tx=0).stop 2024-09-12T00:02:58.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 -- 172.21.15.60:0/782258335 shutdown_connections 2024-09-12T00:02:58.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab09240 0x55d24ab2f920 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab2f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/782258335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab04f90 0x55d24ab174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 -- 172.21.15.60:0/782258335 >> 172.21.15.60:0/782258335 conn(0x55d24ab14c20 msgr2=0x55d24ab13550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 -- 172.21.15.60:0/782258335 shutdown_connections 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 -- 172.21.15.60:0/782258335 wait complete. 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.560+0000 7f7f3dc78740 1 -- start start 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3dc78740 1 Processor -- start 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab04f90 0x55d24ab206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab1b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3dc78740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab09240 0x55d24ab1bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341acc90 con 0x55d24ab04f90 2024-09-12T00:02:58.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341ac500 con 0x55d24ab08920 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3dc78740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341a95e0 con 0x55d24ab09240 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3dc78740 10 client.0 _ll_register_callbacks cb 0x7f7f2c0076c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3963b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab04f90 0x55d24ab206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3963b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab04f90 0x55d24ab206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59694/0 (socket says 172.21.15.60:59694) 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f3963b640 1 -- 172.21.15.60:0/1602483642 learned_addr learned my addr 172.21.15.60:0/1602483642 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f39e3c640 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab09240 0x55d24ab1bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.561+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab1b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3963b640 1 -- 172.21.15.60:0/1602483642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab09240 msgr2=0x55d24ab1bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3963b640 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab09240 0x55d24ab1bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3963b640 1 -- 172.21.15.60:0/1602483642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 msgr2=0x55d24ab1b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3963b640 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab1b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3963b640 1 -- 172.21.15.60:0/1602483642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d24ab1c710 con 0x55d24ab04f90 2024-09-12T00:02:58.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3963b640 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab04f90 0x55d24ab206c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0cd2e0 tx=0x7f7f2c018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8866ba9fff6ddca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f18ff9640 1 -- 172.21.15.60:0/1602483642 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0d2e60 con 0x55d24ab04f90 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f18ff9640 1 -- 172.21.15.60:0/1602483642 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7f2c0cf0d0 con 0x55d24ab04f90 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3dc78740 1 -- 172.21.15.60:0/1602483642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f24036040 con 0x55d24ab04f90 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f18ff9640 1 -- 172.21.15.60:0/1602483642 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7f2c09b5f0 con 0x55d24ab04f90 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3dc78740 10 client.16311 fetch_fsmap learned FSMap version 39 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3dc78740 1 -- 172.21.15.60:0/1602483642 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d24ab923e0 con 0x55d24ab04f90 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f18ff9640 1 -- 172.21.15.60:0/1602483642 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f24036040 con 0x55d24ab04f90 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f18ff9640 1 -- 172.21.15.60:0/1602483642 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f7f2c09af00 con 0x55d24ab04f90 2024-09-12T00:02:58.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.562+0000 7f7f3dc78740 10 client.16311 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.563+0000 7f7f3dc78740 10 client.16311 resolve_mds: validated gid 24496 aka daemon mds.i 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.563+0000 7f7f3dc78740 20 client.16311 populate_metadata read hostname 'smithi060' 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.563+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d24ab17ff0 0x55d24ab94980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.563+0000 7f7f3dc78740 4 client.16311 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.563+0000 7f7f3dc78740 1 -- 172.21.15.60:0/1602483642 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55d24ab108a0 con 0x55d24ab17ff0 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.563+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d24ab17ff0 0x55d24ab94980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.563+0000 7f7f18ff9640 10 client.16311 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.563+0000 7f7f38e3a640 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d24ab17ff0 0x55d24ab94980 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=678b037890f75cc9 server_cookie=5e091d01587b8dfd in_seq=0 out_seq=0 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f18ff9640 1 -- 172.21.15.60:0/1602483642 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55d24ab108a0 con 0x55d24ab17ff0 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f18ff9640 10 client.16311 handle_command_reply: tid=0 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 client.16311 shutdown 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 -- 172.21.15.60:0/1602483642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab04f90 msgr2=0x55d24ab206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab04f90 0x55d24ab206c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0cd2e0 tx=0x7f7f2c018f90 comp rx=0 tx=0).stop 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 -- 172.21.15.60:0/1602483642 shutdown_connections 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d24ab17ff0 0x55d24ab94980 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d24ab09240 0x55d24ab1bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d24ab08920 0x55d24ab1b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 --2- 172.21.15.60:0/1602483642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d24ab04f90 0x55d24ab206c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 -- 172.21.15.60:0/1602483642 >> 172.21.15.60:0/1602483642 conn(0x55d24ab14c20 msgr2=0x55d24ab039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f18ff9640 0 client.16311 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 -- 172.21.15.60:0/1602483642 shutdown_connections 2024-09-12T00:02:58.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.564+0000 7f7f3dc78740 1 -- 172.21.15.60:0/1602483642 wait complete. 2024-09-12T00:02:58.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3dc78740 20 client.16311 trim_cache size 0 max 16384 2024-09-12T00:02:58.573 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:02:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 39, 2024-09-12T00:02:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "leader": 24496, 2024-09-12T00:02:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "set_version": 12, 2024-09-12T00:02:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "sets": {} 2024-09-12T00:02:58.574 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:02:58.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 -- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f1c0a2cf0 msgr2=0x7f7f1c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f1c0a2cf0 0x7f7f1c0a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7f24005cc0 tx=0x7f7f24005c30 comp rx=0 tx=0).stop 2024-09-12T00:02:58.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 -- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34101de0 msgr2=0x7f7f341983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:02:58.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34101de0 0x7f7f341983d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00c920 tx=0x7f7f2c00cde0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 -- 172.21.15.60:0/569933394 shutdown_connections 2024-09-12T00:02:58.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7f1c0a2cf0 0x7f7f1c0a51b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f34106f10 0x7f7f3419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f34102790 0x7f7f34198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 --2- 172.21.15.60:0/569933394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f34101de0 0x7f7f341983d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:02:58.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 -- 172.21.15.60:0/569933394 >> 172.21.15.60:0/569933394 conn(0x7f7f340fd8c0 msgr2=0x7f7f340ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:02:58.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 -- 172.21.15.60:0/569933394 shutdown_connections 2024-09-12T00:02:58.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:02:58.565+0000 7f7f3b89f640 1 -- 172.21.15.60:0/569933394 wait complete. 2024-09-12T00:02:59.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:02:59 smithi060 ceph-mon[30953]: pgmap v111: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-09-12T00:02:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:02:59 smithi105 ceph-mon[34805]: pgmap v111: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-09-12T00:02:59.506 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T00:02:59.506 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-12T00:02:59.646 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-12T00:02:59.647 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T00:02:59.647 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T00:02:59.647 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-12T00:02:59.648 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:02:59 smithi192 ceph-mon[35487]: pgmap v111: 97 pgs: 97 active+clean; 280 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-09-12T00:02:59.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-12T00:03:01.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:01 smithi060 ceph-mon[30953]: pgmap v112: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 457 op/s 2024-09-12T00:03:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:01 smithi105 ceph-mon[34805]: pgmap v112: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 457 op/s 2024-09-12T00:03:01.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:01 smithi192 ceph-mon[35487]: pgmap v112: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 457 op/s 2024-09-12T00:03:03.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:03 smithi060 ceph-mon[30953]: pgmap v113: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 302 op/s 2024-09-12T00:03:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:03 smithi105 ceph-mon[34805]: pgmap v113: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 302 op/s 2024-09-12T00:03:03.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:03 smithi192 ceph-mon[35487]: pgmap v113: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 302 op/s 2024-09-12T00:03:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:05 smithi060 ceph-mon[30953]: pgmap v114: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 325 op/s 2024-09-12T00:03:05.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:05 smithi105 ceph-mon[34805]: pgmap v114: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 325 op/s 2024-09-12T00:03:05.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:05 smithi192 ceph-mon[35487]: pgmap v114: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 325 op/s 2024-09-12T00:03:07.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:07 smithi060 ceph-mon[30953]: pgmap v115: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 516 KiB/s wr, 163 op/s 2024-09-12T00:03:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:07 smithi105 ceph-mon[34805]: pgmap v115: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 516 KiB/s wr, 163 op/s 2024-09-12T00:03:07.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:07 smithi192 ceph-mon[35487]: pgmap v115: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 516 KiB/s wr, 163 op/s 2024-09-12T00:03:09.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:09 smithi060 ceph-mon[30953]: pgmap v116: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 516 KiB/s wr, 163 op/s 2024-09-12T00:03:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:09 smithi105 ceph-mon[34805]: pgmap v116: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 516 KiB/s wr, 163 op/s 2024-09-12T00:03:09.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:09 smithi192 ceph-mon[35487]: pgmap v116: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 516 KiB/s wr, 163 op/s 2024-09-12T00:03:11.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:11 smithi060 ceph-mon[30953]: pgmap v117: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 519 KiB/s wr, 168 op/s 2024-09-12T00:03:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:11 smithi105 ceph-mon[34805]: pgmap v117: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 519 KiB/s wr, 168 op/s 2024-09-12T00:03:11.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:11 smithi192 ceph-mon[35487]: pgmap v117: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 519 KiB/s wr, 168 op/s 2024-09-12T00:03:13.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:13 smithi060 ceph-mon[30953]: pgmap v118: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 43 KiB/s wr, 28 op/s 2024-09-12T00:03:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:13 smithi105 ceph-mon[34805]: pgmap v118: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 43 KiB/s wr, 28 op/s 2024-09-12T00:03:13.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:13 smithi192 ceph-mon[35487]: pgmap v118: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 43 KiB/s wr, 28 op/s 2024-09-12T00:03:14.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:03:14.739 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:15.268 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:15 smithi060 ceph-mon[30953]: pgmap v119: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 32 op/s 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 -- 172.21.15.60:0/4222787506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628106f10 msgr2=0x7f862810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 --2- 172.21.15.60:0/4222787506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628106f10 0x7f862810ea90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8620009ca0 tx=0x7f862002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 -- 172.21.15.60:0/4222787506 shutdown_connections 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 --2- 172.21.15.60:0/4222787506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628106f10 0x7f862810ea90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 --2- 172.21.15.60:0/4222787506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8628102790 0x7f86281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 --2- 172.21.15.60:0/4222787506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8628101de0 0x7f86281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 -- 172.21.15.60:0/4222787506 >> 172.21.15.60:0/4222787506 conn(0x7f86280fd8c0 msgr2=0x7f86280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 -- 172.21.15.60:0/4222787506 shutdown_connections 2024-09-12T00:03:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.353+0000 7f862ce6d640 1 -- 172.21.15.60:0/4222787506 wait complete. 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.354+0000 7f862ce6d640 1 Processor -- start 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.354+0000 7f862ce6d640 1 -- start start 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.354+0000 7f862ce6d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8628101de0 0x7f86280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.354+0000 7f862ce6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628102790 0x7f8628074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.354+0000 7f862ce6d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8628106f10 0x7f8628074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.354+0000 7f862ce6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86281120e0 con 0x7f8628102790 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.354+0000 7f862ce6d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8628111f60 con 0x7f8628101de0 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.354+0000 7f862ce6d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8628112260 con 0x7f8628106f10 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628102790 0x7f8628074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628102790 0x7f8628074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50818/0 (socket says 172.21.15.60:50818) 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 -- 172.21.15.60:0/3646880302 learned_addr learned my addr 172.21.15.60:0/3646880302 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:15.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f8626d9d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8628106f10 0x7f8628074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f862659c640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8628101de0 0x7f86280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 -- 172.21.15.60:0/3646880302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8628106f10 msgr2=0x7f8628074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8628106f10 0x7f8628074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 -- 172.21.15.60:0/3646880302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8628101de0 msgr2=0x7f86280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8628101de0 0x7f86280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 -- 172.21.15.60:0/3646880302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86281a6980 con 0x7f8628102790 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861ffff640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628102790 0x7f8628074a30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f861000d770 tx=0x7f861000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861f7fe640 1 -- 172.21.15.60:0/3646880302 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610017070 con 0x7f8628102790 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f862ce6d640 1 -- 172.21.15.60:0/3646880302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86281a6c70 con 0x7f8628102790 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861f7fe640 1 -- 172.21.15.60:0/3646880302 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8610005520 con 0x7f8628102790 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f861f7fe640 1 -- 172.21.15.60:0/3646880302 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610010460 con 0x7f8628102790 2024-09-12T00:03:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.355+0000 7f862ce6d640 1 -- 172.21.15.60:0/3646880302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86281a7160 con 0x7f8628102790 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f861f7fe640 1 -- 172.21.15.60:0/3646880302 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8610004ea0 con 0x7f8628102790 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f862f246740 1 Processor -- start 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f862f246740 1 -- start start 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f862f246740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb54a0 0x560623cb5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f862f246740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb5dc0 0x560623cc0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f862f246740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cc2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f862f246740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560623c1b2e0 con 0x560623cc0680 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f862f246740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560623bc2ce0 con 0x560623cb54a0 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.358+0000 7f862f246740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560623c172a0 con 0x560623cb5dc0 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cc2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cc2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50820/0 (socket says 172.21.15.60:50820) 2024-09-12T00:03:15.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 -- 172.21.15.60:0/1298165696 learned_addr learned my addr 172.21.15.60:0/1298165696 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f862659c640 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb5dc0 0x560623cc0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f8626d9d640 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb54a0 0x560623cb5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861f7fe640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86140a2cf0 0x7f86140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 -- 172.21.15.60:0/1298165696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb5dc0 msgr2=0x560623cc0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb5dc0 0x560623cc0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 -- 172.21.15.60:0/1298165696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb54a0 msgr2=0x560623cb5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb54a0 0x560623cb5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 -- 172.21.15.60:0/1298165696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560623ba7440 con 0x560623cc0680 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f8626d9d640 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb54a0 0x560623cb5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f8626d9d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86140a2cf0 0x7f86140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861f7fe640 1 -- 172.21.15.60:0/3646880302 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f86100cef00 con 0x7f8628102790 2024-09-12T00:03:15.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861ffff640 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cc2a70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f86100cc610 tx=0x7f8610065ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d98bb9a9627a05a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.359+0000 7f861cff9640 1 -- 172.21.15.60:0/1298165696 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610020020 con 0x560623cc0680 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f861cff9640 1 -- 172.21.15.60:0/1298165696 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86100be0d0 con 0x560623cc0680 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f861cff9640 1 -- 172.21.15.60:0/1298165696 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861009add0 con 0x560623cc0680 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 -- 172.21.15.60:0/1298165696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 msgr2=0x560623cc2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cc2a70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f86100cc610 tx=0x7f8610065ff0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f8626d9d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86140a2cf0 0x7f86140a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f862002f540 tx=0x7f86200095c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 -- 172.21.15.60:0/1298165696 shutdown_connections 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cc2a70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb5dc0 0x560623cc0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 --2- 172.21.15.60:0/1298165696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb54a0 0x560623cb5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 -- 172.21.15.60:0/1298165696 >> 172.21.15.60:0/1298165696 conn(0x560623cb1a30 msgr2=0x560623cb1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:15.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 -- 172.21.15.60:0/1298165696 shutdown_connections 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.360+0000 7f862f246740 1 -- 172.21.15.60:0/1298165696 wait complete. 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 1 -- start start 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 1 Processor -- start 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cbffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cbd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cbd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560623cc3250 con 0x560623cb54a0 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560623bd6050 con 0x560623cb5dc0 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560623cc33d0 con 0x560623cc0680 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862f246740 10 client.0 _ll_register_callbacks cb 0x560623c16160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cbffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cbffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50822/0 (socket says 172.21.15.60:50822) 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862659c640 1 -- 172.21.15.60:0/977078492 learned_addr learned my addr 172.21.15.60:0/977078492 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f8626d9d640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cbd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f861ffff640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cbd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862659c640 1 -- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 msgr2=0x560623cbd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862659c640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cbd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862659c640 1 -- 172.21.15.60:0/977078492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 msgr2=0x560623cbd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862659c640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cbd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f862659c640 1 -- 172.21.15.60:0/977078492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56062398c3c0 con 0x560623cb54a0 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f8626d9d640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cbd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.361+0000 7f861ffff640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cbd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862659c640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cbffe0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f861800be60 tx=0x7f8618012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87ea974655707bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:15.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f860dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f860dffb640 1 -- 172.21.15.60:0/977078492 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618004230 con 0x560623cb54a0 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f860dffb640 1 -- 172.21.15.60:0/977078492 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f86180043d0 con 0x560623cb54a0 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 1 -- 172.21.15.60:0/977078492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86100be0d0 con 0x560623cb54a0 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f860dffb640 1 -- 172.21.15.60:0/977078492 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f86180106a0 con 0x560623cb54a0 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 10 client.16323 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 1 -- 172.21.15.60:0/977078492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560623cced00 con 0x560623cb54a0 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f860dffb640 1 -- 172.21.15.60:0/977078492 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86100be0d0 con 0x560623cb54a0 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f860dffb640 1 -- 172.21.15.60:0/977078492 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f8618019070 con 0x560623cb54a0 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 10 client.16323 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 10 client.16323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 20 client.16323 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560623cd0260 0x560623cd26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 4 client.16323 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.362+0000 7f862f246740 1 -- 172.21.15.60:0/977078492 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560623c28850 con 0x560623cd0260 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.363+0000 7f861ffff640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560623cd0260 0x560623cd26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.363+0000 7f860dffb640 10 client.16323 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.363+0000 7f861ffff640 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560623cd0260 0x560623cd26e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0593801418da0c server_cookie=a9c637b881d2402b in_seq=0 out_seq=0 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f860dffb640 1 -- 172.21.15.60:0/977078492 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560623c28850 con 0x560623cd0260 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f860dffb640 10 client.16323 handle_command_reply: tid=0 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 client.16323 shutdown 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 -- 172.21.15.60:0/977078492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 msgr2=0x560623cbffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cbffe0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f861800be60 tx=0x7f8618012820 comp rx=0 tx=0).stop 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 -- 172.21.15.60:0/977078492 shutdown_connections 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560623cd0260 0x560623cd26e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cbd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cbd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f860dffb640 0 client.16323 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 --2- 172.21.15.60:0/977078492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cbffe0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 -- 172.21.15.60:0/977078492 >> 172.21.15.60:0/977078492 conn(0x560623cb1a30 msgr2=0x560623cb7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 -- 172.21.15.60:0/977078492 shutdown_connections 2024-09-12T00:03:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.364+0000 7f862f246740 1 -- 172.21.15.60:0/977078492 wait complete. 2024-09-12T00:03:15.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.365+0000 7f862f246740 20 client.16323 trim_cache size 0 max 16384 2024-09-12T00:03:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.382+0000 7f862f246740 1 Processor -- start 2024-09-12T00:03:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.382+0000 7f862f246740 1 -- start start 2024-09-12T00:03:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.382+0000 7f862f246740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb54a0 0x560623cbcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f862f246740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cb1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f862f246740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cbf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f862f246740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86281af9c0 con 0x560623cc0680 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f862f246740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b1800 con 0x560623cb5dc0 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f862f246740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b0150 con 0x560623cb54a0 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cbf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cbf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50830/0 (socket says 172.21.15.60:50830) 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f861ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cb1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 -- 172.21.15.60:0/2580081297 learned_addr learned my addr 172.21.15.60:0/2580081297 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f862659c640 1 --2- 172.21.15.60:0/2580081297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb54a0 0x560623cbcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 -- 172.21.15.60:0/2580081297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb54a0 msgr2=0x560623cbcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 --2- 172.21.15.60:0/2580081297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb54a0 0x560623cbcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 -- 172.21.15.60:0/2580081297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 msgr2=0x560623cb1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 --2- 172.21.15.60:0/2580081297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cb1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 -- 172.21.15.60:0/2580081297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560623cbdb60 con 0x560623cc0680 2024-09-12T00:03:15.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f8626d9d640 1 --2- 172.21.15.60:0/2580081297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cbf310 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8620035000 tx=0x7f8620040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcc1f8efd27aa80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.383+0000 7f860ffff640 1 -- 172.21.15.60:0/2580081297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8620050070 con 0x560623cc0680 2024-09-12T00:03:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f860ffff640 1 -- 172.21.15.60:0/2580081297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8620036040 con 0x560623cc0680 2024-09-12T00:03:15.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f860ffff640 1 -- 172.21.15.60:0/2580081297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862003d680 con 0x560623cc0680 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 -- 172.21.15.60:0/2580081297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 msgr2=0x560623cbf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 --2- 172.21.15.60:0/2580081297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cbf310 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8620035000 tx=0x7f8620040000 comp rx=0 tx=0).stop 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 -- 172.21.15.60:0/2580081297 shutdown_connections 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 --2- 172.21.15.60:0/2580081297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cc0680 0x560623cbf310 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 --2- 172.21.15.60:0/2580081297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cb1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 --2- 172.21.15.60:0/2580081297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cb54a0 0x560623cbcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 -- 172.21.15.60:0/2580081297 >> 172.21.15.60:0/2580081297 conn(0x560623cb1a30 msgr2=0x560623cbc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 -- 172.21.15.60:0/2580081297 shutdown_connections 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.384+0000 7f862f246740 1 -- 172.21.15.60:0/2580081297 wait complete. 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 1 -- start start 2024-09-12T00:03:15.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 1 Processor -- start 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cc8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cc8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cc6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b1070 con 0x560623cb54a0 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86281b08e0 con 0x560623cb5dc0 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f86281ad9a0 con 0x560623cc0680 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862f246740 10 client.0 _ll_register_callbacks cb 0x7f861800b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cc8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cc8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50836/0 (socket says 172.21.15.60:50836) 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862659c640 1 -- 172.21.15.60:0/2235652616 learned_addr learned my addr 172.21.15.60:0/2235652616 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f8626d9d640 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cc6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f861ffff640 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cc8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862659c640 1 -- 172.21.15.60:0/2235652616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 msgr2=0x560623cc6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862659c640 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cc6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862659c640 1 -- 172.21.15.60:0/2235652616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 msgr2=0x560623cc8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862659c640 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cc8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.385+0000 7f862659c640 1 -- 172.21.15.60:0/2235652616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560623cc6800 con 0x560623cb54a0 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f862659c640 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cc8a10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8618000c00 tx=0x7f8618004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cc78dac4f67b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f860dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f860dffb640 1 -- 172.21.15.60:0/2235652616 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618032060 con 0x560623cb54a0 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f862f246740 1 -- 172.21.15.60:0/2235652616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8620036040 con 0x560623cb54a0 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f860dffb640 1 -- 172.21.15.60:0/2235652616 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8618005450 con 0x560623cb54a0 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f860dffb640 1 -- 172.21.15.60:0/2235652616 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8618028040 con 0x560623cb54a0 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f862f246740 10 client.16329 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f862f246740 1 -- 172.21.15.60:0/2235652616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560623d3ac60 con 0x560623cb54a0 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f860dffb640 1 -- 172.21.15.60:0/2235652616 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8620036040 con 0x560623cb54a0 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f860dffb640 1 -- 172.21.15.60:0/2235652616 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f8618019040 con 0x560623cb54a0 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f862f246740 10 client.16329 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.386+0000 7f862f246740 10 client.16329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f862f246740 20 client.16329 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f862f246740 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560623d3b3e0 0x560623d3d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f862f246740 4 client.16329 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f862f246740 1 -- 172.21.15.60:0/2235652616 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560623c22d60 con 0x560623d3b3e0 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f861ffff640 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560623d3b3e0 0x560623d3d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f861ffff640 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560623d3b3e0 0x560623d3d800 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=840945ac69577ab2 server_cookie=de7fad35a68e2854 in_seq=0 out_seq=0 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f860dffb640 10 client.16329 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f860dffb640 1 -- 172.21.15.60:0/2235652616 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560623c22d60 con 0x560623d3b3e0 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f860dffb640 10 client.16329 handle_command_reply: tid=0 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f862f246740 1 client.16329 shutdown 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f862f246740 1 -- 172.21.15.60:0/2235652616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 msgr2=0x560623cc8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.387+0000 7f862f246740 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cc8a10 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8618000c00 tx=0x7f8618004590 comp rx=0 tx=0).stop 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 1 -- 172.21.15.60:0/2235652616 shutdown_connections 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x560623d3b3e0 0x560623d3d800 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560623cc0680 0x560623cc6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560623cb5dc0 0x560623cc8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 1 --2- 172.21.15.60:0/2235652616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560623cb54a0 0x560623cc8a10 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 1 -- 172.21.15.60:0/2235652616 >> 172.21.15.60:0/2235652616 conn(0x560623cb1a30 msgr2=0x560623cbf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f860dffb640 0 client.16329 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 1 -- 172.21.15.60:0/2235652616 shutdown_connections 2024-09-12T00:03:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 1 -- 172.21.15.60:0/2235652616 wait complete. 2024-09-12T00:03:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862f246740 20 client.16329 trim_cache size 0 max 16384 2024-09-12T00:03:15.393 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:03:15.393 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:03:15.393 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:03:15.394 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:03:15.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 -- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86140a2cf0 msgr2=0x7f86140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86140a2cf0 0x7f86140a51b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f862002f540 tx=0x7f86200095c0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 -- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628102790 msgr2=0x7f8628074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628102790 0x7f8628074a30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f861000d770 tx=0x7f861000dc30 comp rx=0 tx=0).stop 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 -- 172.21.15.60:0/3646880302 shutdown_connections 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86140a2cf0 0x7f86140a51b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8628106f10 0x7f8628074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8628102790 0x7f8628074a30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 --2- 172.21.15.60:0/3646880302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8628101de0 0x7f86280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.388+0000 7f862ce6d640 1 -- 172.21.15.60:0/3646880302 >> 172.21.15.60:0/3646880302 conn(0x7f86280fd8c0 msgr2=0x7f86280ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.389+0000 7f862ce6d640 1 -- 172.21.15.60:0/3646880302 shutdown_connections 2024-09-12T00:03:15.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:15.389+0000 7f862ce6d640 1 -- 172.21.15.60:0/3646880302 wait complete. 2024-09-12T00:03:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:15 smithi105 ceph-mon[34805]: pgmap v119: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 32 op/s 2024-09-12T00:03:15.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:15 smithi192 ceph-mon[35487]: pgmap v119: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 43 KiB/s wr, 32 op/s 2024-09-12T00:03:16.208 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:03:16.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:03:16.473 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:16.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 -- 172.21.15.60:0/812708524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654106a80 msgr2=0x7f6654106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 --2- 172.21.15.60:0/812708524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654106a80 0x7f6654106e60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6644009930 tx=0x7f664402a420 comp rx=0 tx=0).stop 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 -- 172.21.15.60:0/812708524 shutdown_connections 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 --2- 172.21.15.60:0/812708524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6654101420 0x7f665410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 --2- 172.21.15.60:0/812708524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6654100a80 0x7f6654100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 --2- 172.21.15.60:0/812708524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654106a80 0x7f6654106e60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 -- 172.21.15.60:0/812708524 >> 172.21.15.60:0/812708524 conn(0x7f66540fc7a0 msgr2=0x7f66540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 -- 172.21.15.60:0/812708524 shutdown_connections 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.937+0000 7f665a996640 1 -- 172.21.15.60:0/812708524 wait complete. 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.938+0000 7f665a996640 1 Processor -- start 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.938+0000 7f665a996640 1 -- start start 2024-09-12T00:03:16.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.938+0000 7f665a996640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654100a80 0x7f6654199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.938+0000 7f665a996640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6654101420 0x7f66541998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.938+0000 7f665a996640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6654106a80 0x7f66541a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f665a996640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6654110f60 con 0x7f6654100a80 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f665a996640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6654110de0 con 0x7f6654106a80 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f665a996640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66541110e0 con 0x7f6654101420 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654100a80 0x7f6654199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654100a80 0x7f6654199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50850/0 (socket says 172.21.15.60:50850) 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 -- 172.21.15.60:0/3471319821 learned_addr learned my addr 172.21.15.60:0/3471319821 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6658f33640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6654106a80 0x7f66541a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f66537fe640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6654101420 0x7f66541998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 -- 172.21.15.60:0/3471319821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6654101420 msgr2=0x7f66541998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6654101420 0x7f66541998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:16.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 -- 172.21.15.60:0/3471319821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6654106a80 msgr2=0x7f66541a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6654106a80 0x7f66541a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 -- 172.21.15.60:0/3471319821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66541a4950 con 0x7f6654100a80 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f6653fff640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654100a80 0x7f6654199390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6644009230 tx=0x7f6644004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f66517fa640 1 -- 172.21.15.60:0/3471319821 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664403f030 con 0x7f6654100a80 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f66517fa640 1 -- 172.21.15.60:0/3471319821 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6644003af0 con 0x7f6654100a80 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66541a4b20 con 0x7f6654100a80 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.939+0000 7f66517fa640 1 -- 172.21.15.60:0/3471319821 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644035070 con 0x7f6654100a80 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.940+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66541a4fd0 con 0x7f6654100a80 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.940+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6654100ee0 con 0x7f6654100a80 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.942+0000 7f66517fa640 1 -- 172.21.15.60:0/3471319821 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6644042030 con 0x7f6654100a80 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.942+0000 7f66517fa640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f663c0a2d70 0x7f663c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.942+0000 7f66537fe640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f663c0a2d70 0x7f663c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:16.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.942+0000 7f66517fa640 1 -- 172.21.15.60:0/3471319821 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f66440f0030 con 0x7f6654100a80 2024-09-12T00:03:16.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.943+0000 7f66537fe640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f663c0a2d70 0x7f663c0a5230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6648005fd0 tx=0x7f6648005850 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:16.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:16.946+0000 7f66517fa640 1 -- 172.21.15.60:0/3471319821 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66440bcd60 con 0x7f6654100a80 2024-09-12T00:03:17.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.160+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6654108ff0 con 0x7f6654100a80 2024-09-12T00:03:17.160 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:17 smithi060 ceph-mon[30953]: pgmap v120: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-12T00:03:17.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.161+0000 7f66517fa640 1 -- 172.21.15.60:0/3471319821 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12009 (secure 0 0 0) 0x7f66440bc660 con 0x7f6654100a80 2024-09-12T00:03:17.160 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:03:17.160 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"btime":"2024-09-12T00:02:06:958968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:02:06.347465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:03:17.161 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 39 2024-09-12T00:03:17.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.163+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f663c0a2d70 msgr2=0x7f663c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.163+0000 7f665a996640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f663c0a2d70 0x7f663c0a5230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6648005fd0 tx=0x7f6648005850 comp rx=0 tx=0).stop 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.163+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654100a80 msgr2=0x7f6654199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.163+0000 7f665a996640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654100a80 0x7f6654199390 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6644009230 tx=0x7f6644004270 comp rx=0 tx=0).stop 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.164+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 shutdown_connections 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.164+0000 7f665a996640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f663c0a2d70 0x7f663c0a5230 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.164+0000 7f665a996640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6654106a80 0x7f66541a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.164+0000 7f665a996640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6654101420 0x7f66541998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.164+0000 7f665a996640 1 --2- 172.21.15.60:0/3471319821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6654100a80 0x7f6654199390 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.164+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 >> 172.21.15.60:0/3471319821 conn(0x7f66540fc7a0 msgr2=0x7f66540fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.164+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 shutdown_connections 2024-09-12T00:03:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:17.164+0000 7f665a996640 1 -- 172.21.15.60:0/3471319821 wait complete. 2024-09-12T00:03:17.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:17 smithi105 ceph-mon[34805]: pgmap v120: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-12T00:03:17.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:17 smithi192 ceph-mon[35487]: pgmap v120: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-12T00:03:17.835 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:03:18.097 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:18.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:18 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3471319821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:03:18.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:18 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3471319821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:03:18.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:18 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3471319821' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:03:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.590+0000 7f79346c2640 1 -- 172.21.15.60:0/3304967260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 msgr2=0x7f792c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.590+0000 7f79346c2640 1 --2- 172.21.15.60:0/3304967260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 0x7f792c100ee0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7920009930 tx=0x7f792002a420 comp rx=0 tx=0).stop 2024-09-12T00:03:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.590+0000 7f79346c2640 1 -- 172.21.15.60:0/3304967260 shutdown_connections 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.590+0000 7f79346c2640 1 --2- 172.21.15.60:0/3304967260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f792c101420 0x7f792c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.590+0000 7f79346c2640 1 --2- 172.21.15.60:0/3304967260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 0x7f792c100ee0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.590+0000 7f79346c2640 1 --2- 172.21.15.60:0/3304967260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f792c106a80 0x7f792c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.590+0000 7f79346c2640 1 -- 172.21.15.60:0/3304967260 >> 172.21.15.60:0/3304967260 conn(0x7f792c0fc7a0 msgr2=0x7f792c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.590+0000 7f79346c2640 1 -- 172.21.15.60:0/3304967260 shutdown_connections 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.591+0000 7f79346c2640 1 -- 172.21.15.60:0/3304967260 wait complete. 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.591+0000 7f79346c2640 1 Processor -- start 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.591+0000 7f79346c2640 1 -- start start 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.591+0000 7f79346c2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 0x7f792c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.591+0000 7f79346c2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f792c101420 0x7f792c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.591+0000 7f79346c2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f792c106a80 0x7f792c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.591+0000 7f79346c2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f792c110fe0 con 0x7f792c100a80 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f79346c2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f792c110e60 con 0x7f792c106a80 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f79346c2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f792c111160 con 0x7f792c101420 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 0x7f792c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 0x7f792c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50880/0 (socket says 172.21.15.60:50880) 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 -- 172.21.15.60:0/2152329067 learned_addr learned my addr 172.21.15.60:0/2152329067 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f7931c5d640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f792c101420 0x7f792c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f792c106a80 0x7f792c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 -- 172.21.15.60:0/2152329067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f792c101420 msgr2=0x7f792c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f792c101420 0x7f792c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 -- 172.21.15.60:0/2152329067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f792c106a80 msgr2=0x7f792c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f792c106a80 0x7f792c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 -- 172.21.15.60:0/2152329067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f792c19d530 con 0x7f792c100a80 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f793245e640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 0x7f792c198580 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f792800b4a0 tx=0x7f792800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f791f7fe640 1 -- 172.21.15.60:0/2152329067 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928014070 con 0x7f792c100a80 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f791f7fe640 1 -- 172.21.15.60:0/2152329067 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7928010b10 con 0x7f792c100a80 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f79346c2640 1 -- 172.21.15.60:0/2152329067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792c19d820 con 0x7f792c100a80 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f791f7fe640 1 -- 172.21.15.60:0/2152329067 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928017d60 con 0x7f792c100a80 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.592+0000 7f79346c2640 1 -- 172.21.15.60:0/2152329067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f792c1a5100 con 0x7f792c100a80 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f791f7fe640 1 -- 172.21.15.60:0/2152329067 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7928017070 con 0x7f792c100a80 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f7936a9b740 1 Processor -- start 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f7936a9b740 1 -- start start 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d4c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4c5d0 0x556a90d4ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d59760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f7936a9b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556a90cb22f0 con 0x556a90d4db40 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f7936a9b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556a90c59cf0 con 0x556a90d4c5d0 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.595+0000 7f7936a9b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556a90cae2b0 con 0x556a90d57370 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d4c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d4c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50882/0 (socket says 172.21.15.60:50882) 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 -- 172.21.15.60:0/2156340442 learned_addr learned my addr 172.21.15.60:0/2156340442 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7931c5d640 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d59760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f793245e640 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4c5d0 0x556a90d4ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f791f7fe640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f79180a2cf0 0x7f79180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 -- 172.21.15.60:0/2156340442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 msgr2=0x556a90d59760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d59760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 -- 172.21.15.60:0/2156340442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4c5d0 msgr2=0x556a90d4ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4c5d0 0x556a90d4ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 -- 172.21.15.60:0/2156340442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a90c3e3a0 con 0x556a90d4db40 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f791f7fe640 1 -- 172.21.15.60:0/2152329067 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f79280ce640 con 0x7f792c100a80 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d4c090 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7924010370 tx=0x7f7924010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370842ef22a461d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f79180a2cf0 0x7f79180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.596+0000 7f791cff9640 1 -- 172.21.15.60:0/2156340442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924022070 con 0x556a90d4db40 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f791cff9640 1 -- 172.21.15.60:0/2156340442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79240113e0 con 0x556a90d4db40 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f791cff9640 1 -- 172.21.15.60:0/2156340442 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924016070 con 0x556a90d4db40 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 -- 172.21.15.60:0/2156340442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 msgr2=0x556a90d4c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f79180a2cf0 0x7f79180a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f792401f000 tx=0x7f7924022000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d4c090 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7924010370 tx=0x7f7924010830 comp rx=0 tx=0).stop 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 -- 172.21.15.60:0/2156340442 shutdown_connections 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d59760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4c5d0 0x556a90d4ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 --2- 172.21.15.60:0/2156340442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d4c090 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 -- 172.21.15.60:0/2156340442 >> 172.21.15.60:0/2156340442 conn(0x556a90d15310 msgr2=0x556a90d48c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 -- 172.21.15.60:0/2156340442 shutdown_connections 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.597+0000 7f7936a9b740 1 -- 172.21.15.60:0/2156340442 wait complete. 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 1 -- start start 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 1 Processor -- start 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4c5d0 0x556a90d56d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 0x556a90d54010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d54600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556a90d5a070 con 0x556a90d4c5d0 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556a90c6d060 con 0x556a90d4db40 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556a90d5a1f0 con 0x556a90d57370 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f7936a9b740 10 client.0 _ll_register_callbacks cb 0x556a909c08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f793245e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4c5d0 0x556a90d56d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f793245e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4c5d0 0x556a90d56d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50892/0 (socket says 172.21.15.60:50892) 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.598+0000 7f793245e640 1 -- 172.21.15.60:0/4141163911 learned_addr learned my addr 172.21.15.60:0/4141163911 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7931c5d640 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 0x556a90d54010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7932c5f640 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d54600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f793245e640 1 -- 172.21.15.60:0/4141163911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 msgr2=0x556a90d54600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f793245e640 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d54600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f793245e640 1 -- 172.21.15.60:0/4141163911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 msgr2=0x556a90d54010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f793245e640 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 0x556a90d54010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f793245e640 1 -- 172.21.15.60:0/4141163911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a90a233c0 con 0x556a90d4c5d0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7932c5f640 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d54600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f793245e640 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4c5d0 0x556a90d56d60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f792800be60 tx=0x7f79280177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17efece63194c856 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7915ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7915ffb640 1 -- 172.21.15.60:0/4141163911 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792801e050 con 0x556a90d4c5d0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7915ffb640 1 -- 172.21.15.60:0/4141163911 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7928097380 con 0x556a90d4c5d0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7936a9b740 1 -- 172.21.15.60:0/4141163911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79240113e0 con 0x556a90d4c5d0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7915ffb640 1 -- 172.21.15.60:0/4141163911 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f79280a38d0 con 0x556a90d4c5d0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7936a9b740 10 client.16347 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.599+0000 7f7936a9b740 1 -- 172.21.15.60:0/4141163911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556a90d65b10 con 0x556a90d4c5d0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7915ffb640 1 -- 172.21.15.60:0/4141163911 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79240113e0 con 0x556a90d4c5d0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7915ffb640 1 -- 172.21.15.60:0/4141163911 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f79280b3020 con 0x556a90d4c5d0 2024-09-12T00:03:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7936a9b740 10 client.16347 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7936a9b740 10 client.16347 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:03:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7936a9b740 20 client.16347 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7936a9b740 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x556a90d66fd0 0x556a90d69400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7936a9b740 4 client.16347 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7936a9b740 1 -- 172.21.15.60:0/4141163911 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a90cbf860 con 0x556a90d66fd0 2024-09-12T00:03:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.600+0000 7f7931c5d640 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x556a90d66fd0 0x556a90d69400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.601+0000 7f7931c5d640 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x556a90d66fd0 0x556a90d69400 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=239e7b58e4ee98ea server_cookie=5c61f70bd5bdf2d4 in_seq=0 out_seq=0 2024-09-12T00:03:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.601+0000 7f7915ffb640 10 client.16347 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:03:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.601+0000 7f7915ffb640 1 -- 172.21.15.60:0/4141163911 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a90cbf860 con 0x556a90d66fd0 2024-09-12T00:03:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.601+0000 7f7915ffb640 10 client.16347 handle_command_reply: tid=0 2024-09-12T00:03:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 client.16347 shutdown 2024-09-12T00:03:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 -- 172.21.15.60:0/4141163911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4c5d0 msgr2=0x556a90d56d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4c5d0 0x556a90d56d60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f792800be60 tx=0x7f79280177c0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 -- 172.21.15.60:0/4141163911 shutdown_connections 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d57370 0x556a90d54600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x556a90d66fd0 0x556a90d69400 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 0x556a90d54010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 --2- 172.21.15.60:0/4141163911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4c5d0 0x556a90d56d60 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7915ffb640 0 client.16347 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 -- 172.21.15.60:0/4141163911 >> 172.21.15.60:0/4141163911 conn(0x556a90d15310 msgr2=0x556a90d4e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 -- 172.21.15.60:0/4141163911 shutdown_connections 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 1 -- 172.21.15.60:0/4141163911 wait complete. 2024-09-12T00:03:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.602+0000 7f7936a9b740 20 client.16347 trim_cache size 0 max 16384 2024-09-12T00:03:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7936a9b740 1 Processor -- start 2024-09-12T00:03:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7936a9b740 1 -- start start 2024-09-12T00:03:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 0x556a90d47b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 0x556a90d48050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d57370 0x556a90d4f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7936a9b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1ad940 con 0x556a90d57370 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7936a9b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1af780 con 0x556a90d4db40 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7936a9b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1ae0d0 con 0x556a90d4c5d0 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.615+0000 7f7932c5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d57370 0x556a90d4f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7932c5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d57370 0x556a90d4f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50902/0 (socket says 172.21.15.60:50902) 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7932c5f640 1 -- 172.21.15.60:0/2552834774 learned_addr learned my addr 172.21.15.60:0/2552834774 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f793245e640 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 0x556a90d47b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7931c5d640 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 0x556a90d48050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7932c5f640 1 -- 172.21.15.60:0/2552834774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 msgr2=0x556a90d47b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 0x556a90d47b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7932c5f640 1 -- 172.21.15.60:0/2552834774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 msgr2=0x556a90d48050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 0x556a90d48050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7932c5f640 1 -- 172.21.15.60:0/2552834774 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a90d49960 con 0x556a90d57370 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7932c5f640 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d57370 0x556a90d4f120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7924005e60 tx=0x7f7924025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25216c96d63b1063 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7917fff640 1 -- 172.21.15.60:0/2552834774 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924016040 con 0x556a90d57370 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7917fff640 1 -- 172.21.15.60:0/2552834774 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7924003970 con 0x556a90d57370 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.616+0000 7f7917fff640 1 -- 172.21.15.60:0/2552834774 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79240046b0 con 0x556a90d57370 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 -- 172.21.15.60:0/2552834774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d57370 msgr2=0x556a90d4f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d57370 0x556a90d4f120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7924005e60 tx=0x7f7924025000 comp rx=0 tx=0).stop 2024-09-12T00:03:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 -- 172.21.15.60:0/2552834774 shutdown_connections 2024-09-12T00:03:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d57370 0x556a90d4f120 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d4db40 0x556a90d48050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 --2- 172.21.15.60:0/2552834774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 0x556a90d47b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 -- 172.21.15.60:0/2552834774 >> 172.21.15.60:0/2552834774 conn(0x556a90d15310 msgr2=0x556a90d47400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 -- 172.21.15.60:0/2552834774 shutdown_connections 2024-09-12T00:03:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 -- 172.21.15.60:0/2552834774 wait complete. 2024-09-12T00:03:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 -- start start 2024-09-12T00:03:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.617+0000 7f7936a9b740 1 Processor -- start 2024-09-12T00:03:18.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 0x556a90d50f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d51480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7936a9b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d57370 0x556a90d519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7936a9b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1aeff0 con 0x556a90d4db40 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7936a9b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1ae860 con 0x556a90d57370 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7936a9b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f792c1ab920 con 0x556a90d4c5d0 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7936a9b740 10 client.0 _ll_register_callbacks cb 0x7f79280176c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d51480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d51480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50908/0 (socket says 172.21.15.60:50908) 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 -- 172.21.15.60:0/3547941208 learned_addr learned my addr 172.21.15.60:0/3547941208 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f793245e640 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 0x556a90d50f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7932c5f640 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d57370 0x556a90d519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 -- 172.21.15.60:0/3547941208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 msgr2=0x556a90d50f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 0x556a90d50f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 -- 172.21.15.60:0/3547941208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d57370 msgr2=0x556a90d519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d57370 0x556a90d519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 -- 172.21.15.60:0/3547941208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a90dd50b0 con 0x556a90d4db40 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7931c5d640 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d51480 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7920009900 tx=0x7f7920031b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec02833781fc3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7915ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7915ffb640 1 -- 172.21.15.60:0/3547941208 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792004a070 con 0x556a90d4db40 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7915ffb640 1 -- 172.21.15.60:0/3547941208 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f79200035f0 con 0x556a90d4db40 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.618+0000 7f7936a9b740 1 -- 172.21.15.60:0/3547941208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7924003970 con 0x556a90d4db40 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7915ffb640 1 -- 172.21.15.60:0/3547941208 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7920035040 con 0x556a90d4db40 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7936a9b740 10 client.16353 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7936a9b740 1 -- 172.21.15.60:0/3547941208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556a90dd6320 con 0x556a90d4db40 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7915ffb640 1 -- 172.21.15.60:0/3547941208 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7924003970 con 0x556a90d4db40 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7915ffb640 1 -- 172.21.15.60:0/3547941208 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f792004f980 con 0x556a90d4db40 2024-09-12T00:03:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7936a9b740 10 client.16353 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7936a9b740 10 client.16353 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7936a9b740 20 client.16353 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7936a9b740 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x556a90d66fd0 0x556a90dd8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7936a9b740 4 client.16353 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f7936a9b740 1 -- 172.21.15.60:0/3547941208 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a90cb9d70 con 0x556a90d66fd0 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.619+0000 7f793245e640 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x556a90d66fd0 0x556a90dd8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f793245e640 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x556a90d66fd0 0x556a90dd8b30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=88c24ecf76814e4e server_cookie=81d7dcf3fe790b43 in_seq=0 out_seq=0 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7915ffb640 10 client.16353 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7915ffb640 1 -- 172.21.15.60:0/3547941208 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a90cb9d70 con 0x556a90d66fd0 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7915ffb640 10 client.16353 handle_command_reply: tid=0 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 client.16353 shutdown 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 -- 172.21.15.60:0/3547941208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 msgr2=0x556a90d51480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d51480 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7920009900 tx=0x7f7920031b70 comp rx=0 tx=0).stop 2024-09-12T00:03:18.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 -- 172.21.15.60:0/3547941208 shutdown_connections 2024-09-12T00:03:18.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x556a90d66fd0 0x556a90dd8b30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a90d57370 0x556a90d519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a90d4db40 0x556a90d51480 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 --2- 172.21.15.60:0/3547941208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a90d4c5d0 0x556a90d50f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7915ffb640 0 client.16353 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:03:18.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 -- 172.21.15.60:0/3547941208 >> 172.21.15.60:0/3547941208 conn(0x556a90d15310 msgr2=0x556a90d47c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:18.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 -- 172.21.15.60:0/3547941208 shutdown_connections 2024-09-12T00:03:18.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 1 -- 172.21.15.60:0/3547941208 wait complete. 2024-09-12T00:03:18.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.620+0000 7f7936a9b740 20 client.16353 trim_cache size 0 max 16384 2024-09-12T00:03:18.629 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:18.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 -- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f79180a2cf0 msgr2=0x7f79180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f79180a2cf0 0x7f79180a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f792401f000 tx=0x7f7924022000 comp rx=0 tx=0).stop 2024-09-12T00:03:18.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 -- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 msgr2=0x7f792c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:18.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 0x7f792c198580 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f792800b4a0 tx=0x7f792800b960 comp rx=0 tx=0).stop 2024-09-12T00:03:18.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 -- 172.21.15.60:0/2152329067 shutdown_connections 2024-09-12T00:03:18.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f79180a2cf0 0x7f79180a51b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f792c106a80 0x7f792c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f792c101420 0x7f792c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 --2- 172.21.15.60:0/2152329067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f792c100a80 0x7f792c198580 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:18.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 -- 172.21.15.60:0/2152329067 >> 172.21.15.60:0/2152329067 conn(0x7f792c0fc7a0 msgr2=0x7f792c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:18.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 -- 172.21.15.60:0/2152329067 shutdown_connections 2024-09-12T00:03:18.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:18.621+0000 7f79346c2640 1 -- 172.21.15.60:0/2152329067 wait complete. 2024-09-12T00:03:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:19 smithi060 ceph-mon[30953]: pgmap v121: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-12T00:03:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:19 smithi105 ceph-mon[34805]: pgmap v121: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-12T00:03:19.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:03:19.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:19 smithi192 ceph-mon[35487]: pgmap v121: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-12T00:03:19.775 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 -- 172.21.15.60:0/3110072018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841036e0 msgr2=0x7f0a84107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/3110072018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841036e0 0x7f0a84107b90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009930 tx=0x7f0a7802a420 comp rx=0 tx=0).stop 2024-09-12T00:03:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 -- 172.21.15.60:0/3110072018 shutdown_connections 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/3110072018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a841082a0 0x7f0a8410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/3110072018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a841036e0 0x7f0a84107b90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/3110072018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a84102d30 0x7f0a84103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 -- 172.21.15.60:0/3110072018 >> 172.21.15.60:0/3110072018 conn(0x7f0a840fc7d0 msgr2=0x7f0a840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 -- 172.21.15.60:0/3110072018 shutdown_connections 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 -- 172.21.15.60:0/3110072018 wait complete. 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 Processor -- start 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.287+0000 7f0a8a9af640 1 -- start start 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a8a9af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84102d30 0x7f0a841a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a8a9af640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a841036e0 0x7f0a841a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a8a9af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a841082a0 0x7f0a8419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a8a9af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84101a60 con 0x7f0a84102d30 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a8a9af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841018e0 con 0x7f0a841082a0 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a8a9af640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84101be0 con 0x7f0a841036e0 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84102d30 0x7f0a841a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84102d30 0x7f0a841a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50934/0 (socket says 172.21.15.60:50934) 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a83fff640 1 -- 172.21.15.60:0/1930563394 learned_addr learned my addr 172.21.15.60:0/1930563394 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a841082a0 0x7f0a8419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a841036e0 0x7f0a841a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a83fff640 1 -- 172.21.15.60:0/1930563394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a841036e0 msgr2=0x7f0a841a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a83fff640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a841036e0 0x7f0a841a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a83fff640 1 -- 172.21.15.60:0/1930563394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a841082a0 msgr2=0x7f0a8419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a83fff640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a841082a0 0x7f0a8419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.288+0000 7f0a83fff640 1 -- 172.21.15.60:0/1930563394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8419af60 con 0x7f0a84102d30 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.289+0000 7f0a83fff640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84102d30 0x7f0a841a0620 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400c970 tx=0x7f0a7400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.289+0000 7f0a817fa640 1 -- 172.21.15.60:0/1930563394 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74007bb0 con 0x7f0a84102d30 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.289+0000 7f0a817fa640 1 -- 172.21.15.60:0/1930563394 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a74007d50 con 0x7f0a84102d30 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.289+0000 7f0a817fa640 1 -- 172.21.15.60:0/1930563394 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400f4b0 con 0x7f0a84102d30 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.289+0000 7f0a8a9af640 1 -- 172.21.15.60:0/1930563394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8419b250 con 0x7f0a84102d30 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.289+0000 7f0a8a9af640 1 -- 172.21.15.60:0/1930563394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a841a73d0 con 0x7f0a84102d30 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.291+0000 7f0a817fa640 1 -- 172.21.15.60:0/1930563394 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0a7400f690 con 0x7f0a84102d30 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.291+0000 7f0a8cd88740 1 Processor -- start 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.291+0000 7f0a8cd88740 1 -- start start 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467110090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 0x564467110a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x56446711d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5644670762f0 con 0x564467111b40 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56446701dcf0 con 0x5644671105d0 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5644670722b0 con 0x56446711b370 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a88f4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a88f4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50942/0 (socket says 172.21.15.60:50942) 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a88f4c640 1 -- 172.21.15.60:0/1120346132 learned_addr learned my addr 172.21.15.60:0/1120346132 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a83fff640 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 0x564467110a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x56446711d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a88f4c640 1 -- 172.21.15.60:0/1120346132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 msgr2=0x56446711d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a817fa640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0a6c0a2cf0 0x7f0a6c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x56446711d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a88f4c640 1 -- 172.21.15.60:0/1120346132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 msgr2=0x564467110a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 0x564467110a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a88f4c640 1 -- 172.21.15.60:0/1120346132 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644670023a0 con 0x564467111b40 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x56446711d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.292+0000 7f0a817fa640 1 -- 172.21.15.60:0/1930563394 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f0a740cf0c0 con 0x7f0a84102d30 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.293+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467110090 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009f50 tx=0x7f0a7c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89dad79cd5d01f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.293+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0a6c0a2cf0 0x7f0a6c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.293+0000 7f0a6a7fc640 1 -- 172.21.15.60:0/1120346132 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c01e070 con 0x564467111b40 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.293+0000 7f0a6a7fc640 1 -- 172.21.15.60:0/1120346132 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a7c004530 con 0x564467111b40 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.293+0000 7f0a6a7fc640 1 -- 172.21.15.60:0/1120346132 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00fe30 con 0x564467111b40 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.293+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1120346132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 msgr2=0x564467110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.293+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0a6c0a2cf0 0x7f0a6c0a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c01b000 tx=0x7f0a7c019950 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.293+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467110090 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009f50 tx=0x7f0a7c0118d0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1120346132 shutdown_connections 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x56446711d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 0x564467110a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1120346132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467110090 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1120346132 >> 172.21.15.60:0/1120346132 conn(0x5644670d9310 msgr2=0x56446710cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1120346132 shutdown_connections 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1120346132 wait complete. 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 -- start start 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 Processor -- start 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644671105d0 0x56446711ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467117fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.294+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 0x564467118560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56446711e070 con 0x564467111b40 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564467031060 con 0x56446711b370 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56446711e1f0 con 0x5644671105d0 2024-09-12T00:03:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a8cd88740 10 client.0 _ll_register_callbacks cb 0x564466d848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467117fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467117fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50944/0 (socket says 172.21.15.60:50944) 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 -- 172.21.15.60:0/2661529657 learned_addr learned my addr 172.21.15.60:0/2661529657 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 0x564467118560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a83fff640 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644671105d0 0x56446711ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 -- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644671105d0 msgr2=0x56446711ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644671105d0 0x56446711ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 -- 172.21.15.60:0/2661529657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 msgr2=0x564467118560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 0x564467118560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 -- 172.21.15.60:0/2661529657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564466de73c0 con 0x564467111b40 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a83fff640 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644671105d0 0x56446711ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a837fe640 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467117fc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0a840697d0 tx=0x7f0a78031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a824a7d75d4bed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a637fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a637fe640 1 -- 172.21.15.60:0/2661529657 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7803f070 con 0x564467111b40 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a637fe640 1 -- 172.21.15.60:0/2661529657 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f0a78004240 con 0x564467111b40 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.295+0000 7f0a8cd88740 1 -- 172.21.15.60:0/2661529657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a7c004530 con 0x564467111b40 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a637fe640 1 -- 172.21.15.60:0/2661529657 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0a78035070 con 0x564467111b40 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a8cd88740 10 client.16365 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a8cd88740 1 -- 172.21.15.60:0/2661529657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x564467129a30 con 0x564467111b40 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a637fe640 1 -- 172.21.15.60:0/2661529657 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a7c004530 con 0x564467111b40 2024-09-12T00:03:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a637fe640 1 -- 172.21.15.60:0/2661529657 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f0a78004b30 con 0x564467111b40 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a8cd88740 10 client.16365 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a8cd88740 10 client.16365 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a8cd88740 20 client.16365 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56446712af00 0x56446712d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a8cd88740 4 client.16365 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a8cd88740 1 -- 172.21.15.60:0/2661529657 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564467083860 con 0x56446712af00 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.296+0000 7f0a83fff640 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56446712af00 0x56446712d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.297+0000 7f0a637fe640 10 client.16365 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.297+0000 7f0a83fff640 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56446712af00 0x56446712d360 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a9eb39247c6bcf server_cookie=c356843dbcb3dd5 in_seq=0 out_seq=0 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a637fe640 1 -- 172.21.15.60:0/2661529657 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564467083860 con 0x56446712af00 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a637fe640 10 client.16365 handle_command_reply: tid=0 2024-09-12T00:03:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 client.16365 shutdown 2024-09-12T00:03:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 -- 172.21.15.60:0/2661529657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 msgr2=0x564467117fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467117fc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0a840697d0 tx=0x7f0a78031870 comp rx=0 tx=0).stop 2024-09-12T00:03:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 -- 172.21.15.60:0/2661529657 shutdown_connections 2024-09-12T00:03:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56446712af00 0x56446712d360 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 0x564467118560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467117fc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/2661529657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5644671105d0 0x56446711ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 -- 172.21.15.60:0/2661529657 >> 172.21.15.60:0/2661529657 conn(0x5644670d9310 msgr2=0x564467112930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a637fe640 0 client.16365 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:03:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 -- 172.21.15.60:0/2661529657 shutdown_connections 2024-09-12T00:03:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 1 -- 172.21.15.60:0/2661529657 wait complete. 2024-09-12T00:03:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.298+0000 7f0a8cd88740 20 client.16365 trim_cache size 0 max 16384 2024-09-12T00:03:20.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.311+0000 7f0a8cd88740 1 Processor -- start 2024-09-12T00:03:20.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.311+0000 7f0a8cd88740 1 -- start start 2024-09-12T00:03:20.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.311+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 0x564467127310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.311+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467113120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.311+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x564467113660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.311+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841afb20 con 0x564467111b40 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.311+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b1960 con 0x5644671105d0 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.311+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b02b0 con 0x56446711b370 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467113120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467113120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50958/0 (socket says 172.21.15.60:50958) 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 -- 172.21.15.60:0/1069254942 learned_addr learned my addr 172.21.15.60:0/1069254942 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x564467113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a83fff640 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 0x564467127310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 -- 172.21.15.60:0/1069254942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 msgr2=0x564467113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x564467113660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 -- 172.21.15.60:0/1069254942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 msgr2=0x564467127310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 0x564467127310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 -- 172.21.15.60:0/1069254942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446711a930 con 0x564467111b40 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467113120 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0a78031bf0 tx=0x7f0a7802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a661662def884f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a69ffb640 1 -- 172.21.15.60:0/1069254942 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7803f070 con 0x564467111b40 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a69ffb640 1 -- 172.21.15.60:0/1069254942 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a78003910 con 0x564467111b40 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.312+0000 7f0a69ffb640 1 -- 172.21.15.60:0/1069254942 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78003bb0 con 0x564467111b40 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1069254942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 msgr2=0x564467113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467113120 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0a78031bf0 tx=0x7f0a7802a420 comp rx=0 tx=0).stop 2024-09-12T00:03:20.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1069254942 shutdown_connections 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56446711b370 0x564467113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564467111b40 0x564467113120 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1069254942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5644671105d0 0x564467127310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1069254942 >> 172.21.15.60:0/1069254942 conn(0x5644670d9310 msgr2=0x5644671170b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1069254942 shutdown_connections 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.313+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1069254942 wait complete. 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 1 -- start start 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 1 Processor -- start 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644671105d0 0x564467123730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564467111b40 0x564467123c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 0x564467114a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b11d0 con 0x5644671105d0 2024-09-12T00:03:20.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841b0a40 con 0x56446711b370 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841adb00 con 0x564467111b40 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a8cd88740 10 client.0 _ll_register_callbacks cb 0x7f0a7c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644671105d0 0x564467123730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644671105d0 0x564467123730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50972/0 (socket says 172.21.15.60:50972) 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.314+0000 7f0a83fff640 1 -- 172.21.15.60:0/1389170724 learned_addr learned my addr 172.21.15.60:0/1389170724 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564467111b40 0x564467123c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a88f4c640 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 0x564467114a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a83fff640 1 -- 172.21.15.60:0/1389170724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564467111b40 msgr2=0x564467123c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a83fff640 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564467111b40 0x564467123c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a83fff640 1 -- 172.21.15.60:0/1389170724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 msgr2=0x564467114a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a83fff640 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 0x564467114a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a83fff640 1 -- 172.21.15.60:0/1389170724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564467115220 con 0x5644671105d0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a83fff640 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644671105d0 0x564467123730 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0a740058c0 tx=0x7f0a74004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848cf0756fcbf5f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a637fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a637fe640 1 -- 172.21.15.60:0/1389170724 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7401d040 con 0x5644671105d0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a637fe640 1 -- 172.21.15.60:0/1389170724 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f0a740ccb80 con 0x5644671105d0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1389170724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a78003910 con 0x5644671105d0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a637fe640 1 -- 172.21.15.60:0/1389170724 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0a740860b0 con 0x5644671105d0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a8cd88740 10 client.16371 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.315+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1389170724 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x564467195820 con 0x5644671105d0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a637fe640 1 -- 172.21.15.60:0/1389170724 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a78003910 con 0x5644671105d0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a637fe640 1 -- 172.21.15.60:0/1389170724 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f0a74097d40 con 0x5644671105d0 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a8cd88740 10 client.16371 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:20.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a8cd88740 10 client.16371 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a8cd88740 20 client.16371 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564467195f50 0x564467198370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a8cd88740 4 client.16371 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1389170724 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56446707dd70 con 0x564467195f50 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.316+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564467195f50 0x564467198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a837fe640 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564467195f50 0x564467198370 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5e16206d04fe8d9d server_cookie=3d847b19934aa5eb in_seq=0 out_seq=0 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a637fe640 10 client.16371 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a637fe640 1 -- 172.21.15.60:0/1389170724 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56446707dd70 con 0x564467195f50 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a637fe640 10 client.16371 handle_command_reply: tid=0 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 client.16371 shutdown 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1389170724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644671105d0 msgr2=0x564467123730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644671105d0 0x564467123730 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0a740058c0 tx=0x7f0a74004b00 comp rx=0 tx=0).stop 2024-09-12T00:03:20.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1389170724 shutdown_connections 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564467195f50 0x564467198370 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56446711b370 0x564467114a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564467111b40 0x564467123c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a637fe640 0 client.16371 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 --2- 172.21.15.60:0/1389170724 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5644671105d0 0x564467123730 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1389170724 >> 172.21.15.60:0/1389170724 conn(0x5644670d9310 msgr2=0x564467119820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1389170724 shutdown_connections 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.317+0000 7f0a8cd88740 1 -- 172.21.15.60:0/1389170724 wait complete. 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8cd88740 20 client.16371 trim_cache size 0 max 16384 2024-09-12T00:03:20.325 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:20.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 -- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0a6c0a2cf0 msgr2=0x7f0a6c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0a6c0a2cf0 0x7f0a6c0a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c01b000 tx=0x7f0a7c019950 comp rx=0 tx=0).stop 2024-09-12T00:03:20.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 -- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84102d30 msgr2=0x7f0a841a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:20.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84102d30 0x7f0a841a0620 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400c970 tx=0x7f0a7400ce30 comp rx=0 tx=0).stop 2024-09-12T00:03:20.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 -- 172.21.15.60:0/1930563394 shutdown_connections 2024-09-12T00:03:20.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0a6c0a2cf0 0x7f0a6c0a51b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a841082a0 0x7f0a8419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a841036e0 0x7f0a841a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 --2- 172.21.15.60:0/1930563394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a84102d30 0x7f0a841a0620 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:20.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 -- 172.21.15.60:0/1930563394 >> 172.21.15.60:0/1930563394 conn(0x7f0a840fc7d0 msgr2=0x7f0a840fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:20.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 -- 172.21.15.60:0/1930563394 shutdown_connections 2024-09-12T00:03:20.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:20.318+0000 7f0a8a9af640 1 -- 172.21.15.60:0/1930563394 wait complete. 2024-09-12T00:03:21.154 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:03:21.335 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:21 smithi192 ceph-mon[35487]: pgmap v122: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-12T00:03:21.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:21 smithi060 ceph-mon[30953]: pgmap v122: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-12T00:03:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:21 smithi105 ceph-mon[34805]: pgmap v122: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 3.9 KiB/s wr, 14 op/s 2024-09-12T00:03:21.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 -- 172.21.15.60:0/4150419155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 msgr2=0x7f81c41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:21.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/4150419155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 0x7f81c41089f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009900 tx=0x7f81b402a410 comp rx=0 tx=0).stop 2024-09-12T00:03:21.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 -- 172.21.15.60:0/4150419155 shutdown_connections 2024-09-12T00:03:21.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/4150419155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c4109120 0x7f81c4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/4150419155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 0x7f81c41089f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/4150419155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c4103ff0 0x7f81c41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 -- 172.21.15.60:0/4150419155 >> 172.21.15.60:0/4150419155 conn(0x7f81c40ffab0 msgr2=0x7f81c4101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 -- 172.21.15.60:0/4150419155 shutdown_connections 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.965+0000 7f81cc4b9640 1 -- 172.21.15.60:0/4150419155 wait complete. 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.966+0000 7f81cc4b9640 1 Processor -- start 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.966+0000 7f81cc4b9640 1 -- start start 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.966+0000 7f81cc4b9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c4103ff0 0x7f81c419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.966+0000 7f81cc4b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 0x7f81c419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.966+0000 7f81cc4b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c4109120 0x7f81c419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.966+0000 7f81cc4b9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41142a0 con 0x7f81c41049a0 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.966+0000 7f81cc4b9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81c4114120 con 0x7f81c4109120 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.966+0000 7f81cc4b9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f81c4114420 con 0x7f81c4103ff0 2024-09-12T00:03:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 0x7f81c419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 0x7f81c419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41276/0 (socket says 172.21.15.60:41276) 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 -- 172.21.15.60:0/3273050106 learned_addr learned my addr 172.21.15.60:0/3273050106 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81ca255640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c4103ff0 0x7f81c419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81caa56640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c4109120 0x7f81c419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 -- 172.21.15.60:0/3273050106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c4103ff0 msgr2=0x7f81c419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c4103ff0 0x7f81c419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 -- 172.21.15.60:0/3273050106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c4109120 msgr2=0x7f81c419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c4109120 0x7f81c419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 -- 172.21.15.60:0/3273050106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c419f630 con 0x7f81c41049a0 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81c9a54640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 0x7f81c419abc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f81b4006010 tx=0x7f81b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81bb7fe640 1 -- 172.21.15.60:0/3273050106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b403f030 con 0x7f81c41049a0 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81bb7fe640 1 -- 172.21.15.60:0/3273050106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81b4003d00 con 0x7f81c41049a0 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81cc4b9640 1 -- 172.21.15.60:0/3273050106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c419f8c0 con 0x7f81c41049a0 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.967+0000 7f81bb7fe640 1 -- 172.21.15.60:0/3273050106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4035070 con 0x7f81c41049a0 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.968+0000 7f81cc4b9640 1 -- 172.21.15.60:0/3273050106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c41a7200 con 0x7f81c41049a0 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.970+0000 7f81bb7fe640 1 -- 172.21.15.60:0/3273050106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f81b4042030 con 0x7f81c41049a0 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.970+0000 7f81ce892740 1 Processor -- start 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.970+0000 7f81ce892740 1 -- start start 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ce892740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b39090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ce892740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b39a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ce892740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b46760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ce892740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555557a9f2f0 con 0x555557b395d0 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ce892740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555557a46cf0 con 0x555557b44370 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ce892740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555557a9b2b0 con 0x555557b3ab40 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81bb7fe640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f81b00a2d70 0x7f81b00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ca255640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b39a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ca255640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b39a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41288/0 (socket says 172.21.15.60:41288) 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ca255640 1 -- 172.21.15.60:0/4051997723 learned_addr learned my addr 172.21.15.60:0/4051997723 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81c9a54640 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b46760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81caa56640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f81b00a2d70 0x7f81b00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81bb7fe640 1 -- 172.21.15.60:0/3273050106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f81b40ef890 con 0x7f81c41049a0 2024-09-12T00:03:21.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81caa56640 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b39090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ca255640 1 -- 172.21.15.60:0/4051997723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 msgr2=0x555557b39090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ca255640 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b39090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ca255640 1 -- 172.21.15.60:0/4051997723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 msgr2=0x555557b46760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ca255640 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b46760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81ca255640 1 -- 172.21.15.60:0/4051997723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555557a2b3a0 con 0x555557b395d0 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.971+0000 7f81caa56640 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b39090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.972+0000 7f81ca255640 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b39a10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f81c000ad00 tx=0x7f81c000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d55ef21546a258 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.972+0000 7f81caa56640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f81b00a2d70 0x7f81b00a5230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81bc005fd0 tx=0x7f81bc009330 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.972+0000 7f81b8ff9640 1 -- 172.21.15.60:0/4051997723 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c001d070 con 0x555557b395d0 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.972+0000 7f81b8ff9640 1 -- 172.21.15.60:0/4051997723 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81c0018b40 con 0x555557b395d0 2024-09-12T00:03:21.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.972+0000 7f81b8ff9640 1 -- 172.21.15.60:0/4051997723 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0010c60 con 0x555557b395d0 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 -- 172.21.15.60:0/4051997723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 msgr2=0x555557b39a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b39a10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f81c000ad00 tx=0x7f81c000f790 comp rx=0 tx=0).stop 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 -- 172.21.15.60:0/4051997723 shutdown_connections 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b46760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b39a10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 --2- 172.21.15.60:0/4051997723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b39090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 -- 172.21.15.60:0/4051997723 >> 172.21.15.60:0/4051997723 conn(0x555557b02310 msgr2=0x555557b35c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 -- 172.21.15.60:0/4051997723 shutdown_connections 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 -- 172.21.15.60:0/4051997723 wait complete. 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 -- start start 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.973+0000 7f81ce892740 1 Processor -- start 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81ce892740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b395d0 0x555557b43d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81ce892740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b3ab40 0x555557b40ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81ce892740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b44370 0x555557b415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81ce892740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555557b47070 con 0x555557b44370 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81ce892740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555557a5a060 con 0x555557b3ab40 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81ce892740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555557b471f0 con 0x555557b395d0 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81ce892740 10 client.0 _ll_register_callbacks cb 0x5555577ad8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b44370 0x555557b415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b44370 0x555557b415e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41298/0 (socket says 172.21.15.60:41298) 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 -- 172.21.15.60:0/3226788232 learned_addr learned my addr 172.21.15.60:0/3226788232 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81c9a54640 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b3ab40 0x555557b40ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81ca255640 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b395d0 0x555557b43d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 -- 172.21.15.60:0/3226788232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b395d0 msgr2=0x555557b43d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:21.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b395d0 0x555557b43d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 -- 172.21.15.60:0/3226788232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b3ab40 msgr2=0x555557b40ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b3ab40 0x555557b40ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 -- 172.21.15.60:0/3226788232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555578103c0 con 0x555557b44370 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81caa56640 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b44370 0x555557b415e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f81bc003ba0 tx=0x7f81bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf40173f1482c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81adffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.974+0000 7f81adffb640 1 -- 172.21.15.60:0/3226788232 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc024030 con 0x555557b44370 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81adffb640 1 -- 172.21.15.60:0/3226788232 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f81bc004260 con 0x555557b44370 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 1 -- 172.21.15.60:0/3226788232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81c0018b40 con 0x555557b44370 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81adffb640 1 -- 172.21.15.60:0/3226788232 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f81bc02d020 con 0x555557b44370 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 10 client.16383 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 1 -- 172.21.15.60:0/3226788232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x555557b52b40 con 0x555557b44370 2024-09-12T00:03:21.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81adffb640 1 -- 172.21.15.60:0/3226788232 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81c0018b40 con 0x555557b44370 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81adffb640 1 -- 172.21.15.60:0/3226788232 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f81bc01d050 con 0x555557b44370 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 10 client.16383 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 10 client.16383 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 20 client.16383 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555557b54040 0x555557b56500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 4 client.16383 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ce892740 1 -- 172.21.15.60:0/3226788232 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555557aac860 con 0x555557b54040 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.975+0000 7f81ca255640 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555557b54040 0x555557b56500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.976+0000 7f81ca255640 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555557b54040 0x555557b56500 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4bf6ed70d0e2ca2f server_cookie=9eb7224f97814979 in_seq=0 out_seq=0 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.976+0000 7f81adffb640 10 client.16383 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.976+0000 7f81adffb640 1 -- 172.21.15.60:0/3226788232 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555557aac860 con 0x555557b54040 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.976+0000 7f81adffb640 10 client.16383 handle_command_reply: tid=0 2024-09-12T00:03:21.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 client.16383 shutdown 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 -- 172.21.15.60:0/3226788232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b44370 msgr2=0x555557b415e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b44370 0x555557b415e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f81bc003ba0 tx=0x7f81bc004a40 comp rx=0 tx=0).stop 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 -- 172.21.15.60:0/3226788232 shutdown_connections 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555557b54040 0x555557b56500 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81adffb640 0 client.16383 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b44370 0x555557b415e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b3ab40 0x555557b40ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 --2- 172.21.15.60:0/3226788232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b395d0 0x555557b43d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 -- 172.21.15.60:0/3226788232 >> 172.21.15.60:0/3226788232 conn(0x555557b02310 msgr2=0x555557b3b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 -- 172.21.15.60:0/3226788232 shutdown_connections 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 1 -- 172.21.15.60:0/3226788232 wait complete. 2024-09-12T00:03:21.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.977+0000 7f81ce892740 20 client.16383 trim_cache size 0 max 16384 2024-09-12T00:03:22.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.990+0000 7f81ce892740 1 Processor -- start 2024-09-12T00:03:22.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.990+0000 7f81ce892740 1 -- start start 2024-09-12T00:03:22.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.990+0000 7f81ce892740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b50310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:22.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.990+0000 7f81ce892740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b3c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.990+0000 7f81ce892740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ce892740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41af9e0 con 0x555557b395d0 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ce892740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41b1820 con 0x555557b44370 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ce892740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41b0170 con 0x555557b3ab40 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b50310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b50310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41308/0 (socket says 172.21.15.60:41308) 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 -- 172.21.15.60:0/2398797471 learned_addr learned my addr 172.21.15.60:0/2398797471 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81caa56640 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 -- 172.21.15.60:0/2398797471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 msgr2=0x555557b3c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b3c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 -- 172.21.15.60:0/2398797471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 msgr2=0x555557b3c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 -- 172.21.15.60:0/2398797471 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555557b41be0 con 0x555557b395d0 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81caa56640 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81ca255640 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b50310 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f81c000ad00 tx=0x7f81c0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac9785036d1179f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81affff640 1 -- 172.21.15.60:0/2398797471 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0032070 con 0x555557b395d0 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81affff640 1 -- 172.21.15.60:0/2398797471 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81c0010430 con 0x555557b395d0 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.991+0000 7f81affff640 1 -- 172.21.15.60:0/2398797471 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c001d040 con 0x555557b395d0 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 -- 172.21.15.60:0/2398797471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 msgr2=0x555557b50310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b50310 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f81c000ad00 tx=0x7f81c0005e80 comp rx=0 tx=0).stop 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 -- 172.21.15.60:0/2398797471 shutdown_connections 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b3c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 --2- 172.21.15.60:0/2398797471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b50310 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 -- 172.21.15.60:0/2398797471 >> 172.21.15.60:0/2398797471 conn(0x555557b02310 msgr2=0x555557b40100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 -- 172.21.15.60:0/2398797471 shutdown_connections 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.992+0000 7f81ce892740 1 -- 172.21.15.60:0/2398797471 wait complete. 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 1 -- start start 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 1 Processor -- start 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b4cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b3dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41b1090 con 0x555557b395d0 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41b0900 con 0x555557b44370 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f81c41ad9c0 con 0x555557b3ab40 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ce892740 10 client.0 _ll_register_callbacks cb 0x7f81bc009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ca255640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b4cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ca255640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b4cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41312/0 (socket says 172.21.15.60:41312) 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81ca255640 1 -- 172.21.15.60:0/3578456413 learned_addr learned my addr 172.21.15.60:0/3578456413 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81caa56640 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.993+0000 7f81c9a54640 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b3dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ca255640 1 -- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 msgr2=0x555557b3dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ca255640 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b3dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ca255640 1 -- 172.21.15.60:0/3578456413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 msgr2=0x555557b3e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ca255640 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ca255640 1 -- 172.21.15.60:0/3578456413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555557bbdda0 con 0x555557b395d0 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81c9a54640 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b3dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ca255640 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b4cd60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f81c000f7d0 tx=0x7f81c0010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84352c856d28ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:22.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81adffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81adffb640 1 -- 172.21.15.60:0/3578456413 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c003b060 con 0x555557b395d0 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81adffb640 1 -- 172.21.15.60:0/3578456413 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f81c0010cf0 con 0x555557b395d0 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ce892740 1 -- 172.21.15.60:0/3578456413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81c0010430 con 0x555557b395d0 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81adffb640 1 -- 172.21.15.60:0/3578456413 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f81c0032030 con 0x555557b395d0 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ce892740 10 client.16389 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.994+0000 7f81ce892740 1 -- 172.21.15.60:0/3578456413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x555557bbeeb0 con 0x555557b395d0 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81adffb640 1 -- 172.21.15.60:0/3578456413 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f81c0010430 con 0x555557b395d0 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81adffb640 1 -- 172.21.15.60:0/3578456413 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f81c0004660 con 0x555557b395d0 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81ce892740 10 client.16389 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81ce892740 10 client.16389 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81ce892740 20 client.16389 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81ce892740 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555557bbf3b0 0x555557bc17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81ce892740 4 client.16389 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81ce892740 1 -- 172.21.15.60:0/3578456413 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555557aa6d70 con 0x555557bbf3b0 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81c9a54640 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555557bbf3b0 0x555557bc17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81c9a54640 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555557bbf3b0 0x555557bc17d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50ceca7c2d655554 server_cookie=e5e9cca61951d7f4 in_seq=0 out_seq=0 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.995+0000 7f81adffb640 10 client.16389 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81adffb640 1 -- 172.21.15.60:0/3578456413 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555557aa6d70 con 0x555557bbf3b0 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81adffb640 10 client.16389 handle_command_reply: tid=0 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 client.16389 shutdown 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 -- 172.21.15.60:0/3578456413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 msgr2=0x555557b4cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b4cd60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f81c000f7d0 tx=0x7f81c0010a40 comp rx=0 tx=0).stop 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 -- 172.21.15.60:0/3578456413 shutdown_connections 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555557bbf3b0 0x555557bc17d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555557b44370 0x555557b3e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555557b3ab40 0x555557b3dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81adffb640 0 client.16389 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:03:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 --2- 172.21.15.60:0/3578456413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555557b395d0 0x555557b4cd60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 -- 172.21.15.60:0/3578456413 >> 172.21.15.60:0/3578456413 conn(0x555557b02310 msgr2=0x555557b344e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 -- 172.21.15.60:0/3578456413 shutdown_connections 2024-09-12T00:03:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 1 -- 172.21.15.60:0/3578456413 wait complete. 2024-09-12T00:03:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.996+0000 7f81ce892740 20 client.16389 trim_cache size 0 max 16384 2024-09-12T00:03:22.010 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 -- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f81b00a2d70 msgr2=0x7f81b00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f81b00a2d70 0x7f81b00a5230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81bc005fd0 tx=0x7f81bc009330 comp rx=0 tx=0).stop 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 -- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 msgr2=0x7f81c419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 0x7f81c419abc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f81b4006010 tx=0x7f81b40042f0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 -- 172.21.15.60:0/3273050106 shutdown_connections 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f81b00a2d70 0x7f81b00a5230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81c4109120 0x7f81c419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81c41049a0 0x7f81c419abc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 --2- 172.21.15.60:0/3273050106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c4103ff0 0x7f81c419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 -- 172.21.15.60:0/3273050106 >> 172.21.15.60:0/3273050106 conn(0x7f81c40ffab0 msgr2=0x7f81c4100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 -- 172.21.15.60:0/3273050106 shutdown_connections 2024-09-12T00:03:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:21.997+0000 7f81cc4b9640 1 -- 172.21.15.60:0/3273050106 wait complete. 2024-09-12T00:03:22.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:03:23.072 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:23.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:23 smithi060 ceph-mon[30953]: pgmap v123: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T00:03:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:23 smithi105 ceph-mon[34805]: pgmap v123: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T00:03:23.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:23 smithi192 ceph-mon[35487]: pgmap v123: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-12T00:03:23.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 -- 172.21.15.60:0/3249870700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 msgr2=0x7f9d3010bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 --2- 172.21.15.60:0/3249870700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 0x7f9d3010bc00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009900 tx=0x7f9d1802a410 comp rx=0 tx=0).stop 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 -- 172.21.15.60:0/3249870700 shutdown_connections 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 --2- 172.21.15.60:0/3249870700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d3010c2f0 0x7f9d3010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 --2- 172.21.15.60:0/3249870700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 0x7f9d3010bc00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 --2- 172.21.15.60:0/3249870700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d30102df0 0x7f9d301031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 -- 172.21.15.60:0/3249870700 >> 172.21.15.60:0/3249870700 conn(0x7f9d300fc7d0 msgr2=0x7f9d300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 -- 172.21.15.60:0/3249870700 shutdown_connections 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.582+0000 7f9d3667b640 1 -- 172.21.15.60:0/3249870700 wait complete. 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d3667b640 1 Processor -- start 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d3667b640 1 -- start start 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d3667b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d30102df0 0x7f9d301a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d3667b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 0x7f9d301a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d3667b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3010c2f0 0x7f9d3019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d3667b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d30112270 con 0x7f9d301037a0 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d3667b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d301120f0 con 0x7f9d30102df0 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d3667b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d301123f0 con 0x7f9d3010c2f0 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 0x7f9d301a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 0x7f9d301a0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41324/0 (socket says 172.21.15.60:41324) 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d27fff640 1 -- 172.21.15.60:0/2836515800 learned_addr learned my addr 172.21.15.60:0/2836515800 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d30102df0 0x7f9d301a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.583+0000 7f9d34c18640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3010c2f0 0x7f9d3019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d27fff640 1 -- 172.21.15.60:0/2836515800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3010c2f0 msgr2=0x7f9d3019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d27fff640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3010c2f0 0x7f9d3019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d27fff640 1 -- 172.21.15.60:0/2836515800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d30102df0 msgr2=0x7f9d301a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d27fff640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d30102df0 0x7f9d301a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d27fff640 1 -- 172.21.15.60:0/2836515800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3019afc0 con 0x7f9d301037a0 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d34c18640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3010c2f0 0x7f9d3019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d27fff640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 0x7f9d301a0bc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9d18005940 tx=0x7f9d180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d2dffb640 1 -- 172.21.15.60:0/2836515800 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1803f030 con 0x7f9d301037a0 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d2dffb640 1 -- 172.21.15.60:0/2836515800 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d18003d00 con 0x7f9d301037a0 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d3667b640 1 -- 172.21.15.60:0/2836515800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3019b250 con 0x7f9d301037a0 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d2dffb640 1 -- 172.21.15.60:0/2836515800 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18035070 con 0x7f9d301037a0 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.584+0000 7f9d3667b640 1 -- 172.21.15.60:0/2836515800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d301a7430 con 0x7f9d301037a0 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.586+0000 7f9d2dffb640 1 -- 172.21.15.60:0/2836515800 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9d18042030 con 0x7f9d301037a0 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d38a54740 1 Processor -- start 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d38a54740 1 -- start start 2024-09-12T00:03:23.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a2897b40 0x5560a2896090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a28965d0 0x5560a2896a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a28a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d38a54740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5560a27fc2f0 con 0x5560a2897b40 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d38a54740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5560a27a3cf0 con 0x5560a28965d0 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d38a54740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5560a27f82b0 con 0x5560a28a1370 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d34c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a2897b40 0x5560a2896090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d34c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a2897b40 0x5560a2896090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41328/0 (socket says 172.21.15.60:41328) 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d34c18640 1 -- 172.21.15.60:0/486266973 learned_addr learned my addr 172.21.15.60:0/486266973 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a28965d0 0x5560a2896a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d27fff640 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a28a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d34c18640 1 -- 172.21.15.60:0/486266973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 msgr2=0x5560a28a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d34c18640 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a28a3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d34c18640 1 -- 172.21.15.60:0/486266973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a28965d0 msgr2=0x5560a2896a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d34c18640 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a28965d0 0x5560a2896a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d34c18640 1 -- 172.21.15.60:0/486266973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560a27883a0 con 0x5560a2897b40 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d2dffb640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d1c0a2cf0 0x7f9d1c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.587+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a28965d0 0x5560a2896a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.588+0000 7f9d27fff640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d1c0a2cf0 0x7f9d1c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.588+0000 7f9d34c18640 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a2897b40 0x5560a2896090 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9d28008e60 tx=0x7f9d2800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1612064d9a6fd331 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.588+0000 7f9d2dffb640 1 -- 172.21.15.60:0/2836515800 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9d180efd00 con 0x7f9d301037a0 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.588+0000 7f9d267fc640 1 -- 172.21.15.60:0/486266973 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800f830 con 0x5560a2897b40 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.588+0000 7f9d267fc640 1 -- 172.21.15.60:0/486266973 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d28018480 con 0x5560a2897b40 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.588+0000 7f9d267fc640 1 -- 172.21.15.60:0/486266973 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800e610 con 0x5560a2897b40 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 -- 172.21.15.60:0/486266973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a2897b40 msgr2=0x5560a2896090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d27fff640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d1c0a2cf0 0x7f9d1c0a51b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d180ed550 tx=0x7f9d18000bc0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a2897b40 0x5560a2896090 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9d28008e60 tx=0x7f9d2800d710 comp rx=0 tx=0).stop 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 -- 172.21.15.60:0/486266973 shutdown_connections 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a28a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a28965d0 0x5560a2896a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 --2- 172.21.15.60:0/486266973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a2897b40 0x5560a2896090 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 -- 172.21.15.60:0/486266973 >> 172.21.15.60:0/486266973 conn(0x5560a285f310 msgr2=0x5560a2892c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 -- 172.21.15.60:0/486266973 shutdown_connections 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 -- 172.21.15.60:0/486266973 wait complete. 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 -- start start 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.589+0000 7f9d38a54740 1 Processor -- start 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a289e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a289e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d38a54740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5560a28a4070 con 0x5560a28965d0 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d38a54740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5560a27b7060 con 0x5560a2897b40 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d38a54740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5560a28a41f0 con 0x5560a28a1370 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d38a54740 10 client.0 _ll_register_callbacks cb 0x5560a250a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41334/0 (socket says 172.21.15.60:41334) 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 -- 172.21.15.60:0/2781545120 learned_addr learned my addr 172.21.15.60:0/2781545120 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a289e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a289e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 -- 172.21.15.60:0/2781545120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 msgr2=0x5560a289e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a289e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 -- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 msgr2=0x5560a289e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a289e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d34c18640 1 -- 172.21.15.60:0/2781545120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560a256d3c0 con 0x5560a28965d0 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.590+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a289e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d34c18640 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a0d50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9d28018d10 tx=0x7f9d2800dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1c78dffe16e35e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/2781545120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800f830 con 0x5560a28965d0 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/2781545120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9d2800f9d0 con 0x5560a28965d0 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d38a54740 1 -- 172.21.15.60:0/2781545120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d28018480 con 0x5560a28965d0 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/2781545120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9d2800fbd0 con 0x5560a28965d0 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d38a54740 10 client.16401 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:23.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d38a54740 1 -- 172.21.15.60:0/2781545120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5560a28c0b30 con 0x5560a28965d0 2024-09-12T00:03:23.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/2781545120 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d28018480 con 0x5560a28965d0 2024-09-12T00:03:23.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.591+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/2781545120 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f9d28026020 con 0x5560a28965d0 2024-09-12T00:03:23.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d38a54740 10 client.16401 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:23.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d38a54740 10 client.16401 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:03:23.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d38a54740 20 client.16401 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:23.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d38a54740 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5560a28c1f30 0x5560a28c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d38a54740 4 client.16401 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:23.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d38a54740 1 -- 172.21.15.60:0/2781545120 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560a2809860 con 0x5560a28c1f30 2024-09-12T00:03:23.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5560a28c1f30 0x5560a28c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5560a28c1f30 0x5560a28c4320 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d513c2a6b4552454 server_cookie=dc538ea8f22b2a57 in_seq=0 out_seq=0 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.592+0000 7f9d0f7fe640 10 client.16401 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/2781545120 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560a2809860 con 0x5560a28c1f30 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d0f7fe640 10 client.16401 handle_command_reply: tid=0 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 client.16401 shutdown 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 -- 172.21.15.60:0/2781545120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 msgr2=0x5560a28a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a0d50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9d28018d10 tx=0x7f9d2800dee0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 -- 172.21.15.60:0/2781545120 shutdown_connections 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5560a28c1f30 0x5560a28c4320 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d0f7fe640 0 client.16401 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a289e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a289e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 --2- 172.21.15.60:0/2781545120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a0d50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 -- 172.21.15.60:0/2781545120 >> 172.21.15.60:0/2781545120 conn(0x5560a285f310 msgr2=0x5560a2898930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.593+0000 7f9d38a54740 1 -- 172.21.15.60:0/2781545120 shutdown_connections 2024-09-12T00:03:23.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.594+0000 7f9d38a54740 1 -- 172.21.15.60:0/2781545120 wait complete. 2024-09-12T00:03:23.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.594+0000 7f9d38a54740 20 client.16401 trim_cache size 0 max 16384 2024-09-12T00:03:23.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.606+0000 7f9d38a54740 1 Processor -- start 2024-09-12T00:03:23.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.606+0000 7f9d38a54740 1 -- start start 2024-09-12T00:03:23.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28965d0 0x5560a289dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a288dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28a1370 0x5560a2898820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d38a54740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d30074170 con 0x5560a28a1370 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d38a54740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d301a91f0 con 0x5560a2897b40 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d38a54740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d301a7b40 con 0x5560a28965d0 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28a1370 0x5560a2898820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28a1370 0x5560a2898820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41340/0 (socket says 172.21.15.60:41340) 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 -- 172.21.15.60:0/3415207805 learned_addr learned my addr 172.21.15.60:0/3415207805 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a288dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28965d0 0x5560a289dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 -- 172.21.15.60:0/3415207805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28965d0 msgr2=0x5560a289dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28965d0 0x5560a289dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 -- 172.21.15.60:0/3415207805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 msgr2=0x5560a288dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a288dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 -- 172.21.15.60:0/3415207805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560a28a10c0 con 0x5560a28a1370 2024-09-12T00:03:23.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d34c18640 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28a1370 0x5560a2898820 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9d28005fa0 tx=0x7f9d2801b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b51701731f744f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.607+0000 7f9d25ffb640 1 -- 172.21.15.60:0/3415207805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28018480 con 0x5560a28a1370 2024-09-12T00:03:23.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d25ffb640 1 -- 172.21.15.60:0/3415207805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d2801d030 con 0x5560a28a1370 2024-09-12T00:03:23.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d25ffb640 1 -- 172.21.15.60:0/3415207805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800be50 con 0x5560a28a1370 2024-09-12T00:03:23.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 -- 172.21.15.60:0/3415207805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28a1370 msgr2=0x5560a2898820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28a1370 0x5560a2898820 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9d28005fa0 tx=0x7f9d2801b040 comp rx=0 tx=0).stop 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 -- 172.21.15.60:0/3415207805 shutdown_connections 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28a1370 0x5560a2898820 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a288dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 --2- 172.21.15.60:0/3415207805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28965d0 0x5560a289dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 -- 172.21.15.60:0/3415207805 >> 172.21.15.60:0/3415207805 conn(0x5560a285f310 msgr2=0x5560a2898110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 -- 172.21.15.60:0/3415207805 shutdown_connections 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 -- 172.21.15.60:0/3415207805 wait complete. 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.608+0000 7f9d38a54740 1 -- start start 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d38a54740 1 Processor -- start 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a28a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d38a54740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a292a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d38a54740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d301a8a60 con 0x5560a28965d0 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d38a54740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d301a82d0 con 0x5560a2897b40 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d38a54740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3019bc80 con 0x5560a28a1370 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d38a54740 10 client.0 _ll_register_callbacks cb 0x7f9d200093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d34c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d34c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41352/0 (socket says 172.21.15.60:41352) 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d34c18640 1 -- 172.21.15.60:0/1273889974 learned_addr learned my addr 172.21.15.60:0/1273889974 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a28a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d34c18640 1 -- 172.21.15.60:0/1273889974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 msgr2=0x5560a292a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d34c18640 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a292a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d34c18640 1 -- 172.21.15.60:0/1273889974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 msgr2=0x5560a28a4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d34c18640 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a28a4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.609+0000 7f9d34c18640 1 -- 172.21.15.60:0/1273889974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560a292af30 con 0x5560a28965d0 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d34c18640 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a4a10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9d28018ca0 tx=0x7f9d2800b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbfb7da88840ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/1273889974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28018480 con 0x5560a28965d0 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/1273889974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9d2800f630 con 0x5560a28965d0 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 1 -- 172.21.15.60:0/1273889974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d2801d030 con 0x5560a28965d0 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/1273889974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9d28048050 con 0x5560a28965d0 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 10 client.16407 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:23.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 1 -- 172.21.15.60:0/1273889974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5560a292c210 con 0x5560a28965d0 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/1273889974 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d2801d030 con 0x5560a28965d0 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/1273889974 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f9d28026070 con 0x5560a28965d0 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 10 client.16407 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 10 client.16407 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 20 client.16407 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5560a28c1f30 0x5560a292e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 4 client.16407 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.610+0000 7f9d38a54740 1 -- 172.21.15.60:0/1273889974 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560a2803d70 con 0x5560a28c1f30 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.611+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5560a28c1f30 0x5560a292e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.611+0000 7f9d2ffff640 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5560a28c1f30 0x5560a292e8e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77d0e40d071655e7 server_cookie=8b8dad78d6bb6aab in_seq=0 out_seq=0 2024-09-12T00:03:23.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.611+0000 7f9d0f7fe640 10 client.16407 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.611+0000 7f9d0f7fe640 1 -- 172.21.15.60:0/1273889974 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560a2803d70 con 0x5560a28c1f30 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.611+0000 7f9d0f7fe640 10 client.16407 handle_command_reply: tid=0 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.611+0000 7f9d38a54740 1 client.16407 shutdown 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 -- 172.21.15.60:0/1273889974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 msgr2=0x5560a28a4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a4a10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9d28018ca0 tx=0x7f9d2800b440 comp rx=0 tx=0).stop 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 -- 172.21.15.60:0/1273889974 shutdown_connections 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5560a28c1f30 0x5560a292e8e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5560a28a1370 0x5560a292a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d0f7fe640 0 client.16407 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:03:23.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560a2897b40 0x5560a28a4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 --2- 172.21.15.60:0/1273889974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5560a28965d0 0x5560a28a4a10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 -- 172.21.15.60:0/1273889974 >> 172.21.15.60:0/1273889974 conn(0x5560a285f310 msgr2=0x5560a2898110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 -- 172.21.15.60:0/1273889974 shutdown_connections 2024-09-12T00:03:23.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 1 -- 172.21.15.60:0/1273889974 wait complete. 2024-09-12T00:03:23.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.612+0000 7f9d38a54740 20 client.16407 trim_cache size 0 max 16384 2024-09-12T00:03:23.618 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 -- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d1c0a2cf0 msgr2=0x7f9d1c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d1c0a2cf0 0x7f9d1c0a51b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d180ed550 tx=0x7f9d18000bc0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 -- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 msgr2=0x7f9d301a0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 0x7f9d301a0bc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9d18005940 tx=0x7f9d180042f0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 -- 172.21.15.60:0/2836515800 shutdown_connections 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9d1c0a2cf0 0x7f9d1c0a51b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d3010c2f0 0x7f9d3019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d301037a0 0x7f9d301a0bc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 --2- 172.21.15.60:0/2836515800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d30102df0 0x7f9d301a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:23.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 -- 172.21.15.60:0/2836515800 >> 172.21.15.60:0/2836515800 conn(0x7f9d300fc7d0 msgr2=0x7f9d300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:23.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 -- 172.21.15.60:0/2836515800 shutdown_connections 2024-09-12T00:03:23.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:23.613+0000 7f9d3667b640 1 -- 172.21.15.60:0/2836515800 wait complete. 2024-09-12T00:03:24.408 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:03:24.668 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 -- 172.21.15.60:0/2966024702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 msgr2=0x7fc66c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 --2- 172.21.15.60:0/2966024702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 0x7fc66c10da40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc664009ca0 tx=0x7fc66402a950 comp rx=0 tx=0).stop 2024-09-12T00:03:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 -- 172.21.15.60:0/2966024702 shutdown_connections 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 --2- 172.21.15.60:0/2966024702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 0x7fc66c10da40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 --2- 172.21.15.60:0/2966024702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66c102570 0x7fc66c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 --2- 172.21.15.60:0/2966024702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc66c100e20 0x7fc66c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 -- 172.21.15.60:0/2966024702 >> 172.21.15.60:0/2966024702 conn(0x7fc66c0fc7d0 msgr2=0x7fc66c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 -- 172.21.15.60:0/2966024702 shutdown_connections 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.150+0000 7fc6710eb640 1 -- 172.21.15.60:0/2966024702 wait complete. 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.151+0000 7fc6710eb640 1 Processor -- start 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.151+0000 7fc6710eb640 1 -- start start 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.151+0000 7fc6710eb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc66c100e20 0x7fc66c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.151+0000 7fc6710eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66c102570 0x7fc66c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.151+0000 7fc6710eb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 0x7fc66c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.151+0000 7fc6710eb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1110a0 con 0x7fc66c102ef0 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.151+0000 7fc6710eb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c110f20 con 0x7fc66c102570 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.151+0000 7fc6710eb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c111220 con 0x7fc66c100e20 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 0x7fc66c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 0x7fc66c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41378/0 (socket says 172.21.15.60:41378) 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 -- 172.21.15.60:0/1828414409 learned_addr learned my addr 172.21.15.60:0/1828414409 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66ad9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc66c100e20 0x7fc66c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc663fff640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66c102570 0x7fc66c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 -- 172.21.15.60:0/1828414409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc66c100e20 msgr2=0x7fc66c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc66c100e20 0x7fc66c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 -- 172.21.15.60:0/1828414409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66c102570 msgr2=0x7fc66c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66c102570 0x7fc66c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 -- 172.21.15.60:0/1828414409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c1a6a80 con 0x7fc66c102ef0 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc663fff640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66c102570 0x7fc66c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc66b59e640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 0x7fc66c0fd700 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc664005cc0 tx=0x7fc66402f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc668d99640 1 -- 172.21.15.60:0/1828414409 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664034040 con 0x7fc66c102ef0 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc6710eb640 1 -- 172.21.15.60:0/1828414409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c1a6d10 con 0x7fc66c102ef0 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc668d99640 1 -- 172.21.15.60:0/1828414409 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc664030940 con 0x7fc66c102ef0 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc668d99640 1 -- 172.21.15.60:0/1828414409 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6640456e0 con 0x7fc66c102ef0 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.152+0000 7fc6710eb640 1 -- 172.21.15.60:0/1828414409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c1a71f0 con 0x7fc66c102ef0 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc668d99640 1 -- 172.21.15.60:0/1828414409 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc664037020 con 0x7fc66c102ef0 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc6734c4740 1 Processor -- start 2024-09-12T00:03:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc6734c4740 1 -- start start 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 0x556aae372090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae3725d0 0x556aae372a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae37d370 0x556aae37f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc6734c4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556aae2d82f0 con 0x556aae37d370 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc6734c4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556aae27fcf0 con 0x556aae3725d0 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.155+0000 7fc6734c4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556aae2d42b0 con 0x556aae373b40 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc668d99640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc6580a2cf0 0x7fc6580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc663fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae37d370 0x556aae37f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc663fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae37d370 0x556aae37f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41392/0 (socket says 172.21.15.60:41392) 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae3725d0 0x556aae372a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc663fff640 1 -- 172.21.15.60:0/1869003248 learned_addr learned my addr 172.21.15.60:0/1869003248 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66b59e640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc6580a2cf0 0x7fc6580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc663fff640 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 0x556aae372090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc668d99640 1 -- 172.21.15.60:0/1828414409 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc6640f0310 con 0x7fc66c102ef0 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66ad9d640 1 -- 172.21.15.60:0/1869003248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 msgr2=0x556aae372090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 0x556aae372090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66ad9d640 1 -- 172.21.15.60:0/1869003248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae37d370 msgr2=0x556aae37f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae37d370 0x556aae37f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66ad9d640 1 -- 172.21.15.60:0/1869003248 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aae2643a0 con 0x556aae3725d0 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc663fff640 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 0x556aae372090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66b59e640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc6580a2cf0 0x7fc6580a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6640b8df0 tx=0x7fc664004530 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.156+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae3725d0 0x556aae372a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00bbf0 tx=0x7fc65c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec2f26cc6688dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6617fa640 1 -- 172.21.15.60:0/1869003248 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c004030 con 0x556aae3725d0 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6617fa640 1 -- 172.21.15.60:0/1869003248 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc65c0041d0 con 0x556aae3725d0 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6617fa640 1 -- 172.21.15.60:0/1869003248 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c011800 con 0x556aae3725d0 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 -- 172.21.15.60:0/1869003248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae3725d0 msgr2=0x556aae372a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae3725d0 0x556aae372a10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00bbf0 tx=0x7fc65c0107a0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 -- 172.21.15.60:0/1869003248 shutdown_connections 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae37d370 0x556aae37f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae3725d0 0x556aae372a10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 --2- 172.21.15.60:0/1869003248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 0x556aae372090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 -- 172.21.15.60:0/1869003248 >> 172.21.15.60:0/1869003248 conn(0x556aae33b310 msgr2=0x556aae36ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 -- 172.21.15.60:0/1869003248 shutdown_connections 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.157+0000 7fc6734c4740 1 -- 172.21.15.60:0/1869003248 wait complete. 2024-09-12T00:03:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 1 -- start start 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 1 Processor -- start 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae37cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae379fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 0x556aae37a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556aae380070 con 0x556aae3725d0 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556aae293060 con 0x556aae373b40 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556aae3801f0 con 0x556aae37d370 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc6734c4740 10 client.0 _ll_register_callbacks cb 0x556aadfe68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc663fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae37cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc663fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae37cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41398/0 (socket says 172.21.15.60:41398) 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.158+0000 7fc663fff640 1 -- 172.21.15.60:0/3916277922 learned_addr learned my addr 172.21.15.60:0/3916277922 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae379fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc663fff640 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 0x556aae37a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc663fff640 1 -- 172.21.15.60:0/3916277922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 msgr2=0x556aae37a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc663fff640 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 0x556aae37a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc663fff640 1 -- 172.21.15.60:0/3916277922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 msgr2=0x556aae379fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc663fff640 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae379fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc663fff640 1 -- 172.21.15.60:0/3916277922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aae0493c0 con 0x556aae3725d0 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae379fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc663fff640 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae37cd20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc654013800 tx=0x7fc65400b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbe7f7f4a4f787e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc6527fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc6527fc640 1 -- 172.21.15.60:0/3916277922 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654010ce0 con 0x556aae3725d0 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc6527fc640 1 -- 172.21.15.60:0/3916277922 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc654005020 con 0x556aae3725d0 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc6734c4740 1 -- 172.21.15.60:0/3916277922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc65c0041d0 con 0x556aae3725d0 2024-09-12T00:03:25.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc6527fc640 1 -- 172.21.15.60:0/3916277922 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc654022030 con 0x556aae3725d0 2024-09-12T00:03:25.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc6734c4740 10 client.16419 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:25.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.159+0000 7fc6734c4740 1 -- 172.21.15.60:0/3916277922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556aae38baf0 con 0x556aae3725d0 2024-09-12T00:03:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc6527fc640 1 -- 172.21.15.60:0/3916277922 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc65c0041d0 con 0x556aae3725d0 2024-09-12T00:03:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc6527fc640 1 -- 172.21.15.60:0/3916277922 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fc65400f040 con 0x556aae3725d0 2024-09-12T00:03:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc6734c4740 10 client.16419 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc6734c4740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc6734c4740 20 client.16419 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556aae38d080 0x556aae38f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc6734c4740 4 client.16419 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc6734c4740 1 -- 172.21.15.60:0/3916277922 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aae2e5860 con 0x556aae38d080 2024-09-12T00:03:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.160+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556aae38d080 0x556aae38f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.161+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556aae38d080 0x556aae38f4e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=294ebbf8baf32d00 server_cookie=3fe983ed78037002 in_seq=0 out_seq=0 2024-09-12T00:03:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.161+0000 7fc6527fc640 10 client.16419 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6527fc640 1 -- 172.21.15.60:0/3916277922 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556aae2e5860 con 0x556aae38d080 2024-09-12T00:03:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6527fc640 10 client.16419 handle_command_reply: tid=0 2024-09-12T00:03:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 client.16419 shutdown 2024-09-12T00:03:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 -- 172.21.15.60:0/3916277922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 msgr2=0x556aae37cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae37cd20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc654013800 tx=0x7fc65400b3c0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 -- 172.21.15.60:0/3916277922 shutdown_connections 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556aae38d080 0x556aae38f4e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6527fc640 0 client.16419 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 0x556aae37a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae379fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3916277922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae37cd20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 -- 172.21.15.60:0/3916277922 >> 172.21.15.60:0/3916277922 conn(0x556aae33b310 msgr2=0x556aae374960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 -- 172.21.15.60:0/3916277922 shutdown_connections 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 1 -- 172.21.15.60:0/3916277922 wait complete. 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.162+0000 7fc6734c4740 20 client.16419 trim_cache size 0 max 16384 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.175+0000 7fc6734c4740 1 Processor -- start 2024-09-12T00:03:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.175+0000 7fc6734c4740 1 -- start start 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.175+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae389340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.175+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 0x556aae375120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.175+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae37d370 0x556aae375660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.175+0000 7fc6734c4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1af9b0 con 0x556aae3725d0 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.175+0000 7fc6734c4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b17f0 con 0x556aae37d370 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.175+0000 7fc6734c4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b0140 con 0x556aae373b40 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae389340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae389340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41406/0 (socket says 172.21.15.60:41406) 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 -- 172.21.15.60:0/4275299228 learned_addr learned my addr 172.21.15.60:0/4275299228 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 -- 172.21.15.60:0/4275299228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 msgr2=0x556aae375120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 --2- 172.21.15.60:0/4275299228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 0x556aae375120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 -- 172.21.15.60:0/4275299228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae37d370 msgr2=0x556aae375660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 --2- 172.21.15.60:0/4275299228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae37d370 0x556aae375660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 -- 172.21.15.60:0/4275299228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aae3733a0 con 0x556aae3725d0 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc663fff640 1 --2- 172.21.15.60:0/4275299228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae389340 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc654004950 tx=0x7fc65400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8816db1d08f3a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc660ff9640 1 -- 172.21.15.60:0/4275299228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654010ae0 con 0x556aae3725d0 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc660ff9640 1 -- 172.21.15.60:0/4275299228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc65402b070 con 0x556aae3725d0 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.176+0000 7fc660ff9640 1 -- 172.21.15.60:0/4275299228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654003850 con 0x556aae3725d0 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 -- 172.21.15.60:0/4275299228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 msgr2=0x556aae389340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 --2- 172.21.15.60:0/4275299228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae389340 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc654004950 tx=0x7fc65400bce0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 -- 172.21.15.60:0/4275299228 shutdown_connections 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 --2- 172.21.15.60:0/4275299228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae37d370 0x556aae375660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 --2- 172.21.15.60:0/4275299228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae373b40 0x556aae375120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 --2- 172.21.15.60:0/4275299228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae389340 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 -- 172.21.15.60:0/4275299228 >> 172.21.15.60:0/4275299228 conn(0x556aae33b310 msgr2=0x556aae37f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 -- 172.21.15.60:0/4275299228 shutdown_connections 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 -- 172.21.15.60:0/4275299228 wait complete. 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 -- start start 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.177+0000 7fc6734c4740 1 Processor -- start 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae3770e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae377620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6734c4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 0x556aae377b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6734c4740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b1060 con 0x556aae3725d0 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6734c4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1b08d0 con 0x556aae373b40 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6734c4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1ad9b0 con 0x556aae37d370 2024-09-12T00:03:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6734c4740 10 client.0 _ll_register_callbacks cb 0x7fc65400b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae3770e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae3770e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41408/0 (socket says 172.21.15.60:41408) 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 -- 172.21.15.60:0/3453742646 learned_addr learned my addr 172.21.15.60:0/3453742646 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae377620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 -- 172.21.15.60:0/3453742646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 msgr2=0x556aae377b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 0x556aae377b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 -- 172.21.15.60:0/3453742646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 msgr2=0x556aae377620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae377620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 -- 172.21.15.60:0/3453742646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aae383c00 con 0x556aae3725d0 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc663fff640 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae3770e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc654004470 tx=0x7fc654004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223d751758af4411 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6527fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6527fc640 1 -- 172.21.15.60:0/3453742646 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65400ba40 con 0x556aae3725d0 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6734c4740 1 -- 172.21.15.60:0/3453742646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc65402b070 con 0x556aae3725d0 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.178+0000 7fc6527fc640 1 -- 172.21.15.60:0/3453742646 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc654010ae0 con 0x556aae3725d0 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6527fc640 1 -- 172.21.15.60:0/3453742646 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc65403d020 con 0x556aae3725d0 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6734c4740 10 client.16425 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6734c4740 1 -- 172.21.15.60:0/3453742646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556aae3f8150 con 0x556aae3725d0 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6527fc640 1 -- 172.21.15.60:0/3453742646 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc65402b070 con 0x556aae3725d0 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6527fc640 1 -- 172.21.15.60:0/3453742646 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fc654003c40 con 0x556aae3725d0 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6734c4740 10 client.16425 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6734c4740 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6734c4740 20 client.16425 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556aae38d080 0x556aae3fa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6734c4740 4 client.16425 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc6734c4740 1 -- 172.21.15.60:0/3453742646 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556aae2dfd70 con 0x556aae38d080 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.179+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556aae38d080 0x556aae3fa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc66ad9d640 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556aae38d080 0x556aae3fa8d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b490910cac061984 server_cookie=15d6c4633696149 in_seq=0 out_seq=0 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6527fc640 10 client.16425 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6527fc640 1 -- 172.21.15.60:0/3453742646 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556aae2dfd70 con 0x556aae38d080 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6527fc640 10 client.16425 handle_command_reply: tid=0 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 client.16425 shutdown 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 -- 172.21.15.60:0/3453742646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 msgr2=0x556aae3770e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae3770e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc654004470 tx=0x7fc654004510 comp rx=0 tx=0).stop 2024-09-12T00:03:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 -- 172.21.15.60:0/3453742646 shutdown_connections 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556aae38d080 0x556aae3fa8d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aae37d370 0x556aae377b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aae373b40 0x556aae377620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6527fc640 0 client.16425 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 --2- 172.21.15.60:0/3453742646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aae3725d0 0x556aae3770e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 -- 172.21.15.60:0/3453742646 >> 172.21.15.60:0/3453742646 conn(0x556aae33b310 msgr2=0x556aae36dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 -- 172.21.15.60:0/3453742646 shutdown_connections 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 1 -- 172.21.15.60:0/3453742646 wait complete. 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.180+0000 7fc6734c4740 20 client.16425 trim_cache size 0 max 16384 2024-09-12T00:03:25.188 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 -- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc6580a2cf0 msgr2=0x7fc6580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc6580a2cf0 0x7fc6580a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6640b8df0 tx=0x7fc664004530 comp rx=0 tx=0).stop 2024-09-12T00:03:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 -- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 msgr2=0x7fc66c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 0x7fc66c0fd700 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fc664005cc0 tx=0x7fc66402f790 comp rx=0 tx=0).stop 2024-09-12T00:03:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 -- 172.21.15.60:0/1828414409 shutdown_connections 2024-09-12T00:03:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc6580a2cf0 0x7fc6580a51b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc66c102ef0 0x7fc66c0fd700 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66c102570 0x7fc66c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 --2- 172.21.15.60:0/1828414409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc66c100e20 0x7fc66c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 -- 172.21.15.60:0/1828414409 >> 172.21.15.60:0/1828414409 conn(0x7fc66c0fc7d0 msgr2=0x7fc66c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 -- 172.21.15.60:0/1828414409 shutdown_connections 2024-09-12T00:03:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:25.181+0000 7fc6710eb640 1 -- 172.21.15.60:0/1828414409 wait complete. 2024-09-12T00:03:25.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:25 smithi060 ceph-mon[30953]: pgmap v124: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-12T00:03:25.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:25 smithi105 ceph-mon[34805]: pgmap v124: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-12T00:03:25.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:25 smithi192 ceph-mon[35487]: pgmap v124: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-12T00:03:27.016 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:03:27.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:03:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:27.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:27 smithi060 ceph-mon[30953]: pgmap v125: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T00:03:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:27 smithi105 ceph-mon[34805]: pgmap v125: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T00:03:27.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:27 smithi192 ceph-mon[35487]: pgmap v125: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T00:03:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 -- 172.21.15.60:0/1907097303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 msgr2=0x7f7af41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 --2- 172.21.15.60:0/1907097303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 0x7f7af41031d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009900 tx=0x7f7ae402a410 comp rx=0 tx=0).stop 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 -- 172.21.15.60:0/1907097303 shutdown_connections 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 --2- 172.21.15.60:0/1907097303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af410c2f0 0x7f7af410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 --2- 172.21.15.60:0/1907097303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7af41037a0 0x7f7af410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 --2- 172.21.15.60:0/1907097303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 0x7f7af41031d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 -- 172.21.15.60:0/1907097303 >> 172.21.15.60:0/1907097303 conn(0x7f7af40fc7d0 msgr2=0x7f7af40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 -- 172.21.15.60:0/1907097303 shutdown_connections 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.763+0000 7f7afa847640 1 -- 172.21.15.60:0/1907097303 wait complete. 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7afa847640 1 Processor -- start 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7afa847640 1 -- start start 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7afa847640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 0x7f7af41a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7afa847640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af41037a0 0x7f7af41a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7afa847640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7af410c2f0 0x7f7af419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7afa847640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7af4114430 con 0x7f7af4102df0 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7afa847640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41142b0 con 0x7f7af410c2f0 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7afa847640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41145b0 con 0x7f7af41037a0 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7af3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 0x7f7af41a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7af3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 0x7f7af41a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41426/0 (socket says 172.21.15.60:41426) 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7af3fff640 1 -- 172.21.15.60:0/3391699745 learned_addr learned my addr 172.21.15.60:0/3391699745 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7aebfff640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af41037a0 0x7f7af41a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.764+0000 7f7af8de4640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7af410c2f0 0x7f7af419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af3fff640 1 -- 172.21.15.60:0/3391699745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af41037a0 msgr2=0x7f7af41a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af3fff640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af41037a0 0x7f7af41a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af3fff640 1 -- 172.21.15.60:0/3391699745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7af410c2f0 msgr2=0x7f7af419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af3fff640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7af410c2f0 0x7f7af419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af3fff640 1 -- 172.21.15.60:0/3391699745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af419af70 con 0x7f7af4102df0 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af8de4640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7af410c2f0 0x7f7af419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af3fff640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 0x7f7af41a0630 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4006010 tx=0x7f7ae40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af1ffb640 1 -- 172.21.15.60:0/3391699745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae403f030 con 0x7f7af4102df0 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af1ffb640 1 -- 172.21.15.60:0/3391699745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ae4003d00 con 0x7f7af4102df0 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7afa847640 1 -- 172.21.15.60:0/3391699745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af419b200 con 0x7f7af4102df0 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7af1ffb640 1 -- 172.21.15.60:0/3391699745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4035070 con 0x7f7af4102df0 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.765+0000 7f7afa847640 1 -- 172.21.15.60:0/3391699745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af41a73e0 con 0x7f7af4102df0 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.767+0000 7f7af1ffb640 1 -- 172.21.15.60:0/3391699745 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7ae4042030 con 0x7f7af4102df0 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.767+0000 7f7afcc20740 1 Processor -- start 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7afcc20740 1 -- start start 2024-09-12T00:03:27.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea64f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea65480 0x56005ea6f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea6fd40 0x56005ea72130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7afcc20740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56005e9ca280 con 0x56005ea64b60 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7afcc20740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56005e971b10 con 0x56005ea6fd40 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7afcc20740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56005e9c6240 con 0x56005ea65480 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea64f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea64f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41438/0 (socket says 172.21.15.60:41438) 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 -- 172.21.15.60:0/2257664938 learned_addr learned my addr 172.21.15.60:0/2257664938 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af1ffb640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7ae00a2cf0 0x7f7ae00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af3fff640 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea65480 0x56005ea6f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7aebfff640 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea6fd40 0x56005ea72130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7ae00a2cf0 0x7f7ae00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 -- 172.21.15.60:0/2257664938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea65480 msgr2=0x56005ea6f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea65480 0x56005ea6f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 -- 172.21.15.60:0/2257664938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea6fd40 msgr2=0x56005ea72130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea6fd40 0x56005ea72130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af8de4640 1 -- 172.21.15.60:0/2257664938 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005e97e1f0 con 0x56005ea64b60 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.768+0000 7f7af1ffb640 1 -- 172.21.15.60:0/3391699745 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7ae40efac0 con 0x7f7af4102df0 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.769+0000 7f7af8de4640 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea64f40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7aec013910 tx=0x7f7aec013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e94ad816be7f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.769+0000 7f7aea7fc640 1 -- 172.21.15.60:0/2257664938 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec004b20 con 0x56005ea64b60 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.769+0000 7f7aea7fc640 1 -- 172.21.15.60:0/2257664938 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7aec004cc0 con 0x56005ea64b60 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.769+0000 7f7aea7fc640 1 -- 172.21.15.60:0/2257664938 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec01d640 con 0x56005ea64b60 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 -- 172.21.15.60:0/2257664938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 msgr2=0x56005ea64f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7af8de4640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7ae00a2cf0 0x7f7ae00a51b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7aec020000 tx=0x7f7aec01f000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:27.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea64f40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7aec013910 tx=0x7f7aec013dd0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 -- 172.21.15.60:0/2257664938 shutdown_connections 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea6fd40 0x56005ea72130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea65480 0x56005ea6f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2257664938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea64f40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 -- 172.21.15.60:0/2257664938 >> 172.21.15.60:0/2257664938 conn(0x56005ea610f0 msgr2=0x56005ea614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 -- 172.21.15.60:0/2257664938 shutdown_connections 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 -- 172.21.15.60:0/2257664938 wait complete. 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 -- start start 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.770+0000 7f7afcc20740 1 Processor -- start 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea64b60 0x56005ea6cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 0x56005ea6d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea6fd40 0x56005ea6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7afcc20740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56005ea72910 con 0x56005ea6fd40 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7afcc20740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56005e984f10 con 0x56005ea65480 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7afcc20740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56005ea72a90 con 0x56005ea64b60 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7afcc20740 10 client.0 _ll_register_callbacks cb 0x56005e94da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea6fd40 0x56005ea6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea6fd40 0x56005ea6d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41440/0 (socket says 172.21.15.60:41440) 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 -- 172.21.15.60:0/2904015903 learned_addr learned my addr 172.21.15.60:0/2904015903 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af3fff640 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea64b60 0x56005ea6cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7aebfff640 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 0x56005ea6d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 -- 172.21.15.60:0/2904015903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea64b60 msgr2=0x56005ea6cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea64b60 0x56005ea6cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 -- 172.21.15.60:0/2904015903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 msgr2=0x56005ea6d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 0x56005ea6d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 -- 172.21.15.60:0/2904015903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56005e73b6a0 con 0x56005ea6fd40 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7af8de4640 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea6fd40 0x56005ea6d670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009560 tx=0x7f7aec011880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8789aa6ea03e9de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7ad37fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7ad37fe640 1 -- 172.21.15.60:0/2904015903 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aec035060 con 0x56005ea6fd40 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7ad37fe640 1 -- 172.21.15.60:0/2904015903 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7aec0049e0 con 0x56005ea6fd40 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.771+0000 7f7afcc20740 1 -- 172.21.15.60:0/2904015903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aec004cc0 con 0x56005ea6fd40 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7ad37fe640 1 -- 172.21.15.60:0/2904015903 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7aec02c040 con 0x56005ea6fd40 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7afcc20740 10 client.16437 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7afcc20740 1 -- 172.21.15.60:0/2904015903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56005ea7e510 con 0x56005ea6fd40 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7ad37fe640 1 -- 172.21.15.60:0/2904015903 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7aec004cc0 con 0x56005ea6fd40 2024-09-12T00:03:27.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7ad37fe640 1 -- 172.21.15.60:0/2904015903 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f7aec026470 con 0x56005ea6fd40 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7afcc20740 10 client.16437 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7afcc20740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7afcc20740 20 client.16437 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56005ea7f860 0x56005ea81c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7afcc20740 4 client.16437 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7afcc20740 1 -- 172.21.15.60:0/2904015903 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56005e9d77f0 con 0x56005ea7f860 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.772+0000 7f7af3fff640 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56005ea7f860 0x56005ea81c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.773+0000 7f7af3fff640 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56005ea7f860 0x56005ea81c50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b627d8e70b85afcf server_cookie=845dac5bb248f844 in_seq=0 out_seq=0 2024-09-12T00:03:27.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.773+0000 7f7ad37fe640 10 client.16437 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.773+0000 7f7ad37fe640 1 -- 172.21.15.60:0/2904015903 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56005e9d77f0 con 0x56005ea7f860 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.773+0000 7f7ad37fe640 10 client.16437 handle_command_reply: tid=0 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 client.16437 shutdown 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 -- 172.21.15.60:0/2904015903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea6fd40 msgr2=0x56005ea6d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea6fd40 0x56005ea6d670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009560 tx=0x7f7aec011880 comp rx=0 tx=0).stop 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 -- 172.21.15.60:0/2904015903 shutdown_connections 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56005ea7f860 0x56005ea81c50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea6fd40 0x56005ea6d670 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7ad37fe640 0 client.16437 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:27.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 0x56005ea6d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 --2- 172.21.15.60:0/2904015903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea64b60 0x56005ea6cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 -- 172.21.15.60:0/2904015903 >> 172.21.15.60:0/2904015903 conn(0x56005ea610f0 msgr2=0x56005ea60270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 -- 172.21.15.60:0/2904015903 shutdown_connections 2024-09-12T00:03:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 1 -- 172.21.15.60:0/2904015903 wait complete. 2024-09-12T00:03:27.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.774+0000 7f7afcc20740 20 client.16437 trim_cache size 0 max 16384 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.791+0000 7f7afcc20740 1 Processor -- start 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.791+0000 7f7afcc20740 1 -- start start 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea64b60 0x56005ea675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea65480 0x56005ea87310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 0x56005ea87850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7afcc20740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41afad0 con 0x56005ea65480 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7afcc20740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41b1910 con 0x56005ea64b60 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7afcc20740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41b0260 con 0x56005ea6fd40 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea65480 0x56005ea87310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea65480 0x56005ea87310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41444/0 (socket says 172.21.15.60:41444) 2024-09-12T00:03:27.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 -- 172.21.15.60:0/3247389186 learned_addr learned my addr 172.21.15.60:0/3247389186 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:27.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7af3fff640 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea64b60 0x56005ea675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7af8de4640 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 0x56005ea87850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 -- 172.21.15.60:0/3247389186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 msgr2=0x56005ea87850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 0x56005ea87850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 -- 172.21.15.60:0/3247389186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea64b60 msgr2=0x56005ea675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:27.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea64b60 0x56005ea675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 -- 172.21.15.60:0/3247389186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005ea652b0 con 0x56005ea65480 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.792+0000 7f7aebfff640 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea65480 0x56005ea87310 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7af40697d0 tx=0x7f7adc00daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45558b04d0deca84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7ae9ffb640 1 -- 172.21.15.60:0/3247389186 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc003770 con 0x56005ea65480 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7ae9ffb640 1 -- 172.21.15.60:0/3247389186 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7adc003e10 con 0x56005ea65480 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7ae9ffb640 1 -- 172.21.15.60:0/3247389186 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0103d0 con 0x56005ea65480 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 -- 172.21.15.60:0/3247389186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea65480 msgr2=0x56005ea87310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea65480 0x56005ea87310 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7af40697d0 tx=0x7f7adc00daf0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 -- 172.21.15.60:0/3247389186 shutdown_connections 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 0x56005ea87850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea65480 0x56005ea87310 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 --2- 172.21.15.60:0/3247389186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea64b60 0x56005ea675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 -- 172.21.15.60:0/3247389186 >> 172.21.15.60:0/3247389186 conn(0x56005ea610f0 msgr2=0x56005ea6eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 -- 172.21.15.60:0/3247389186 shutdown_connections 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.793+0000 7f7afcc20740 1 -- 172.21.15.60:0/3247389186 wait complete. 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 1 -- start start 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 1 Processor -- start 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea77ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 0x56005ea78430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 0x56005ea74ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41b1180 con 0x56005ea64b60 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41b09f0 con 0x56005ea65480 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7af41adab0 con 0x56005ea6fd40 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7afcc20740 10 client.0 _ll_register_callbacks cb 0x7f7aec029040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7af3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea77ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7af3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea77ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41450/0 (socket says 172.21.15.60:41450) 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7af3fff640 1 -- 172.21.15.60:0/1913320816 learned_addr learned my addr 172.21.15.60:0/1913320816 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.794+0000 7f7aebfff640 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 0x56005ea78430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7af8de4640 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 0x56005ea74ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7af3fff640 1 -- 172.21.15.60:0/1913320816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 msgr2=0x56005ea74ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7af3fff640 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 0x56005ea74ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7af3fff640 1 -- 172.21.15.60:0/1913320816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 msgr2=0x56005ea78430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7af3fff640 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 0x56005ea78430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7af3fff640 1 -- 172.21.15.60:0/1913320816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56005ea75510 con 0x56005ea64b60 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7af3fff640 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea77ef0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4000c00 tx=0x7f7ae40f1fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920ec322c621b27b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7ad37fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7ad37fe640 1 -- 172.21.15.60:0/1913320816 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4049040 con 0x56005ea64b60 2024-09-12T00:03:27.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7ad37fe640 1 -- 172.21.15.60:0/1913320816 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7ae40ba3f0 con 0x56005ea64b60 2024-09-12T00:03:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7afcc20740 1 -- 172.21.15.60:0/1913320816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7adc003e10 con 0x56005ea64b60 2024-09-12T00:03:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7ad37fe640 1 -- 172.21.15.60:0/1913320816 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7ae40bc7f0 con 0x56005ea64b60 2024-09-12T00:03:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7afcc20740 10 client.16443 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7afcc20740 1 -- 172.21.15.60:0/1913320816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56005eaeadf0 con 0x56005ea64b60 2024-09-12T00:03:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.795+0000 7f7ad37fe640 1 -- 172.21.15.60:0/1913320816 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7adc003e10 con 0x56005ea64b60 2024-09-12T00:03:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7ad37fe640 1 -- 172.21.15.60:0/1913320816 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f7ae403b460 con 0x56005ea64b60 2024-09-12T00:03:27.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7afcc20740 10 client.16443 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7afcc20740 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7afcc20740 20 client.16443 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7afcc20740 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56005eaeb500 0x56005eaed920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7afcc20740 4 client.16443 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:03:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7afcc20740 1 -- 172.21.15.60:0/1913320816 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56005e9d1d00 con 0x56005eaeb500 2024-09-12T00:03:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7aebfff640 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56005eaeb500 0x56005eaed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:27.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7aebfff640 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56005eaeb500 0x56005eaed920 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44f45cb27a13706d server_cookie=df242272fe16439e in_seq=0 out_seq=0 2024-09-12T00:03:27.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.796+0000 7f7ad37fe640 10 client.16443 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.797+0000 7f7ad37fe640 1 -- 172.21.15.60:0/1913320816 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56005e9d1d00 con 0x56005eaeb500 2024-09-12T00:03:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.797+0000 7f7ad37fe640 10 client.16443 handle_command_reply: tid=0 2024-09-12T00:03:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.797+0000 7f7afcc20740 1 client.16443 shutdown 2024-09-12T00:03:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 -- 172.21.15.60:0/1913320816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 msgr2=0x56005ea77ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea77ef0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4000c00 tx=0x7f7ae40f1fd0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 -- 172.21.15.60:0/1913320816 shutdown_connections 2024-09-12T00:03:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56005eaeb500 0x56005eaed920 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56005ea6fd40 0x56005ea74ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56005ea65480 0x56005ea78430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 --2- 172.21.15.60:0/1913320816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56005ea64b60 0x56005ea77ef0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 -- 172.21.15.60:0/1913320816 >> 172.21.15.60:0/1913320816 conn(0x56005ea610f0 msgr2=0x56005ea6cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7ad37fe640 0 client.16443 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 -- 172.21.15.60:0/1913320816 shutdown_connections 2024-09-12T00:03:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 1 -- 172.21.15.60:0/1913320816 wait complete. 2024-09-12T00:03:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afcc20740 20 client.16443 trim_cache size 0 max 16384 2024-09-12T00:03:27.807 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:03:27.807 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:03:27.807 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "ea0467fa-e002-4eb9-b7cd-7595773c596a", 2024-09-12T00:03:27.807 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:03:27.808 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:03:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afa847640 1 -- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7ae00a2cf0 msgr2=0x7f7ae00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afa847640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7ae00a2cf0 0x7f7ae00a51b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7aec020000 tx=0x7f7aec01f000 comp rx=0 tx=0).stop 2024-09-12T00:03:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afa847640 1 -- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 msgr2=0x7f7af41a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.798+0000 7f7afa847640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 0x7f7af41a0630 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4006010 tx=0x7f7ae40042f0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.799+0000 7f7afa847640 1 -- 172.21.15.60:0/3391699745 shutdown_connections 2024-09-12T00:03:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.799+0000 7f7afa847640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7ae00a2cf0 0x7f7ae00a51b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.799+0000 7f7afa847640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7af410c2f0 0x7f7af419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.799+0000 7f7afa847640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7af41037a0 0x7f7af41a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.799+0000 7f7afa847640 1 --2- 172.21.15.60:0/3391699745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7af4102df0 0x7f7af41a0630 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.799+0000 7f7afa847640 1 -- 172.21.15.60:0/3391699745 >> 172.21.15.60:0/3391699745 conn(0x7f7af40fc7d0 msgr2=0x7f7af40fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.799+0000 7f7afa847640 1 -- 172.21.15.60:0/3391699745 shutdown_connections 2024-09-12T00:03:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:27.799+0000 7f7afa847640 1 -- 172.21.15.60:0/3391699745 wait complete. 2024-09-12T00:03:28.427 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:28 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:03:28.428 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:28 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:28.428 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:28 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:03:28.428 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:28 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:28 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:03:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:28 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:28 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:03:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:28 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:28.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:28 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:03:28.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:28 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:28.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:28 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:03:28.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:28 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:28.665 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:03:28.923 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:29.298 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:29 smithi060 ceph-mon[30953]: pgmap v126: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T00:03:29.298 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:29 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:03:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 -- 172.21.15.60:0/1960127214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0100a80 msgr2=0x7fc2e0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 --2- 172.21.15.60:0/1960127214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0100a80 0x7fc2e0100ee0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009930 tx=0x7fc2d402a420 comp rx=0 tx=0).stop 2024-09-12T00:03:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 -- 172.21.15.60:0/1960127214 shutdown_connections 2024-09-12T00:03:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 --2- 172.21.15.60:0/1960127214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0101420 0x7fc2e010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 --2- 172.21.15.60:0/1960127214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0100a80 0x7fc2e0100ee0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 --2- 172.21.15.60:0/1960127214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e0106a80 0x7fc2e0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 -- 172.21.15.60:0/1960127214 >> 172.21.15.60:0/1960127214 conn(0x7fc2e00fc7a0 msgr2=0x7fc2e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 -- 172.21.15.60:0/1960127214 shutdown_connections 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.381+0000 7fc2e566a640 1 -- 172.21.15.60:0/1960127214 wait complete. 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2e566a640 1 Processor -- start 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2e566a640 1 -- start start 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2e566a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0100a80 0x7fc2e0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2e566a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e0101420 0x7fc2e0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2e566a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0106a80 0x7fc2e019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2e566a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e0110fe0 con 0x7fc2e0106a80 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2e566a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e0110e60 con 0x7fc2e0101420 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2e566a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e0111160 con 0x7fc2e0100a80 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0106a80 0x7fc2e019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0106a80 0x7fc2e019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41456/0 (socket says 172.21.15.60:41456) 2024-09-12T00:03:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2df7fe640 1 -- 172.21.15.60:0/3744444863 learned_addr learned my addr 172.21.15.60:0/3744444863 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e0101420 0x7fc2e0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.382+0000 7fc2deffd640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0100a80 0x7fc2e0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2df7fe640 1 -- 172.21.15.60:0/3744444863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0100a80 msgr2=0x7fc2e0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2df7fe640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0100a80 0x7fc2e0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2df7fe640 1 -- 172.21.15.60:0/3744444863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e0101420 msgr2=0x7fc2e0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2df7fe640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e0101420 0x7fc2e0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2df7fe640 1 -- 172.21.15.60:0/3744444863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e019d530 con 0x7fc2e0106a80 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2df7fe640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0106a80 0x7fc2e019ce50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800d750 tx=0x7fc2d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2c7fff640 1 -- 172.21.15.60:0/3744444863 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8017070 con 0x7fc2e0106a80 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2e566a640 1 -- 172.21.15.60:0/3744444863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e019d820 con 0x7fc2e0106a80 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2c7fff640 1 -- 172.21.15.60:0/3744444863 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2d8005520 con 0x7fc2e0106a80 2024-09-12T00:03:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2c7fff640 1 -- 172.21.15.60:0/3744444863 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8004e00 con 0x7fc2e0106a80 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.383+0000 7fc2e566a640 1 -- 172.21.15.60:0/3744444863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e01a5100 con 0x7fc2e0106a80 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.385+0000 7fc2c7fff640 1 -- 172.21.15.60:0/3744444863 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc2d8004fa0 con 0x7fc2e0106a80 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2e7a43740 1 Processor -- start 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2e7a43740 1 -- start start 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aadc0 0x5609496b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496b5680 0x5609496b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5609496102e0 con 0x5609496aadc0 2024-09-12T00:03:29.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5609495b7ce0 con 0x5609496aa4a0 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56094960c2a0 con 0x5609496b5680 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2deffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aadc0 0x5609496b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2deffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aadc0 0x5609496b5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41468/0 (socket says 172.21.15.60:41468) 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2deffd640 1 -- 172.21.15.60:0/2916290505 learned_addr learned my addr 172.21.15.60:0/2916290505 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.386+0000 7fc2c7fff640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc2c80a2cf0 0x7fc2c80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496b5680 0x5609496b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2df7fe640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc2c80a2cf0 0x7fc2c80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2deffd640 1 -- 172.21.15.60:0/2916290505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496b5680 msgr2=0x5609496b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2deffd640 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496b5680 0x5609496b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2deffd640 1 -- 172.21.15.60:0/2916290505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 msgr2=0x5609496aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2deffd640 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2deffd640 1 -- 172.21.15.60:0/2916290505 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56094959c440 con 0x5609496aadc0 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2c7fff640 1 -- 172.21.15.60:0/3744444863 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc2d80cedc0 con 0x7fc2e0106a80 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2deffd640 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aadc0 0x5609496b5140 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000a4b0 tx=0x7fc2d00096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81163afab09d8bdd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2c57fa640 1 -- 172.21.15.60:0/2916290505 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0018020 con 0x5609496aadc0 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2df7fe640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc2c80a2cf0 0x7fc2c80a51b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8097d50 tx=0x7fc2d806a2b0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2c57fa640 1 -- 172.21.15.60:0/2916290505 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2d0014d10 con 0x5609496aadc0 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.387+0000 7fc2c57fa640 1 -- 172.21.15.60:0/2916290505 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d00122c0 con 0x5609496aadc0 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2916290505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aadc0 msgr2=0x5609496b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aadc0 0x5609496b5140 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000a4b0 tx=0x7fc2d00096d0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2916290505 shutdown_connections 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496b5680 0x5609496b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aadc0 0x5609496b5140 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2916290505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2916290505 >> 172.21.15.60:0/2916290505 conn(0x5609496a6a30 msgr2=0x5609496a6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2916290505 shutdown_connections 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2916290505 wait complete. 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 -- start start 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.388+0000 7fc2e7a43740 1 Processor -- start 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 0x5609496b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5609496b8250 con 0x5609496aa4a0 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5609495cb050 con 0x5609496b5680 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5609496b83d0 con 0x5609496aadc0 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2e7a43740 10 client.0 _ll_register_callbacks cb 0x56094960b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41482/0 (socket says 172.21.15.60:41482) 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 -- 172.21.15.60:0/811802927 learned_addr learned my addr 172.21.15.60:0/811802927 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 0x5609496b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2deffd640 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 -- 172.21.15.60:0/811802927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 msgr2=0x5609496b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 -- 172.21.15.60:0/811802927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 msgr2=0x5609496b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:29.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 0x5609496b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 -- 172.21.15.60:0/811802927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609493813c0 con 0x5609496aa4a0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496b4cf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc2d402a940 tx=0x7fc2d402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c44157782d716e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.389+0000 7fc2c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/811802927 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4035040 con 0x5609496aa4a0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/811802927 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc2d403ea70 con 0x5609496aa4a0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 1 -- 172.21.15.60:0/811802927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2d0014d10 con 0x5609496aa4a0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/811802927 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc2d4053050 con 0x5609496aa4a0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 10 client.16455 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 1 -- 172.21.15.60:0/811802927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5609496cc430 con 0x5609496aa4a0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/811802927 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2d0014d10 con 0x5609496aa4a0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/811802927 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fc2d403b3d0 con 0x5609496aa4a0 2024-09-12T00:03:29.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 10 client.16455 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:29.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:29.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 20 client.16455 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:29.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5609496cd840 0x5609496cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 4 client.16455 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:29.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.390+0000 7fc2e7a43740 1 -- 172.21.15.60:0/811802927 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56094961d850 con 0x5609496cd840 2024-09-12T00:03:29.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.391+0000 7fc2deffd640 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5609496cd840 0x5609496cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.391+0000 7fc2c2ff5640 10 client.16455 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:29.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.391+0000 7fc2deffd640 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5609496cd840 0x5609496cfcc0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cf9617bdcfafdfe server_cookie=f92d2487a0c1f90b in_seq=0 out_seq=0 2024-09-12T00:03:29.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/811802927 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56094961d850 con 0x5609496cd840 2024-09-12T00:03:29.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2c2ff5640 10 client.16455 handle_command_reply: tid=0 2024-09-12T00:03:29.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 client.16455 shutdown 2024-09-12T00:03:29.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 -- 172.21.15.60:0/811802927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 msgr2=0x5609496b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496b4cf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc2d402a940 tx=0x7fc2d402a420 comp rx=0 tx=0).stop 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 -- 172.21.15.60:0/811802927 shutdown_connections 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5609496cd840 0x5609496cfcc0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 0x5609496b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2c2ff5640 0 client.16455 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/811802927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496b4cf0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 -- 172.21.15.60:0/811802927 >> 172.21.15.60:0/811802927 conn(0x5609496a6a30 msgr2=0x5609496a5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 -- 172.21.15.60:0/811802927 shutdown_connections 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 1 -- 172.21.15.60:0/811802927 wait complete. 2024-09-12T00:03:29.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.392+0000 7fc2e7a43740 20 client.16455 trim_cache size 0 max 16384 2024-09-12T00:03:29.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.409+0000 7fc2e7a43740 1 Processor -- start 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2e7a43740 1 -- start start 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 0x5609496b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01ab690 con 0x5609496aa4a0 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01ad4d0 con 0x5609496b5680 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01abe20 con 0x5609496aadc0 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41490/0 (socket says 172.21.15.60:41490) 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 -- 172.21.15.60:0/3037096241 learned_addr learned my addr 172.21.15.60:0/3037096241 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2deffd640 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 -- 172.21.15.60:0/3037096241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 msgr2=0x5609496b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 -- 172.21.15.60:0/3037096241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 msgr2=0x5609496b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 0x5609496b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 -- 172.21.15.60:0/3037096241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609496aabf0 con 0x5609496aa4a0 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2deffd640 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.410+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496a5e40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009a50 tx=0x7fc2d4031b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12eca4a910aa68ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2c4ff9640 1 -- 172.21.15.60:0/3037096241 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4035040 con 0x5609496aa4a0 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2c4ff9640 1 -- 172.21.15.60:0/3037096241 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2d403be60 con 0x5609496aa4a0 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2c4ff9640 1 -- 172.21.15.60:0/3037096241 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40042a0 con 0x5609496aa4a0 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 -- 172.21.15.60:0/3037096241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 msgr2=0x5609496a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496a5e40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009a50 tx=0x7fc2d4031b70 comp rx=0 tx=0).stop 2024-09-12T00:03:29.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 -- 172.21.15.60:0/3037096241 shutdown_connections 2024-09-12T00:03:29.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496b5680 0x5609496b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/3037096241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496aa4a0 0x5609496a5e40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 -- 172.21.15.60:0/3037096241 >> 172.21.15.60:0/3037096241 conn(0x5609496a6a30 msgr2=0x5609496b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:29.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 -- 172.21.15.60:0/3037096241 shutdown_connections 2024-09-12T00:03:29.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.411+0000 7fc2e7a43740 1 -- 172.21.15.60:0/3037096241 wait complete. 2024-09-12T00:03:29.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 1 -- start start 2024-09-12T00:03:29.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 1 Processor -- start 2024-09-12T00:03:29.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496b5680 0x5609496c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01acd40 con 0x5609496b5680 2024-09-12T00:03:29.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01ac5b0 con 0x5609496aa4a0 2024-09-12T00:03:29.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01a9670 con 0x5609496aadc0 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2e7a43740 10 client.0 _ll_register_callbacks cb 0x7fc2d40314e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496b5680 0x5609496c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496b5680 0x5609496c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41504/0 (socket says 172.21.15.60:41504) 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 -- 172.21.15.60:0/2972223563 learned_addr learned my addr 172.21.15.60:0/2972223563 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2deffd640 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 -- 172.21.15.60:0/2972223563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 msgr2=0x5609496c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 -- 172.21.15.60:0/2972223563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 msgr2=0x5609496c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.412+0000 7fc2de7fc640 1 -- 172.21.15.60:0/2972223563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560949737810 con 0x5609496b5680 2024-09-12T00:03:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2de7fc640 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496b5680 0x5609496c8f40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc2d403bda0 tx=0x7fc2d403bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e9a9b6b56634e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/2972223563 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4050070 con 0x5609496b5680 2024-09-12T00:03:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/2972223563 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fc2d403ec80 con 0x5609496b5680 2024-09-12T00:03:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2972223563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2d403be60 con 0x5609496b5680 2024-09-12T00:03:29.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/2972223563 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc2d4035040 con 0x5609496b5680 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 10 client.16461 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2972223563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560949738a90 con 0x5609496b5680 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/2972223563 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2d403be60 con 0x5609496b5680 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/2972223563 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fc2d4005030 con 0x5609496b5680 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 10 client.16461 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 10 client.16461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 20 client.16461 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5609496cd840 0x56094973b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 4 client.16461 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.413+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2972223563 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560949617d60 con 0x5609496cd840 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2deffd640 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5609496cd840 0x56094973b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:29.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2deffd640 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5609496cd840 0x56094973b110 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=398f2319e25731db server_cookie=7940f85ecbe22d15 in_seq=0 out_seq=0 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2c2ff5640 10 client.16461 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2c2ff5640 1 -- 172.21.15.60:0/2972223563 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560949617d60 con 0x5609496cd840 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2c2ff5640 10 client.16461 handle_command_reply: tid=0 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2e7a43740 1 client.16461 shutdown 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2972223563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496b5680 msgr2=0x5609496c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496b5680 0x5609496c8f40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc2d403bda0 tx=0x7fc2d403bb00 comp rx=0 tx=0).stop 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2972223563 shutdown_connections 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.414+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5609496cd840 0x56094973b110 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5609496b5680 0x5609496c8f40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5609496aadc0 0x5609496c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e7a43740 1 --2- 172.21.15.60:0/2972223563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5609496aa4a0 0x5609496c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2c2ff5640 0 client.16461 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:29.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2972223563 >> 172.21.15.60:0/2972223563 conn(0x5609496a6a30 msgr2=0x5609496b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:29.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2972223563 shutdown_connections 2024-09-12T00:03:29.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e7a43740 1 -- 172.21.15.60:0/2972223563 wait complete. 2024-09-12T00:03:29.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e7a43740 20 client.16461 trim_cache size 0 max 16384 2024-09-12T00:03:29.422 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:03:29.422 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:03:29.422 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:03:29.422 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:03:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 -- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc2c80a2cf0 msgr2=0x7fc2c80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc2c80a2cf0 0x7fc2c80a51b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8097d50 tx=0x7fc2d806a2b0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 -- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0106a80 msgr2=0x7fc2e019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0106a80 0x7fc2e019ce50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800d750 tx=0x7fc2d800dc10 comp rx=0 tx=0).stop 2024-09-12T00:03:29.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 -- 172.21.15.60:0/3744444863 shutdown_connections 2024-09-12T00:03:29.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fc2c80a2cf0 0x7fc2c80a51b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2e0106a80 0x7fc2e019ce50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e0101420 0x7fc2e0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 --2- 172.21.15.60:0/3744444863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2e0100a80 0x7fc2e0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:29.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 -- 172.21.15.60:0/3744444863 >> 172.21.15.60:0/3744444863 conn(0x7fc2e00fc7a0 msgr2=0x7fc2e006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:29.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 -- 172.21.15.60:0/3744444863 shutdown_connections 2024-09-12T00:03:29.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:29.415+0000 7fc2e566a640 1 -- 172.21.15.60:0/3744444863 wait complete. 2024-09-12T00:03:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:29 smithi105 ceph-mon[34805]: pgmap v126: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T00:03:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:29 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:03:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:29 smithi192 ceph-mon[35487]: pgmap v126: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-12T00:03:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:29 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:03:30.101 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:03:30.102 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:03:30.361 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.831+0000 7f070b8eb640 1 -- 172.21.15.60:0/348471661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0704101270 msgr2=0x7f070410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:30.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.831+0000 7f070b8eb640 1 --2- 172.21.15.60:0/348471661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0704101270 0x7f070410df30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009900 tx=0x7f06f402a410 comp rx=0 tx=0).stop 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 -- 172.21.15.60:0/348471661 shutdown_connections 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 --2- 172.21.15.60:0/348471661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f070410e470 0x7f0704110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 --2- 172.21.15.60:0/348471661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0704101270 0x7f070410df30 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 --2- 172.21.15.60:0/348471661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07041008c0 0x7f0704100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 -- 172.21.15.60:0/348471661 >> 172.21.15.60:0/348471661 conn(0x7f07040fc790 msgr2=0x7f07040febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 -- 172.21.15.60:0/348471661 shutdown_connections 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 -- 172.21.15.60:0/348471661 wait complete. 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 Processor -- start 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.832+0000 7f070b8eb640 1 -- start start 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f070b8eb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07041008c0 0x7f07041a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:30.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f070b8eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0704101270 0x7f07041a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f070b8eb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f070410e470 0x7f070419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f070b8eb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07041142d0 con 0x7f07041008c0 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f070b8eb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0704114150 con 0x7f0704101270 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f070b8eb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0704114450 con 0x7f070410e470 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07041008c0 0x7f07041a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07041008c0 0x7f07041a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41522/0 (socket says 172.21.15.60:41522) 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 -- 172.21.15.60:0/1901157600 learned_addr learned my addr 172.21.15.60:0/1901157600 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0708e86640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0704101270 0x7f07041a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709e88640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f070410e470 0x7f070419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 -- 172.21.15.60:0/1901157600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f070410e470 msgr2=0x7f070419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f070410e470 0x7f070419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:30.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 -- 172.21.15.60:0/1901157600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0704101270 msgr2=0x7f07041a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0704101270 0x7f07041a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 -- 172.21.15.60:0/1901157600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070419ad10 con 0x7f07041008c0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709e88640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f070410e470 0x7f070419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.833+0000 7f0709687640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07041008c0 0x7f07041a0420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f070000c890 tx=0x7f070000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.834+0000 7f06fa7fc640 1 -- 172.21.15.60:0/1901157600 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700004220 con 0x7f07041008c0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.834+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070419b000 con 0x7f07041008c0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.834+0000 7f06fa7fc640 1 -- 172.21.15.60:0/1901157600 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07000043c0 con 0x7f07041008c0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.834+0000 7f06fa7fc640 1 -- 172.21.15.60:0/1901157600 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700004b10 con 0x7f07041008c0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.834+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07041a72f0 con 0x7f07041008c0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.835+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0704100ca0 con 0x7f07041008c0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.837+0000 7f06fa7fc640 1 -- 172.21.15.60:0/1901157600 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f07000051b0 con 0x7f07041008c0 2024-09-12T00:03:30.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.837+0000 7f06fa7fc640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f06f00a2cf0 0x7f06f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:30.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.837+0000 7f06fa7fc640 1 -- 172.21.15.60:0/1901157600 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f07000cf480 con 0x7f07041008c0 2024-09-12T00:03:30.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.837+0000 7f0708e86640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f06f00a2cf0 0x7f06f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:30.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.838+0000 7f0708e86640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f06f00a2cf0 0x7f06f00a51b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009230 tx=0x7f06f40058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:30.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:30.840+0000 7f06fa7fc640 1 -- 172.21.15.60:0/1901157600 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0700014030 con 0x7f07041008c0 2024-09-12T00:03:31.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.056+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f070419bb10 con 0x7f07041008c0 2024-09-12T00:03:31.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.057+0000 7f06fa7fc640 1 -- 172.21.15.60:0/1901157600 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12009 (secure 0 0 0) 0x7f070009c0f0 con 0x7f07041008c0 2024-09-12T00:03:31.057 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:03:31.057 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"btime":"2024-09-12T00:02:06:958968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:02:06.347465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:03:31.058 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 39 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f06f00a2cf0 msgr2=0x7f06f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f06f00a2cf0 0x7f06f00a51b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009230 tx=0x7f06f40058d0 comp rx=0 tx=0).stop 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07041008c0 msgr2=0x7f07041a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07041008c0 0x7f07041a0420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f070000c890 tx=0x7f070000cd50 comp rx=0 tx=0).stop 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 shutdown_connections 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f06f00a2cf0 0x7f06f00a51b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f070410e470 0x7f070419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0704101270 0x7f07041a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 --2- 172.21.15.60:0/1901157600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07041008c0 0x7f07041a0420 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:31.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.059+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 >> 172.21.15.60:0/1901157600 conn(0x7f07040fc790 msgr2=0x7f07040feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:31.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.060+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 shutdown_connections 2024-09-12T00:03:31.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:31.060+0000 7f070b8eb640 1 -- 172.21.15.60:0/1901157600 wait complete. 2024-09-12T00:03:31.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:31 smithi060 ceph-mon[30953]: pgmap v127: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-12T00:03:31.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:31 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1901157600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:03:31.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:31 smithi105 ceph-mon[34805]: pgmap v127: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-12T00:03:31.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:31 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1901157600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:03:31.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:31 smithi192 ceph-mon[35487]: pgmap v127: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-12T00:03:31.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:31 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1901157600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:03:31.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:03:32.075 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.539+0000 7f0c5aa26640 1 -- 172.21.15.60:0/1379770334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54102570 msgr2=0x7f0c541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.539+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/1379770334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54102570 0x7f0c541029b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009900 tx=0x7f0c4802a480 comp rx=0 tx=0).stop 2024-09-12T00:03:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.539+0000 7f0c5aa26640 1 -- 172.21.15.60:0/1379770334 shutdown_connections 2024-09-12T00:03:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.540+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/1379770334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c54102ef0 0x7f0c5410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.540+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/1379770334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54102570 0x7f0c541029b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.540+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/1379770334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c54100e20 0x7f0c54101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.540+0000 7f0c5aa26640 1 -- 172.21.15.60:0/1379770334 >> 172.21.15.60:0/1379770334 conn(0x7f0c540fc7d0 msgr2=0x7f0c540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.540+0000 7f0c5aa26640 1 -- 172.21.15.60:0/1379770334 shutdown_connections 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.540+0000 7f0c5aa26640 1 -- 172.21.15.60:0/1379770334 wait complete. 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.540+0000 7f0c5aa26640 1 Processor -- start 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.540+0000 7f0c5aa26640 1 -- start start 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c5aa26640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54100e20 0x7f0c54198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c5aa26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c54102570 0x7f0c54198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c5aa26640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c54102ef0 0x7f0c5419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c5aa26640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c541110a0 con 0x7f0c54100e20 2024-09-12T00:03:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c5aa26640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c54110f20 con 0x7f0c54102570 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c5aa26640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c54111220 con 0x7f0c54102ef0 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54100e20 0x7f0c54198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54100e20 0x7f0c54198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34306/0 (socket says 172.21.15.60:34306) 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 -- 172.21.15.60:0/2622432710 learned_addr learned my addr 172.21.15.60:0/2622432710 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c537fe640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c54102570 0x7f0c54198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c54102ef0 0x7f0c5419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 -- 172.21.15.60:0/2622432710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c54102ef0 msgr2=0x7f0c5419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c54102ef0 0x7f0c5419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 -- 172.21.15.60:0/2622432710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c54102570 msgr2=0x7f0c54198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c54102570 0x7f0c54198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 -- 172.21.15.60:0/2622432710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5419d600 con 0x7f0c54100e20 2024-09-12T00:03:32.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c53fff640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54100e20 0x7f0c54198650 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400e9f0 tx=0x7f0c4400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c517fa640 1 -- 172.21.15.60:0/2622432710 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400cd80 con 0x7f0c54100e20 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c5aa26640 1 -- 172.21.15.60:0/2622432710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5419d8f0 con 0x7f0c54100e20 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c517fa640 1 -- 172.21.15.60:0/2622432710 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c44005520 con 0x7f0c54100e20 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.541+0000 7f0c517fa640 1 -- 172.21.15.60:0/2622432710 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44010690 con 0x7f0c54100e20 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.542+0000 7f0c5aa26640 1 -- 172.21.15.60:0/2622432710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c541a51d0 con 0x7f0c54100e20 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.544+0000 7f0c517fa640 1 -- 172.21.15.60:0/2622432710 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0c440046c0 con 0x7f0c54100e20 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.544+0000 7f0c5cdff740 1 Processor -- start 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.544+0000 7f0c5cdff740 1 -- start start 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.544+0000 7f0c517fa640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0c3c0a2cf0 0x7f0c3c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae3380e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3380e5d0 0x55ae3380ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c517fa640 1 -- 172.21.15.60:0/2622432710 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f0c440cf810 con 0x7f0c54100e20 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3381d780 0x55ae3381fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ae337742f0 con 0x55ae3380e5d0 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ae3371bcf0 con 0x55ae3380fb40 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ae337702b0 con 0x55ae3381d780 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0c3c0a2cf0 0x7f0c3c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae3380e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c537fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3380e5d0 0x55ae3380ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae3380e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:59222/0 (socket says 172.21.15.60:59222) 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 -- 172.21.15.60:0/1882822727 learned_addr learned my addr 172.21.15.60:0/1882822727 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 -- 172.21.15.60:0/1882822727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3381d780 msgr2=0x55ae3381fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3381d780 0x55ae3381fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3381d780 0x55ae3381fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 -- 172.21.15.60:0/1882822727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3380e5d0 msgr2=0x55ae3380ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3380e5d0 0x55ae3380ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 -- 172.21.15.60:0/1882822727 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae337003a0 con 0x55ae3380fb40 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3381d780 0x55ae3381fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c537fe640 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3380e5d0 0x55ae3380ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0c3c0a2cf0 0x7f0c3c0a51b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005fd0 tx=0x7f0c4c011810 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.545+0000 7f0c53fff640 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae3380e090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c440a44c0 tx=0x7f0c4409b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c59b3fc590a0449 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c3a7fc640 1 -- 172.21.15.60:0/1882822727 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c440a0130 con 0x55ae3380fb40 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c3a7fc640 1 -- 172.21.15.60:0/1882822727 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c440a49f0 con 0x55ae3380fb40 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c3a7fc640 1 -- 172.21.15.60:0/1882822727 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4409b1d0 con 0x55ae3380fb40 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 -- 172.21.15.60:0/1882822727 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 msgr2=0x55ae3380e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae3380e090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c440a44c0 tx=0x7f0c4409b6e0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 -- 172.21.15.60:0/1882822727 shutdown_connections 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3381d780 0x55ae3381fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3380e5d0 0x55ae3380ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/1882822727 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae3380e090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 -- 172.21.15.60:0/1882822727 >> 172.21.15.60:0/1882822727 conn(0x55ae337d7310 msgr2=0x55ae3380ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 -- 172.21.15.60:0/1882822727 shutdown_connections 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.546+0000 7f0c5cdff740 1 -- 172.21.15.60:0/1882822727 wait complete. 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 1 -- start start 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 1 Processor -- start 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae3381d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae3381a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae3381a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ae338203c0 con 0x55ae3381d780 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ae3372f060 con 0x55ae3380e5d0 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ae33820540 con 0x55ae3380fb40 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c5cdff740 10 client.0 _ll_register_callbacks cb 0x55ae334828c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c58fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae3381a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae3381d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c58fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae3381a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34322/0 (socket says 172.21.15.60:34322) 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae3381d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:59228/0 (socket says 172.21.15.60:59228) 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.547+0000 7f0c58fc3640 1 -- 172.21.15.60:0/734215118 learned_addr learned my addr 172.21.15.60:0/734215118 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c537fe640 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae3381a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c58fc3640 1 -- 172.21.15.60:0/734215118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 msgr2=0x55ae3381a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae3381a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c58fc3640 1 -- 172.21.15.60:0/734215118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 msgr2=0x55ae3381d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae3381d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c58fc3640 1 -- 172.21.15.60:0/734215118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae334e53c0 con 0x55ae3381d780 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c53fff640 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae3381d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae3381a9e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c003fc0 tx=0x7f0c4c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7663004261c1dc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c337fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c337fe640 1 -- 172.21.15.60:0/734215118 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c024070 con 0x55ae3381d780 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c337fe640 1 -- 172.21.15.60:0/734215118 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f0c4c00f710 con 0x55ae3381d780 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c5cdff740 1 -- 172.21.15.60:0/734215118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c440a49f0 con 0x55ae3381d780 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c337fe640 1 -- 172.21.15.60:0/734215118 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0c4c030050 con 0x55ae3381d780 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c5cdff740 10 client.16479 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:32.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.548+0000 7f0c5cdff740 1 -- 172.21.15.60:0/734215118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ae3382be10 con 0x55ae3381d780 2024-09-12T00:03:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c337fe640 1 -- 172.21.15.60:0/734215118 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c440a49f0 con 0x55ae3381d780 2024-09-12T00:03:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c337fe640 1 -- 172.21.15.60:0/734215118 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f0c4c020ca0 con 0x55ae3381d780 2024-09-12T00:03:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c5cdff740 10 client.16479 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c5cdff740 10 client.16479 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:03:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c5cdff740 20 client.16479 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ae3382d270 0x55ae3382f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c5cdff740 4 client.16479 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c5cdff740 1 -- 172.21.15.60:0/734215118 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae33781860 con 0x55ae3382d270 2024-09-12T00:03:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c53fff640 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ae3382d270 0x55ae3382f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c53fff640 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ae3382d270 0x55ae3382f6f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c9da551c92ad8f47 server_cookie=bf794f746cbc66c5 in_seq=0 out_seq=0 2024-09-12T00:03:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.549+0000 7f0c337fe640 10 client.16479 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:03:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c337fe640 1 -- 172.21.15.60:0/734215118 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae33781860 con 0x55ae3382d270 2024-09-12T00:03:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c337fe640 10 client.16479 handle_command_reply: tid=0 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 client.16479 shutdown 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 -- 172.21.15.60:0/734215118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 msgr2=0x55ae3381a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae3381a9e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c003fc0 tx=0x7f0c4c004ab0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 -- 172.21.15.60:0/734215118 shutdown_connections 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae3381a9e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae3381a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ae3382d270 0x55ae3382f6f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/734215118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae3381d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c337fe640 0 client.16479 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.550+0000 7f0c5cdff740 1 -- 172.21.15.60:0/734215118 >> 172.21.15.60:0/734215118 conn(0x55ae337d7310 msgr2=0x55ae338109c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.551+0000 7f0c5cdff740 1 -- 172.21.15.60:0/734215118 shutdown_connections 2024-09-12T00:03:32.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.551+0000 7f0c5cdff740 1 -- 172.21.15.60:0/734215118 wait complete. 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.551+0000 7f0c5cdff740 20 client.16479 trim_cache size 0 max 16384 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c5cdff740 1 Processor -- start 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c5cdff740 1 -- start start 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380e5d0 0x55ae33829660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae33834fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33835500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c541ab610 con 0x55ae3381d780 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c541ad450 con 0x55ae3380fb40 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c541abda0 con 0x55ae3380e5d0 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33835500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33835500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34328/0 (socket says 172.21.15.60:34328) 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 -- 172.21.15.60:0/2091617187 learned_addr learned my addr 172.21.15.60:0/2091617187 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:32.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c537fe640 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae33834fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c53fff640 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380e5d0 0x55ae33829660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 -- 172.21.15.60:0/2091617187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380e5d0 msgr2=0x55ae33829660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380e5d0 0x55ae33829660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 -- 172.21.15.60:0/2091617187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 msgr2=0x55ae33834fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae33834fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 -- 172.21.15.60:0/2091617187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3380ebe0 con 0x55ae3381d780 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.564+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33835500 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c004a80 tx=0x7f0c4c0091c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed540bfa1c7029d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c39ffb640 1 -- 172.21.15.60:0/2091617187 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c024070 con 0x55ae3381d780 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c39ffb640 1 -- 172.21.15.60:0/2091617187 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c4c019070 con 0x55ae3381d780 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c39ffb640 1 -- 172.21.15.60:0/2091617187 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c017040 con 0x55ae3381d780 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c5cdff740 1 -- 172.21.15.60:0/2091617187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 msgr2=0x55ae33835500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33835500 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c004a80 tx=0x7f0c4c0091c0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c5cdff740 1 -- 172.21.15.60:0/2091617187 shutdown_connections 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33835500 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380fb40 0x55ae33834fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/2091617187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380e5d0 0x55ae33829660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.565+0000 7f0c5cdff740 1 -- 172.21.15.60:0/2091617187 >> 172.21.15.60:0/2091617187 conn(0x55ae337d7310 msgr2=0x55ae33818ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 -- 172.21.15.60:0/2091617187 shutdown_connections 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 -- 172.21.15.60:0/2091617187 wait complete. 2024-09-12T00:03:32.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 -- start start 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 Processor -- start 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae33825f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae338212e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33821820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c541accc0 con 0x55ae3381d780 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c541ac530 con 0x55ae3380e5d0 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c541a95f0 con 0x55ae3380fb40 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.566+0000 7f0c5cdff740 10 client.0 _ll_register_callbacks cb 0x7f0c4c003ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c58fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33821820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae33825f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c537fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae338212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c58fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33821820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34336/0 (socket says 172.21.15.60:34336) 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae33825f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:59242/0 (socket says 172.21.15.60:59242) 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c58fc3640 1 -- 172.21.15.60:0/4253291983 learned_addr learned my addr 172.21.15.60:0/4253291983 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c537fe640 1 -- 172.21.15.60:0/4253291983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 msgr2=0x55ae33825f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c537fe640 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae33825f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c537fe640 1 -- 172.21.15.60:0/4253291983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 msgr2=0x55ae33821820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c537fe640 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33821820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c537fe640 1 -- 172.21.15.60:0/4253291983 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae33822050 con 0x55ae3380fb40 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c58fc3640 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33821820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c53fff640 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae33825f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c537fe640 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae338212e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005940 tx=0x7f0c480319b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52a9050a62712fec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c337fe640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:03:32.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c337fe640 1 -- 172.21.15.60:0/4253291983 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4804b020 con 0x55ae3380fb40 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c337fe640 1 -- 172.21.15.60:0/4253291983 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f0c48004450 con 0x55ae3380fb40 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.567+0000 7f0c5cdff740 1 -- 172.21.15.60:0/4253291983 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c4c019070 con 0x55ae3380fb40 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c337fe640 1 -- 172.21.15.60:0/4253291983 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0c48035040 con 0x55ae3380fb40 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c5cdff740 10 client.25906 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c5cdff740 1 -- 172.21.15.60:0/4253291983 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ae33897f80 con 0x55ae3380fb40 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c337fe640 1 -- 172.21.15.60:0/4253291983 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c4c019070 con 0x55ae3380fb40 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c337fe640 1 -- 172.21.15.60:0/4253291983 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f0c4803d910 con 0x55ae3380fb40 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c5cdff740 10 client.25906 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c5cdff740 10 client.25906 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c5cdff740 20 client.25906 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ae33898840 0x55ae3389ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c5cdff740 4 client.25906 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:32.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c5cdff740 1 -- 172.21.15.60:0/4253291983 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae3377bd70 con 0x55ae33898840 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.568+0000 7f0c53fff640 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ae33898840 0x55ae3389ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c53fff640 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ae33898840 0x55ae3389ac60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=82b01e7966830b92 server_cookie=5f0a90bc611fb413 in_seq=0 out_seq=0 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c337fe640 10 client.25906 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c337fe640 1 -- 172.21.15.60:0/4253291983 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae3377bd70 con 0x55ae33898840 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c337fe640 10 client.25906 handle_command_reply: tid=0 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 client.25906 shutdown 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 -- 172.21.15.60:0/4253291983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 msgr2=0x55ae338212e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae338212e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005940 tx=0x7f0c480319b0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 -- 172.21.15.60:0/4253291983 shutdown_connections 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ae3381d780 0x55ae33821820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae3380fb40 0x55ae338212e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ae33898840 0x55ae3389ac60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 --2- 172.21.15.60:0/4253291983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ae3380e5d0 0x55ae33825f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 -- 172.21.15.60:0/4253291983 >> 172.21.15.60:0/4253291983 conn(0x55ae337d7310 msgr2=0x55ae3381bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:32.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c337fe640 0 client.25906 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:03:32.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 -- 172.21.15.60:0/4253291983 shutdown_connections 2024-09-12T00:03:32.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 1 -- 172.21.15.60:0/4253291983 wait complete. 2024-09-12T00:03:32.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.569+0000 7f0c5cdff740 20 client.25906 trim_cache size 0 max 16384 2024-09-12T00:03:32.589 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 -- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0c3c0a2cf0 msgr2=0x7f0c3c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0c3c0a2cf0 0x7f0c3c0a51b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005fd0 tx=0x7f0c4c011810 comp rx=0 tx=0).stop 2024-09-12T00:03:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 -- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54100e20 msgr2=0x7f0c54198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54100e20 0x7f0c54198650 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400e9f0 tx=0x7f0c4400edf0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 -- 172.21.15.60:0/2622432710 shutdown_connections 2024-09-12T00:03:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0c3c0a2cf0 0x7f0c3c0a51b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c54102ef0 0x7f0c5419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c54102570 0x7f0c54198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 --2- 172.21.15.60:0/2622432710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54100e20 0x7f0c54198650 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 -- 172.21.15.60:0/2622432710 >> 172.21.15.60:0/2622432710 conn(0x7f0c540fc7d0 msgr2=0x7f0c5406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 -- 172.21.15.60:0/2622432710 shutdown_connections 2024-09-12T00:03:32.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:32.570+0000 7f0c5aa26640 1 -- 172.21.15.60:0/2622432710 wait complete. 2024-09-12T00:03:33.436 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:33 smithi060 ceph-mon[30953]: pgmap v128: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:03:33.436 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:03:33.436 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:03:33.436 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:03:33.436 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:03:33.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:03:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:33 smithi105 ceph-mon[34805]: pgmap v128: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:03:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:03:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:03:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:03:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:03:33.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:33 smithi192 ceph-mon[35487]: pgmap v128: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:03:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:03:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:03:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:03:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:03:33.721 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.173+0000 7f6536496640 1 -- 172.21.15.60:0/4255902059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 msgr2=0x7f65301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.173+0000 7f6536496640 1 --2- 172.21.15.60:0/4255902059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 0x7f65301021c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6520009900 tx=0x7f652002a410 comp rx=0 tx=0).stop 2024-09-12T00:03:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 -- 172.21.15.60:0/4255902059 shutdown_connections 2024-09-12T00:03:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 --2- 172.21.15.60:0/4255902059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6530106f10 0x7f653010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 --2- 172.21.15.60:0/4255902059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6530102790 0x7f65301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 --2- 172.21.15.60:0/4255902059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 0x7f65301021c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 -- 172.21.15.60:0/4255902059 >> 172.21.15.60:0/4255902059 conn(0x7f65300fd8c0 msgr2=0x7f65300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 -- 172.21.15.60:0/4255902059 shutdown_connections 2024-09-12T00:03:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 -- 172.21.15.60:0/4255902059 wait complete. 2024-09-12T00:03:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 Processor -- start 2024-09-12T00:03:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 -- start start 2024-09-12T00:03:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 0x7f6530198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6530102790 0x7f6530198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6530106f10 0x7f653019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6530112120 con 0x7f6530101de0 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6530111fa0 con 0x7f6530102790 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.174+0000 7f6536496640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65301122a0 con 0x7f6530106f10 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 0x7f6530198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 0x7f6530198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34360/0 (socket says 172.21.15.60:34360) 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 -- 172.21.15.60:0/974821103 learned_addr learned my addr 172.21.15.60:0/974821103 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f6534a33640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6530106f10 0x7f653019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f6527fff640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6530102790 0x7f6530198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 -- 172.21.15.60:0/974821103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6530106f10 msgr2=0x7f653019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6530106f10 0x7f653019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 -- 172.21.15.60:0/974821103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6530102790 msgr2=0x7f6530198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6530102790 0x7f6530198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 -- 172.21.15.60:0/974821103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653019d4c0 con 0x7f6530101de0 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f6534a33640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6530106f10 0x7f653019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652ffff640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 0x7f6530198510 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6520004770 tx=0x7f6520032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652dffb640 1 -- 172.21.15.60:0/974821103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652003f030 con 0x7f6530101de0 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652dffb640 1 -- 172.21.15.60:0/974821103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6520003d00 con 0x7f6530101de0 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f6536496640 1 -- 172.21.15.60:0/974821103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653019d750 con 0x7f6530101de0 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f652dffb640 1 -- 172.21.15.60:0/974821103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520035070 con 0x7f6530101de0 2024-09-12T00:03:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.175+0000 7f6536496640 1 -- 172.21.15.60:0/974821103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65301a5090 con 0x7f6530101de0 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f652dffb640 1 -- 172.21.15.60:0/974821103 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6520042030 con 0x7f6530101de0 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f653886f740 1 Processor -- start 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f653886f740 1 -- start start 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f653886f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247738b40 0x565247737090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f653886f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x565247737a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f653886f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x565247744760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f653886f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56524769d2f0 con 0x5652477375d0 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f653886f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x565247644cf0 con 0x565247742370 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f653886f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5652476992b0 con 0x565247738b40 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.178+0000 7f652ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x565247737a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x565247737a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34362/0 (socket says 172.21.15.60:34362) 2024-09-12T00:03:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652ffff640 1 -- 172.21.15.60:0/3582327225 learned_addr learned my addr 172.21.15.60:0/3582327225 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652dffb640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f651c0a2cf0 0x7f651c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f6534a33640 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247738b40 0x565247737090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f6527fff640 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x565247744760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f6534a33640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f651c0a2cf0 0x7f651c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652dffb640 1 -- 172.21.15.60:0/974821103 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f65200ef9f0 con 0x7f6530101de0 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652ffff640 1 -- 172.21.15.60:0/3582327225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247738b40 msgr2=0x565247737090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652ffff640 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247738b40 0x565247737090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652ffff640 1 -- 172.21.15.60:0/3582327225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 msgr2=0x565247744760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652ffff640 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x565247744760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652ffff640 1 -- 172.21.15.60:0/3582327225 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652476293a0 con 0x5652477375d0 2024-09-12T00:03:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f652ffff640 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x565247737a10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f65200bbc60 tx=0x7f6520009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24b7ee70bc59770 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f6534a33640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f651c0a2cf0 0x7f651c0a51b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6528009440 tx=0x7f65280093d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f65267fc640 1 -- 172.21.15.60:0/3582327225 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520049070 con 0x5652477375d0 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f65267fc640 1 -- 172.21.15.60:0/3582327225 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65200bc660 con 0x5652477375d0 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.179+0000 7f65267fc640 1 -- 172.21.15.60:0/3582327225 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652003b460 con 0x5652477375d0 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 -- 172.21.15.60:0/3582327225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 msgr2=0x565247737a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x565247737a10 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f65200bbc60 tx=0x7f6520009260 comp rx=0 tx=0).stop 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 -- 172.21.15.60:0/3582327225 shutdown_connections 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x565247744760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x565247737a10 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 --2- 172.21.15.60:0/3582327225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247738b40 0x565247737090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 -- 172.21.15.60:0/3582327225 >> 172.21.15.60:0/3582327225 conn(0x565247700310 msgr2=0x565247733c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 -- 172.21.15.60:0/3582327225 shutdown_connections 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 -- 172.21.15.60:0/3582327225 wait complete. 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.180+0000 7f653886f740 1 -- start start 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f653886f740 1 Processor -- start 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f653886f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x565247741dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f653886f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f653886f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x56524773f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f653886f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56524769d2f0 con 0x565247738b40 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f653886f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x565247658060 con 0x565247742370 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f653886f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x565247744e30 con 0x5652477375d0 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f653886f740 10 client.0 _ll_register_callbacks cb 0x5652473ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6527fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6527fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34368/0 (socket says 172.21.15.60:34368) 2024-09-12T00:03:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6527fff640 1 -- 172.21.15.60:0/269547380 learned_addr learned my addr 172.21.15.60:0/269547380 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6534a33640 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x56524773f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f652ffff640 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x565247741dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6527fff640 1 -- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 msgr2=0x565247741dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6527fff640 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x565247741dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6527fff640 1 -- 172.21.15.60:0/269547380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 msgr2=0x56524773f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6527fff640 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x56524773f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f6527fff640 1 -- 172.21.15.60:0/269547380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56524740e3c0 con 0x565247738b40 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.181+0000 7f652ffff640 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x565247741dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f6527fff640 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773f080 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f651800bea0 tx=0x7f65180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4faeac6b6c8a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f650f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f650f7fe640 1 -- 172.21.15.60:0/269547380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518004230 con 0x565247738b40 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f650f7fe640 1 -- 172.21.15.60:0/269547380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f65180043d0 con 0x565247738b40 2024-09-12T00:03:34.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 1 -- 172.21.15.60:0/269547380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65200bc660 con 0x565247738b40 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f650f7fe640 1 -- 172.21.15.60:0/269547380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f65180035f0 con 0x565247738b40 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 10 client.16497 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 1 -- 172.21.15.60:0/269547380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x565247750830 con 0x565247738b40 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f650f7fe640 1 -- 172.21.15.60:0/269547380 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65200bc660 con 0x565247738b40 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f650f7fe640 1 -- 172.21.15.60:0/269547380 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f651801ba70 con 0x565247738b40 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 10 client.16497 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 10 client.16497 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 20 client.16497 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x565247751ce0 0x565247754150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 4 client.16497 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.182+0000 7f653886f740 1 -- 172.21.15.60:0/269547380 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652476aa860 con 0x565247751ce0 2024-09-12T00:03:34.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.183+0000 7f652ffff640 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x565247751ce0 0x565247754150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.183+0000 7f652ffff640 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x565247751ce0 0x565247754150 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1fe2fb7b5e4d468f server_cookie=76cb20ae4872800a in_seq=0 out_seq=0 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.183+0000 7f650f7fe640 10 client.16497 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f650f7fe640 1 -- 172.21.15.60:0/269547380 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652476aa860 con 0x565247751ce0 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f650f7fe640 10 client.16497 handle_command_reply: tid=0 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 client.16497 shutdown 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 -- 172.21.15.60:0/269547380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 msgr2=0x56524773f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773f080 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f651800bea0 tx=0x7f65180117b0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 -- 172.21.15.60:0/269547380 shutdown_connections 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x565247751ce0 0x565247754150 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x56524773f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773f080 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 --2- 172.21.15.60:0/269547380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x565247741dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f650f7fe640 0 client.16497 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:03:34.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.184+0000 7f653886f740 1 -- 172.21.15.60:0/269547380 >> 172.21.15.60:0/269547380 conn(0x565247700310 msgr2=0x565247739990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:34.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.185+0000 7f653886f740 1 -- 172.21.15.60:0/269547380 shutdown_connections 2024-09-12T00:03:34.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.185+0000 7f653886f740 1 -- 172.21.15.60:0/269547380 wait complete. 2024-09-12T00:03:34.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.185+0000 7f653886f740 20 client.16497 trim_cache size 0 max 16384 2024-09-12T00:03:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f653886f740 1 Processor -- start 2024-09-12T00:03:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f653886f740 1 -- start start 2024-09-12T00:03:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f653886f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x5652477383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f653886f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f653886f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x56524773a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f653886f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65301ad8a0 con 0x565247738b40 2024-09-12T00:03:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f653886f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65301af6e0 con 0x565247742370 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f653886f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65301ae030 con 0x5652477375d0 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f6527fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f6527fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34380/0 (socket says 172.21.15.60:34380) 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.198+0000 7f6527fff640 1 -- 172.21.15.60:0/3436120977 learned_addr learned my addr 172.21.15.60:0/3436120977 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6534a33640 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x56524773a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f652ffff640 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x5652477383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6527fff640 1 -- 172.21.15.60:0/3436120977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 msgr2=0x5652477383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6527fff640 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x5652477383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6527fff640 1 -- 172.21.15.60:0/3436120977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 msgr2=0x56524773a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6527fff640 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x56524773a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6527fff640 1 -- 172.21.15.60:0/3436120977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56524773d5d0 con 0x565247738b40 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6527fff640 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773a310 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f651800be70 tx=0x7f651800ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b876e6e42fb69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6525ffb640 1 -- 172.21.15.60:0/3436120977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651801b670 con 0x565247738b40 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6525ffb640 1 -- 172.21.15.60:0/3436120977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f651802b040 con 0x565247738b40 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.199+0000 7f6525ffb640 1 -- 172.21.15.60:0/3436120977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518024430 con 0x565247738b40 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 -- 172.21.15.60:0/3436120977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 msgr2=0x56524773a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773a310 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f651800be70 tx=0x7f651800ba90 comp rx=0 tx=0).stop 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 -- 172.21.15.60:0/3436120977 shutdown_connections 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247742370 0x56524773a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x565247738b40 0x56524773a310 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 --2- 172.21.15.60:0/3436120977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652477375d0 0x5652477383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 -- 172.21.15.60:0/3436120977 >> 172.21.15.60:0/3436120977 conn(0x565247700310 msgr2=0x56524772ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 -- 172.21.15.60:0/3436120977 shutdown_connections 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 -- 172.21.15.60:0/3436120977 wait complete. 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.200+0000 7f653886f740 1 -- start start 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f653886f740 1 Processor -- start 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f653886f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x56524774a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f653886f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247738b40 0x56524774a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f653886f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247742370 0x56524773b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f653886f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65301aef50 con 0x5652477375d0 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f653886f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65301ae7c0 con 0x565247738b40 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f653886f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65301ab880 con 0x565247742370 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f653886f740 10 client.0 _ll_register_callbacks cb 0x7f651800b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f652ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x56524774a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f652ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x56524774a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34392/0 (socket says 172.21.15.60:34392) 2024-09-12T00:03:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f652ffff640 1 -- 172.21.15.60:0/3421193841 learned_addr learned my addr 172.21.15.60:0/3421193841 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f6527fff640 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247738b40 0x56524774a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f6534a33640 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247742370 0x56524773b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f652ffff640 1 -- 172.21.15.60:0/3421193841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247742370 msgr2=0x56524773b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f652ffff640 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247742370 0x56524773b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f652ffff640 1 -- 172.21.15.60:0/3421193841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247738b40 msgr2=0x56524774a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f652ffff640 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247738b40 0x56524774a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f652ffff640 1 -- 172.21.15.60:0/3421193841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56524773bfa0 con 0x5652477375d0 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.201+0000 7f6527fff640 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247738b40 0x56524774a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f652ffff640 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x56524774a2a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f65200b8930 tx=0x7f6520032e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5f6d04066049a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f650f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f650f7fe640 1 -- 172.21.15.60:0/3421193841 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65200d4070 con 0x5652477375d0 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f650f7fe640 1 -- 172.21.15.60:0/3421193841 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f652003b460 con 0x5652477375d0 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 1 -- 172.21.15.60:0/3421193841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f651802b040 con 0x5652477375d0 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f650f7fe640 1 -- 172.21.15.60:0/3421193841 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6520049040 con 0x5652477375d0 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 10 client.16503 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 1 -- 172.21.15.60:0/3421193841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5652477c07e0 con 0x5652477375d0 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f650f7fe640 1 -- 172.21.15.60:0/3421193841 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f651802b040 con 0x5652477375d0 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f650f7fe640 1 -- 172.21.15.60:0/3421193841 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f65200ed410 con 0x5652477375d0 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 10 client.16503 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 10 client.16503 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 20 client.16503 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5652477c0e50 0x5652477c3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 4 client.16503 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.202+0000 7f653886f740 1 -- 172.21.15.60:0/3421193841 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5652476a4d70 con 0x5652477c0e50 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f6527fff640 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5652477c0e50 0x5652477c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f6527fff640 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5652477c0e50 0x5652477c3270 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=14cda8f7c0ea16ae server_cookie=446f715f4f3baf41 in_seq=0 out_seq=0 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f650f7fe640 10 client.16503 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f650f7fe640 1 -- 172.21.15.60:0/3421193841 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5652476a4d70 con 0x5652477c0e50 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f650f7fe640 10 client.16503 handle_command_reply: tid=0 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f653886f740 1 client.16503 shutdown 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f653886f740 1 -- 172.21.15.60:0/3421193841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 msgr2=0x56524774a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f653886f740 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x56524774a2a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f65200b8930 tx=0x7f6520032e80 comp rx=0 tx=0).stop 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.203+0000 7f653886f740 1 -- 172.21.15.60:0/3421193841 shutdown_connections 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f653886f740 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5652477c0e50 0x5652477c3270 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f653886f740 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x565247742370 0x56524773b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f653886f740 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565247738b40 0x56524774a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f653886f740 1 --2- 172.21.15.60:0/3421193841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652477375d0 0x56524774a2a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f653886f740 1 -- 172.21.15.60:0/3421193841 >> 172.21.15.60:0/3421193841 conn(0x565247700310 msgr2=0x56524773a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f650f7fe640 0 client.16503 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:03:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f653886f740 1 -- 172.21.15.60:0/3421193841 shutdown_connections 2024-09-12T00:03:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f653886f740 1 -- 172.21.15.60:0/3421193841 wait complete. 2024-09-12T00:03:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f653886f740 20 client.16503 trim_cache size 0 max 16384 2024-09-12T00:03:34.214 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 -- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f651c0a2cf0 msgr2=0x7f651c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f651c0a2cf0 0x7f651c0a51b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6528009440 tx=0x7f65280093d0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 -- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 msgr2=0x7f6530198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 0x7f6530198510 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6520004770 tx=0x7f6520032c90 comp rx=0 tx=0).stop 2024-09-12T00:03:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 -- 172.21.15.60:0/974821103 shutdown_connections 2024-09-12T00:03:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f651c0a2cf0 0x7f651c0a51b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6530106f10 0x7f653019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6530102790 0x7f6530198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 --2- 172.21.15.60:0/974821103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6530101de0 0x7f6530198510 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.204+0000 7f6536496640 1 -- 172.21.15.60:0/974821103 >> 172.21.15.60:0/974821103 conn(0x7f65300fd8c0 msgr2=0x7f65300fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.205+0000 7f6536496640 1 -- 172.21.15.60:0/974821103 shutdown_connections 2024-09-12T00:03:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:34.205+0000 7f6536496640 1 -- 172.21.15.60:0/974821103 wait complete. 2024-09-12T00:03:35.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:03:35.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:35 smithi060 ceph-mon[30953]: pgmap v129: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:35.360 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:35.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:35 smithi105 ceph-mon[34805]: pgmap v129: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:35.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:35 smithi192 ceph-mon[35487]: pgmap v129: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:35.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 -- 172.21.15.60:0/2996261405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7304102df0 msgr2=0x7f73041031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 --2- 172.21.15.60:0/2996261405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7304102df0 0x7f73041031d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009ca0 tx=0x7f72f402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 -- 172.21.15.60:0/2996261405 shutdown_connections 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 --2- 172.21.15.60:0/2996261405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f730410c2f0 0x7f730410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 --2- 172.21.15.60:0/2996261405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73041037a0 0x7f730410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 --2- 172.21.15.60:0/2996261405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7304102df0 0x7f73041031d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 -- 172.21.15.60:0/2996261405 >> 172.21.15.60:0/2996261405 conn(0x7f73040fc7d0 msgr2=0x7f73040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 -- 172.21.15.60:0/2996261405 shutdown_connections 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 -- 172.21.15.60:0/2996261405 wait complete. 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.853+0000 7f7308e6e640 1 Processor -- start 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7308e6e640 1 -- start start 2024-09-12T00:03:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7308e6e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7304102df0 0x7f7304198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7308e6e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73041037a0 0x7f7304198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7308e6e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730410c2f0 0x7f730419cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7308e6e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f73041122e0 con 0x7f73041037a0 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7308e6e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7304112160 con 0x7f7304102df0 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7308e6e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7304112460 con 0x7f730410c2f0 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7301d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73041037a0 0x7f7304198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7301d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73041037a0 0x7f7304198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34400/0 (socket says 172.21.15.60:34400) 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7301d9b640 1 -- 172.21.15.60:0/3668445390 learned_addr learned my addr 172.21.15.60:0/3668445390 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f730259c640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7304102df0 0x7f7304198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7302d9d640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730410c2f0 0x7f730419cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7301d9b640 1 -- 172.21.15.60:0/3668445390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730410c2f0 msgr2=0x7f730419cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7301d9b640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730410c2f0 0x7f730419cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7301d9b640 1 -- 172.21.15.60:0/3668445390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7304102df0 msgr2=0x7f7304198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7301d9b640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7304102df0 0x7f7304198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7301d9b640 1 -- 172.21.15.60:0/3668445390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730419d6d0 con 0x7f73041037a0 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.854+0000 7f7302d9d640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730410c2f0 0x7f730419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.855+0000 7f7301d9b640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73041037a0 0x7f7304198c60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f72f8006fd0 tx=0x7f72f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.855+0000 7f72f37fe640 1 -- 172.21.15.60:0/3668445390 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8011830 con 0x7f73041037a0 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.855+0000 7f7308e6e640 1 -- 172.21.15.60:0/3668445390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730419d9c0 con 0x7f73041037a0 2024-09-12T00:03:35.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.855+0000 7f72f37fe640 1 -- 172.21.15.60:0/3668445390 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f72f8016070 con 0x7f73041037a0 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.855+0000 7f72f37fe640 1 -- 172.21.15.60:0/3668445390 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f800f2e0 con 0x7f73041037a0 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.855+0000 7f7308e6e640 1 -- 172.21.15.60:0/3668445390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73041a52a0 con 0x7f73041037a0 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.857+0000 7f72f37fe640 1 -- 172.21.15.60:0/3668445390 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f72f80119d0 con 0x7f73041037a0 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.857+0000 7f730b247740 1 Processor -- start 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.857+0000 7f730b247740 1 -- start start 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730b247740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bbd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730b247740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730b247740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730b247740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4b232f0 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730b247740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4acacf0 con 0x55c3b4bbeb40 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730b247740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4b1f2b0 con 0x55c3b4bcc780 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f72f37fe640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72ec0a2cf0 0x7f72ec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34412/0 (socket says 172.21.15.60:34412) 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f7302d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bbd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730259c640 1 -- 172.21.15.60:0/3642324758 learned_addr learned my addr 172.21.15.60:0/3642324758 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f7302d9d640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72ec0a2cf0 0x7f72ec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f72f37fe640 1 -- 172.21.15.60:0/3668445390 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f72f80cea10 con 0x7f73041037a0 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f7301d9b640 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730259c640 1 -- 172.21.15.60:0/3642324758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 msgr2=0x55c3b4bceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730259c640 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730259c640 1 -- 172.21.15.60:0/3642324758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 msgr2=0x55c3b4bbd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730259c640 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bbd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f730259c640 1 -- 172.21.15.60:0/3642324758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b4aaf3a0 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f7302d9d640 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.858+0000 7f7301d9b640 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.859+0000 7f7302d9d640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72ec0a2cf0 0x7f72ec0a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0129e0 tx=0x7f72fc005bc0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.859+0000 7f730259c640 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbda10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009ca0 tx=0x7f72f4031b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416fa0a109781b42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.859+0000 7f72f0ff9640 1 -- 172.21.15.60:0/3642324758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4031670 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.859+0000 7f72f0ff9640 1 -- 172.21.15.60:0/3642324758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f72f4036030 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.859+0000 7f72f0ff9640 1 -- 172.21.15.60:0/3642324758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4004790 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.859+0000 7f730b247740 1 -- 172.21.15.60:0/3642324758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 msgr2=0x55c3b4bbda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.859+0000 7f730b247740 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbda10 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009ca0 tx=0x7f72f4031b90 comp rx=0 tx=0).stop 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 -- 172.21.15.60:0/3642324758 shutdown_connections 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbda10 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 --2- 172.21.15.60:0/3642324758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bbd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 -- 172.21.15.60:0/3642324758 >> 172.21.15.60:0/3642324758 conn(0x55c3b4b86310 msgr2=0x55c3b4bb9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 -- 172.21.15.60:0/3642324758 shutdown_connections 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 -- 172.21.15.60:0/3642324758 wait complete. 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 -- start start 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 Processor -- start 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bcc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.860+0000 7f730b247740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bc93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730b247740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730b247740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4bcf420 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730b247740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4ade060 con 0x55c3b4bbeb40 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730b247740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3b4bcf5a0 con 0x55c3b4bcc780 2024-09-12T00:03:35.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730b247740 10 client.0 _ll_register_callbacks cb 0x55c3b48318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bcc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bcc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34414/0 (socket says 172.21.15.60:34414) 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 -- 172.21.15.60:0/25927287 learned_addr learned my addr 172.21.15.60:0/25927287 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f7301d9b640 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bc93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f7302d9d640 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 -- 172.21.15.60:0/25927287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 msgr2=0x55c3b4bc9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 -- 172.21.15.60:0/25927287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 msgr2=0x55c3b4bc93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bc93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 -- 172.21.15.60:0/25927287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b48943c0 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f730259c640 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bcc0f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f72f4000f80 tx=0x7f72f40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a233752939c57a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:35.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.861+0000 7f72e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f72e9ffb640 1 -- 172.21.15.60:0/25927287 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4049040 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f72e9ffb640 1 -- 172.21.15.60:0/25927287 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f72f4003b70 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 1 -- 172.21.15.60:0/25927287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f4036030 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f72e9ffb640 1 -- 172.21.15.60:0/25927287 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f72f405d050 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 10 client.16515 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 1 -- 172.21.15.60:0/25927287 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c3b4bcf420 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f72e9ffb640 1 -- 172.21.15.60:0/25927287 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f72f4036030 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f72e9ffb640 1 -- 172.21.15.60:0/25927287 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f72f404c030 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 10 client.16515 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 10 client.16515 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 20 client.16515 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55c3b4bdbfb0 0x55c3b4bde3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 4 client.16515 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:35.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.862+0000 7f730b247740 1 -- 172.21.15.60:0/25927287 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3b4b30860 con 0x55c3b4bdbfb0 2024-09-12T00:03:35.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.863+0000 7f7301d9b640 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55c3b4bdbfb0 0x55c3b4bde3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.863+0000 7f7301d9b640 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55c3b4bdbfb0 0x55c3b4bde3a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e5e1fd8d185274 server_cookie=45037b99bb429442 in_seq=0 out_seq=0 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.863+0000 7f72e9ffb640 10 client.16515 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f72e9ffb640 1 -- 172.21.15.60:0/25927287 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f72f8079e50 con 0x55c3b4bdbfb0 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f72e9ffb640 10 client.16515 handle_command_reply: tid=0 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 client.16515 shutdown 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 -- 172.21.15.60:0/25927287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 msgr2=0x55c3b4bcc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bcc0f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f72f4000f80 tx=0x7f72f40095c0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 -- 172.21.15.60:0/25927287 shutdown_connections 2024-09-12T00:03:35.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55c3b4bdbfb0 0x55c3b4bde3a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f72e9ffb640 0 client.16515 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:03:35.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bc93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 --2- 172.21.15.60:0/25927287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bcc0f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 -- 172.21.15.60:0/25927287 >> 172.21.15.60:0/25927287 conn(0x55c3b4b86310 msgr2=0x55c3b4bbf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:35.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 -- 172.21.15.60:0/25927287 shutdown_connections 2024-09-12T00:03:35.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 1 -- 172.21.15.60:0/25927287 wait complete. 2024-09-12T00:03:35.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.864+0000 7f730b247740 20 client.16515 trim_cache size 0 max 16384 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730b247740 1 Processor -- start 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730b247740 1 -- start start 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730b247740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbe410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730b247740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bd86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730b247740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730b247740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f73041ab4b0 con 0x55c3b4bbeb40 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730b247740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73041ad2f0 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730b247740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73041abc40 con 0x55c3b4bcc780 2024-09-12T00:03:35.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f7301d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bd86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f7301d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bd86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34418/0 (socket says 172.21.15.60:34418) 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f7301d9b640 1 -- 172.21.15.60:0/481914462 learned_addr learned my addr 172.21.15.60:0/481914462 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f730259c640 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbe410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f7302d9d640 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.877+0000 7f7301d9b640 1 -- 172.21.15.60:0/481914462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 msgr2=0x55c3b4bc8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f7301d9b640 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f7301d9b640 1 -- 172.21.15.60:0/481914462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbd5d0 msgr2=0x55c3b4bbe410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f7301d9b640 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbe410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f7301d9b640 1 -- 172.21.15.60:0/481914462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b4bbd2d0 con 0x55c3b4bbeb40 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f7301d9b640 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bd86c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f72f8097a00 tx=0x7f72f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30915f816de5950d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f72ebfff640 1 -- 172.21.15.60:0/481914462 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80bb0b0 con 0x55c3b4bbeb40 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f72ebfff640 1 -- 172.21.15.60:0/481914462 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55c3b4b30860 con 0x55c3b4bbeb40 2024-09-12T00:03:35.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f72ebfff640 1 -- 172.21.15.60:0/481914462 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8011de0 con 0x55c3b4bbeb40 2024-09-12T00:03:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f730b247740 1 -- 172.21.15.60:0/481914462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbeb40 msgr2=0x55c3b4bd86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.878+0000 7f730b247740 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bd86c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f72f8097a00 tx=0x7f72f80046c0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 -- 172.21.15.60:0/481914462 shutdown_connections 2024-09-12T00:03:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bd86c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 --2- 172.21.15.60:0/481914462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bbe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 -- 172.21.15.60:0/481914462 >> 172.21.15.60:0/481914462 conn(0x55c3b4b86310 msgr2=0x55c3b4bc7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 -- 172.21.15.60:0/481914462 shutdown_connections 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 -- 172.21.15.60:0/481914462 wait complete. 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 -- start start 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 Processor -- start 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bd4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bc5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f73041acb60 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73041ac3d0 con 0x55c3b4bcc780 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73041a94b0 con 0x55c3b4bbeb40 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bd4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730b247740 10 client.0 _ll_register_callbacks cb 0x7f72fc00dab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bd4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34420/0 (socket says 172.21.15.60:34420) 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.879+0000 7f730259c640 1 -- 172.21.15.60:0/3905726125 learned_addr learned my addr 172.21.15.60:0/3905726125 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f7302d9d640 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f7301d9b640 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bc5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730259c640 1 -- 172.21.15.60:0/3905726125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bbeb40 msgr2=0x55c3b4bc5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730259c640 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bc5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730259c640 1 -- 172.21.15.60:0/3905726125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bcc780 msgr2=0x55c3b4bc6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730259c640 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730259c640 1 -- 172.21.15.60:0/3905726125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b4bc6900 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730259c640 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bd4cb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009860 tx=0x7f72f4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6e91d13895be6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f72e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f72e9ffb640 1 -- 172.21.15.60:0/3905726125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4066060 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f72e9ffb640 1 -- 172.21.15.60:0/3905726125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f72f4031680 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730b247740 1 -- 172.21.15.60:0/3905726125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c3b4b30860 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f72e9ffb640 1 -- 172.21.15.60:0/3905726125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f72f4031880 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730b247740 10 client.16521 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.880+0000 7f730b247740 1 -- 172.21.15.60:0/3905726125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c3b4c469d0 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f72e9ffb640 1 -- 172.21.15.60:0/3905726125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55c3b4b30860 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f72e9ffb640 1 -- 172.21.15.60:0/3905726125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f72f404c040 con 0x55c3b4bbd5d0 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f730b247740 10 client.16521 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f730b247740 10 client.16521 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f730b247740 20 client.16521 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f730b247740 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55c3b4c47180 0x55c3b4c495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f730b247740 4 client.16521 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f730b247740 1 -- 172.21.15.60:0/3905726125 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3b4b2ad70 con 0x55c3b4c47180 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.881+0000 7f7301d9b640 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55c3b4c47180 0x55c3b4c495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f7301d9b640 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55c3b4c47180 0x55c3b4c495a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a9925a7ee8c3446 server_cookie=774e65ad9ab2ef46 in_seq=0 out_seq=0 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f72e9ffb640 10 client.16521 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f72e9ffb640 1 -- 172.21.15.60:0/3905726125 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3b4b2ad70 con 0x55c3b4c47180 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f72e9ffb640 10 client.16521 handle_command_reply: tid=0 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 client.16521 shutdown 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 -- 172.21.15.60:0/3905726125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 msgr2=0x55c3b4bd4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bd4cb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009860 tx=0x7f72f4005ef0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 -- 172.21.15.60:0/3905726125 shutdown_connections 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55c3b4c47180 0x55c3b4c495a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c3b4bcc780 0x55c3b4bc6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3b4bbeb40 0x55c3b4bc5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f72e9ffb640 0 client.16521 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:03:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 --2- 172.21.15.60:0/3905726125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c3b4bbd5d0 0x55c3b4bd4cb0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 -- 172.21.15.60:0/3905726125 >> 172.21.15.60:0/3905726125 conn(0x55c3b4b86310 msgr2=0x55c3b4bc8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 -- 172.21.15.60:0/3905726125 shutdown_connections 2024-09-12T00:03:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 1 -- 172.21.15.60:0/3905726125 wait complete. 2024-09-12T00:03:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.882+0000 7f730b247740 20 client.16521 trim_cache size 0 max 16384 2024-09-12T00:03:35.888 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 -- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72ec0a2cf0 msgr2=0x7f72ec0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72ec0a2cf0 0x7f72ec0a51b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0129e0 tx=0x7f72fc005bc0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 -- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73041037a0 msgr2=0x7f7304198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73041037a0 0x7f7304198c60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f72f8006fd0 tx=0x7f72f800b8e0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 -- 172.21.15.60:0/3668445390 shutdown_connections 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f72ec0a2cf0 0x7f72ec0a51b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f730410c2f0 0x7f730419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73041037a0 0x7f7304198c60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 --2- 172.21.15.60:0/3668445390 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7304102df0 0x7f7304198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 -- 172.21.15.60:0/3668445390 >> 172.21.15.60:0/3668445390 conn(0x7f73040fc7d0 msgr2=0x7f73040fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 -- 172.21.15.60:0/3668445390 shutdown_connections 2024-09-12T00:03:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:35.883+0000 7f7308e6e640 1 -- 172.21.15.60:0/3668445390 wait complete. 2024-09-12T00:03:36.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:03:36.925 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:37.297 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:37 smithi060 ceph-mon[30953]: pgmap v130: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:37.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 -- 172.21.15.60:0/3968674978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 msgr2=0x7f1d5010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 --2- 172.21.15.60:0/3968674978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 0x7f1d5010bb50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009900 tx=0x7f1d4002a480 comp rx=0 tx=0).stop 2024-09-12T00:03:37.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 -- 172.21.15.60:0/3968674978 shutdown_connections 2024-09-12T00:03:37.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 --2- 172.21.15.60:0/3968674978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d5010c170 0x7f1d5010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 --2- 172.21.15.60:0/3968674978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 0x7f1d5010bb50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 --2- 172.21.15.60:0/3968674978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d50102d40 0x7f1d50103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 -- 172.21.15.60:0/3968674978 >> 172.21.15.60:0/3968674978 conn(0x7f1d500fc7a0 msgr2=0x7f1d500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 -- 172.21.15.60:0/3968674978 shutdown_connections 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.381+0000 7f1d57a30640 1 -- 172.21.15.60:0/3968674978 wait complete. 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d57a30640 1 Processor -- start 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d57a30640 1 -- start start 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d57a30640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d50102d40 0x7f1d50198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d57a30640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 0x7f1d50198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d57a30640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d5010c170 0x7f1d5019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d57a30640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501120e0 con 0x7f1d50103660 2024-09-12T00:03:37.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d57a30640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1d50111f60 con 0x7f1d5010c170 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d57a30640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1d50112260 con 0x7f1d50102d40 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d54fcb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 0x7f1d50198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d54fcb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 0x7f1d50198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34442/0 (socket says 172.21.15.60:34442) 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d54fcb640 1 -- 172.21.15.60:0/2897752707 learned_addr learned my addr 172.21.15.60:0/2897752707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.382+0000 7f1d557cc640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d50102d40 0x7f1d50198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d5010c170 0x7f1d5019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d54fcb640 1 -- 172.21.15.60:0/2897752707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d50102d40 msgr2=0x7f1d50198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d50102d40 0x7f1d50198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d54fcb640 1 -- 172.21.15.60:0/2897752707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d5010c170 msgr2=0x7f1d5019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d5010c170 0x7f1d5019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d54fcb640 1 -- 172.21.15.60:0/2897752707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5019d510 con 0x7f1d50103660 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 0x7f1d50198aa0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1d4002aa70 tx=0x7f1d40032a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d467fc640 1 -- 172.21.15.60:0/2897752707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4003f030 con 0x7f1d50103660 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d467fc640 1 -- 172.21.15.60:0/2897752707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d40032e40 con 0x7f1d50103660 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d57a30640 1 -- 172.21.15.60:0/2897752707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5019d7a0 con 0x7f1d50103660 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d467fc640 1 -- 172.21.15.60:0/2897752707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40035070 con 0x7f1d50103660 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.383+0000 7f1d57a30640 1 -- 172.21.15.60:0/2897752707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d501a50e0 con 0x7f1d50103660 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.385+0000 7f1d467fc640 1 -- 172.21.15.60:0/2897752707 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1d40042030 con 0x7f1d50103660 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d59e09740 1 Processor -- start 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d59e09740 1 -- start start 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d467fc640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f1d3c0a2d70 0x7f1d3c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda90090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda90a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda9b370 0x55bacda9d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d59e09740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bacd9f62f0 con 0x55bacda905d0 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d59e09740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55bacd99dcf0 con 0x55bacda91b40 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d59e09740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bacd9f22b0 con 0x55bacda9b370 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f1d3c0a2d70 0x7f1d3c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda90a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda90a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34454/0 (socket says 172.21.15.60:34454) 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 -- 172.21.15.60:0/2526143382 learned_addr learned my addr 172.21.15.60:0/2526143382 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:37.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.386+0000 7f1d467fc640 1 -- 172.21.15.60:0/2897752707 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1d400ef700 con 0x7f1d50103660 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d557cc640 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda90090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda9b370 0x55bacda9d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 -- 172.21.15.60:0/2526143382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda9b370 msgr2=0x55bacda9d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda9b370 0x55bacda9d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 -- 172.21.15.60:0/2526143382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 msgr2=0x55bacda90090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda90090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 -- 172.21.15.60:0/2526143382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bacd9823a0 con 0x55bacda905d0 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f1d3c0a2d70 0x7f1d3c0a5230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d48005fd0 tx=0x7f1d48012810 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda90a10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1d400c4350 tx=0x7f1d400b8090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2086e7466f5850e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d3b7fe640 1 -- 172.21.15.60:0/2526143382 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40049070 con 0x55bacda905d0 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d3b7fe640 1 -- 172.21.15.60:0/2526143382 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d400c4880 con 0x55bacda905d0 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.387+0000 7f1d3b7fe640 1 -- 172.21.15.60:0/2526143382 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d400ed0c0 con 0x55bacda905d0 2024-09-12T00:03:37.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 -- 172.21.15.60:0/2526143382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 msgr2=0x55bacda90a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda90a10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1d400c4350 tx=0x7f1d400b8090 comp rx=0 tx=0).stop 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 -- 172.21.15.60:0/2526143382 shutdown_connections 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda9b370 0x55bacda9d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda90a10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2526143382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda90090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 -- 172.21.15.60:0/2526143382 >> 172.21.15.60:0/2526143382 conn(0x55bacda59310 msgr2=0x55bacda8cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 -- 172.21.15.60:0/2526143382 shutdown_connections 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 -- 172.21.15.60:0/2526143382 wait complete. 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.388+0000 7f1d59e09740 1 -- start start 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d59e09740 1 Processor -- start 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacda9adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda98060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacda987f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d59e09740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bacda9de30 con 0x55bacda9b370 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d59e09740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55bacd9b1060 con 0x55bacda91b40 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d59e09740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bacda9dfb0 con 0x55bacda905d0 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d59e09740 10 client.0 _ll_register_callbacks cb 0x55bacd7048c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d55fcd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacda987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d55fcd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacda987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34462/0 (socket says 172.21.15.60:34462) 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d55fcd640 1 -- 172.21.15.60:0/3865781823 learned_addr learned my addr 172.21.15.60:0/3865781823 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d557cc640 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacda9adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.389+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda98060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d55fcd640 1 -- 172.21.15.60:0/3865781823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 msgr2=0x55bacda9adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacda9adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d55fcd640 1 -- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 msgr2=0x55bacda98060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda98060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d55fcd640 1 -- 172.21.15.60:0/3865781823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bacd7673c0 con 0x55bacda9b370 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda98060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacda987f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800e7f0 tx=0x7f1d48004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4002fbda07bea346 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d38ff9640 1 -- 172.21.15.60:0/3865781823 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800f940 con 0x55bacda9b370 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d59e09740 1 -- 172.21.15.60:0/3865781823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d400c4880 con 0x55bacda9b370 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d38ff9640 1 -- 172.21.15.60:0/3865781823 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1d4800fae0 con 0x55bacda9b370 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d38ff9640 1 -- 172.21.15.60:0/3865781823 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1d4800fce0 con 0x55bacda9b370 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d59e09740 10 client.16533 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d59e09740 1 -- 172.21.15.60:0/3865781823 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bacdab2070 con 0x55bacda9b370 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.390+0000 7f1d38ff9640 1 -- 172.21.15.60:0/3865781823 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d400c4880 con 0x55bacda9b370 2024-09-12T00:03:37.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.391+0000 7f1d38ff9640 1 -- 172.21.15.60:0/3865781823 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f1d48027590 con 0x55bacda9b370 2024-09-12T00:03:37.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.391+0000 7f1d59e09740 10 client.16533 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:37.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.391+0000 7f1d59e09740 10 client.16533 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:03:37.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.391+0000 7f1d59e09740 20 client.16533 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:37.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.391+0000 7f1d59e09740 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55bacdab3500 0x55bacdab5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.391+0000 7f1d59e09740 4 client.16533 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:37.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.391+0000 7f1d59e09740 1 -- 172.21.15.60:0/3865781823 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bacda03860 con 0x55bacdab3500 2024-09-12T00:03:37.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.391+0000 7f1d557cc640 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55bacdab3500 0x55bacdab5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d557cc640 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55bacdab3500 0x55bacdab5960 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5fb9f11dd24f910 server_cookie=9919b7a2ea69e6b4 in_seq=0 out_seq=0 2024-09-12T00:03:37.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d38ff9640 10 client.16533 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d38ff9640 1 -- 172.21.15.60:0/3865781823 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bacda03860 con 0x55bacdab3500 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d38ff9640 10 client.16533 handle_command_reply: tid=0 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 client.16533 shutdown 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 -- 172.21.15.60:0/3865781823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 msgr2=0x55bacda987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacda987f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800e7f0 tx=0x7f1d48004ab0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 -- 172.21.15.60:0/3865781823 shutdown_connections 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55bacdab3500 0x55bacdab5960 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacda987f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacda98060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 --2- 172.21.15.60:0/3865781823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacda9adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d59e09740 1 -- 172.21.15.60:0/3865781823 >> 172.21.15.60:0/3865781823 conn(0x55bacda59310 msgr2=0x55bacda92990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.392+0000 7f1d38ff9640 0 client.16533 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:03:37.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.393+0000 7f1d59e09740 1 -- 172.21.15.60:0/3865781823 shutdown_connections 2024-09-12T00:03:37.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.393+0000 7f1d59e09740 1 -- 172.21.15.60:0/3865781823 wait complete. 2024-09-12T00:03:37.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.393+0000 7f1d59e09740 20 client.16533 trim_cache size 0 max 16384 2024-09-12T00:03:37.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d59e09740 1 Processor -- start 2024-09-12T00:03:37.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d59e09740 1 -- start start 2024-09-12T00:03:37.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda8bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda91b40 0x55bacda93180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda9b370 0x55bacda936c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d59e09740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501ab640 con 0x55bacda905d0 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d59e09740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501ad480 con 0x55bacda9b370 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d59e09740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501abdd0 con 0x55bacda91b40 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda8bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda8bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34474/0 (socket says 172.21.15.60:34474) 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 -- 172.21.15.60:0/1747907292 learned_addr learned my addr 172.21.15.60:0/1747907292 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 -- 172.21.15.60:0/1747907292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda91b40 msgr2=0x55bacda93180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 --2- 172.21.15.60:0/1747907292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda91b40 0x55bacda93180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 -- 172.21.15.60:0/1747907292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda9b370 msgr2=0x55bacda936c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/1747907292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda9b370 0x55bacda936c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 --2- 172.21.15.60:0/1747907292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda9b370 0x55bacda936c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 -- 172.21.15.60:0/1747907292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bacda91740 con 0x55bacda905d0 2024-09-12T00:03:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.406+0000 7f1d557cc640 1 --2- 172.21.15.60:0/1747907292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda8bbf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55bacdab61d0 tx=0x7f1d4c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16784f168f3fb8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:37.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d3affd640 1 -- 172.21.15.60:0/1747907292 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c011440 con 0x55bacda905d0 2024-09-12T00:03:37.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d3affd640 1 -- 172.21.15.60:0/1747907292 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d4c011ae0 con 0x55bacda905d0 2024-09-12T00:03:37.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d3affd640 1 -- 172.21.15.60:0/1747907292 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c01dbc0 con 0x55bacda905d0 2024-09-12T00:03:37.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 -- 172.21.15.60:0/1747907292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 msgr2=0x55bacda8bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 --2- 172.21.15.60:0/1747907292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda8bbf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55bacdab61d0 tx=0x7f1d4c00b390 comp rx=0 tx=0).stop 2024-09-12T00:03:37.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 -- 172.21.15.60:0/1747907292 shutdown_connections 2024-09-12T00:03:37.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 --2- 172.21.15.60:0/1747907292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda9b370 0x55bacda936c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 --2- 172.21.15.60:0/1747907292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda91b40 0x55bacda93180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 --2- 172.21.15.60:0/1747907292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda905d0 0x55bacda8bbf0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 -- 172.21.15.60:0/1747907292 >> 172.21.15.60:0/1747907292 conn(0x55bacda59310 msgr2=0x55bacda8b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 -- 172.21.15.60:0/1747907292 shutdown_connections 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.407+0000 7f1d59e09740 1 -- 172.21.15.60:0/1747907292 wait complete. 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 1 -- start start 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 1 Processor -- start 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacdaa7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacdaa84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacdb1d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501accf0 con 0x55bacda9b370 2024-09-12T00:03:37.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501ac560 con 0x55bacda91b40 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501a9620 con 0x55bacda905d0 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d59e09740 10 client.0 _ll_register_callbacks cb 0x7f1d4800e410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d55fcd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacdb1d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d55fcd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacdb1d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34478/0 (socket says 172.21.15.60:34478) 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d55fcd640 1 -- 172.21.15.60:0/2110235124 learned_addr learned my addr 172.21.15.60:0/2110235124 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.408+0000 7f1d54fcb640 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacdaa84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d557cc640 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacdaa7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d55fcd640 1 -- 172.21.15.60:0/2110235124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 msgr2=0x55bacdaa7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacdaa7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d55fcd640 1 -- 172.21.15.60:0/2110235124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 msgr2=0x55bacdaa84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacdaa84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d55fcd640 1 -- 172.21.15.60:0/2110235124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bacdb1d840 con 0x55bacda9b370 2024-09-12T00:03:37.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d557cc640 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacdaa7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d55fcd640 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacdb1d200 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1d480279e0 tx=0x7f1d480276b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fa307e392627f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d38ff9640 1 -- 172.21.15.60:0/2110235124 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800e5b0 con 0x55bacda9b370 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d38ff9640 1 -- 172.21.15.60:0/2110235124 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1d4800f9a0 con 0x55bacda9b370 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d59e09740 1 -- 172.21.15.60:0/2110235124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d4c011ae0 con 0x55bacda9b370 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d38ff9640 1 -- 172.21.15.60:0/2110235124 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1d4800fe80 con 0x55bacda9b370 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d59e09740 10 client.16539 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d59e09740 1 -- 172.21.15.60:0/2110235124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bacdb1eb20 con 0x55bacda9b370 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d38ff9640 1 -- 172.21.15.60:0/2110235124 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d4c011ae0 con 0x55bacda9b370 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.409+0000 7f1d38ff9640 1 -- 172.21.15.60:0/2110235124 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f1d48039450 con 0x55bacda9b370 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d59e09740 10 client.16539 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d59e09740 10 client.16539 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:03:37.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d59e09740 20 client.16539 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55bacdb1f1f0 0x55bacdb21610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d59e09740 4 client.16539 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d59e09740 1 -- 172.21.15.60:0/2110235124 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bacd9fdd70 con 0x55bacdb1f1f0 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d557cc640 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55bacdb1f1f0 0x55bacdb21610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d557cc640 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55bacdb1f1f0 0x55bacdb21610 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87e31adefe683864 server_cookie=d3c6e8ee00b48884 in_seq=0 out_seq=0 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d38ff9640 10 client.16539 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d38ff9640 1 -- 172.21.15.60:0/2110235124 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bacd9fdd70 con 0x55bacdb1f1f0 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.410+0000 7f1d38ff9640 10 client.16539 handle_command_reply: tid=0 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 client.16539 shutdown 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 -- 172.21.15.60:0/2110235124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 msgr2=0x55bacdb1d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacdb1d200 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1d480279e0 tx=0x7f1d480276b0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 -- 172.21.15.60:0/2110235124 shutdown_connections 2024-09-12T00:03:37.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55bacdb1f1f0 0x55bacdb21610 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bacda9b370 0x55bacdb1d200 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bacda91b40 0x55bacdaa84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 --2- 172.21.15.60:0/2110235124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bacda905d0 0x55bacdaa7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 -- 172.21.15.60:0/2110235124 >> 172.21.15.60:0/2110235124 conn(0x55bacda59310 msgr2=0x55bacda9a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:37.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d38ff9640 0 client.16539 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:03:37.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 -- 172.21.15.60:0/2110235124 shutdown_connections 2024-09-12T00:03:37.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 1 -- 172.21.15.60:0/2110235124 wait complete. 2024-09-12T00:03:37.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d59e09740 20 client.16539 trim_cache size 0 max 16384 2024-09-12T00:03:37.417 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:37.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d57a30640 1 -- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f1d3c0a2d70 msgr2=0x7f1d3c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d57a30640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f1d3c0a2d70 0x7f1d3c0a5230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d48005fd0 tx=0x7f1d48012810 comp rx=0 tx=0).stop 2024-09-12T00:03:37.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d57a30640 1 -- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 msgr2=0x7f1d50198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.411+0000 7f1d57a30640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 0x7f1d50198aa0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1d4002aa70 tx=0x7f1d40032a40 comp rx=0 tx=0).stop 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.412+0000 7f1d57a30640 1 -- 172.21.15.60:0/2897752707 shutdown_connections 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.412+0000 7f1d57a30640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f1d3c0a2d70 0x7f1d3c0a5230 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.412+0000 7f1d57a30640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d5010c170 0x7f1d5019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.412+0000 7f1d57a30640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d50103660 0x7f1d50198aa0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.412+0000 7f1d57a30640 1 --2- 172.21.15.60:0/2897752707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d50102d40 0x7f1d50198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.412+0000 7f1d57a30640 1 -- 172.21.15.60:0/2897752707 >> 172.21.15.60:0/2897752707 conn(0x7f1d500fc7a0 msgr2=0x7f1d500fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.412+0000 7f1d57a30640 1 -- 172.21.15.60:0/2897752707 shutdown_connections 2024-09-12T00:03:37.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:37.412+0000 7f1d57a30640 1 -- 172.21.15.60:0/2897752707 wait complete. 2024-09-12T00:03:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:37 smithi105 ceph-mon[34805]: pgmap v130: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:37.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:37 smithi192 ceph-mon[35487]: pgmap v130: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:38.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:03:38.361 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:38.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 -- 172.21.15.60:0/1984991764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 msgr2=0x7f37f4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 --2- 172.21.15.60:0/1984991764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 0x7f37f4103120 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009900 tx=0x7f37e402a480 comp rx=0 tx=0).stop 2024-09-12T00:03:38.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 -- 172.21.15.60:0/1984991764 shutdown_connections 2024-09-12T00:03:38.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 --2- 172.21.15.60:0/1984991764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f410c170 0x7f37f410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 --2- 172.21.15.60:0/1984991764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37f4103660 0x7f37f410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 --2- 172.21.15.60:0/1984991764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 0x7f37f4103120 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 -- 172.21.15.60:0/1984991764 >> 172.21.15.60:0/1984991764 conn(0x7f37f40fc7a0 msgr2=0x7f37f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:38.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 -- 172.21.15.60:0/1984991764 shutdown_connections 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.824+0000 7f37f976b640 1 -- 172.21.15.60:0/1984991764 wait complete. 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f976b640 1 Processor -- start 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f976b640 1 -- start start 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f976b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 0x7f37f41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f976b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37f4103660 0x7f37f4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f976b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f410c170 0x7f37f4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f976b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4112090 con 0x7f37f4102d40 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f976b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4111f10 con 0x7f37f410c170 2024-09-12T00:03:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f976b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4112210 con 0x7f37f4103660 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 0x7f37f41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 0x7f37f41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34490/0 (socket says 172.21.15.60:34490) 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37f2ffd640 1 -- 172.21.15.60:0/220052878 learned_addr learned my addr 172.21.15.60:0/220052878 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.825+0000 7f37ebfff640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37f4103660 0x7f37f4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f2ffd640 1 -- 172.21.15.60:0/220052878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37f4103660 msgr2=0x7f37f4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f2ffd640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37f4103660 0x7f37f4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f2ffd640 1 -- 172.21.15.60:0/220052878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f410c170 msgr2=0x7f37f4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f2ffd640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f410c170 0x7f37f4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f2ffd640 1 -- 172.21.15.60:0/220052878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f41a6990 con 0x7f37f4102d40 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f2ffd640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 0x7f37f41009a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f37e4006010 tx=0x7f37e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f0ff9640 1 -- 172.21.15.60:0/220052878 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e403f030 con 0x7f37f4102d40 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f0ff9640 1 -- 172.21.15.60:0/220052878 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f37e4003d00 con 0x7f37f4102d40 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f976b640 1 -- 172.21.15.60:0/220052878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f41a6c20 con 0x7f37f4102d40 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f0ff9640 1 -- 172.21.15.60:0/220052878 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4035070 con 0x7f37f4102d40 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.826+0000 7f37f976b640 1 -- 172.21.15.60:0/220052878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f41a7100 con 0x7f37f4102d40 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.829+0000 7f37fbb44740 1 Processor -- start 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.829+0000 7f37f0ff9640 1 -- 172.21.15.60:0/220052878 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f37e4042030 con 0x7f37f4102d40 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.829+0000 7f37fbb44740 1 -- start start 2024-09-12T00:03:38.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec73090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec735d0 0x55a79ec73a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec7e370 0x55a79ec80760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37fbb44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a79ebd92f0 con 0x55a79ec74b40 2024-09-12T00:03:38.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37fbb44740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a79eb80cf0 con 0x55a79ec735d0 2024-09-12T00:03:38.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37fbb44740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a79ebd52b0 con 0x55a79ec7e370 2024-09-12T00:03:38.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec73090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec73090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34500/0 (socket says 172.21.15.60:34500) 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 -- 172.21.15.60:0/1471334448 learned_addr learned my addr 172.21.15.60:0/1471334448 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f2ffd640 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec735d0 0x55a79ec73a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37ebfff640 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec7e370 0x55a79ec80760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 -- 172.21.15.60:0/1471334448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec7e370 msgr2=0x55a79ec80760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec7e370 0x55a79ec80760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 -- 172.21.15.60:0/1471334448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec735d0 msgr2=0x55a79ec73a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec735d0 0x55a79ec73a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 -- 172.21.15.60:0/1471334448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a79eb653a0 con 0x55a79ec74b40 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37ebfff640 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec7e370 0x55a79ec80760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f0ff9640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f37e00a2cf0 0x7f37e00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f37fe640 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec73090 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f37ec007c60 tx=0x7f37ec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c013d781ad06e572 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f2ffd640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f37e00a2cf0 0x7f37e00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.830+0000 7f37f0ff9640 1 -- 172.21.15.60:0/220052878 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f37e40ef930 con 0x7f37f4102d40 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37e97fa640 1 -- 172.21.15.60:0/1471334448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec003b70 con 0x55a79ec74b40 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37e97fa640 1 -- 172.21.15.60:0/1471334448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f37ec003d10 con 0x55a79ec74b40 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37e97fa640 1 -- 172.21.15.60:0/1471334448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec00f970 con 0x55a79ec74b40 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37fbb44740 1 -- 172.21.15.60:0/1471334448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 msgr2=0x55a79ec73090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37f2ffd640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f37e00a2cf0 0x7f37e00a51b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f37e40ed180 tx=0x7f37e40f2f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37fbb44740 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec73090 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f37ec007c60 tx=0x7f37ec00c6a0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37fbb44740 1 -- 172.21.15.60:0/1471334448 shutdown_connections 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37fbb44740 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec7e370 0x55a79ec80760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37fbb44740 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec735d0 0x55a79ec73a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.831+0000 7f37fbb44740 1 --2- 172.21.15.60:0/1471334448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec73090 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 -- 172.21.15.60:0/1471334448 >> 172.21.15.60:0/1471334448 conn(0x55a79ec3c310 msgr2=0x55a79ec6fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 -- 172.21.15.60:0/1471334448 shutdown_connections 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 -- 172.21.15.60:0/1471334448 wait complete. 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 -- start start 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 Processor -- start 2024-09-12T00:03:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec7dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec74b40 0x55a79ec7af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec7e370 0x55a79ec7b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a79ec81070 con 0x55a79ec7e370 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a79eb94060 con 0x55a79ec74b40 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a79ec811f0 con 0x55a79ec735d0 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37fbb44740 10 client.0 _ll_register_callbacks cb 0x55a79e8e78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37f37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec7e370 0x55a79ec7b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37f37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec7e370 0x55a79ec7b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34506/0 (socket says 172.21.15.60:34506) 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.832+0000 7f37f37fe640 1 -- 172.21.15.60:0/223465927 learned_addr learned my addr 172.21.15.60:0/223465927 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:38.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37f37fe640 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec7dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37ebfff640 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec74b40 0x55a79ec7af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37f37fe640 1 -- 172.21.15.60:0/223465927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 msgr2=0x55a79ec7dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:38.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37f37fe640 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec7dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37f37fe640 1 -- 172.21.15.60:0/223465927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec74b40 msgr2=0x55a79ec7af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:38.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37f37fe640 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec74b40 0x55a79ec7af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37f37fe640 1 -- 172.21.15.60:0/223465927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a79e94a3c0 con 0x55a79ec7e370 2024-09-12T00:03:38.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37f37fe640 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec7e370 0x55a79ec7b4e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00cfd0 tx=0x7f37ec00f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c79eb457ea4ee3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:38.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37da7fc640 1 -- 172.21.15.60:0/223465927 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec021040 con 0x55a79ec7e370 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37da7fc640 1 -- 172.21.15.60:0/223465927 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f37ec0040c0 con 0x55a79ec7e370 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37fbb44740 1 -- 172.21.15.60:0/223465927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37ec003d10 con 0x55a79ec7e370 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37da7fc640 1 -- 172.21.15.60:0/223465927 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f37ec00fe10 con 0x55a79ec7e370 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37fbb44740 10 client.16551 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.833+0000 7f37fbb44740 1 -- 172.21.15.60:0/223465927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a79ec8c9f0 con 0x55a79ec7e370 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37da7fc640 1 -- 172.21.15.60:0/223465927 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f37ec003d10 con 0x55a79ec7e370 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37da7fc640 1 -- 172.21.15.60:0/223465927 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f37ec032980 con 0x55a79ec7e370 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37fbb44740 10 client.16551 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37fbb44740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37fbb44740 20 client.16551 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37fbb44740 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a79ec8de50 0x55a79ec90240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37fbb44740 4 client.16551 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37fbb44740 1 -- 172.21.15.60:0/223465927 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a79ebe6860 con 0x55a79ec8de50 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.834+0000 7f37ebfff640 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a79ec8de50 0x55a79ec90240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.835+0000 7f37ebfff640 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a79ec8de50 0x55a79ec90240 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7a10116d81b8d23 server_cookie=e8454588169e71b3 in_seq=0 out_seq=0 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.835+0000 7f37da7fc640 10 client.16551 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.835+0000 7f37da7fc640 1 -- 172.21.15.60:0/223465927 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a79ebe6860 con 0x55a79ec8de50 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.835+0000 7f37da7fc640 10 client.16551 handle_command_reply: tid=0 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.835+0000 7f37fbb44740 1 client.16551 shutdown 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.835+0000 7f37fbb44740 1 -- 172.21.15.60:0/223465927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec7e370 msgr2=0x55a79ec7b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.835+0000 7f37fbb44740 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec7e370 0x55a79ec7b4e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00cfd0 tx=0x7f37ec00f590 comp rx=0 tx=0).stop 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 1 -- 172.21.15.60:0/223465927 shutdown_connections 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a79ec8de50 0x55a79ec90240 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec7e370 0x55a79ec7b4e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec74b40 0x55a79ec7af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 1 --2- 172.21.15.60:0/223465927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec7dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 1 -- 172.21.15.60:0/223465927 >> 172.21.15.60:0/223465927 conn(0x55a79ec3c310 msgr2=0x55a79ec75930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37da7fc640 0 client.16551 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 1 -- 172.21.15.60:0/223465927 shutdown_connections 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 1 -- 172.21.15.60:0/223465927 wait complete. 2024-09-12T00:03:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.836+0000 7f37fbb44740 20 client.16551 trim_cache size 0 max 16384 2024-09-12T00:03:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37fbb44740 1 Processor -- start 2024-09-12T00:03:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37fbb44740 1 -- start start 2024-09-12T00:03:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec8a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec76120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 0x55a79ec76660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37fbb44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41afa10 con 0x55a79ec74b40 2024-09-12T00:03:38.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37fbb44740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41b1850 con 0x55a79ec7e370 2024-09-12T00:03:38.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37fbb44740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41b01a0 con 0x55a79ec735d0 2024-09-12T00:03:38.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37ebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec76120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37ebfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec76120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34514/0 (socket says 172.21.15.60:34514) 2024-09-12T00:03:38.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37ebfff640 1 -- 172.21.15.60:0/508556013 learned_addr learned my addr 172.21.15.60:0/508556013 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:38.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37f37fe640 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec8a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37f37fe640 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 0x55a79ec76660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37ebfff640 1 -- 172.21.15.60:0/508556013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 msgr2=0x55a79ec8a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:38.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37ebfff640 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec8a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37ebfff640 1 -- 172.21.15.60:0/508556013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 msgr2=0x55a79ec76660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:38.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37ebfff640 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 0x55a79ec76660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.849+0000 7f37ebfff640 1 -- 172.21.15.60:0/508556013 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a79ec74750 con 0x55a79ec74b40 2024-09-12T00:03:38.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.850+0000 7f37f37fe640 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec8a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:38.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.850+0000 7f37ebfff640 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec76120 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55a79ec74070 tx=0x7f37dc00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620c9fff4d876987 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:38.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.850+0000 7f37e8ff9640 1 -- 172.21.15.60:0/508556013 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc003d20 con 0x55a79ec74b40 2024-09-12T00:03:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.850+0000 7f37e8ff9640 1 -- 172.21.15.60:0/508556013 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f37dc005520 con 0x55a79ec74b40 2024-09-12T00:03:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.850+0000 7f37e8ff9640 1 -- 172.21.15.60:0/508556013 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0126b0 con 0x55a79ec74b40 2024-09-12T00:03:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- 172.21.15.60:0/508556013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 msgr2=0x55a79ec76120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec76120 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x55a79ec74070 tx=0x7f37dc00bcb0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- 172.21.15.60:0/508556013 shutdown_connections 2024-09-12T00:03:38.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 0x55a79ec76660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec74b40 0x55a79ec76120 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 --2- 172.21.15.60:0/508556013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec735d0 0x55a79ec8a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- 172.21.15.60:0/508556013 >> 172.21.15.60:0/508556013 conn(0x55a79ec3c310 msgr2=0x55a79ec8fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- 172.21.15.60:0/508556013 shutdown_connections 2024-09-12T00:03:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- 172.21.15.60:0/508556013 wait complete. 2024-09-12T00:03:38.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- start start 2024-09-12T00:03:38.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 Processor -- start 2024-09-12T00:03:38.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec735d0 0x55a79ec86930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec74b40 0x55a79ec81cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 0x55a79ec821f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41b10c0 con 0x55a79ec735d0 2024-09-12T00:03:38.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41b0930 con 0x55a79ec7e370 2024-09-12T00:03:38.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37f41ad9f0 con 0x55a79ec74b40 2024-09-12T00:03:38.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37fbb44740 10 client.0 _ll_register_callbacks cb 0x7f37e40f5420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:38.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.851+0000 7f37f37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec735d0 0x55a79ec86930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec735d0 0x55a79ec86930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34530/0 (socket says 172.21.15.60:34530) 2024-09-12T00:03:38.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 -- 172.21.15.60:0/2650461510 learned_addr learned my addr 172.21.15.60:0/2650461510 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37ebfff640 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec74b40 0x55a79ec81cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 0x55a79ec821f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 -- 172.21.15.60:0/2650461510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec74b40 msgr2=0x55a79ec81cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec74b40 0x55a79ec81cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 -- 172.21.15.60:0/2650461510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 msgr2=0x55a79ec821f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 0x55a79ec821f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 -- 172.21.15.60:0/2650461510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a79ec82760 con 0x55a79ec735d0 2024-09-12T00:03:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37f37fe640 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec735d0 0x55a79ec86930 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00fde0 tx=0x7f37ec00f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956a429d10cffd30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37da7fc640 1 -- 172.21.15.60:0/2650461510 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec007560 con 0x55a79ec735d0 2024-09-12T00:03:38.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37fbb44740 1 -- 172.21.15.60:0/2650461510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37dc005520 con 0x55a79ec735d0 2024-09-12T00:03:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37da7fc640 1 -- 172.21.15.60:0/2650461510 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f37ec032640 con 0x55a79ec735d0 2024-09-12T00:03:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37da7fc640 1 -- 172.21.15.60:0/2650461510 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f37ec032840 con 0x55a79ec735d0 2024-09-12T00:03:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37fbb44740 10 client.16557 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.852+0000 7f37fbb44740 1 -- 172.21.15.60:0/2650461510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a79ecf8790 con 0x55a79ec735d0 2024-09-12T00:03:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37da7fc640 1 -- 172.21.15.60:0/2650461510 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f37dc005520 con 0x55a79ec735d0 2024-09-12T00:03:38.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37da7fc640 1 -- 172.21.15.60:0/2650461510 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f37ec03d020 con 0x55a79ec735d0 2024-09-12T00:03:38.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37fbb44740 10 client.16557 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:38.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37fbb44740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:38.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37fbb44740 20 client.16557 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:38.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37fbb44740 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a79ecf8f10 0x55a79ecfb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:38.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37fbb44740 4 client.16557 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:03:38.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37fbb44740 1 -- 172.21.15.60:0/2650461510 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a79ebe0d70 con 0x55a79ecf8f10 2024-09-12T00:03:38.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.853+0000 7f37ebfff640 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a79ecf8f10 0x55a79ecfb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:38.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37ebfff640 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a79ecf8f10 0x55a79ecfb330 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=199f4b59eb9b31f3 server_cookie=19b9fcd19c22e6bf in_seq=0 out_seq=0 2024-09-12T00:03:38.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37da7fc640 10 client.16557 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:38.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37da7fc640 1 -- 172.21.15.60:0/2650461510 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a79ebe0d70 con 0x55a79ecf8f10 2024-09-12T00:03:38.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37da7fc640 10 client.16557 handle_command_reply: tid=0 2024-09-12T00:03:38.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 client.16557 shutdown 2024-09-12T00:03:38.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 -- 172.21.15.60:0/2650461510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec735d0 msgr2=0x55a79ec86930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec735d0 0x55a79ec86930 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f37ec00fde0 tx=0x7f37ec00f590 comp rx=0 tx=0).stop 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 -- 172.21.15.60:0/2650461510 shutdown_connections 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a79ecf8f10 0x55a79ecfb330 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a79ec7e370 0x55a79ec821f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a79ec74b40 0x55a79ec81cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37da7fc640 0 client.16557 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 --2- 172.21.15.60:0/2650461510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a79ec735d0 0x55a79ec86930 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 -- 172.21.15.60:0/2650461510 >> 172.21.15.60:0/2650461510 conn(0x55a79ec3c310 msgr2=0x55a79ec6e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 -- 172.21.15.60:0/2650461510 shutdown_connections 2024-09-12T00:03:38.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 1 -- 172.21.15.60:0/2650461510 wait complete. 2024-09-12T00:03:38.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.854+0000 7f37fbb44740 20 client.16557 trim_cache size 0 max 16384 2024-09-12T00:03:38.873 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:03:38.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 -- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f37e00a2cf0 msgr2=0x7f37e00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f37e00a2cf0 0x7f37e00a51b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f37e40ed180 tx=0x7f37e40f2f90 comp rx=0 tx=0).stop 2024-09-12T00:03:38.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 -- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 msgr2=0x7f37f41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:38.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 0x7f37f41009a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f37e4006010 tx=0x7f37e40042f0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 -- 172.21.15.60:0/220052878 shutdown_connections 2024-09-12T00:03:38.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f37e00a2cf0 0x7f37e00a51b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f410c170 0x7f37f4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37f4103660 0x7f37f4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 --2- 172.21.15.60:0/220052878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37f4102d40 0x7f37f41009a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:38.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 -- 172.21.15.60:0/220052878 >> 172.21.15.60:0/220052878 conn(0x7f37f40fc7a0 msgr2=0x7f37f40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:38.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 -- 172.21.15.60:0/220052878 shutdown_connections 2024-09-12T00:03:38.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:38.855+0000 7f37f976b640 1 -- 172.21.15.60:0/220052878 wait complete. 2024-09-12T00:03:39.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:39 smithi105 ceph-mon[34805]: pgmap v131: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:39.498 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:39 smithi060 ceph-mon[30953]: pgmap v131: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:39.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:39 smithi192 ceph-mon[35487]: pgmap v131: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:40.682 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:03:40.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:03:40.955 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:41.334 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:41 smithi060 ceph-mon[30953]: pgmap v132: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:41.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 -- 172.21.15.60:0/2803923312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 msgr2=0x7f275010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 --2- 172.21.15.60:0/2803923312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 0x7f275010e610 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f2748009ca0 tx=0x7f274802a950 comp rx=0 tx=0).stop 2024-09-12T00:03:41.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 -- 172.21.15.60:0/2803923312 shutdown_connections 2024-09-12T00:03:41.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 --2- 172.21.15.60:0/2803923312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 0x7f275010e610 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 --2- 172.21.15.60:0/2803923312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2750103660 0x7f275010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 --2- 172.21.15.60:0/2803923312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2750102d40 0x7f2750103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 -- 172.21.15.60:0/2803923312 >> 172.21.15.60:0/2803923312 conn(0x7f27500fc7a0 msgr2=0x7f27500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 -- 172.21.15.60:0/2803923312 shutdown_connections 2024-09-12T00:03:41.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.420+0000 7f27550a6640 1 -- 172.21.15.60:0/2803923312 wait complete. 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f27550a6640 1 Processor -- start 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f27550a6640 1 -- start start 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f27550a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2750102d40 0x7f27501984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f27550a6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2750103660 0x7f27501989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f27550a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 0x7f275019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f27550a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2750112070 con 0x7f275010c170 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f27550a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2750111ef0 con 0x7f2750102d40 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f27550a6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27501121f0 con 0x7f2750103660 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 0x7f275019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 0x7f275019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34552/0 (socket says 172.21.15.60:34552) 2024-09-12T00:03:41.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274f59e640 1 -- 172.21.15.60:0/611361586 learned_addr learned my addr 172.21.15.60:0/611361586 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274ed9d640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2750102d40 0x7f27501984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f2747fff640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2750103660 0x7f27501989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274f59e640 1 -- 172.21.15.60:0/611361586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2750103660 msgr2=0x7f27501989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274f59e640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2750103660 0x7f27501989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274f59e640 1 -- 172.21.15.60:0/611361586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2750102d40 msgr2=0x7f27501984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274f59e640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2750102d40 0x7f27501984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.421+0000 7f274f59e640 1 -- 172.21.15.60:0/611361586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275019d460 con 0x7f275010c170 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.422+0000 7f274f59e640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 0x7f275019cd80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2748005cc0 tx=0x7f2748030e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.422+0000 7f274cd99640 1 -- 172.21.15.60:0/611361586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748034040 con 0x7f275010c170 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.422+0000 7f274cd99640 1 -- 172.21.15.60:0/611361586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2748003e00 con 0x7f275010c170 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.422+0000 7f27550a6640 1 -- 172.21.15.60:0/611361586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275019d6f0 con 0x7f275010c170 2024-09-12T00:03:41.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.422+0000 7f274cd99640 1 -- 172.21.15.60:0/611361586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480456e0 con 0x7f275010c170 2024-09-12T00:03:41.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.422+0000 7f27550a6640 1 -- 172.21.15.60:0/611361586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27501a5030 con 0x7f275010c170 2024-09-12T00:03:41.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.424+0000 7f274cd99640 1 -- 172.21.15.60:0/611361586 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2748037020 con 0x7f275010c170 2024-09-12T00:03:41.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.424+0000 7f275747f740 1 Processor -- start 2024-09-12T00:03:41.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.424+0000 7f275747f740 1 -- start start 2024-09-12T00:03:41.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f275747f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb20e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f275747f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb2fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f275747f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 0x55d01eb32540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f275747f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d01ea86280 con 0x55d01eb20a40 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f275747f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d01ea2db10 con 0x55d01eb30150 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f275747f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d01ea82240 con 0x55d01eb21360 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f274cd99640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f273c0a2d70 0x7f273c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f2747fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb20e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f2747fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb20e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34562/0 (socket says 172.21.15.60:34562) 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f2747fff640 1 -- 172.21.15.60:0/464184434 learned_addr learned my addr 172.21.15.60:0/464184434 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f274cd99640 1 -- 172.21.15.60:0/611361586 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f27480f02a0 con 0x7f275010c170 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f2747fff640 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 0x55d01eb32540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f274f59e640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f273c0a2d70 0x7f273c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.425+0000 7f274ed9d640 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb2fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f2747fff640 1 -- 172.21.15.60:0/464184434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 msgr2=0x55d01eb2fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:41.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f2747fff640 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb2fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f2747fff640 1 -- 172.21.15.60:0/464184434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 msgr2=0x55d01eb32540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f2747fff640 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 0x55d01eb32540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f2747fff640 1 -- 172.21.15.60:0/464184434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01ea3a1f0 con 0x55d01eb20a40 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f2747fff640 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb20e20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2738014870 tx=0x7f273800a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9816da37a8da0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f274f59e640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f273c0a2d70 0x7f273c0a5230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f27480edc00 tx=0x7f274802a950 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f27457fa640 1 -- 172.21.15.60:0/464184434 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738005020 con 0x55d01eb20a40 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f27457fa640 1 -- 172.21.15.60:0/464184434 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f273800abf0 con 0x55d01eb20a40 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.426+0000 7f27457fa640 1 -- 172.21.15.60:0/464184434 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273800d940 con 0x55d01eb20a40 2024-09-12T00:03:41.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 -- 172.21.15.60:0/464184434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 msgr2=0x55d01eb20e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb20e20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2738014870 tx=0x7f273800a5e0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 -- 172.21.15.60:0/464184434 shutdown_connections 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 0x55d01eb32540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb2fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 --2- 172.21.15.60:0/464184434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb20e20 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 -- 172.21.15.60:0/464184434 >> 172.21.15.60:0/464184434 conn(0x55d01eb1d0f0 msgr2=0x55d01eb1d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 -- 172.21.15.60:0/464184434 shutdown_connections 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 -- 172.21.15.60:0/464184434 wait complete. 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 -- start start 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 Processor -- start 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb20a40 0x55d01eb2d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb21360 0x55d01eb2d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb2da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.427+0000 7f275747f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d01eb32d20 con 0x55d01eb30150 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f275747f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d01ea40f10 con 0x55d01eb21360 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f275747f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d01eb32ea0 con 0x55d01eb20a40 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f275747f740 10 client.0 _ll_register_callbacks cb 0x55d01ea09a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb2da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb2da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34576/0 (socket says 172.21.15.60:34576) 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 -- 172.21.15.60:0/2169047044 learned_addr learned my addr 172.21.15.60:0/2169047044 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f274ed9d640 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb21360 0x55d01eb2d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb20a40 0x55d01eb2d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 -- 172.21.15.60:0/2169047044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb20a40 msgr2=0x55d01eb2d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb20a40 0x55d01eb2d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 -- 172.21.15.60:0/2169047044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb21360 msgr2=0x55d01eb2d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb21360 0x55d01eb2d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 -- 172.21.15.60:0/2169047044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01e7f76a0 con 0x55d01eb30150 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f274ed9d640 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb21360 0x55d01eb2d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f2747fff640 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb2da80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f27380058e0 tx=0x7f2738016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212e0170a209a15a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f27367fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f27367fc640 1 -- 172.21.15.60:0/2169047044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738005410 con 0x55d01eb30150 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f27367fc640 1 -- 172.21.15.60:0/2169047044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f27380055b0 con 0x55d01eb30150 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.428+0000 7f275747f740 1 -- 172.21.15.60:0/2169047044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f273800abf0 con 0x55d01eb30150 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f27367fc640 1 -- 172.21.15.60:0/2169047044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f273800d740 con 0x55d01eb30150 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f275747f740 10 client.16569 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f275747f740 1 -- 172.21.15.60:0/2169047044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d01eb3e910 con 0x55d01eb30150 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f27367fc640 1 -- 172.21.15.60:0/2169047044 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f273800abf0 con 0x55d01eb30150 2024-09-12T00:03:41.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f27367fc640 1 -- 172.21.15.60:0/2169047044 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f273800fac0 con 0x55d01eb30150 2024-09-12T00:03:41.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f275747f740 10 client.16569 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:41.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f275747f740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:41.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f275747f740 20 client.16569 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:41.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f275747f740 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d01eb3fc60 0x55d01eb42050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f275747f740 4 client.16569 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:41.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f275747f740 1 -- 172.21.15.60:0/2169047044 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d01ea937f0 con 0x55d01eb3fc60 2024-09-12T00:03:41.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.429+0000 7f274ed9d640 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d01eb3fc60 0x55d01eb42050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.430+0000 7f27367fc640 10 client.16569 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:41.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.430+0000 7f274ed9d640 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d01eb3fc60 0x55d01eb42050 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bb6741c402a3ef2 server_cookie=826ea4ad52427257 in_seq=0 out_seq=0 2024-09-12T00:03:41.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.430+0000 7f27367fc640 1 -- 172.21.15.60:0/2169047044 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d01ea937f0 con 0x55d01eb3fc60 2024-09-12T00:03:41.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.430+0000 7f27367fc640 10 client.16569 handle_command_reply: tid=0 2024-09-12T00:03:41.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.430+0000 7f275747f740 1 client.16569 shutdown 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 -- 172.21.15.60:0/2169047044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 msgr2=0x55d01eb2da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb2da80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f27380058e0 tx=0x7f2738016040 comp rx=0 tx=0).stop 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 -- 172.21.15.60:0/2169047044 shutdown_connections 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d01eb3fc60 0x55d01eb42050 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb2da80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f27367fc640 0 client.16569 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb21360 0x55d01eb2d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 --2- 172.21.15.60:0/2169047044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb20a40 0x55d01eb2d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 -- 172.21.15.60:0/2169047044 >> 172.21.15.60:0/2169047044 conn(0x55d01eb1d0f0 msgr2=0x55d01eb22e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 -- 172.21.15.60:0/2169047044 shutdown_connections 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 1 -- 172.21.15.60:0/2169047044 wait complete. 2024-09-12T00:03:41.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.431+0000 7f275747f740 20 client.16569 trim_cache size 0 max 16384 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.448+0000 7f275747f740 1 Processor -- start 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.448+0000 7f275747f740 1 -- start start 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.448+0000 7f275747f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb2bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.448+0000 7f275747f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb47620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.448+0000 7f275747f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 0x55d01eb47b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.448+0000 7f275747f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27501ab5f0 con 0x55d01eb20a40 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.448+0000 7f275747f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27501ad430 con 0x55d01eb30150 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.448+0000 7f275747f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27501abd80 con 0x55d01eb21360 2024-09-12T00:03:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb2bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb2bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34578/0 (socket says 172.21.15.60:34578) 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 -- 172.21.15.60:0/541828240 learned_addr learned my addr 172.21.15.60:0/541828240 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f274ed9d640 1 --2- 172.21.15.60:0/541828240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb47620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 -- 172.21.15.60:0/541828240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 msgr2=0x55d01eb47620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 --2- 172.21.15.60:0/541828240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb47620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 -- 172.21.15.60:0/541828240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 msgr2=0x55d01eb47b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 --2- 172.21.15.60:0/541828240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 0x55d01eb47b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 -- 172.21.15.60:0/541828240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d01eb23560 con 0x55d01eb20a40 2024-09-12T00:03:41.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2747fff640 1 --2- 172.21.15.60:0/541828240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb2bf40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f27380125e0 tx=0x7f2738012660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d3019c34d4f682 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2744ff9640 1 -- 172.21.15.60:0/541828240 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738004d80 con 0x55d01eb20a40 2024-09-12T00:03:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2744ff9640 1 -- 172.21.15.60:0/541828240 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2738029070 con 0x55d01eb20a40 2024-09-12T00:03:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.449+0000 7f2744ff9640 1 -- 172.21.15.60:0/541828240 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273800d8e0 con 0x55d01eb20a40 2024-09-12T00:03:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 -- 172.21.15.60:0/541828240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 msgr2=0x55d01eb2bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 --2- 172.21.15.60:0/541828240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb2bf40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f27380125e0 tx=0x7f2738012660 comp rx=0 tx=0).stop 2024-09-12T00:03:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 -- 172.21.15.60:0/541828240 shutdown_connections 2024-09-12T00:03:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 --2- 172.21.15.60:0/541828240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb30150 0x55d01eb47b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 --2- 172.21.15.60:0/541828240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb47620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 --2- 172.21.15.60:0/541828240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb20a40 0x55d01eb2bf40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 -- 172.21.15.60:0/541828240 >> 172.21.15.60:0/541828240 conn(0x55d01eb1d0f0 msgr2=0x55d01eb2ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 -- 172.21.15.60:0/541828240 shutdown_connections 2024-09-12T00:03:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 -- 172.21.15.60:0/541828240 wait complete. 2024-09-12T00:03:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.450+0000 7f275747f740 1 -- start start 2024-09-12T00:03:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f275747f740 1 Processor -- start 2024-09-12T00:03:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f275747f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb20a40 0x55d01eb38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f275747f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb33d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f275747f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb34480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f275747f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27501acca0 con 0x55d01eb30150 2024-09-12T00:03:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f275747f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27501ac510 con 0x55d01eb20a40 2024-09-12T00:03:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f275747f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27501a95f0 con 0x55d01eb21360 2024-09-12T00:03:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f275747f740 10 client.0 _ll_register_callbacks cb 0x7f273800ade0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb34480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb34480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34582/0 (socket says 172.21.15.60:34582) 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 -- 172.21.15.60:0/2847425576 learned_addr learned my addr 172.21.15.60:0/2847425576 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb20a40 0x55d01eb38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f274ed9d640 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb33d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 -- 172.21.15.60:0/2847425576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 msgr2=0x55d01eb33d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb33d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 -- 172.21.15.60:0/2847425576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb20a40 msgr2=0x55d01eb38a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb20a40 0x55d01eb38a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.451+0000 7f2747fff640 1 -- 172.21.15.60:0/2847425576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d01eba95f0 con 0x55d01eb30150 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f2747fff640 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb34480 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f273800a470 tx=0x7f27380041c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab6c9a522081286 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f27367fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f27367fc640 1 -- 172.21.15.60:0/2847425576 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738005410 con 0x55d01eb30150 2024-09-12T00:03:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f27367fc640 1 -- 172.21.15.60:0/2847425576 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f27380055b0 con 0x55d01eb30150 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 1 -- 172.21.15.60:0/2847425576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2738029070 con 0x55d01eb30150 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f27367fc640 1 -- 172.21.15.60:0/2847425576 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f273800d8e0 con 0x55d01eb30150 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 10 client.16575 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 1 -- 172.21.15.60:0/2847425576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d01ebaa7d0 con 0x55d01eb30150 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f27367fc640 1 -- 172.21.15.60:0/2847425576 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2738029070 con 0x55d01eb30150 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f27367fc640 1 -- 172.21.15.60:0/2847425576 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f273800f450 con 0x55d01eb30150 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 10 client.16575 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 20 client.16575 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d01eb3fc60 0x55d01ebacd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 4 client.16575 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:03:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.452+0000 7f275747f740 1 -- 172.21.15.60:0/2847425576 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d01ea8dd00 con 0x55d01eb3fc60 2024-09-12T00:03:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.453+0000 7f274ed9d640 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d01eb3fc60 0x55d01ebacd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.453+0000 7f274ed9d640 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d01eb3fc60 0x55d01ebacd20 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f9ef09e7952a5 server_cookie=b329d56db2517f1e in_seq=0 out_seq=0 2024-09-12T00:03:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.453+0000 7f27367fc640 10 client.16575 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.454+0000 7f27367fc640 1 -- 172.21.15.60:0/2847425576 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d01ea8dd00 con 0x55d01eb3fc60 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.454+0000 7f27367fc640 10 client.16575 handle_command_reply: tid=0 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.454+0000 7f275747f740 1 client.16575 shutdown 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.454+0000 7f275747f740 1 -- 172.21.15.60:0/2847425576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 msgr2=0x55d01eb34480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.454+0000 7f275747f740 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb34480 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f273800a470 tx=0x7f27380041c0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 1 -- 172.21.15.60:0/2847425576 shutdown_connections 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d01eb3fc60 0x55d01ebacd20 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d01eb30150 0x55d01eb34480 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d01eb21360 0x55d01eb33d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 1 --2- 172.21.15.60:0/2847425576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d01eb20a40 0x55d01eb38a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 1 -- 172.21.15.60:0/2847425576 >> 172.21.15.60:0/2847425576 conn(0x55d01eb1d0f0 msgr2=0x55d01eb2cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27367fc640 0 client.16575 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 1 -- 172.21.15.60:0/2847425576 shutdown_connections 2024-09-12T00:03:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 1 -- 172.21.15.60:0/2847425576 wait complete. 2024-09-12T00:03:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f275747f740 20 client.16575 trim_cache size 0 max 16384 2024-09-12T00:03:41.460 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:03:41.460 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:03:41.460 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "c3be6865-8848-43d6-b003-368b73113e0d", 2024-09-12T00:03:41.460 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:03:41.460 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:03:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 -- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f273c0a2d70 msgr2=0x7f273c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f273c0a2d70 0x7f273c0a5230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f27480edc00 tx=0x7f274802a950 comp rx=0 tx=0).stop 2024-09-12T00:03:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 -- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 msgr2=0x7f275019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 0x7f275019cd80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2748005cc0 tx=0x7f2748030e10 comp rx=0 tx=0).stop 2024-09-12T00:03:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 -- 172.21.15.60:0/611361586 shutdown_connections 2024-09-12T00:03:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f273c0a2d70 0x7f273c0a5230 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f275010c170 0x7f275019cd80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2750103660 0x7f27501989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.455+0000 7f27550a6640 1 --2- 172.21.15.60:0/611361586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2750102d40 0x7f27501984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:41.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.456+0000 7f27550a6640 1 -- 172.21.15.60:0/611361586 >> 172.21.15.60:0/611361586 conn(0x7f27500fc7a0 msgr2=0x7f27500fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:41.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.456+0000 7f27550a6640 1 -- 172.21.15.60:0/611361586 shutdown_connections 2024-09-12T00:03:41.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:41.456+0000 7f27550a6640 1 -- 172.21.15.60:0/611361586 wait complete. 2024-09-12T00:03:41.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:41 smithi105 ceph-mon[34805]: pgmap v132: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:41.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:41 smithi192 ceph-mon[35487]: pgmap v132: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:42.308 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:42 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:03:42.308 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:42.308 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:42 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:03:42.308 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:42.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:03:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:42 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:03:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:42 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:03:42.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:42 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:03:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:42 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:03:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:03:42.605 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 -- 172.21.15.60:0/2460575033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 msgr2=0x7f9e9410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 --2- 172.21.15.60:0/2460575033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 0x7f9e9410bb50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009900 tx=0x7f9e8402a480 comp rx=0 tx=0).stop 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 -- 172.21.15.60:0/2460575033 shutdown_connections 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 --2- 172.21.15.60:0/2460575033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e9410c170 0x7f9e9410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 --2- 172.21.15.60:0/2460575033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 0x7f9e9410bb50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 --2- 172.21.15.60:0/2460575033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e94102d40 0x7f9e94103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 -- 172.21.15.60:0/2460575033 >> 172.21.15.60:0/2460575033 conn(0x7f9e940fc7a0 msgr2=0x7f9e940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 -- 172.21.15.60:0/2460575033 shutdown_connections 2024-09-12T00:03:43.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 -- 172.21.15.60:0/2460575033 wait complete. 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 Processor -- start 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.104+0000 7f9e9b644640 1 -- start start 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e9b644640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e94102d40 0x7f9e941984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e9b644640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 0x7f9e94198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e9b644640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e9410c170 0x7f9e9419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e9b644640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94112090 con 0x7f9e94103660 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e9b644640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94111f10 con 0x7f9e9410c170 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e9b644640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94112210 con 0x7f9e94102d40 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 0x7f9e94198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 0x7f9e94198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38630/0 (socket says 172.21.15.60:38630) 2024-09-12T00:03:43.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 -- 172.21.15.60:0/560363711 learned_addr learned my addr 172.21.15.60:0/560363711 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e99be1640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e9410c170 0x7f9e9419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 -- 172.21.15.60:0/560363711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e94102d40 msgr2=0x7f9e941984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e94102d40 0x7f9e941984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 -- 172.21.15.60:0/560363711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e9410c170 msgr2=0x7f9e9419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e9410c170 0x7f9e9419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 -- 172.21.15.60:0/560363711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9419d480 con 0x7f9e94103660 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 0x7f9e94198a10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9e84006010 tx=0x7f9e840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e8a7fc640 1 -- 172.21.15.60:0/560363711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8403f030 con 0x7f9e94103660 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e8a7fc640 1 -- 172.21.15.60:0/560363711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e84003d00 con 0x7f9e94103660 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e9b644640 1 -- 172.21.15.60:0/560363711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9419d710 con 0x7f9e94103660 2024-09-12T00:03:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.105+0000 7f9e8a7fc640 1 -- 172.21.15.60:0/560363711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84035070 con 0x7f9e94103660 2024-09-12T00:03:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.106+0000 7f9e9b644640 1 -- 172.21.15.60:0/560363711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e941a5050 con 0x7f9e94103660 2024-09-12T00:03:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e8a7fc640 1 -- 172.21.15.60:0/560363711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9e84042030 con 0x7f9e94103660 2024-09-12T00:03:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e9da1d740 1 Processor -- start 2024-09-12T00:03:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e9da1d740 1 -- start start 2024-09-12T00:03:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff34a0 0x55a803ff3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff3dc0 0x55a803ffe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804000a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a803f592e0 con 0x55a803ff34a0 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a803f00ce0 con 0x55a803ffe680 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.108+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a803f552a0 con 0x55a803ff3dc0 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e8a7fc640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9e800a2cf0 0x7f9e800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e993e0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff3dc0 0x55a803ffe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804000a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e99be1640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9e800a2cf0 0x7f9e800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e993e0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff3dc0 0x55a803ffe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:42754/0 (socket says 172.21.15.60:42754) 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e993e0640 1 -- 172.21.15.60:0/1329131091 learned_addr learned my addr 172.21.15.60:0/1329131091 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e8a7fc640 1 -- 172.21.15.60:0/560363711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9e840efa70 con 0x7f9e94103660 2024-09-12T00:03:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e99be1640 1 --2- 172.21.15.60:0/1329131091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff34a0 0x55a803ff3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e98bdf640 1 -- 172.21.15.60:0/1329131091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff3dc0 msgr2=0x55a803ffe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/1329131091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff3dc0 0x55a803ffe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e98bdf640 1 -- 172.21.15.60:0/1329131091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff34a0 msgr2=0x55a803ff3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/1329131091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff34a0 0x55a803ff3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e98bdf640 1 -- 172.21.15.60:0/1329131091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a803ee5440 con 0x55a803ffe680 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.109+0000 7f9e99be1640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9e800a2cf0 0x7f9e800a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c005cc0 tx=0x7f9e8c012a10 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.110+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/1329131091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804000a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e840ed210 tx=0x7f9e8408f050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cfc96ec823ffb6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.110+0000 7f9e7f7fe640 1 -- 172.21.15.60:0/1329131091 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84049070 con 0x55a803ffe680 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.110+0000 7f9e7f7fe640 1 -- 172.21.15.60:0/1329131091 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e84087070 con 0x55a803ffe680 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.110+0000 7f9e7f7fe640 1 -- 172.21.15.60:0/1329131091 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8403b460 con 0x55a803ffe680 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.110+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1329131091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 msgr2=0x55a804000a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.110+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1329131091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804000a70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e840ed210 tx=0x7f9e8408f050 comp rx=0 tx=0).stop 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.110+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1329131091 shutdown_connections 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1329131091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804000a70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1329131091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff3dc0 0x55a803ffe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1329131091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff34a0 0x55a803ff3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1329131091 >> 172.21.15.60:0/1329131091 conn(0x55a803fefa30 msgr2=0x55a803fefe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1329131091 shutdown_connections 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1329131091 wait complete. 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 -- start start 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 Processor -- start 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a803ffe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ffb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a803ffb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a804001010 con 0x55a803ff3dc0 2024-09-12T00:03:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a803f14050 con 0x55a803ffe680 2024-09-12T00:03:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a804001190 con 0x55a803ff34a0 2024-09-12T00:03:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.111+0000 7f9e9da1d740 10 client.0 _ll_register_callbacks cb 0x55a803f54160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ffb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e99be1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a803ffb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ffb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38660/0 (socket says 172.21.15.60:38660) 2024-09-12T00:03:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 -- 172.21.15.60:0/1548033120 learned_addr learned my addr 172.21.15.60:0/1548033120 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e993e0640 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a803ffe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 -- 172.21.15.60:0/1548033120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 msgr2=0x55a803ffe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a803ffe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 -- 172.21.15.60:0/1548033120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 msgr2=0x55a803ffb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a803ffb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 -- 172.21.15.60:0/1548033120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a803cca3c0 con 0x55a803ff3dc0 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e99be1640 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a803ffb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ffb2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9e84005940 tx=0x7f9e840c4cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4f63c28301171e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e7cff9640 1 -- 172.21.15.60:0/1548033120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84049050 con 0x55a803ff3dc0 2024-09-12T00:03:43.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e7cff9640 1 -- 172.21.15.60:0/1548033120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9e8403bce0 con 0x55a803ff3dc0 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1548033120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e84087070 con 0x55a803ff3dc0 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.112+0000 7f9e7cff9640 1 -- 172.21.15.60:0/1548033120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9e840bbfe0 con 0x55a803ff3dc0 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e9da1d740 10 client.16587 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1548033120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a804001010 con 0x55a803ff3dc0 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e7cff9640 1 -- 172.21.15.60:0/1548033120 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e84087070 con 0x55a803ff3dc0 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e7cff9640 1 -- 172.21.15.60:0/1548033120 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f9e840b8650 con 0x55a803ff3dc0 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e9da1d740 10 client.16587 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e9da1d740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e9da1d740 20 client.16587 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a80400dcb0 0x55a8040100d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e9da1d740 4 client.16587 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:03:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1548033120 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a803f66850 con 0x55a80400dcb0 2024-09-12T00:03:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.113+0000 7f9e993e0640 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a80400dcb0 0x55a8040100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.114+0000 7f9e993e0640 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a80400dcb0 0x55a8040100d0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=385a64468b720eb server_cookie=25612709850fcee3 in_seq=0 out_seq=0 2024-09-12T00:03:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.114+0000 7f9e7cff9640 10 client.16587 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:43.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.114+0000 7f9e7cff9640 1 -- 172.21.15.60:0/1548033120 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a803f66850 con 0x55a80400dcb0 2024-09-12T00:03:43.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.114+0000 7f9e7cff9640 10 client.16587 handle_command_reply: tid=0 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 client.16587 shutdown 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1548033120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 msgr2=0x55a803ffb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ffb2f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9e84005940 tx=0x7f9e840c4cc0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1548033120 shutdown_connections 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a80400dcb0 0x55a8040100d0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a803ffb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ffb2f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/1548033120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a803ffe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e7cff9640 0 client.16587 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1548033120 >> 172.21.15.60:0/1548033120 conn(0x55a803fefa30 msgr2=0x55a803ff5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1548033120 shutdown_connections 2024-09-12T00:03:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 1 -- 172.21.15.60:0/1548033120 wait complete. 2024-09-12T00:03:43.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.115+0000 7f9e9da1d740 20 client.16587 trim_cache size 0 max 16384 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e9da1d740 1 Processor -- start 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e9da1d740 1 -- start start 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a80400a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ff67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804015980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941ab5f0 con 0x55a803ff3dc0 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941ad430 con 0x55a803ffe680 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941abd80 con 0x55a803ff34a0 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ff67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ff67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38662/0 (socket says 172.21.15.60:38662) 2024-09-12T00:03:43.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 -- 172.21.15.60:0/4069421158 learned_addr learned my addr 172.21.15.60:0/4069421158 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e993e0640 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a80400a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e99be1640 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804015980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 -- 172.21.15.60:0/4069421158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 msgr2=0x55a80400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a80400a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 -- 172.21.15.60:0/4069421158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 msgr2=0x55a804015980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804015980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 -- 172.21.15.60:0/4069421158 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a803ff32d0 con 0x55a803ff3dc0 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e99be1640 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804015980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.133+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ff67f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9e840b89b0 tx=0x7f9e840c4c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c0f9f955b60642 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e7effd640 1 -- 172.21.15.60:0/4069421158 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84049070 con 0x55a803ff3dc0 2024-09-12T00:03:43.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e7effd640 1 -- 172.21.15.60:0/4069421158 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e840bc6e0 con 0x55a803ff3dc0 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e7effd640 1 -- 172.21.15.60:0/4069421158 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840c4810 con 0x55a803ff3dc0 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4069421158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 msgr2=0x55a803ff67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ff67f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9e840b89b0 tx=0x7f9e840c4c50 comp rx=0 tx=0).stop 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4069421158 shutdown_connections 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804015980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a803ff67f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4069421158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a80400a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4069421158 >> 172.21.15.60:0/4069421158 conn(0x55a803fefa30 msgr2=0x55a803ff60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.134+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4069421158 shutdown_connections 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4069421158 wait complete. 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 -- start start 2024-09-12T00:03:43.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 Processor -- start 2024-09-12T00:03:43.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a804001660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a804001ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804076940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941acca0 con 0x55a803ff3dc0 2024-09-12T00:03:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941ac510 con 0x55a803ffe680 2024-09-12T00:03:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941a95d0 con 0x55a803ff34a0 2024-09-12T00:03:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e9da1d740 10 client.0 _ll_register_callbacks cb 0x7f9e90005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:03:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a804001ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e98bdf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a804001ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38670/0 (socket says 172.21.15.60:38670) 2024-09-12T00:03:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.135+0000 7f9e98bdf640 1 -- 172.21.15.60:0/4136518818 learned_addr learned my addr 172.21.15.60:0/4136518818 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e993e0640 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a804001660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e99be1640 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e98bdf640 1 -- 172.21.15.60:0/4136518818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 msgr2=0x55a804001660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a804001660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e98bdf640 1 -- 172.21.15.60:0/4136518818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 msgr2=0x55a804076940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804076940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e98bdf640 1 -- 172.21.15.60:0/4136518818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a804076e80 con 0x55a803ff3dc0 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e99be1640 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804076940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:03:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e98bdf640 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a804001ba0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9e84005c40 tx=0x7f9e840b8360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5be67f2f85a623 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e7cff9640 1 -- 172.21.15.60:0/4136518818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84085020 con 0x55a803ff3dc0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e7cff9640 1 -- 172.21.15.60:0/4136518818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f9e840ba080 con 0x55a803ff3dc0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4136518818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e840bc6e0 con 0x55a803ff3dc0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e7cff9640 1 -- 172.21.15.60:0/4136518818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9e84049040 con 0x55a803ff3dc0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e9da1d740 10 client.16593 fetch_fsmap learned FSMap version 39 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.136+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4136518818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a804076e80 con 0x55a803ff3dc0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e7cff9640 1 -- 172.21.15.60:0/4136518818 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e840bc6e0 con 0x55a803ff3dc0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e7cff9640 1 -- 172.21.15.60:0/4136518818 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f9e840a50a0 con 0x55a803ff3dc0 2024-09-12T00:03:43.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e9da1d740 10 client.16593 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:03:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e9da1d740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:03:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e9da1d740 20 client.16593 populate_metadata read hostname 'smithi060' 2024-09-12T00:03:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a804078380 0x55a80407a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:03:43.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e9da1d740 4 client.16593 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:03:43.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4136518818 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a803f60d60 con 0x55a804078380 2024-09-12T00:03:43.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.137+0000 7f9e993e0640 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a804078380 0x55a80407a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:03:43.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e7cff9640 10 client.16593 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:43.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e993e0640 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a804078380 0x55a80407a7a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b460a726997bcad7 server_cookie=2a55268d4f57fa7a in_seq=0 out_seq=0 2024-09-12T00:03:43.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e7cff9640 1 -- 172.21.15.60:0/4136518818 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a803f60d60 con 0x55a804078380 2024-09-12T00:03:43.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e7cff9640 10 client.16593 handle_command_reply: tid=0 2024-09-12T00:03:43.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 client.16593 shutdown 2024-09-12T00:03:43.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4136518818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 msgr2=0x55a804001ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a804001ba0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9e84005c40 tx=0x7f9e840b8360 comp rx=0 tx=0).stop 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4136518818 shutdown_connections 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55a804078380 0x55a80407a7a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a803ffe680 0x55a804076940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e7cff9640 0 client.16593 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a803ff3dc0 0x55a804001ba0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 --2- 172.21.15.60:0/4136518818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a803ff34a0 0x55a804001660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4136518818 >> 172.21.15.60:0/4136518818 conn(0x55a803fefa30 msgr2=0x55a803ffd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4136518818 shutdown_connections 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 1 -- 172.21.15.60:0/4136518818 wait complete. 2024-09-12T00:03:43.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.138+0000 7f9e9da1d740 20 client.16593 trim_cache size 0 max 16384 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "c3be6865-8848-43d6-b003-368b73113e0d": { 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "c3be6865-8848-43d6-b003-368b73113e0d", 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:03:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:03:43.149 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:03:43.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 -- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9e800a2cf0 msgr2=0x7f9e800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9e800a2cf0 0x7f9e800a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c005cc0 tx=0x7f9e8c012a10 comp rx=0 tx=0).stop 2024-09-12T00:03:43.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 -- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 msgr2=0x7f9e94198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 0x7f9e94198a10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9e84006010 tx=0x7f9e840042f0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 -- 172.21.15.60:0/560363711 shutdown_connections 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f9e800a2cf0 0x7f9e800a51b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e9410c170 0x7f9e9419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e94103660 0x7f9e94198a10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 --2- 172.21.15.60:0/560363711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e94102d40 0x7f9e941984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 -- 172.21.15.60:0/560363711 >> 172.21.15.60:0/560363711 conn(0x7f9e940fc7a0 msgr2=0x7f9e940fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 -- 172.21.15.60:0/560363711 shutdown_connections 2024-09-12T00:03:43.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:03:43.139+0000 7f9e9b644640 1 -- 172.21.15.60:0/560363711 wait complete. 2024-09-12T00:03:43.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:43 smithi060 ceph-mon[30953]: pgmap v133: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:43 smithi105 ceph-mon[34805]: pgmap v133: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:43.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:43 smithi192 ceph-mon[35487]: pgmap v133: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:43.909 INFO:tasks.cephfs.filesystem:scrub status for tag:c3be6865-8848-43d6-b003-368b73113e0d - {'path': '/', 'tag': 'c3be6865-8848-43d6-b003-368b73113e0d', 'options': 'recursive,force'} 2024-09-12T00:03:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:44 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:03:44.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:44 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:03:44.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:44 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:03:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:45 smithi105 ceph-mon[34805]: pgmap v134: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:03:45.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:45 smithi192 ceph-mon[35487]: pgmap v134: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:03:45.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:45 smithi060 ceph-mon[30953]: pgmap v134: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:03:47.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:47 smithi105 ceph-mon[34805]: pgmap v135: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:47 smithi192 ceph-mon[35487]: pgmap v135: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:47 smithi060 ceph-mon[30953]: pgmap v135: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:49.391 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:49 smithi060 ceph-mon[30953]: pgmap v136: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:49 smithi105 ceph-mon[34805]: pgmap v136: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:49.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:49 smithi192 ceph-mon[35487]: pgmap v136: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:51.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:51 smithi105 ceph-mon[34805]: pgmap v137: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:51.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:51 smithi192 ceph-mon[35487]: pgmap v137: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:51.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:51 smithi060 ceph-mon[30953]: pgmap v137: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:53.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:53 smithi105 ceph-mon[34805]: pgmap v138: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:53.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:53 smithi192 ceph-mon[35487]: pgmap v138: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:53.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:53 smithi060 ceph-mon[30953]: pgmap v138: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:03:55.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:55 smithi105 ceph-mon[34805]: pgmap v139: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:55.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:55 smithi192 ceph-mon[35487]: pgmap v139: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:55.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:55 smithi060 ceph-mon[30953]: pgmap v139: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:03:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:57 smithi105 ceph-mon[34805]: pgmap v140: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:03:57.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:57 smithi192 ceph-mon[35487]: pgmap v140: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:03:57.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:57 smithi060 ceph-mon[30953]: pgmap v140: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:03:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:03:59 smithi105 ceph-mon[34805]: pgmap v141: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:03:59.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:03:59 smithi192 ceph-mon[35487]: pgmap v141: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:03:59.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:03:59 smithi060 ceph-mon[30953]: pgmap v141: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:01 smithi105 ceph-mon[34805]: pgmap v142: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:04:01.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:01 smithi192 ceph-mon[35487]: pgmap v142: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:04:01.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:01 smithi060 ceph-mon[30953]: pgmap v142: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:04:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:03 smithi105 ceph-mon[34805]: pgmap v143: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:03.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:03 smithi192 ceph-mon[35487]: pgmap v143: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:03.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:03 smithi060 ceph-mon[30953]: pgmap v143: 97 pgs: 97 active+clean; 275 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:05.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:05 smithi105 ceph-mon[34805]: pgmap v144: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:05.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:05 smithi192 ceph-mon[35487]: pgmap v144: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:05.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:05 smithi060 ceph-mon[30953]: pgmap v144: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:07 smithi105 ceph-mon[34805]: pgmap v145: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:07.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:07 smithi192 ceph-mon[35487]: pgmap v145: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:07.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:07 smithi060 ceph-mon[30953]: pgmap v145: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:09 smithi105 ceph-mon[34805]: pgmap v146: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:09.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:09 smithi192 ceph-mon[35487]: pgmap v146: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:09.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:09 smithi060 ceph-mon[30953]: pgmap v146: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:11 smithi105 ceph-mon[34805]: pgmap v147: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:11.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:11 smithi192 ceph-mon[35487]: pgmap v147: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:11.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:11 smithi060 ceph-mon[30953]: pgmap v147: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:13 smithi105 ceph-mon[34805]: pgmap v148: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:13.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:13 smithi192 ceph-mon[35487]: pgmap v148: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:13.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:13 smithi060 ceph-mon[30953]: pgmap v148: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:04:13.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:04:14.186 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:14.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 -- 172.21.15.60:0/3125197470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc106f10 msgr2=0x7fd2cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 --2- 172.21.15.60:0/3125197470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc106f10 0x7fd2cc10ea90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4009ca0 tx=0x7fd2c402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 -- 172.21.15.60:0/3125197470 shutdown_connections 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 --2- 172.21.15.60:0/3125197470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc106f10 0x7fd2cc10ea90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 --2- 172.21.15.60:0/3125197470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc102790 0x7fd2cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 --2- 172.21.15.60:0/3125197470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc101de0 0x7fd2cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 -- 172.21.15.60:0/3125197470 >> 172.21.15.60:0/3125197470 conn(0x7fd2cc0fd8e0 msgr2=0x7fd2cc0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 -- 172.21.15.60:0/3125197470 shutdown_connections 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 -- 172.21.15.60:0/3125197470 wait complete. 2024-09-12T00:04:14.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 Processor -- start 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.661+0000 7fd2d4709640 1 -- start start 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d4709640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc101de0 0x7fd2cc1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d4709640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc102790 0x7fd2cc198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d4709640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc106f10 0x7fd2cc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d4709640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc112090 con 0x7fd2cc101de0 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d4709640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc111f10 con 0x7fd2cc102790 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d4709640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc112210 con 0x7fd2cc106f10 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc101de0 0x7fd2cc1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc101de0 0x7fd2cc1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40150/0 (socket says 172.21.15.60:40150) 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 -- 172.21.15.60:0/4146348861 learned_addr learned my addr 172.21.15.60:0/4146348861 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc102790 0x7fd2cc198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 -- 172.21.15.60:0/4146348861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc106f10 msgr2=0x7fd2cc19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc106f10 0x7fd2cc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 -- 172.21.15.60:0/4146348861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc102790 msgr2=0x7fd2cc198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc102790 0x7fd2cc198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 -- 172.21.15.60:0/4146348861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc19d3a0 con 0x7fd2cc101de0 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc102790 0x7fd2cc198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc101de0 0x7fd2cc1983f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c970 tx=0x7fd2c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2c37fe640 1 -- 172.21.15.60:0/4146348861 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8007bb0 con 0x7fd2cc101de0 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2c37fe640 1 -- 172.21.15.60:0/4146348861 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2c8007d50 con 0x7fd2cc101de0 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2d4709640 1 -- 172.21.15.60:0/4146348861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2cc19d690 con 0x7fd2cc101de0 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.662+0000 7fd2c37fe640 1 -- 172.21.15.60:0/4146348861 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800f4b0 con 0x7fd2cc101de0 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.663+0000 7fd2d4709640 1 -- 172.21.15.60:0/4146348861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2cc1a4f70 con 0x7fd2cc101de0 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.665+0000 7fd2c37fe640 1 -- 172.21.15.60:0/4146348861 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd2c80046c0 con 0x7fd2cc101de0 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.665+0000 7fd2d6ae2740 1 Processor -- start 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.665+0000 7fd2d6ae2740 1 -- start start 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98d7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98e2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562ae983d2e0 con 0x562ae98e2680 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562ae97e4ce0 con 0x562ae98d7dc0 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562ae98392a0 con 0x562ae98d74a0 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2c37fe640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2b80a2d70 0x7fd2b80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98e4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40164/0 (socket says 172.21.15.60:40164) 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 -- 172.21.15.60:0/3977203014 learned_addr learned my addr 172.21.15.60:0/3977203014 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2b80a2d70 0x7fd2b80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98d7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2c37fe640 1 -- 172.21.15.60:0/4146348861 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd2c80cf1d0 con 0x7fd2cc101de0 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 -- 172.21.15.60:0/3977203014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 msgr2=0x562ae98d7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98d7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 -- 172.21.15.60:0/3977203014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 msgr2=0x562ae98e2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98e2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 -- 172.21.15.60:0/3977203014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ae97c9440 con 0x562ae98e2680 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98d7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.666+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98e4a70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc008ba0 tx=0x7fd2bc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3aebcf8db3a9c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2b80a2d70 0x7fd2b80a5230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4006010 tx=0x7fd2c4005f80 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2c0ff9640 1 -- 172.21.15.60:0/3977203014 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc014070 con 0x562ae98e2680 2024-09-12T00:04:14.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2c0ff9640 1 -- 172.21.15.60:0/3977203014 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2bc0047a0 con 0x562ae98e2680 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2c0ff9640 1 -- 172.21.15.60:0/3977203014 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc010720 con 0x562ae98e2680 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/3977203014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 msgr2=0x562ae98e4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98e4a70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc008ba0 tx=0x7fd2bc00e720 comp rx=0 tx=0).stop 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/3977203014 shutdown_connections 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98e4a70 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98e2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/3977203014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98d7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/3977203014 >> 172.21.15.60:0/3977203014 conn(0x562ae98d3a30 msgr2=0x562ae98d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.667+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/3977203014 shutdown_connections 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/3977203014 wait complete. 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 -- start start 2024-09-12T00:04:14.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 Processor -- start 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98e1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98df220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562ae98e5250 con 0x562ae98e2680 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562ae97f8050 con 0x562ae98d7dc0 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562ae98e53d0 con 0x562ae98d74a0 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d6ae2740 10 client.0 _ll_register_callbacks cb 0x562ae9838160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d2ca6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d2ca6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98df760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40178/0 (socket says 172.21.15.60:40178) 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/1206265795 learned_addr learned my addr 172.21.15.60:0/1206265795 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:14.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98e1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.668+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/1206265795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 msgr2=0x562ae98e1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98e1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/1206265795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 msgr2=0x562ae98df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98df220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/1206265795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ae95ae3c0 con 0x562ae98e2680 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98df760 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4031830 tx=0x7fd2c402f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce247b6641be001 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:14.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1206265795 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c404f070 con 0x562ae98e2680 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1206265795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2bc0047a0 con 0x562ae98e2680 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1206265795 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd2c40309d0 con 0x562ae98e2680 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1206265795 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd2c4030bd0 con 0x562ae98e2680 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d6ae2740 10 client.16605 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1206265795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x562ae98f0bc0 con 0x562ae98e2680 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.669+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1206265795 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2bc0047a0 con 0x562ae98e2680 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1206265795 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fd2c404a070 con 0x562ae98e2680 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2d6ae2740 10 client.16605 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2d6ae2740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:04:14.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2d6ae2740 20 client.16605 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562ae98f20a0 0x562ae98f4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2d6ae2740 4 client.16605 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1206265795 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ae984a850 con 0x562ae98f20a0 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562ae98f20a0 0x562ae98f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2b5ffb640 10 client.16605 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.670+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562ae98f20a0 0x562ae98f4540 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4072480e9be98865 server_cookie=793b22fc4e019a7 in_seq=0 out_seq=0 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1206265795 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ae984a850 con 0x562ae98f20a0 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2b5ffb640 10 client.16605 handle_command_reply: tid=0 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 client.16605 shutdown 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1206265795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 msgr2=0x562ae98df760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98df760 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4031830 tx=0x7fd2c402f9e0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1206265795 shutdown_connections 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562ae98f20a0 0x562ae98f4540 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98e2680 0x562ae98df760 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d7dc0 0x562ae98df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2b5ffb640 0 client.16605 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1206265795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98e1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1206265795 >> 172.21.15.60:0/1206265795 conn(0x562ae98d3a30 msgr2=0x562ae98d9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1206265795 shutdown_connections 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1206265795 wait complete. 2024-09-12T00:04:14.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.671+0000 7fd2d6ae2740 20 client.16605 trim_cache size 0 max 16384 2024-09-12T00:04:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.688+0000 7fd2d6ae2740 1 Processor -- start 2024-09-12T00:04:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.688+0000 7fd2d6ae2740 1 -- start start 2024-09-12T00:04:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 0x562ae98ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae98fa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc1ad720 con 0x562ae98d7dc0 2024-09-12T00:04:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc1af560 con 0x562ae98d3a30 2024-09-12T00:04:14.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc1adeb0 con 0x562ae98d74a0 2024-09-12T00:04:14.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae98fa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae98fa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40182/0 (socket says 172.21.15.60:40182) 2024-09-12T00:04:14.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/322532652 learned_addr learned my addr 172.21.15.60:0/322532652 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:14.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 0x562ae98ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/322532652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 msgr2=0x562ae98f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:14.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98f9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/322532652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 msgr2=0x562ae98ee4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 0x562ae98ee4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/322532652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ae98d7bf0 con 0x562ae98d7dc0 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae98fa350 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd2c402ade0 tx=0x7fd2c4030fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c0cb7745de514 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.689+0000 7fd2b7fff640 1 -- 172.21.15.60:0/322532652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4058020 con 0x562ae98d7dc0 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2b7fff640 1 -- 172.21.15.60:0/322532652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2c4045070 con 0x562ae98d7dc0 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2b7fff640 1 -- 172.21.15.60:0/322532652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c404f040 con 0x562ae98d7dc0 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/322532652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 msgr2=0x562ae98fa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae98fa350 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd2c402ade0 tx=0x7fd2c4030fb0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/322532652 shutdown_connections 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae98fa350 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae98f9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/322532652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 0x562ae98ee4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/322532652 >> 172.21.15.60:0/322532652 conn(0x562ae98df8c0 msgr2=0x562ae98ddaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/322532652 shutdown_connections 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/322532652 wait complete. 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.690+0000 7fd2d6ae2740 1 -- start start 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.691+0000 7fd2d6ae2740 1 Processor -- start 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 0x562ae9954da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae99552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d6ae2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae9955820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc1aedd0 con 0x562ae98d7dc0 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc1ae640 con 0x562ae98d3a30 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d6ae2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc1ab700 con 0x562ae98d74a0 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d6ae2740 10 client.0 _ll_register_callbacks cb 0x7fd2c4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae9955820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae9955820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40198/0 (socket says 172.21.15.60:40198) 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/1406283785 learned_addr learned my addr 172.21.15.60:0/1406283785 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 0x562ae9954da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d1ca4640 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae99552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/1406283785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 msgr2=0x562ae99552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:14.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae99552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/1406283785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 msgr2=0x562ae9954da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 0x562ae9954da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 -- 172.21.15.60:0/1406283785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ae995fff0 con 0x562ae98d7dc0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2d2ca6640 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae9955820 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd2c403eef0 tx=0x7fd2c403b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7296cb324c34bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.692+0000 7fd2b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1406283785 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c406d060 con 0x562ae98d7dc0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1406283785 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd2c403e430 con 0x562ae98d7dc0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1406283785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2c4045070 con 0x562ae98d7dc0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1406283785 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd2c4058030 con 0x562ae98d7dc0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 10 client.16611 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1406283785 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x562ae99612c0 con 0x562ae98d7dc0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1406283785 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2c4045070 con 0x562ae98d7dc0 2024-09-12T00:04:14.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1406283785 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7fd2c404a040 con 0x562ae98d7dc0 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 10 client.16611 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 20 client.16611 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562ae98e2680 0x562ae99639d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 4 client.16611 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1406283785 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562ae9844d60 con 0x562ae98e2680 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.693+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562ae98e2680 0x562ae99639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d24a5640 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562ae98e2680 0x562ae99639d0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fe393f3ac80097d server_cookie=4df3efb55c2e8186 in_seq=0 out_seq=0 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2b5ffb640 10 client.16611 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2b5ffb640 1 -- 172.21.15.60:0/1406283785 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562ae9844d60 con 0x562ae98e2680 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2b5ffb640 10 client.16611 handle_command_reply: tid=0 2024-09-12T00:04:14.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 client.16611 shutdown 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1406283785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 msgr2=0x562ae9955820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae9955820 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd2c403eef0 tx=0x7fd2c403b610 comp rx=0 tx=0).stop 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1406283785 shutdown_connections 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562ae98e2680 0x562ae99639d0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562ae98d7dc0 0x562ae9955820 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ae98d74a0 0x562ae99552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 --2- 172.21.15.60:0/1406283785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562ae98d3a30 0x562ae9954da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2b5ffb640 0 client.16611 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1406283785 >> 172.21.15.60:0/1406283785 conn(0x562ae98df8c0 msgr2=0x562ae98e12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1406283785 shutdown_connections 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 1 -- 172.21.15.60:0/1406283785 wait complete. 2024-09-12T00:04:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.694+0000 7fd2d6ae2740 20 client.16611 trim_cache size 0 max 16384 2024-09-12T00:04:14.715 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:04:14.715 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:04:14.715 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:04:14.715 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 -- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2b80a2d70 msgr2=0x7fd2b80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2b80a2d70 0x7fd2b80a5230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4006010 tx=0x7fd2c4005f80 comp rx=0 tx=0).stop 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 -- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc101de0 msgr2=0x7fd2cc1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc101de0 0x7fd2cc1983f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800c970 tx=0x7fd2c800ce30 comp rx=0 tx=0).stop 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 -- 172.21.15.60:0/4146348861 shutdown_connections 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2b80a2d70 0x7fd2b80a5230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc106f10 0x7fd2cc19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2cc102790 0x7fd2cc198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 --2- 172.21.15.60:0/4146348861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2cc101de0 0x7fd2cc1983f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:14.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 -- 172.21.15.60:0/4146348861 >> 172.21.15.60:0/4146348861 conn(0x7fd2cc0fd8e0 msgr2=0x7fd2cc0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:14.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 -- 172.21.15.60:0/4146348861 shutdown_connections 2024-09-12T00:04:14.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:14.695+0000 7fd2d4709640 1 -- 172.21.15.60:0/4146348861 wait complete. 2024-09-12T00:04:15.331 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:15 smithi060 ceph-mon[30953]: pgmap v149: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:15 smithi105 ceph-mon[34805]: pgmap v149: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:15.492 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:04:15.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:04:15.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:15 smithi192 ceph-mon[35487]: pgmap v149: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:04:15.757 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:16.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1538996816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 msgr2=0x7fd4a8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:16.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1538996816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 0x7fd4a8106e60 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009930 tx=0x7fd4a402a420 comp rx=0 tx=0).stop 2024-09-12T00:04:16.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1538996816 shutdown_connections 2024-09-12T00:04:16.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1538996816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4a8101420 0x7fd4a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1538996816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4a8100a80 0x7fd4a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1538996816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 0x7fd4a8106e60 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1538996816 >> 172.21.15.60:0/1538996816 conn(0x7fd4a80fc7a0 msgr2=0x7fd4a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:16.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1538996816 shutdown_connections 2024-09-12T00:04:16.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.253+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1538996816 wait complete. 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4b03b9640 1 Processor -- start 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4b03b9640 1 -- start start 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4b03b9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4a8100a80 0x7fd4a810e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4b03b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4a8101420 0x7fd4a810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4b03b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 0x7fd4a810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4b03b9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a81120a0 con 0x7fd4a8106a80 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4b03b9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8111f20 con 0x7fd4a8101420 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4b03b9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8112220 con 0x7fd4a8100a80 2024-09-12T00:04:16.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae956640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 0x7fd4a810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae956640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 0x7fd4a810ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40228/0 (socket says 172.21.15.60:40228) 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae956640 1 -- 172.21.15.60:0/1543551410 learned_addr learned my addr 172.21.15.60:0/1543551410 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae155640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4a8100a80 0x7fd4a810e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ad954640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4a8101420 0x7fd4a810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae956640 1 -- 172.21.15.60:0/1543551410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4a8100a80 msgr2=0x7fd4a810e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae956640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4a8100a80 0x7fd4a810e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae956640 1 -- 172.21.15.60:0/1543551410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4a8101420 msgr2=0x7fd4a810e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae956640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4a8101420 0x7fd4a810e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.254+0000 7fd4ae956640 1 -- 172.21.15.60:0/1543551410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a81a6a40 con 0x7fd4a8106a80 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.255+0000 7fd4ae956640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 0x7fd4a810ece0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000cad0 tx=0x7fd4a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.255+0000 7fd49f7fe640 1 -- 172.21.15.60:0/1543551410 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000ae20 con 0x7fd4a8106a80 2024-09-12T00:04:16.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.255+0000 7fd49f7fe640 1 -- 172.21.15.60:0/1543551410 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd4a0004b20 con 0x7fd4a8106a80 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.255+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a81a6d30 con 0x7fd4a8106a80 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.255+0000 7fd49f7fe640 1 -- 172.21.15.60:0/1543551410 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000f780 con 0x7fd4a8106a80 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.255+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a81a7220 con 0x7fd4a8106a80 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.256+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a8100ee0 con 0x7fd4a8106a80 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.257+0000 7fd49f7fe640 1 -- 172.21.15.60:0/1543551410 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd4a0004cd0 con 0x7fd4a8106a80 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.258+0000 7fd49f7fe640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd4940a2cf0 0x7fd4940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.258+0000 7fd49f7fe640 1 -- 172.21.15.60:0/1543551410 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fd4a00cf440 con 0x7fd4a8106a80 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.258+0000 7fd4ae155640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd4940a2cf0 0x7fd4940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:16.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.258+0000 7fd4ae155640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd4940a2cf0 0x7fd4940a51b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009900 tx=0x7fd4a40058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:16.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.262+0000 7fd49f7fe640 1 -- 172.21.15.60:0/1543551410 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4a0014030 con 0x7fd4a8106a80 2024-09-12T00:04:16.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.475+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4a8108ff0 con 0x7fd4a8106a80 2024-09-12T00:04:16.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.476+0000 7fd49f7fe640 1 -- 172.21.15.60:0/1543551410 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+12009 (secure 0 0 0) 0x7fd4a009c0b0 con 0x7fd4a8106a80 2024-09-12T00:04:16.475 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:04:16.475 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":39,"btime":"2024-09-12T00:02:06:958968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:02:06.347465+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24467,24475,24484,24485,24496]},"id":1}]} 2024-09-12T00:04:16.476 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 39 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd4940a2cf0 msgr2=0x7fd4940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd4940a2cf0 0x7fd4940a51b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009900 tx=0x7fd4a40058d0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 msgr2=0x7fd4a810ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 0x7fd4a810ece0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000cad0 tx=0x7fd4a000cf90 comp rx=0 tx=0).stop 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 shutdown_connections 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd4940a2cf0 0x7fd4940a51b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4a8106a80 0x7fd4a810ece0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4a8101420 0x7fd4a810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 --2- 172.21.15.60:0/1543551410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4a8100a80 0x7fd4a810e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.478+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 >> 172.21.15.60:0/1543551410 conn(0x7fd4a80fc7a0 msgr2=0x7fd4a80fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:16.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.479+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 shutdown_connections 2024-09-12T00:04:16.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:16.479+0000 7fd4b03b9640 1 -- 172.21.15.60:0/1543551410 wait complete. 2024-09-12T00:04:17.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:04:17.450 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:17.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:17 smithi105 ceph-mon[34805]: pgmap v150: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T00:04:17.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:17 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1543551410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:04:17.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:17 smithi192 ceph-mon[35487]: pgmap v150: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T00:04:17.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:17 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1543551410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:04:17.572 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:17 smithi060 ceph-mon[30953]: pgmap v150: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T00:04:17.572 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:17 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1543551410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:04:17.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 -- 172.21.15.60:0/1619805427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 msgr2=0x7f19401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 --2- 172.21.15.60:0/1619805427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 0x7f19401067e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1934009900 tx=0x7f193402a410 comp rx=0 tx=0).stop 2024-09-12T00:04:17.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 -- 172.21.15.60:0/1619805427 shutdown_connections 2024-09-12T00:04:17.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 --2- 172.21.15.60:0/1619805427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1940106f10 0x7f194010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 --2- 172.21.15.60:0/1619805427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 0x7f19401067e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 --2- 172.21.15.60:0/1619805427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1940101de0 0x7f19401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 -- 172.21.15.60:0/1619805427 >> 172.21.15.60:0/1619805427 conn(0x7f19400fd8c0 msgr2=0x7f19400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 -- 172.21.15.60:0/1619805427 shutdown_connections 2024-09-12T00:04:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.929+0000 7f1946995640 1 -- 172.21.15.60:0/1619805427 wait complete. 2024-09-12T00:04:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.930+0000 7f1946995640 1 Processor -- start 2024-09-12T00:04:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.930+0000 7f1946995640 1 -- start start 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.930+0000 7f1946995640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1940101de0 0x7f19401985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.930+0000 7f1946995640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 0x7f1940198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.930+0000 7f1946995640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1940106f10 0x7f194019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.930+0000 7f1946995640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19401120d0 con 0x7f1940102790 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f1946995640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1940111f50 con 0x7f1940106f10 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f1946995640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1940112250 con 0x7f1940101de0 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 0x7f1940198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 0x7f1940198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40254/0 (socket says 172.21.15.60:40254) 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 -- 172.21.15.60:0/584891057 learned_addr learned my addr 172.21.15.60:0/584891057 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193ffff640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1940101de0 0x7f19401985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f1944f32640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1940106f10 0x7f194019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 -- 172.21.15.60:0/584891057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1940101de0 msgr2=0x7f19401985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1940101de0 0x7f19401985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 -- 172.21.15.60:0/584891057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1940106f10 msgr2=0x7f194019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1940106f10 0x7f194019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 -- 172.21.15.60:0/584891057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194019d580 con 0x7f1940102790 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193f7fe640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 0x7f1940198b10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1934006010 tx=0x7f19340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193d7fa640 1 -- 172.21.15.60:0/584891057 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193403f030 con 0x7f1940102790 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f1946995640 1 -- 172.21.15.60:0/584891057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194019d810 con 0x7f1940102790 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193d7fa640 1 -- 172.21.15.60:0/584891057 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1934003d00 con 0x7f1940102790 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.931+0000 7f193d7fa640 1 -- 172.21.15.60:0/584891057 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934035070 con 0x7f1940102790 2024-09-12T00:04:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.932+0000 7f1946995640 1 -- 172.21.15.60:0/584891057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19401a5150 con 0x7f1940102790 2024-09-12T00:04:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f193d7fa640 1 -- 172.21.15.60:0/584891057 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1934042030 con 0x7f1940102790 2024-09-12T00:04:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f1948d6e740 1 Processor -- start 2024-09-12T00:04:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f1948d6e740 1 -- start start 2024-09-12T00:04:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 0x55ab13239090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13239a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab13246760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f1948d6e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ab1319f2f0 con 0x55ab13244370 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f1948d6e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ab13146cf0 con 0x55ab132395d0 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f1948d6e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ab1319b2b0 con 0x55ab1323ab40 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.934+0000 7f193d7fa640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f19280a2cf0 0x7f19280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab13246760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab13246760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40258/0 (socket says 172.21.15.60:40258) 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193f7fe640 1 -- 172.21.15.60:0/1052412759 learned_addr learned my addr 172.21.15.60:0/1052412759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193ffff640 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13239a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f1944f32640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f19280a2cf0 0x7f19280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f1944f32640 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 0x55ab13239090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193d7fa640 1 -- 172.21.15.60:0/584891057 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f19340ef9c0 con 0x7f1940102790 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193ffff640 1 -- 172.21.15.60:0/1052412759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 msgr2=0x55ab13239090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:17.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193ffff640 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 0x55ab13239090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193ffff640 1 -- 172.21.15.60:0/1052412759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 msgr2=0x55ab13246760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193ffff640 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab13246760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193ffff640 1 -- 172.21.15.60:0/1052412759 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab1312b3a0 con 0x55ab132395d0 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f1944f32640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f19280a2cf0 0x7f19280a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1938009fd0 tx=0x7f1938009ee0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f193ffff640 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13239a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f193000bbf0 tx=0x7f19300107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f77449b00978482 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f19267fc640 1 -- 172.21.15.60:0/1052412759 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930004030 con 0x55ab132395d0 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f19267fc640 1 -- 172.21.15.60:0/1052412759 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19300041d0 con 0x55ab132395d0 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.935+0000 7f19267fc640 1 -- 172.21.15.60:0/1052412759 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930011680 con 0x55ab132395d0 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 -- 172.21.15.60:0/1052412759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 msgr2=0x55ab13239a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13239a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f193000bbf0 tx=0x7f19300107a0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 -- 172.21.15.60:0/1052412759 shutdown_connections 2024-09-12T00:04:17.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab13246760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13239a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 --2- 172.21.15.60:0/1052412759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 0x55ab13239090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 -- 172.21.15.60:0/1052412759 >> 172.21.15.60:0/1052412759 conn(0x55ab13202310 msgr2=0x55ab13235c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 -- 172.21.15.60:0/1052412759 shutdown_connections 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.936+0000 7f1948d6e740 1 -- 172.21.15.60:0/1052412759 wait complete. 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 1 -- start start 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 1 Processor -- start 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13243d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab13240ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 0x55ab132415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ab13247070 con 0x55ab1323ab40 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ab1315a060 con 0x55ab132395d0 2024-09-12T00:04:17.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ab132471f0 con 0x55ab13244370 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f1948d6e740 10 client.0 _ll_register_callbacks cb 0x55ab12ead8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab13240ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab13240ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40274/0 (socket says 172.21.15.60:40274) 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.937+0000 7f193f7fe640 1 -- 172.21.15.60:0/2218663294 learned_addr learned my addr 172.21.15.60:0/2218663294 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f193ffff640 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13243d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f1944f32640 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 0x55ab132415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f193f7fe640 1 -- 172.21.15.60:0/2218663294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 msgr2=0x55ab132415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f193f7fe640 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 0x55ab132415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f193f7fe640 1 -- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 msgr2=0x55ab13243d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f193f7fe640 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13243d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f193f7fe640 1 -- 172.21.15.60:0/2218663294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab12f103c0 con 0x55ab1323ab40 2024-09-12T00:04:17.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f193ffff640 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13243d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f193f7fe640 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab13240ff0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1934000c00 tx=0x7f1934009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ee49843e83860a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f191f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f191f7fe640 1 -- 172.21.15.60:0/2218663294 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934049040 con 0x55ab1323ab40 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f191f7fe640 1 -- 172.21.15.60:0/2218663294 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f19340b86b0 con 0x55ab1323ab40 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f1948d6e740 1 -- 172.21.15.60:0/2218663294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19300041d0 con 0x55ab1323ab40 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f191f7fe640 1 -- 172.21.15.60:0/2218663294 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f19340bb9a0 con 0x55ab1323ab40 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f1948d6e740 10 client.16629 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f1948d6e740 1 -- 172.21.15.60:0/2218663294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ab13252ae0 con 0x55ab1323ab40 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.938+0000 7f191f7fe640 1 -- 172.21.15.60:0/2218663294 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19300041d0 con 0x55ab1323ab40 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f191f7fe640 1 -- 172.21.15.60:0/2218663294 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f19340bab70 con 0x55ab1323ab40 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f1948d6e740 10 client.16629 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f1948d6e740 10 client.16629 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:04:17.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f1948d6e740 20 client.16629 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ab13253f90 0x55ab132563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f1948d6e740 4 client.16629 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f1948d6e740 1 -- 172.21.15.60:0/2218663294 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab131ac860 con 0x55ab13253f90 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f193ffff640 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ab13253f90 0x55ab132563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f191f7fe640 10 client.16629 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.939+0000 7f193ffff640 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ab13253f90 0x55ab132563f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e7e87a0a7faa668d server_cookie=59327d791eced3b7 in_seq=0 out_seq=0 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f191f7fe640 1 -- 172.21.15.60:0/2218663294 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab131ac860 con 0x55ab13253f90 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f191f7fe640 10 client.16629 handle_command_reply: tid=0 2024-09-12T00:04:17.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f1948d6e740 1 client.16629 shutdown 2024-09-12T00:04:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f1948d6e740 1 -- 172.21.15.60:0/2218663294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 msgr2=0x55ab13240ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab13240ff0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1934000c00 tx=0x7f1934009560 comp rx=0 tx=0).stop 2024-09-12T00:04:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f1948d6e740 1 -- 172.21.15.60:0/2218663294 shutdown_connections 2024-09-12T00:04:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 0x55ab132415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab13240ff0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.940+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ab13253f90 0x55ab132563f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.941+0000 7f191f7fe640 0 client.16629 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:04:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.941+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2218663294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13243d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.941+0000 7f1948d6e740 1 -- 172.21.15.60:0/2218663294 >> 172.21.15.60:0/2218663294 conn(0x55ab13202310 msgr2=0x55ab1323b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.941+0000 7f1948d6e740 1 -- 172.21.15.60:0/2218663294 shutdown_connections 2024-09-12T00:04:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.941+0000 7f1948d6e740 1 -- 172.21.15.60:0/2218663294 wait complete. 2024-09-12T00:04:17.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.941+0000 7f1948d6e740 20 client.16629 trim_cache size 0 max 16384 2024-09-12T00:04:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1948d6e740 1 Processor -- start 2024-09-12T00:04:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1948d6e740 1 -- start start 2024-09-12T00:04:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13250310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 0x55ab1323fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab1325bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1948d6e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19401ad840 con 0x55ab13244370 2024-09-12T00:04:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1948d6e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19401af680 con 0x55ab132395d0 2024-09-12T00:04:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1948d6e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19401adfd0 con 0x55ab1323ab40 2024-09-12T00:04:17.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1944f32640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab1325bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1944f32640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab1325bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40286/0 (socket says 172.21.15.60:40286) 2024-09-12T00:04:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f193ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13250310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f1944f32640 1 -- 172.21.15.60:0/1275504545 learned_addr learned my addr 172.21.15.60:0/1275504545 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.954+0000 7f193f7fe640 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 0x55ab1323fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1944f32640 1 -- 172.21.15.60:0/1275504545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 msgr2=0x55ab1323fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1944f32640 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 0x55ab1323fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1944f32640 1 -- 172.21.15.60:0/1275504545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 msgr2=0x55ab13250310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1944f32640 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13250310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1944f32640 1 -- 172.21.15.60:0/1275504545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab13240530 con 0x55ab13244370 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f193ffff640 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13250310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1944f32640 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab1325bcb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f193800b800 tx=0x7f193801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef0f5a1ff5ab148 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1925ffb640 1 -- 172.21.15.60:0/1275504545 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193802c070 con 0x55ab13244370 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1925ffb640 1 -- 172.21.15.60:0/1275504545 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1938027950 con 0x55ab13244370 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.955+0000 7f1925ffb640 1 -- 172.21.15.60:0/1275504545 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938014040 con 0x55ab13244370 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 -- 172.21.15.60:0/1275504545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 msgr2=0x55ab1325bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab1325bcb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f193800b800 tx=0x7f193801d000 comp rx=0 tx=0).stop 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 -- 172.21.15.60:0/1275504545 shutdown_connections 2024-09-12T00:04:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab13244370 0x55ab1325bcb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab1323ab40 0x55ab1323fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 --2- 172.21.15.60:0/1275504545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab13250310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 -- 172.21.15.60:0/1275504545 >> 172.21.15.60:0/1275504545 conn(0x55ab13202310 msgr2=0x55ab1323f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 -- 172.21.15.60:0/1275504545 shutdown_connections 2024-09-12T00:04:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 -- 172.21.15.60:0/1275504545 wait complete. 2024-09-12T00:04:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.956+0000 7f1948d6e740 1 -- start start 2024-09-12T00:04:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1948d6e740 1 Processor -- start 2024-09-12T00:04:17.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab1323e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab1323e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1948d6e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 0x55ab1323eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1948d6e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19401aeef0 con 0x55ab1323ab40 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1948d6e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19401ae760 con 0x55ab132395d0 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1948d6e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19401ab820 con 0x55ab13244370 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1948d6e740 10 client.0 _ll_register_callbacks cb 0x7f19340056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab1323e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab1323e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40288/0 (socket says 172.21.15.60:40288) 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 -- 172.21.15.60:0/2474593359 learned_addr learned my addr 172.21.15.60:0/2474593359 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f1944f32640 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 0x55ab1323eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193ffff640 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab1323e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 -- 172.21.15.60:0/2474593359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 msgr2=0x55ab1323eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 0x55ab1323eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 -- 172.21.15.60:0/2474593359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 msgr2=0x55ab1323e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab1323e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 -- 172.21.15.60:0/2474593359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab132c20c0 con 0x55ab1323ab40 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f193f7fe640 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab1323e560 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1934005c40 tx=0x7f193403b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8db54ababbd4887 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.957+0000 7f191f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f191f7fe640 1 -- 172.21.15.60:0/2474593359 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934078020 con 0x55ab1323ab40 2024-09-12T00:04:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f191f7fe640 1 -- 172.21.15.60:0/2474593359 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f19340ba600 con 0x55ab1323ab40 2024-09-12T00:04:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 1 -- 172.21.15.60:0/2474593359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1938027950 con 0x55ab1323ab40 2024-09-12T00:04:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f191f7fe640 1 -- 172.21.15.60:0/2474593359 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1934049040 con 0x55ab1323ab40 2024-09-12T00:04:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 10 client.16635 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 1 -- 172.21.15.60:0/2474593359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ab132c20c0 con 0x55ab1323ab40 2024-09-12T00:04:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f191f7fe640 1 -- 172.21.15.60:0/2474593359 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1938027950 con 0x55ab1323ab40 2024-09-12T00:04:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f191f7fe640 1 -- 172.21.15.60:0/2474593359 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f19340ed380 con 0x55ab1323ab40 2024-09-12T00:04:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 10 client.16635 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 10 client.16635 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 20 client.16635 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ab132c3810 0x55ab132c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 4 client.16635 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.958+0000 7f1948d6e740 1 -- 172.21.15.60:0/2474593359 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab131a6d70 con 0x55ab132c3810 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f193ffff640 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ab132c3810 0x55ab132c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f193ffff640 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ab132c3810 0x55ab132c5c30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=34b8427a8748a049 server_cookie=4ec9b46c7da30447 in_seq=0 out_seq=0 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f191f7fe640 10 client.16635 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f191f7fe640 1 -- 172.21.15.60:0/2474593359 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab131a6d70 con 0x55ab132c3810 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f191f7fe640 10 client.16635 handle_command_reply: tid=0 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 client.16635 shutdown 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 -- 172.21.15.60:0/2474593359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 msgr2=0x55ab1323e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab1323e560 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1934005c40 tx=0x7f193403b710 comp rx=0 tx=0).stop 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 -- 172.21.15.60:0/2474593359 shutdown_connections 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ab13244370 0x55ab1323eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab1323ab40 0x55ab1323e560 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55ab132c3810 0x55ab132c5c30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 --2- 172.21.15.60:0/2474593359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab132395d0 0x55ab1323e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 -- 172.21.15.60:0/2474593359 >> 172.21.15.60:0/2474593359 conn(0x55ab13202310 msgr2=0x55ab132344e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f191f7fe640 0 client.16635 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.959+0000 7f1948d6e740 1 -- 172.21.15.60:0/2474593359 shutdown_connections 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1948d6e740 1 -- 172.21.15.60:0/2474593359 wait complete. 2024-09-12T00:04:17.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1948d6e740 20 client.16635 trim_cache size 0 max 16384 2024-09-12T00:04:17.973 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:04:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 -- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f19280a2cf0 msgr2=0x7f19280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f19280a2cf0 0x7f19280a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1938009fd0 tx=0x7f1938009ee0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 -- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 msgr2=0x7f1940198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 0x7f1940198b10 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1934006010 tx=0x7f19340042f0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 -- 172.21.15.60:0/584891057 shutdown_connections 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f19280a2cf0 0x7f19280a51b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1940106f10 0x7f194019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1940102790 0x7f1940198b10 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 --2- 172.21.15.60:0/584891057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1940101de0 0x7f19401985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 -- 172.21.15.60:0/584891057 >> 172.21.15.60:0/584891057 conn(0x7f19400fd8c0 msgr2=0x7f19400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 -- 172.21.15.60:0/584891057 shutdown_connections 2024-09-12T00:04:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:17.960+0000 7f1946995640 1 -- 172.21.15.60:0/584891057 wait complete. 2024-09-12T00:04:18.839 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:04:19.096 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:19.343 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:19 smithi060 ceph-mon[30953]: pgmap v151: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T00:04:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:19 smithi105 ceph-mon[34805]: pgmap v151: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T00:04:19.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:19 smithi192 ceph-mon[35487]: pgmap v151: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 -- 172.21.15.60:0/2365073168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940101dd0 msgr2=0x7f59401021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 --2- 172.21.15.60:0/2365073168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940101dd0 0x7f59401021b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5930009900 tx=0x7f593002a410 comp rx=0 tx=0).stop 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 -- 172.21.15.60:0/2365073168 shutdown_connections 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 --2- 172.21.15.60:0/2365073168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5940106f00 0x7f594010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 --2- 172.21.15.60:0/2365073168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5940102780 0x7f59401067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 --2- 172.21.15.60:0/2365073168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940101dd0 0x7f59401021b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 -- 172.21.15.60:0/2365073168 >> 172.21.15.60:0/2365073168 conn(0x7f59400fd890 msgr2=0x7f59400ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 -- 172.21.15.60:0/2365073168 shutdown_connections 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.592+0000 7f5944d05640 1 -- 172.21.15.60:0/2365073168 wait complete. 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f5944d05640 1 Processor -- start 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f5944d05640 1 -- start start 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f5944d05640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5940101dd0 0x7f5940198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f5944d05640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940102780 0x7f5940198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f5944d05640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5940106f00 0x7f594019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f5944d05640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5940112080 con 0x7f5940102780 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f5944d05640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5940111f00 con 0x7f5940101dd0 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f5944d05640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5940112200 con 0x7f5940106f00 2024-09-12T00:04:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f593dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940102780 0x7f5940198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f593dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940102780 0x7f5940198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40304/0 (socket says 172.21.15.60:40304) 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f593dd9b640 1 -- 172.21.15.60:0/3857747691 learned_addr learned my addr 172.21.15.60:0/3857747691 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f593e59c640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5940101dd0 0x7f5940198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.593+0000 7f593ed9d640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5940106f00 0x7f594019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f593dd9b640 1 -- 172.21.15.60:0/3857747691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5940106f00 msgr2=0x7f594019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f593dd9b640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5940106f00 0x7f594019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f593dd9b640 1 -- 172.21.15.60:0/3857747691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5940101dd0 msgr2=0x7f5940198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f593dd9b640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5940101dd0 0x7f5940198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f593dd9b640 1 -- 172.21.15.60:0/3857747691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594019d4f0 con 0x7f5940102780 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f593dd9b640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940102780 0x7f5940198a80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f593400d770 tx=0x7f593400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f592f7fe640 1 -- 172.21.15.60:0/3857747691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934017070 con 0x7f5940102780 2024-09-12T00:04:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f592f7fe640 1 -- 172.21.15.60:0/3857747691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5934005520 con 0x7f5940102780 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f592f7fe640 1 -- 172.21.15.60:0/3857747691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934010460 con 0x7f5940102780 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f5944d05640 1 -- 172.21.15.60:0/3857747691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594019d7e0 con 0x7f5940102780 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.594+0000 7f5944d05640 1 -- 172.21.15.60:0/3857747691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59401a50c0 con 0x7f5940102780 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.596+0000 7f592f7fe640 1 -- 172.21.15.60:0/3857747691 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5934004ea0 con 0x7f5940102780 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f59470de740 1 Processor -- start 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f59470de740 1 -- start start 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f59470de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 0x5557a1d80090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f59470de740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d80a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f59470de740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f59470de740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5557a1ce62f0 con 0x5557a1d8b370 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f59470de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5557a1c8dcf0 con 0x5557a1d81b40 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f59470de740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557a1ce22b0 con 0x5557a1d805d0 2024-09-12T00:04:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f592f7fe640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f59280a2cf0 0x7f59280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.597+0000 7f593dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593ed9d640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f59280a2cf0 0x7f59280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593e59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d80a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593e59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d80a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:36936/0 (socket says 172.21.15.60:36936) 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593e59c640 1 -- 172.21.15.60:0/2426575916 learned_addr learned my addr 172.21.15.60:0/2426575916 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40310/0 (socket says 172.21.15.60:40310) 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593ed9d640 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 0x5557a1d80090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f592f7fe640 1 -- 172.21.15.60:0/3857747691 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f59340cef30 con 0x7f5940102780 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593dd9b640 1 -- 172.21.15.60:0/2426575916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 msgr2=0x5557a1d80a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593dd9b640 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d80a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593dd9b640 1 -- 172.21.15.60:0/2426575916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 msgr2=0x5557a1d80090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593dd9b640 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 0x5557a1d80090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593dd9b640 1 -- 172.21.15.60:0/2426575916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557a1c723a0 con 0x5557a1d8b370 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593e59c640 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d80a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593ed9d640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f59280a2cf0 0x7f59280a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5938005c40 tx=0x7f59380099b0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f593dd9b640 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8d760 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f59340cc6d0 tx=0x7f593406d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a36e827acabf01b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f592cff9640 1 -- 172.21.15.60:0/2426575916 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934020040 con 0x5557a1d8b370 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f592cff9640 1 -- 172.21.15.60:0/2426575916 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f593409bba0 con 0x5557a1d8b370 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.598+0000 7f592cff9640 1 -- 172.21.15.60:0/2426575916 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340a4110 con 0x5557a1d8b370 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.599+0000 7f59470de740 1 -- 172.21.15.60:0/2426575916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 msgr2=0x5557a1d8d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.599+0000 7f59470de740 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8d760 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f59340cc6d0 tx=0x7f593406d460 comp rx=0 tx=0).stop 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.599+0000 7f59470de740 1 -- 172.21.15.60:0/2426575916 shutdown_connections 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.599+0000 7f59470de740 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8d760 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.599+0000 7f59470de740 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d80a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.599+0000 7f59470de740 1 --2- 172.21.15.60:0/2426575916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 0x5557a1d80090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.599+0000 7f59470de740 1 -- 172.21.15.60:0/2426575916 >> 172.21.15.60:0/2426575916 conn(0x5557a1d49310 msgr2=0x5557a1d7cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.600+0000 7f59470de740 1 -- 172.21.15.60:0/2426575916 shutdown_connections 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.600+0000 7f59470de740 1 -- 172.21.15.60:0/2426575916 wait complete. 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.600+0000 7f59470de740 1 -- start start 2024-09-12T00:04:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.600+0000 7f59470de740 1 Processor -- start 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f59470de740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d8adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f59470de740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d88060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f59470de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d8b370 0x5557a1d887f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f59470de740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5557a1d8e070 con 0x5557a1d81b40 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f59470de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5557a1ca1060 con 0x5557a1d8b370 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f59470de740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557a1d8e1f0 con 0x5557a1d805d0 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f59470de740 10 client.0 _ll_register_callbacks cb 0x5557a19f48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d88060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d88060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40314/0 (socket says 172.21.15.60:40314) 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d8b370 0x5557a1d887f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 -- 172.21.15.60:0/1159474290 learned_addr learned my addr 172.21.15.60:0/1159474290 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593e59c640 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d8adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 -- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 msgr2=0x5557a1d8adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d8adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 -- 172.21.15.60:0/1159474290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d8b370 msgr2=0x5557a1d887f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d8b370 0x5557a1d887f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 -- 172.21.15.60:0/1159474290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557a1a573c0 con 0x5557a1d81b40 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593e59c640 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d8adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f593dd9b640 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d88060 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5934009fd0 tx=0x7f5934097140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e054ad34305b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.601+0000 7f5925ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f5925ffb640 1 -- 172.21.15.60:0/1159474290 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934020040 con 0x5557a1d81b40 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f5925ffb640 1 -- 172.21.15.60:0/1159474290 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f5934097b10 con 0x5557a1d81b40 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 1 -- 172.21.15.60:0/1159474290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f593409bba0 con 0x5557a1d81b40 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f5925ffb640 1 -- 172.21.15.60:0/1159474290 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f59340bb860 con 0x5557a1d81b40 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 10 client.16647 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 1 -- 172.21.15.60:0/1159474290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5557a1d99b60 con 0x5557a1d81b40 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f5925ffb640 1 -- 172.21.15.60:0/1159474290 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f593409bba0 con 0x5557a1d81b40 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f5925ffb640 1 -- 172.21.15.60:0/1159474290 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f59340a3c80 con 0x5557a1d81b40 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 10 client.16647 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 10 client.16647 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 20 client.16647 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5557a1d9aeb0 0x5557a1d9d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 4 client.16647 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.602+0000 7f59470de740 1 -- 172.21.15.60:0/1159474290 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557a1cf3860 con 0x5557a1d9aeb0 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.603+0000 7f593e59c640 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5557a1d9aeb0 0x5557a1d9d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.603+0000 7f593e59c640 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5557a1d9aeb0 0x5557a1d9d2a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5af4a90efd3cef3b server_cookie=2b10fffe25ea2c4 in_seq=0 out_seq=0 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.603+0000 7f5925ffb640 10 client.16647 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f5925ffb640 1 -- 172.21.15.60:0/1159474290 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5557a1cf3860 con 0x5557a1d9aeb0 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f5925ffb640 10 client.16647 handle_command_reply: tid=0 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 client.16647 shutdown 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 -- 172.21.15.60:0/1159474290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 msgr2=0x5557a1d88060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d88060 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5934009fd0 tx=0x7f5934097140 comp rx=0 tx=0).stop 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 -- 172.21.15.60:0/1159474290 shutdown_connections 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5557a1d9aeb0 0x5557a1d9d2a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d8b370 0x5557a1d887f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d88060 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 --2- 172.21.15.60:0/1159474290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1d8adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.604+0000 7f59470de740 1 -- 172.21.15.60:0/1159474290 >> 172.21.15.60:0/1159474290 conn(0x5557a1d49310 msgr2=0x5557a1d82990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.605+0000 7f5925ffb640 0 client.16647 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.605+0000 7f59470de740 1 -- 172.21.15.60:0/1159474290 shutdown_connections 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.605+0000 7f59470de740 1 -- 172.21.15.60:0/1159474290 wait complete. 2024-09-12T00:04:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.605+0000 7f59470de740 20 client.16647 trim_cache size 0 max 16384 2024-09-12T00:04:19.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.617+0000 7f59470de740 1 Processor -- start 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f59470de740 1 -- start start 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f59470de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d805d0 0x5557a1d7ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f59470de740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d83120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f59470de740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d8b370 0x5557a1d83660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f59470de740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f59401ab5f0 con 0x5557a1d81b40 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f59470de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59401ad430 con 0x5557a1d805d0 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f59470de740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f59401abd80 con 0x5557a1d8b370 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d83120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d83120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40330/0 (socket says 172.21.15.60:40330) 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 -- 172.21.15.60:0/734928578 learned_addr learned my addr 172.21.15.60:0/734928578 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593ed9d640 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d8b370 0x5557a1d83660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593e59c640 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d805d0 0x5557a1d7ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 -- 172.21.15.60:0/734928578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d8b370 msgr2=0x5557a1d83660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d8b370 0x5557a1d83660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 -- 172.21.15.60:0/734928578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d805d0 msgr2=0x5557a1d7ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d805d0 0x5557a1d7ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 -- 172.21.15.60:0/734928578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557a1d97310 con 0x5557a1d81b40 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.618+0000 7f593dd9b640 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d83120 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5934097e70 tx=0x7f59340999b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6f4c34202e0745 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f5927fff640 1 -- 172.21.15.60:0/734928578 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934020050 con 0x5557a1d81b40 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f5927fff640 1 -- 172.21.15.60:0/734928578 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f593409bba0 con 0x5557a1d81b40 2024-09-12T00:04:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f5927fff640 1 -- 172.21.15.60:0/734928578 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934097b10 con 0x5557a1d81b40 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 -- 172.21.15.60:0/734928578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 msgr2=0x5557a1d83120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d83120 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5934097e70 tx=0x7f59340999b0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 -- 172.21.15.60:0/734928578 shutdown_connections 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d8b370 0x5557a1d83660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d81b40 0x5557a1d83120 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 --2- 172.21.15.60:0/734928578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d805d0 0x5557a1d7ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 -- 172.21.15.60:0/734928578 >> 172.21.15.60:0/734928578 conn(0x5557a1d49310 msgr2=0x5557a1d7c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 -- 172.21.15.60:0/734928578 shutdown_connections 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.619+0000 7f59470de740 1 -- 172.21.15.60:0/734928578 wait complete. 2024-09-12T00:04:19.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 1 -- start start 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 1 Processor -- start 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1dfdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 0x5557a1dfe070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f59401acca0 con 0x5557a1d8b370 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59401ac510 con 0x5557a1d81b40 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f59401a95d0 con 0x5557a1d805d0 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f59470de740 10 client.0 _ll_register_callbacks cb 0x7f5934009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:19.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40344/0 (socket says 172.21.15.60:40344) 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593ed9d640 1 -- 172.21.15.60:0/1865393537 learned_addr learned my addr 172.21.15.60:0/1865393537 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593e59c640 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1dfdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593dd9b640 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 0x5557a1dfe070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593ed9d640 1 -- 172.21.15.60:0/1865393537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 msgr2=0x5557a1dfdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593ed9d640 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1dfdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593ed9d640 1 -- 172.21.15.60:0/1865393537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 msgr2=0x5557a1dfe070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.620+0000 7f593ed9d640 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 0x5557a1dfe070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f593ed9d640 1 -- 172.21.15.60:0/1865393537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557a1d8f210 con 0x5557a1d8b370 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f593ed9d640 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8e9e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5938021ba0 tx=0x7f5938005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03d36cfe4c15c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f5925ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:19.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f5925ffb640 1 -- 172.21.15.60:0/1865393537 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593802c600 con 0x5557a1d8b370 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f5925ffb640 1 -- 172.21.15.60:0/1865393537 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f593802c7a0 con 0x5557a1d8b370 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f59470de740 1 -- 172.21.15.60:0/1865393537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f593409bba0 con 0x5557a1d8b370 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f5925ffb640 1 -- 172.21.15.60:0/1865393537 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f593803a050 con 0x5557a1d8b370 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f59470de740 10 client.16653 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f59470de740 1 -- 172.21.15.60:0/1865393537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5557a1e05340 con 0x5557a1d8b370 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f5925ffb640 1 -- 172.21.15.60:0/1865393537 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f593409bba0 con 0x5557a1d8b370 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.621+0000 7f5925ffb640 1 -- 172.21.15.60:0/1865393537 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f5938035c30 con 0x5557a1d8b370 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f59470de740 10 client.16653 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f59470de740 10 client.16653 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f59470de740 20 client.16653 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f59470de740 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5557a1e05ba0 0x5557a1e07fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f59470de740 4 client.16653 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:04:19.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f59470de740 1 -- 172.21.15.60:0/1865393537 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557a1cedd70 con 0x5557a1e05ba0 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f593e59c640 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5557a1e05ba0 0x5557a1e07fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f593e59c640 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5557a1e05ba0 0x5557a1e07fc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c8a57a3fad673328 server_cookie=30df38c5da9470aa in_seq=0 out_seq=0 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f5925ffb640 10 client.16653 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f5925ffb640 1 -- 172.21.15.60:0/1865393537 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557a1cedd70 con 0x5557a1e05ba0 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f5925ffb640 10 client.16653 handle_command_reply: tid=0 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.622+0000 7f59470de740 1 client.16653 shutdown 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 -- 172.21.15.60:0/1865393537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 msgr2=0x5557a1d8e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8e9e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5938021ba0 tx=0x7f5938005bd0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 -- 172.21.15.60:0/1865393537 shutdown_connections 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5557a1e05ba0 0x5557a1e07fc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557a1d8b370 0x5557a1d8e9e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557a1d81b40 0x5557a1dfe070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 --2- 172.21.15.60:0/1865393537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557a1d805d0 0x5557a1dfdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 -- 172.21.15.60:0/1865393537 >> 172.21.15.60:0/1865393537 conn(0x5557a1d49310 msgr2=0x5557a1d7b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5925ffb640 0 client.16653 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 -- 172.21.15.60:0/1865393537 shutdown_connections 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 1 -- 172.21.15.60:0/1865393537 wait complete. 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f59470de740 20 client.16653 trim_cache size 0 max 16384 2024-09-12T00:04:19.628 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5944d05640 1 -- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f59280a2cf0 msgr2=0x7f59280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5944d05640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f59280a2cf0 0x7f59280a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5938005c40 tx=0x7f59380099b0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5944d05640 1 -- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940102780 msgr2=0x7f5940198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5944d05640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940102780 0x7f5940198a80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f593400d770 tx=0x7f593400dc30 comp rx=0 tx=0).stop 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5944d05640 1 -- 172.21.15.60:0/3857747691 shutdown_connections 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5944d05640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f59280a2cf0 0x7f59280a51b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5944d05640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5940106f00 0x7f594019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.623+0000 7f5944d05640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5940102780 0x7f5940198a80 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.624+0000 7f5944d05640 1 --2- 172.21.15.60:0/3857747691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5940101dd0 0x7f5940198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.624+0000 7f5944d05640 1 -- 172.21.15.60:0/3857747691 >> 172.21.15.60:0/3857747691 conn(0x7f59400fd890 msgr2=0x7f59400fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.624+0000 7f5944d05640 1 -- 172.21.15.60:0/3857747691 shutdown_connections 2024-09-12T00:04:19.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:19.624+0000 7f5944d05640 1 -- 172.21.15.60:0/3857747691 wait complete. 2024-09-12T00:04:20.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:04:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:21.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 -- 172.21.15.60:0/1007697398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4101de0 msgr2=0x7feef41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 --2- 172.21.15.60:0/1007697398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4101de0 0x7feef41021c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7feee8009900 tx=0x7feee802a410 comp rx=0 tx=0).stop 2024-09-12T00:04:21.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 -- 172.21.15.60:0/1007697398 shutdown_connections 2024-09-12T00:04:21.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 --2- 172.21.15.60:0/1007697398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feef4106f10 0x7feef410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 --2- 172.21.15.60:0/1007697398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feef4102790 0x7feef41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 --2- 172.21.15.60:0/1007697398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4101de0 0x7feef41021c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 -- 172.21.15.60:0/1007697398 >> 172.21.15.60:0/1007697398 conn(0x7feef40fd8c0 msgr2=0x7feef40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 -- 172.21.15.60:0/1007697398 shutdown_connections 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.085+0000 7feefae29640 1 -- 172.21.15.60:0/1007697398 wait complete. 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feefae29640 1 Processor -- start 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feefae29640 1 -- start start 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feefae29640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feef4101de0 0x7feef40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feefae29640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4102790 0x7feef4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feefae29640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feef4106f10 0x7feef4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feefae29640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feef4112150 con 0x7feef4102790 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feefae29640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feef4111fd0 con 0x7feef4101de0 2024-09-12T00:04:21.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feefae29640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feef41122d0 con 0x7feef4106f10 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feef3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4102790 0x7feef4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feef3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4102790 0x7feef4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40370/0 (socket says 172.21.15.60:40370) 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.086+0000 7feef3fff640 1 -- 172.21.15.60:0/2819345432 learned_addr learned my addr 172.21.15.60:0/2819345432 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef93c6640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feef4106f10 0x7feef4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef8bc5640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feef4101de0 0x7feef40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef3fff640 1 -- 172.21.15.60:0/2819345432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feef4106f10 msgr2=0x7feef4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef3fff640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feef4106f10 0x7feef4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef3fff640 1 -- 172.21.15.60:0/2819345432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feef4101de0 msgr2=0x7feef40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef3fff640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feef4101de0 0x7feef40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef3fff640 1 -- 172.21.15.60:0/2819345432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef41a6b30 con 0x7feef4102790 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef3fff640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4102790 0x7feef4074a30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7feee000b4a0 tx=0x7feee000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:21.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef1ffb640 1 -- 172.21.15.60:0/2819345432 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0014070 con 0x7feef4102790 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef1ffb640 1 -- 172.21.15.60:0/2819345432 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feee0010b10 con 0x7feef4102790 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feefae29640 1 -- 172.21.15.60:0/2819345432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef41a6e20 con 0x7feef4102790 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feef1ffb640 1 -- 172.21.15.60:0/2819345432 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0017d60 con 0x7feef4102790 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.087+0000 7feefae29640 1 -- 172.21.15.60:0/2819345432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef41a72d0 con 0x7feef4102790 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feef1ffb640 1 -- 172.21.15.60:0/2819345432 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7feee0017070 con 0x7feef4102790 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feefd202740 1 Processor -- start 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feefd202740 1 -- start start 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feefd202740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c67b40 0x564599c66090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feefd202740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c66a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feefd202740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c71370 0x564599c73760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feefd202740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564599bcc2f0 con 0x564599c67b40 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feefd202740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564599b73cf0 con 0x564599c665d0 2024-09-12T00:04:21.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feefd202740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564599bc82b0 con 0x564599c71370 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feef1ffb640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feee40a2cf0 0x7feee40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feef93c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c67b40 0x564599c66090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feef93c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c67b40 0x564599c66090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40372/0 (socket says 172.21.15.60:40372) 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feef93c6640 1 -- 172.21.15.60:0/1334030500 learned_addr learned my addr 172.21.15.60:0/1334030500 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.090+0000 7feef93c6640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feee40a2cf0 0x7feee40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef8bc5640 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c66a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef3fff640 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c71370 0x564599c73760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef1ffb640 1 -- 172.21.15.60:0/2819345432 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7feee00ce710 con 0x7feef4102790 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef93c6640 1 -- 172.21.15.60:0/1334030500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c71370 msgr2=0x564599c73760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:21.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef93c6640 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c71370 0x564599c73760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef93c6640 1 -- 172.21.15.60:0/1334030500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 msgr2=0x564599c66a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef93c6640 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c66a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef93c6640 1 -- 172.21.15.60:0/1334030500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564599b583a0 con 0x564599c67b40 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef3fff640 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c71370 0x564599c73760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef93c6640 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c67b40 0x564599c66090 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7feeec00af30 tx=0x7feeec016700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2211d3677855b8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feef93c6640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feee40a2cf0 0x7feee40a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feeec009fd0 tx=0x7feeec01a000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feedeffd640 1 -- 172.21.15.60:0/1334030500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec026070 con 0x564599c67b40 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feedeffd640 1 -- 172.21.15.60:0/1334030500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feeec00a590 con 0x564599c67b40 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.091+0000 7feedeffd640 1 -- 172.21.15.60:0/1334030500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec013040 con 0x564599c67b40 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 -- 172.21.15.60:0/1334030500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c67b40 msgr2=0x564599c66090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c67b40 0x564599c66090 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7feeec00af30 tx=0x7feeec016700 comp rx=0 tx=0).stop 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 -- 172.21.15.60:0/1334030500 shutdown_connections 2024-09-12T00:04:21.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c71370 0x564599c73760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c66a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 --2- 172.21.15.60:0/1334030500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c67b40 0x564599c66090 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 -- 172.21.15.60:0/1334030500 >> 172.21.15.60:0/1334030500 conn(0x564599c2f310 msgr2=0x564599c62c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 -- 172.21.15.60:0/1334030500 shutdown_connections 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 -- 172.21.15.60:0/1334030500 wait complete. 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 -- start start 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.092+0000 7feefd202740 1 Processor -- start 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feefd202740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c70d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feefd202740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feefd202740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feefd202740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564599c74010 con 0x564599c71370 2024-09-12T00:04:21.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feefd202740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564599b87060 con 0x564599c665d0 2024-09-12T00:04:21.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feefd202740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564599c74190 con 0x564599c67b40 2024-09-12T00:04:21.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feefd202740 10 client.0 _ll_register_callbacks cb 0x5645998da8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:21.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40378/0 (socket says 172.21.15.60:40378) 2024-09-12T00:04:21.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 -- 172.21.15.60:0/1138030250 learned_addr learned my addr 172.21.15.60:0/1138030250 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:21.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef3fff640 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef8bc5640 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c70d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 -- 172.21.15.60:0/1138030250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 msgr2=0x564599c6dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 -- 172.21.15.60:0/1138030250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 msgr2=0x564599c70d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c70d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 -- 172.21.15.60:0/1138030250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56459993d3c0 con 0x564599c71370 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef8bc5640 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c70d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feef93c6640 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6e570 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7feeec021d00 tx=0x7feeec009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dcdff11872cfce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.093+0000 7feed3fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feed3fff640 1 -- 172.21.15.60:0/1138030250 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec031020 con 0x564599c71370 2024-09-12T00:04:21.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feed3fff640 1 -- 172.21.15.60:0/1138030250 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7feeec019d10 con 0x564599c71370 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 1 -- 172.21.15.60:0/1138030250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeec00a590 con 0x564599c71370 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feed3fff640 1 -- 172.21.15.60:0/1138030250 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7feeec03c050 con 0x564599c71370 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 10 client.16665 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 1 -- 172.21.15.60:0/1138030250 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x564599c7fa60 con 0x564599c71370 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feed3fff640 1 -- 172.21.15.60:0/1138030250 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feeec00a590 con 0x564599c71370 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feed3fff640 1 -- 172.21.15.60:0/1138030250 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7feeec02c710 con 0x564599c71370 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 10 client.16665 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 10 client.16665 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 20 client.16665 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564599c80f20 0x564599c83310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 4 client.16665 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:21.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.094+0000 7feefd202740 1 -- 172.21.15.60:0/1138030250 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564599bd9860 con 0x564599c80f20 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.095+0000 7feef8bc5640 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564599c80f20 0x564599c83310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.095+0000 7feef8bc5640 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564599c80f20 0x564599c83310 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d8b4673cf50197d server_cookie=98bc71a114a0a3c0 in_seq=0 out_seq=0 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.095+0000 7feed3fff640 10 client.16665 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feed3fff640 1 -- 172.21.15.60:0/1138030250 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564599bd9860 con 0x564599c80f20 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feed3fff640 10 client.16665 handle_command_reply: tid=0 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 client.16665 shutdown 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 -- 172.21.15.60:0/1138030250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 msgr2=0x564599c6e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6e570 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7feeec021d00 tx=0x7feeec009d90 comp rx=0 tx=0).stop 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 -- 172.21.15.60:0/1138030250 shutdown_connections 2024-09-12T00:04:21.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564599c80f20 0x564599c83310 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6e570 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feed3fff640 0 client.16665 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:04:21.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 --2- 172.21.15.60:0/1138030250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c70d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 -- 172.21.15.60:0/1138030250 >> 172.21.15.60:0/1138030250 conn(0x564599c2f310 msgr2=0x564599c68930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:21.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 -- 172.21.15.60:0/1138030250 shutdown_connections 2024-09-12T00:04:21.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 1 -- 172.21.15.60:0/1138030250 wait complete. 2024-09-12T00:04:21.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.096+0000 7feefd202740 20 client.16665 trim_cache size 0 max 16384 2024-09-12T00:04:21.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.109+0000 7feefd202740 1 Processor -- start 2024-09-12T00:04:21.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.109+0000 7feefd202740 1 -- start start 2024-09-12T00:04:21.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.109+0000 7feefd202740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c7d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.109+0000 7feefd202740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c88a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.109+0000 7feefd202740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c88f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.109+0000 7feefd202740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feef41afb90 con 0x564599c71370 2024-09-12T00:04:21.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feefd202740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feef41b19d0 con 0x564599c665d0 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feefd202740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feef41b0320 con 0x564599c67b40 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c88f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c88f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40392/0 (socket says 172.21.15.60:40392) 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 -- 172.21.15.60:0/2020605177 learned_addr learned my addr 172.21.15.60:0/2020605177 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef8bc5640 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c7d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef3fff640 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c88a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 -- 172.21.15.60:0/2020605177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 msgr2=0x564599c88a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c88a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 -- 172.21.15.60:0/2020605177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 msgr2=0x564599c7d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c7d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 -- 172.21.15.60:0/2020605177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564599c62ed0 con 0x564599c71370 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef3fff640 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c88a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feef93c6640 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c88f70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7feeec007160 tx=0x7feeec004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66da8fea12d40963 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feede7fc640 1 -- 172.21.15.60:0/2020605177 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec045070 con 0x564599c71370 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feede7fc640 1 -- 172.21.15.60:0/2020605177 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feeec009e10 con 0x564599c71370 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.110+0000 7feede7fc640 1 -- 172.21.15.60:0/2020605177 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec031040 con 0x564599c71370 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 -- 172.21.15.60:0/2020605177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 msgr2=0x564599c88f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c88f70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7feeec007160 tx=0x7feeec004b50 comp rx=0 tx=0).stop 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 -- 172.21.15.60:0/2020605177 shutdown_connections 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c88f70 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c88a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 --2- 172.21.15.60:0/2020605177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c7d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 -- 172.21.15.60:0/2020605177 >> 172.21.15.60:0/2020605177 conn(0x564599c2f310 msgr2=0x564599c6df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:21.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 -- 172.21.15.60:0/2020605177 shutdown_connections 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 -- 172.21.15.60:0/2020605177 wait complete. 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.111+0000 7feefd202740 1 -- start start 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feefd202740 1 Processor -- start 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feefd202740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c6b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feefd202740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feefd202740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feefd202740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feef41b1240 con 0x564599c71370 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feefd202740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feef41b0ab0 con 0x564599c665d0 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feefd202740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feef41adb70 con 0x564599c67b40 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feefd202740 10 client.0 _ll_register_callbacks cb 0x7feeec024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef93c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef93c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40402/0 (socket says 172.21.15.60:40402) 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef93c6640 1 -- 172.21.15.60:0/992045781 learned_addr learned my addr 172.21.15.60:0/992045781 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef3fff640 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef8bc5640 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c6b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef93c6640 1 -- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 msgr2=0x564599c6b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef93c6640 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef93c6640 1 -- 172.21.15.60:0/992045781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 msgr2=0x564599c6b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef93c6640 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c6b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef93c6640 1 -- 172.21.15.60:0/992045781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564599ceab60 con 0x564599c71370 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.112+0000 7feef3fff640 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feef93c6640 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6bc10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7feeec02ccd0 tx=0x7feeec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34b80e1f6c9ac6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feed3fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feed3fff640 1 -- 172.21.15.60:0/992045781 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec045030 con 0x564599c71370 2024-09-12T00:04:21.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feed3fff640 1 -- 172.21.15.60:0/992045781 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7feeec02cd50 con 0x564599c71370 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feefd202740 1 -- 172.21.15.60:0/992045781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564599bd3d70 con 0x564599c71370 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feed3fff640 1 -- 172.21.15.60:0/992045781 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7feeec031050 con 0x564599c71370 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feefd202740 10 client.16671 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feefd202740 1 -- 172.21.15.60:0/992045781 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x564599cebdb0 con 0x564599c71370 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feed3fff640 1 -- 172.21.15.60:0/992045781 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x564599bd3d70 con 0x564599c71370 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feed3fff640 1 -- 172.21.15.60:0/992045781 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7feeec021860 con 0x564599c71370 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.113+0000 7feefd202740 10 client.16671 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feefd202740 10 client.16671 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feefd202740 20 client.16671 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feefd202740 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564599cec4d0 0x564599cee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feefd202740 4 client.16671 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feefd202740 1 -- 172.21.15.60:0/992045781 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564599b50170 con 0x564599cec4d0 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feef8bc5640 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564599cec4d0 0x564599cee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:21.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feef8bc5640 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564599cec4d0 0x564599cee8f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41ff5899be27732a server_cookie=7416db53c0d9219b in_seq=0 out_seq=0 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feed3fff640 10 client.16671 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feed3fff640 1 -- 172.21.15.60:0/992045781 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564599b50170 con 0x564599cec4d0 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feed3fff640 10 client.16671 handle_command_reply: tid=0 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.114+0000 7feefd202740 1 client.16671 shutdown 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 -- 172.21.15.60:0/992045781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 msgr2=0x564599c6bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6bc10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7feeec02ccd0 tx=0x7feeec009840 comp rx=0 tx=0).stop 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 -- 172.21.15.60:0/992045781 shutdown_connections 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564599cec4d0 0x564599cee8f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564599c71370 0x564599c6bc10 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564599c67b40 0x564599c6b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 --2- 172.21.15.60:0/992045781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564599c665d0 0x564599c6b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feed3fff640 0 client.16671 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:04:21.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 -- 172.21.15.60:0/992045781 >> 172.21.15.60:0/992045781 conn(0x564599c2f310 msgr2=0x564599c6e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:21.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 -- 172.21.15.60:0/992045781 shutdown_connections 2024-09-12T00:04:21.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 1 -- 172.21.15.60:0/992045781 wait complete. 2024-09-12T00:04:21.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefd202740 20 client.16671 trim_cache size 0 max 16384 2024-09-12T00:04:21.124 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefae29640 1 -- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feee40a2cf0 msgr2=0x7feee40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefae29640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feee40a2cf0 0x7feee40a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feeec009fd0 tx=0x7feeec01a000 comp rx=0 tx=0).stop 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefae29640 1 -- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4102790 msgr2=0x7feef4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.115+0000 7feefae29640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4102790 0x7feef4074a30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7feee000b4a0 tx=0x7feee000b960 comp rx=0 tx=0).stop 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.116+0000 7feefae29640 1 -- 172.21.15.60:0/2819345432 shutdown_connections 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.116+0000 7feefae29640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feee40a2cf0 0x7feee40a51b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.116+0000 7feefae29640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feef4106f10 0x7feef4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.116+0000 7feefae29640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feef4102790 0x7feef4074a30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.116+0000 7feefae29640 1 --2- 172.21.15.60:0/2819345432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feef4101de0 0x7feef40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:21.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.116+0000 7feefae29640 1 -- 172.21.15.60:0/2819345432 >> 172.21.15.60:0/2819345432 conn(0x7feef40fd8c0 msgr2=0x7feef40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:21.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.116+0000 7feefae29640 1 -- 172.21.15.60:0/2819345432 shutdown_connections 2024-09-12T00:04:21.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:21.116+0000 7feefae29640 1 -- 172.21.15.60:0/2819345432 wait complete. 2024-09-12T00:04:21.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:21 smithi060 ceph-mon[30953]: pgmap v152: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T00:04:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:21 smithi105 ceph-mon[34805]: pgmap v152: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T00:04:21.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:21 smithi192 ceph-mon[35487]: pgmap v152: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T00:04:21.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:04:22.092 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:22.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/2951783182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34103740 msgr2=0x7f8c34107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/2951783182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34103740 0x7f8c34107b80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009930 tx=0x7f8c2802a420 comp rx=0 tx=0).stop 2024-09-12T00:04:22.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/2951783182 shutdown_connections 2024-09-12T00:04:22.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/2951783182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c34108290 0x7f8c3410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/2951783182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34103740 0x7f8c34107b80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/2951783182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c34102d90 0x7f8c34103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/2951783182 >> 172.21.15.60:0/2951783182 conn(0x7f8c340fc7d0 msgr2=0x7f8c340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/2951783182 shutdown_connections 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.596+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/2951783182 wait complete. 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.597+0000 7f8c3a4fe640 1 Processor -- start 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.597+0000 7f8c3a4fe640 1 -- start start 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c3a4fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c34102d90 0x7f8c341986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c3a4fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c34103740 0x7f8c34198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c3a4fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34108290 0x7f8c3419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c3a4fe640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c341121b0 con 0x7f8c34108290 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c3a4fe640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c34112030 con 0x7f8c34102d90 2024-09-12T00:04:22.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c3a4fe640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c34112330 con 0x7f8c34103740 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c38a9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34108290 0x7f8c3419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c38a9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34108290 0x7f8c3419cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54104/0 (socket says 172.21.15.60:54104) 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c33fff640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c34102d90 0x7f8c341986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c38a9b640 1 -- 172.21.15.60:0/1661679391 learned_addr learned my addr 172.21.15.60:0/1661679391 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c337fe640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c34103740 0x7f8c34198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c38a9b640 1 -- 172.21.15.60:0/1661679391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c34103740 msgr2=0x7f8c34198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c38a9b640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c34103740 0x7f8c34198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c38a9b640 1 -- 172.21.15.60:0/1661679391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c34102d90 msgr2=0x7f8c341986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c38a9b640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c34102d90 0x7f8c341986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c38a9b640 1 -- 172.21.15.60:0/1661679391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3419d650 con 0x7f8c34108290 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.598+0000 7f8c33fff640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c34102d90 0x7f8c341986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.599+0000 7f8c38a9b640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34108290 0x7f8c3419cf70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00eb10 tx=0x7f8c2c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.599+0000 7f8c317fa640 1 -- 172.21.15.60:0/1661679391 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c004b20 con 0x7f8c34108290 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.599+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/1661679391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3419d940 con 0x7f8c34108290 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.599+0000 7f8c317fa640 1 -- 172.21.15.60:0/1661679391 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2c004cc0 con 0x7f8c34108290 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.599+0000 7f8c317fa640 1 -- 172.21.15.60:0/1661679391 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0107f0 con 0x7f8c34108290 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.599+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/1661679391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c341a5220 con 0x7f8c34108290 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.601+0000 7f8c317fa640 1 -- 172.21.15.60:0/1661679391 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8c2c005020 con 0x7f8c34108290 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.601+0000 7f8c3c8d7740 1 Processor -- start 2024-09-12T00:04:22.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.601+0000 7f8c3c8d7740 1 -- start start 2024-09-12T00:04:22.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 0x55ee5eeef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeefa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 0x55ee5ef00b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ee5ee552f0 con 0x55ee5eeef5d0 2024-09-12T00:04:22.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ee5edfccf0 con 0x55ee5eef0b40 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ee5ee512b0 con 0x55ee5eefe780 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeefa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c317fa640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c1c0a2cf0 0x7f8c1c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeefa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54108/0 (socket says 172.21.15.60:54108) 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 -- 172.21.15.60:0/157821822 learned_addr learned my addr 172.21.15.60:0/157821822 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c337fe640 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 0x55ee5eeef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c38a9b640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c1c0a2cf0 0x7f8c1c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 -- 172.21.15.60:0/157821822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 msgr2=0x55ee5ef00b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c337fe640 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 0x55ee5ef00b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 0x55ee5ef00b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c317fa640 1 -- 172.21.15.60:0/1661679391 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8c2c0cf930 con 0x7f8c34108290 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 -- 172.21.15.60:0/157821822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 msgr2=0x55ee5eeef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 0x55ee5eeef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 -- 172.21.15.60:0/157821822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5ede13a0 con 0x55ee5eeef5d0 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c337fe640 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 0x55ee5ef00b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c33fff640 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeefa10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8c240115f0 tx=0x7f8c24011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e406d7a16f18e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c38a9b640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c1c0a2cf0 0x7f8c1c0a51b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c098810 tx=0x7f8c2c00efd0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.602+0000 7f8c1a7fc640 1 -- 172.21.15.60:0/157821822 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2401e070 con 0x55ee5eeef5d0 2024-09-12T00:04:22.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c1a7fc640 1 -- 172.21.15.60:0/157821822 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2400fb40 con 0x55ee5eeef5d0 2024-09-12T00:04:22.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c1a7fc640 1 -- 172.21.15.60:0/157821822 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24019c40 con 0x55ee5eeef5d0 2024-09-12T00:04:22.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/157821822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 msgr2=0x55ee5eeefa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeefa10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8c240115f0 tx=0x7f8c24011ab0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/157821822 shutdown_connections 2024-09-12T00:04:22.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 0x55ee5ef00b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeefa10 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/157821822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 0x55ee5eeef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/157821822 >> 172.21.15.60:0/157821822 conn(0x55ee5eeb8310 msgr2=0x55ee5eeebc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/157821822 shutdown_connections 2024-09-12T00:04:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.603+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/157821822 wait complete. 2024-09-12T00:04:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 1 -- start start 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 1 Processor -- start 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eeef5d0 0x55ee5eefe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 0x55ee5eefb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eefe780 0x55ee5eefb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ee5ef01480 con 0x55ee5eefe780 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ee5ee10060 con 0x55ee5eeef5d0 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ee5ef01600 con 0x55ee5eef0b40 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c3c8d7740 10 client.0 _ll_register_callbacks cb 0x55ee5eb638c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eefe780 0x55ee5eefb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eefe780 0x55ee5eefb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54118/0 (socket says 172.21.15.60:54118) 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c337fe640 1 -- 172.21.15.60:0/2326245931 learned_addr learned my addr 172.21.15.60:0/2326245931 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c33fff640 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 0x55ee5eefb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.604+0000 7f8c337fe640 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eeef5d0 0x55ee5eefe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c337fe640 1 -- 172.21.15.60:0/2326245931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 msgr2=0x55ee5eefb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:22.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c337fe640 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 0x55ee5eefb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c337fe640 1 -- 172.21.15.60:0/2326245931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eeef5d0 msgr2=0x55ee5eefe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c337fe640 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eeef5d0 0x55ee5eefe160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c337fe640 1 -- 172.21.15.60:0/2326245931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5ebc63c0 con 0x55ee5eefe780 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c337fe640 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eefe780 0x55ee5eefb9e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8c340697d0 tx=0x7f8c2802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbf917454d5851 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c137fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c137fe640 1 -- 172.21.15.60:0/2326245931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28035040 con 0x55ee5eefe780 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c137fe640 1 -- 172.21.15.60:0/2326245931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8c28004230 con 0x55ee5eefe780 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/2326245931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c2400fb40 con 0x55ee5eefe780 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c137fe640 1 -- 172.21.15.60:0/2326245931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8c28051050 con 0x55ee5eefe780 2024-09-12T00:04:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c3c8d7740 10 client.16683 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/2326245931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ee5ef0ce70 con 0x55ee5eefe780 2024-09-12T00:04:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c137fe640 1 -- 172.21.15.60:0/2326245931 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2400fb40 con 0x55ee5eefe780 2024-09-12T00:04:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.605+0000 7f8c137fe640 1 -- 172.21.15.60:0/2326245931 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f8c28003850 con 0x55ee5eefe780 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c3c8d7740 10 client.16683 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c3c8d7740 10 client.16683 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c3c8d7740 20 client.16683 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ee5ef0e2d0 0x55ee5ef10710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c3c8d7740 4 client.16683 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/2326245931 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee5ee62860 con 0x55ee5ef0e2d0 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c33fff640 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ee5ef0e2d0 0x55ee5ef10710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c137fe640 10 client.16683 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.606+0000 7f8c33fff640 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ee5ef0e2d0 0x55ee5ef10710 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=563b879a639aa136 server_cookie=4dc0dc0c2a5b15d2 in_seq=0 out_seq=0 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c137fe640 1 -- 172.21.15.60:0/2326245931 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee5ee62860 con 0x55ee5ef0e2d0 2024-09-12T00:04:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c137fe640 10 client.16683 handle_command_reply: tid=0 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 client.16683 shutdown 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/2326245931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eefe780 msgr2=0x55ee5eefb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eefe780 0x55ee5eefb9e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8c340697d0 tx=0x7f8c2802a420 comp rx=0 tx=0).stop 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/2326245931 shutdown_connections 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ee5ef0e2d0 0x55ee5ef10710 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eefe780 0x55ee5eefb9e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c137fe640 0 client.16683 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 0x55ee5eefb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/2326245931 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eeef5d0 0x55ee5eefe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/2326245931 >> 172.21.15.60:0/2326245931 conn(0x55ee5eeb8310 msgr2=0x55ee5eef1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.607+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/2326245931 shutdown_connections 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.608+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/2326245931 wait complete. 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.608+0000 7f8c3c8d7740 20 client.16683 trim_cache size 0 max 16384 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c3c8d7740 1 Processor -- start 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c3c8d7740 1 -- start start 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeebe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 0x55ee5ef0a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 0x55ee5eefacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c341ab7f0 con 0x55ee5eeef5d0 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c341ad630 con 0x55ee5eef0b40 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c341abf80 con 0x55ee5eefe780 2024-09-12T00:04:22.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeebe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54130/0 (socket says 172.21.15.60:54130) 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.621+0000 7f8c337fe640 1 -- 172.21.15.60:0/3574503936 learned_addr learned my addr 172.21.15.60:0/3574503936 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c33fff640 1 --2- 172.21.15.60:0/3574503936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 0x55ee5ef0a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c337fe640 1 -- 172.21.15.60:0/3574503936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 msgr2=0x55ee5eefacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c337fe640 1 --2- 172.21.15.60:0/3574503936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 0x55ee5eefacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c337fe640 1 -- 172.21.15.60:0/3574503936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 msgr2=0x55ee5ef0a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c337fe640 1 --2- 172.21.15.60:0/3574503936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 0x55ee5ef0a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c337fe640 1 -- 172.21.15.60:0/3574503936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5eefa3c0 con 0x55ee5eeef5d0 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c337fe640 1 --2- 172.21.15.60:0/3574503936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeebe10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8c280092a0 tx=0x7f8c28005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d0f6a72aa00a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c19ffb640 1 -- 172.21.15.60:0/3574503936 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2805a070 con 0x55ee5eeef5d0 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c19ffb640 1 -- 172.21.15.60:0/3574503936 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2804e030 con 0x55ee5eeef5d0 2024-09-12T00:04:22.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.622+0000 7f8c19ffb640 1 -- 172.21.15.60:0/3574503936 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28035040 con 0x55ee5eeef5d0 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/3574503936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 msgr2=0x55ee5eeebe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/3574503936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeebe10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8c280092a0 tx=0x7f8c28005890 comp rx=0 tx=0).stop 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/3574503936 shutdown_connections 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/3574503936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eefe780 0x55ee5eefacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/3574503936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eef0b40 0x55ee5ef0a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/3574503936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eeebe10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/3574503936 >> 172.21.15.60:0/3574503936 conn(0x55ee5eeb8310 msgr2=0x55ee5eeeb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/3574503936 shutdown_connections 2024-09-12T00:04:22.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/3574503936 wait complete. 2024-09-12T00:04:22.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 -- start start 2024-09-12T00:04:22.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.623+0000 7f8c3c8d7740 1 Processor -- start 2024-09-12T00:04:22.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eef8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 0x55ee5eef8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c3c8d7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eefe780 0x55ee5eef8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c341acea0 con 0x55ee5eeef5d0 2024-09-12T00:04:22.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c341ac710 con 0x55ee5eefe780 2024-09-12T00:04:22.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c3c8d7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c341a97f0 con 0x55ee5eef0b40 2024-09-12T00:04:22.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c3c8d7740 10 client.0 _ll_register_callbacks cb 0x7f8c2c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:22.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eef8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eef8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54140/0 (socket says 172.21.15.60:54140) 2024-09-12T00:04:22.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 -- 172.21.15.60:0/517985348 learned_addr learned my addr 172.21.15.60:0/517985348 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:22.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c33fff640 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 0x55ee5eef8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eefe780 0x55ee5eef8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 -- 172.21.15.60:0/517985348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 msgr2=0x55ee5eef8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 0x55ee5eef8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 -- 172.21.15.60:0/517985348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eefe780 msgr2=0x55ee5eef8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eefe780 0x55ee5eef8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 -- 172.21.15.60:0/517985348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5ef78110 con 0x55ee5eeef5d0 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c337fe640 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eef8530 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8c28006010 tx=0x7f8c28003900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2773cc90a927bf09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.624+0000 7f8c137fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c137fe640 1 -- 172.21.15.60:0/517985348 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2805a070 con 0x55ee5eeef5d0 2024-09-12T00:04:22.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c137fe640 1 -- 172.21.15.60:0/517985348 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8c28005240 con 0x55ee5eeef5d0 2024-09-12T00:04:22.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/517985348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c2804e030 con 0x55ee5eeef5d0 2024-09-12T00:04:22.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c137fe640 1 -- 172.21.15.60:0/517985348 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8c28035040 con 0x55ee5eeef5d0 2024-09-12T00:04:22.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 10 client.16689 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:22.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/517985348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ee5ef793b0 con 0x55ee5eeef5d0 2024-09-12T00:04:22.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c137fe640 1 -- 172.21.15.60:0/517985348 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c2804e030 con 0x55ee5eeef5d0 2024-09-12T00:04:22.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c137fe640 1 -- 172.21.15.60:0/517985348 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f8c2805f060 con 0x55ee5eeef5d0 2024-09-12T00:04:22.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 10 client.16689 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 10 client.16689 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 20 client.16689 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ee5ef0e2d0 0x55ee5ef7ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 4 client.16689 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.625+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/517985348 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee5ee5cd70 con 0x55ee5ef0e2d0 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.626+0000 7f8c33fff640 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ee5ef0e2d0 0x55ee5ef7ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.626+0000 7f8c33fff640 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ee5ef0e2d0 0x55ee5ef7ba30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e89db197ef91b80 server_cookie=51627a24eafa1b2 in_seq=0 out_seq=0 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.626+0000 7f8c137fe640 10 client.16689 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.626+0000 7f8c137fe640 1 -- 172.21.15.60:0/517985348 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee5ee5cd70 con 0x55ee5ef0e2d0 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.626+0000 7f8c137fe640 10 client.16689 handle_command_reply: tid=0 2024-09-12T00:04:22.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.626+0000 7f8c3c8d7740 1 client.16689 shutdown 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/517985348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 msgr2=0x55ee5eef8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eef8530 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8c28006010 tx=0x7f8c28003900 comp rx=0 tx=0).stop 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/517985348 shutdown_connections 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55ee5ef0e2d0 0x55ee5ef7ba30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ee5eefe780 0x55ee5eef8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ee5eef0b40 0x55ee5eef8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 --2- 172.21.15.60:0/517985348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ee5eeef5d0 0x55ee5eef8530 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/517985348 >> 172.21.15.60:0/517985348 conn(0x55ee5eeb8310 msgr2=0x55ee5eef1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c137fe640 0 client.16689 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/517985348 shutdown_connections 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 1 -- 172.21.15.60:0/517985348 wait complete. 2024-09-12T00:04:22.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3c8d7740 20 client.16689 trim_cache size 0 max 16384 2024-09-12T00:04:22.651 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:04:22.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c1c0a2cf0 msgr2=0x7f8c1c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c1c0a2cf0 0x7f8c1c0a51b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c098810 tx=0x7f8c2c00efd0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34108290 msgr2=0x7f8c3419cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34108290 0x7f8c3419cf70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00eb10 tx=0x7f8c2c00c2d0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/1661679391 shutdown_connections 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c1c0a2cf0 0x7f8c1c0a51b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c34108290 0x7f8c3419cf70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c34103740 0x7f8c34198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 --2- 172.21.15.60:0/1661679391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c34102d90 0x7f8c341986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:22.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.627+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/1661679391 >> 172.21.15.60:0/1661679391 conn(0x7f8c340fc7d0 msgr2=0x7f8c34106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:22.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.628+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/1661679391 shutdown_connections 2024-09-12T00:04:22.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:22.628+0000 7f8c3a4fe640 1 -- 172.21.15.60:0/1661679391 wait complete. 2024-09-12T00:04:23.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:23 smithi060 ceph-mon[30953]: pgmap v153: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:04:23.415 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:04:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:23 smithi105 ceph-mon[34805]: pgmap v153: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:04:23.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:23 smithi192 ceph-mon[35487]: pgmap v153: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:04:23.674 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.164+0000 7f38cc00c640 1 -- 172.21.15.60:0/2990717439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 msgr2=0x7f38c4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.164+0000 7f38cc00c640 1 --2- 172.21.15.60:0/2990717439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 0x7f38c4103110 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009cd0 tx=0x7f38b402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 -- 172.21.15.60:0/2990717439 shutdown_connections 2024-09-12T00:04:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 --2- 172.21.15.60:0/2990717439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c41082a0 0x7f38c410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 --2- 172.21.15.60:0/2990717439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38c41036e0 0x7f38c4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 --2- 172.21.15.60:0/2990717439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 0x7f38c4103110 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 -- 172.21.15.60:0/2990717439 >> 172.21.15.60:0/2990717439 conn(0x7f38c40fc7d0 msgr2=0x7f38c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 -- 172.21.15.60:0/2990717439 shutdown_connections 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 -- 172.21.15.60:0/2990717439 wait complete. 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 Processor -- start 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 -- start start 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 0x7f38c41986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.165+0000 7f38cc00c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38c41036e0 0x7f38c4198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38cc00c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c41082a0 0x7f38c419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38cc00c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41121e0 con 0x7f38c4102d30 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38cc00c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4112060 con 0x7f38c41036e0 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38cc00c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38c4112360 con 0x7f38c41082a0 2024-09-12T00:04:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 0x7f38c41986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 0x7f38c41986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54152/0 (socket says 172.21.15.60:54152) 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 -- 172.21.15.60:0/3245760739 learned_addr learned my addr 172.21.15.60:0/3245760739 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c41082a0 0x7f38c419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c95a7640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38c41036e0 0x7f38c4198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 -- 172.21.15.60:0/3245760739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c41082a0 msgr2=0x7f38c419cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c41082a0 0x7f38c419cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 -- 172.21.15.60:0/3245760739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38c41036e0 msgr2=0x7f38c4198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38c41036e0 0x7f38c4198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 -- 172.21.15.60:0/3245760739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c419d660 con 0x7f38c4102d30 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c41082a0 0x7f38c419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c95a7640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38c41036e0 0x7f38c4198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c9da8640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 0x7f38c41986b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f38b4031040 tx=0x7f38b4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c2ffd640 1 -- 172.21.15.60:0/3245760739 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4004040 con 0x7f38c4102d30 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38cc00c640 1 -- 172.21.15.60:0/3245760739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c419d8f0 con 0x7f38c4102d30 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c2ffd640 1 -- 172.21.15.60:0/3245760739 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b40046e0 con 0x7f38c4102d30 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38c2ffd640 1 -- 172.21.15.60:0/3245760739 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b403b400 con 0x7f38c4102d30 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.166+0000 7f38cc00c640 1 -- 172.21.15.60:0/3245760739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c41a5230 con 0x7f38c4102d30 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38c2ffd640 1 -- 172.21.15.60:0/3245760739 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f38b4030630 con 0x7f38c4102d30 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38ce3e5740 1 Processor -- start 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38ce3e5740 1 -- start start 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee37fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee37fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cee37642f0 con 0x55cee37fe5d0 2024-09-12T00:04:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cee370bcf0 con 0x55cee3809370 2024-09-12T00:04:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.169+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cee37602b0 con 0x55cee37ffb40 2024-09-12T00:04:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee37fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee37fea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54158/0 (socket says 172.21.15.60:54158) 2024-09-12T00:04:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 -- 172.21.15.60:0/3440052872 learned_addr learned my addr 172.21.15.60:0/3440052872 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c2ffd640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38ac0a2cf0 0x7f38ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c95a7640 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee37fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38ac0a2cf0 0x7f38ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c2ffd640 1 -- 172.21.15.60:0/3245760739 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f38b402e030 con 0x7f38c4102d30 2024-09-12T00:04:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 -- 172.21.15.60:0/3440052872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 msgr2=0x55cee37fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee37fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 -- 172.21.15.60:0/3440052872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 msgr2=0x55cee380b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 -- 172.21.15.60:0/3440052872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee36f03a0 con 0x55cee37fe5d0 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c95a7640 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38c9da8640 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee37fea10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f38b40bc7d0 tx=0x7f38b402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d497a85b0f00a5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38ac0a2cf0 0x7f38ac0a51b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f38bc005fd0 tx=0x7f38bc005850 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.170+0000 7f38abfff640 1 -- 172.21.15.60:0/3440052872 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40bc610 con 0x55cee37fe5d0 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.171+0000 7f38abfff640 1 -- 172.21.15.60:0/3440052872 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b4036070 con 0x55cee37fe5d0 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.171+0000 7f38abfff640 1 -- 172.21.15.60:0/3440052872 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40bc430 con 0x55cee37fe5d0 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.171+0000 7f38ce3e5740 1 -- 172.21.15.60:0/3440052872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 msgr2=0x55cee37fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.171+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee37fea10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f38b40bc7d0 tx=0x7f38b402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 -- 172.21.15.60:0/3440052872 shutdown_connections 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee37fea10 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/3440052872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee37fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 -- 172.21.15.60:0/3440052872 >> 172.21.15.60:0/3440052872 conn(0x55cee37c7310 msgr2=0x55cee37fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 -- 172.21.15.60:0/3440052872 shutdown_connections 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 -- 172.21.15.60:0/3440052872 wait complete. 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 -- start start 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.172+0000 7f38ce3e5740 1 Processor -- start 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3808de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee3806090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee38067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cee37642f0 con 0x55cee37fe5d0 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cee371f060 con 0x55cee3809370 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cee380be30 con 0x55cee37ffb40 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ce3e5740 10 client.0 _ll_register_callbacks cb 0x55cee34728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3808de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3808de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54174/0 (socket says 172.21.15.60:54174) 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 -- 172.21.15.60:0/963561810 learned_addr learned my addr 172.21.15.60:0/963561810 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c95a7640 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee3806090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee38067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 -- 172.21.15.60:0/963561810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 msgr2=0x55cee3806090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee3806090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 -- 172.21.15.60:0/963561810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 msgr2=0x55cee38067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee38067d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 -- 172.21.15.60:0/963561810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee34d53c0 con 0x55cee37fe5d0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38c9da8640 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3808de0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f38b40eddb0 tx=0x7f38b40bcfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca9da4eb3cfe6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38a97fa640 1 -- 172.21.15.60:0/963561810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40f38e0 con 0x55cee37fe5d0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38a97fa640 1 -- 172.21.15.60:0/963561810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f38b40badd0 con 0x55cee37fe5d0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.173+0000 7f38ce3e5740 1 -- 172.21.15.60:0/963561810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b4036070 con 0x55cee37fe5d0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38a97fa640 1 -- 172.21.15.60:0/963561810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f38b40bcad0 con 0x55cee37fe5d0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38ce3e5740 10 client.16701 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38ce3e5740 1 -- 172.21.15.60:0/963561810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55cee38177e0 con 0x55cee37fe5d0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38a97fa640 1 -- 172.21.15.60:0/963561810 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b4036070 con 0x55cee37fe5d0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38a97fa640 1 -- 172.21.15.60:0/963561810 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f38b404d020 con 0x55cee37fe5d0 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38ce3e5740 10 client.16701 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38ce3e5740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38ce3e5740 20 client.16701 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cee3818960 0x55cee381ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38ce3e5740 4 client.16701 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38ce3e5740 1 -- 172.21.15.60:0/963561810 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cee3771860 con 0x55cee3818960 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.174+0000 7f38c95a7640 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cee3818960 0x55cee381ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.175+0000 7f38a97fa640 10 client.16701 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.175+0000 7f38c95a7640 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cee3818960 0x55cee381ad50 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5620ba0fa4f005 server_cookie=1fe8cc5959dd40c1 in_seq=0 out_seq=0 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.175+0000 7f38a97fa640 1 -- 172.21.15.60:0/963561810 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cee3771860 con 0x55cee3818960 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.175+0000 7f38a97fa640 10 client.16701 handle_command_reply: tid=0 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.175+0000 7f38ce3e5740 1 client.16701 shutdown 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.175+0000 7f38ce3e5740 1 -- 172.21.15.60:0/963561810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 msgr2=0x55cee3808de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.175+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3808de0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f38b40eddb0 tx=0x7f38b40bcfe0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 1 -- 172.21.15.60:0/963561810 shutdown_connections 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cee3818960 0x55cee381ad50 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee38067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee3806090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38a97fa640 0 client.16701 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/963561810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3808de0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 1 -- 172.21.15.60:0/963561810 >> 172.21.15.60:0/963561810 conn(0x55cee37c7310 msgr2=0x55cee3800960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 1 -- 172.21.15.60:0/963561810 shutdown_connections 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 1 -- 172.21.15.60:0/963561810 wait complete. 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.176+0000 7f38ce3e5740 20 client.16701 trim_cache size 0 max 16384 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ce3e5740 1 Processor -- start 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ce3e5740 1 -- start start 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3814f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee3801120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee3801660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41ad8e0 con 0x55cee37fe5d0 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41af720 con 0x55cee3809370 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41ae070 con 0x55cee37ffb40 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c9da8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3814f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c9da8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3814f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54186/0 (socket says 172.21.15.60:54186) 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c9da8640 1 -- 172.21.15.60:0/2409160499 learned_addr learned my addr 172.21.15.60:0/2409160499 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee3801660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c95a7640 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee3801120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c9da8640 1 -- 172.21.15.60:0/2409160499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 msgr2=0x55cee3801120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c9da8640 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee3801120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c9da8640 1 -- 172.21.15.60:0/2409160499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 msgr2=0x55cee3801660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c9da8640 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee3801660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38c9da8640 1 -- 172.21.15.60:0/2409160499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cee3806b40 con 0x55cee37fe5d0 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.189+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee3801660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38c9da8640 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3814f50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f38b40c5900 tx=0x7f38b402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debdf1ca95a63aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ab7fe640 1 -- 172.21.15.60:0/2409160499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40b8d70 con 0x55cee37fe5d0 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ab7fe640 1 -- 172.21.15.60:0/2409160499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b4036070 con 0x55cee37fe5d0 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ab7fe640 1 -- 172.21.15.60:0/2409160499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40bc610 con 0x55cee37fe5d0 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ce3e5740 1 -- 172.21.15.60:0/2409160499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 msgr2=0x55cee3814f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3814f50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f38b40c5900 tx=0x7f38b402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ce3e5740 1 -- 172.21.15.60:0/2409160499 shutdown_connections 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee3801660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37ffb40 0x55cee3801120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/2409160499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37fe5d0 0x55cee3814f50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.190+0000 7f38ce3e5740 1 -- 172.21.15.60:0/2409160499 >> 172.21.15.60:0/2409160499 conn(0x55cee37c7310 msgr2=0x55cee3808110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.191+0000 7f38ce3e5740 1 -- 172.21.15.60:0/2409160499 shutdown_connections 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.191+0000 7f38ce3e5740 1 -- 172.21.15.60:0/2409160499 wait complete. 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.191+0000 7f38ce3e5740 1 -- start start 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.191+0000 7f38ce3e5740 1 Processor -- start 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37fe5d0 0x55cee380cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37ffb40 0x55cee380d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38ce3e5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41aef90 con 0x55cee37ffb40 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41ae800 con 0x55cee3809370 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38ce3e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38c41ab8e0 con 0x55cee37fe5d0 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38ce3e5740 10 client.0 _ll_register_callbacks cb 0x7f38b4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37ffb40 0x55cee380d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37ffb40 0x55cee380d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54198/0 (socket says 172.21.15.60:54198) 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 -- 172.21.15.60:0/1717183898 learned_addr learned my addr 172.21.15.60:0/1717183898 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c9da8640 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37fe5d0 0x55cee380cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38ca5a9640 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 -- 172.21.15.60:0/1717183898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37fe5d0 msgr2=0x55cee380cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37fe5d0 0x55cee380cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 -- 172.21.15.60:0/1717183898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 msgr2=0x55cee380d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 -- 172.21.15.60:0/1717183898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cee3882500 con 0x55cee37ffb40 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38c95a7640 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37ffb40 0x55cee380d2b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f38c40fede0 tx=0x7f38b801a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0ff65cf1b230b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.192+0000 7f38a97fa640 1 -- 172.21.15.60:0/1717183898 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8005230 con 0x55cee37ffb40 2024-09-12T00:04:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38a97fa640 1 -- 172.21.15.60:0/1717183898 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f38b80053d0 con 0x55cee37ffb40 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 1 -- 172.21.15.60:0/1717183898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b4036070 con 0x55cee37ffb40 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38a97fa640 1 -- 172.21.15.60:0/1717183898 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f38b80055d0 con 0x55cee37ffb40 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 10 client.16707 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 1 -- 172.21.15.60:0/1717183898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55cee38837d0 con 0x55cee37ffb40 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38a97fa640 1 -- 172.21.15.60:0/1717183898 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f38b4036070 con 0x55cee37ffb40 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38a97fa640 1 -- 172.21.15.60:0/1717183898 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f38b800f040 con 0x55cee37ffb40 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 10 client.16707 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 10 client.16707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 20 client.16707 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cee3883fa0 0x55cee38863c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 4 client.16707 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38ce3e5740 1 -- 172.21.15.60:0/1717183898 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cee376bd70 con 0x55cee3883fa0 2024-09-12T00:04:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.193+0000 7f38c9da8640 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cee3883fa0 0x55cee38863c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38c9da8640 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cee3883fa0 0x55cee38863c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f43c6c0784c2dd54 server_cookie=74862d1dd7e12471 in_seq=0 out_seq=0 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38a97fa640 10 client.16707 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38a97fa640 1 -- 172.21.15.60:0/1717183898 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cee376bd70 con 0x55cee3883fa0 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38a97fa640 10 client.16707 handle_command_reply: tid=0 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 client.16707 shutdown 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 -- 172.21.15.60:0/1717183898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37ffb40 msgr2=0x55cee380d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37ffb40 0x55cee380d2b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f38c40fede0 tx=0x7f38b801a660 comp rx=0 tx=0).stop 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 -- 172.21.15.60:0/1717183898 shutdown_connections 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cee3883fa0 0x55cee38863c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cee3809370 0x55cee380d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cee37ffb40 0x55cee380d2b0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38a97fa640 0 client.16707 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:24.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 --2- 172.21.15.60:0/1717183898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cee37fe5d0 0x55cee380cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 -- 172.21.15.60:0/1717183898 >> 172.21.15.60:0/1717183898 conn(0x55cee37c7310 msgr2=0x55cee3804830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:24.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 -- 172.21.15.60:0/1717183898 shutdown_connections 2024-09-12T00:04:24.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 1 -- 172.21.15.60:0/1717183898 wait complete. 2024-09-12T00:04:24.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.194+0000 7f38ce3e5740 20 client.16707 trim_cache size 0 max 16384 2024-09-12T00:04:24.210 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 -- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38ac0a2cf0 msgr2=0x7f38ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38ac0a2cf0 0x7f38ac0a51b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f38bc005fd0 tx=0x7f38bc005850 comp rx=0 tx=0).stop 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 -- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 msgr2=0x7f38c41986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 0x7f38c41986b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f38b4031040 tx=0x7f38b4003f10 comp rx=0 tx=0).stop 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 -- 172.21.15.60:0/3245760739 shutdown_connections 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f38ac0a2cf0 0x7f38ac0a51b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c41082a0 0x7f38c419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38c41036e0 0x7f38c4198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 --2- 172.21.15.60:0/3245760739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38c4102d30 0x7f38c41986b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 -- 172.21.15.60:0/3245760739 >> 172.21.15.60:0/3245760739 conn(0x7f38c40fc7d0 msgr2=0x7f38c4105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:24.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 -- 172.21.15.60:0/3245760739 shutdown_connections 2024-09-12T00:04:24.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:24.195+0000 7f38cc00c640 1 -- 172.21.15.60:0/3245760739 wait complete. 2024-09-12T00:04:25.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:25 smithi105 ceph-mon[34805]: pgmap v154: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:04:25.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:25 smithi192 ceph-mon[35487]: pgmap v154: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:04:25.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:25 smithi060 ceph-mon[30953]: pgmap v154: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:04:25.868 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:04:25.868 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:04:26.138 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 -- 172.21.15.60:0/1430790253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 msgr2=0x7f8c5c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 --2- 172.21.15.60:0/1430790253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 0x7f8c5c10ea90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009ca0 tx=0x7f8c5402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 -- 172.21.15.60:0/1430790253 shutdown_connections 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 --2- 172.21.15.60:0/1430790253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 0x7f8c5c10ea90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 --2- 172.21.15.60:0/1430790253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c5c102790 0x7f8c5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 --2- 172.21.15.60:0/1430790253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c5c101de0 0x7f8c5c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 -- 172.21.15.60:0/1430790253 >> 172.21.15.60:0/1430790253 conn(0x7f8c5c0fd8c0 msgr2=0x7f8c5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 -- 172.21.15.60:0/1430790253 shutdown_connections 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 -- 172.21.15.60:0/1430790253 wait complete. 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.645+0000 7f8c630dc640 1 Processor -- start 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c630dc640 1 -- start start 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c630dc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c5c101de0 0x7f8c5c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c630dc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c5c102790 0x7f8c5c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c630dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 0x7f8c5c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c630dc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c112090 con 0x7f8c5c106f10 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c630dc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c111f10 con 0x7f8c5c102790 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c630dc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c112210 con 0x7f8c5c101de0 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 0x7f8c5c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 0x7f8c5c19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54210/0 (socket says 172.21.15.60:54210) 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 -- 172.21.15.60:0/2666580435 learned_addr learned my addr 172.21.15.60:0/2666580435 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c5c102790 0x7f8c5c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c60e78640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c5c101de0 0x7f8c5c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 -- 172.21.15.60:0/2666580435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c5c101de0 msgr2=0x7f8c5c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c5c101de0 0x7f8c5c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 -- 172.21.15.60:0/2666580435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c5c102790 msgr2=0x7f8c5c1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c5c102790 0x7f8c5c1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 -- 172.21.15.60:0/2666580435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c19d450 con 0x7f8c5c106f10 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c60e78640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c5c101de0 0x7f8c5c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.646+0000 7f8c61679640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 0x7f8c5c19cd70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8c54006010 tx=0x7f8c540319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.647+0000 7f8c59ffb640 1 -- 172.21.15.60:0/2666580435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5402fa20 con 0x7f8c5c106f10 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.647+0000 7f8c630dc640 1 -- 172.21.15.60:0/2666580435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5c19d6e0 con 0x7f8c5c106f10 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.647+0000 7f8c59ffb640 1 -- 172.21.15.60:0/2666580435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c5402fbc0 con 0x7f8c5c106f10 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.647+0000 7f8c59ffb640 1 -- 172.21.15.60:0/2666580435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c54046860 con 0x7f8c5c106f10 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.647+0000 7f8c630dc640 1 -- 172.21.15.60:0/2666580435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c5c1a5020 con 0x7f8c5c106f10 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.649+0000 7f8c59ffb640 1 -- 172.21.15.60:0/2666580435 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8c54046a00 con 0x7f8c5c106f10 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c654b5740 1 Processor -- start 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c654b5740 1 -- start start 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c59ffb640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c440a2cf0 0x7f8c440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f29ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2aa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c654b5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f86f205280 con 0x55f86f2a0480 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c654b5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f86f1acb10 con 0x55f86f2aad40 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c654b5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f86f201240 con 0x55f86f29fb60 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c440a2cf0 0x7f8c440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c59ffb640 1 -- 172.21.15.60:0/2666580435 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8c540f0a40 con 0x7f8c5c106f10 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c60e78640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f29ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c60e78640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f29ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:35606/0 (socket says 172.21.15.60:35606) 2024-09-12T00:04:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.650+0000 7f8c60e78640 1 -- 172.21.15.60:0/2848192603 learned_addr learned my addr 172.21.15.60:0/2848192603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c61679640 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c60e78640 1 -- 172.21.15.60:0/2848192603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 msgr2=0x55f86f2ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c60e78640 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c60e78640 1 -- 172.21.15.60:0/2848192603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 msgr2=0x55f86f2aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c60e78640 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c60e78640 1 -- 172.21.15.60:0/2848192603 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86f1b91f0 con 0x55f86f29fb60 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c60e78640 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f29ff40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00bd40 tx=0x7f8c4c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0646053fa51e878 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c440a2cf0 0x7f8c440a51b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55f86f29cf50 tx=0x7f8c50004150 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c42ffd640 1 -- 172.21.15.60:0/2848192603 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c015070 con 0x55f86f29fb60 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c42ffd640 1 -- 172.21.15.60:0/2848192603 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c4c00be30 con 0x55f86f29fb60 2024-09-12T00:04:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.651+0000 7f8c42ffd640 1 -- 172.21.15.60:0/2848192603 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011ae0 con 0x55f86f29fb60 2024-09-12T00:04:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 -- 172.21.15.60:0/2848192603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 msgr2=0x55f86f29ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f29ff40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00bd40 tx=0x7f8c4c00f730 comp rx=0 tx=0).stop 2024-09-12T00:04:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 -- 172.21.15.60:0/2848192603 shutdown_connections 2024-09-12T00:04:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 --2- 172.21.15.60:0/2848192603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f29ff40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 -- 172.21.15.60:0/2848192603 >> 172.21.15.60:0/2848192603 conn(0x55f86f29c0f0 msgr2=0x55f86f29c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:26.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 -- 172.21.15.60:0/2848192603 shutdown_connections 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 -- 172.21.15.60:0/2848192603 wait complete. 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.652+0000 7f8c654b5740 1 -- start start 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c654b5740 1 Processor -- start 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f2af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c654b5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f86f2ad910 con 0x55f86f2a0480 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c654b5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f86f1bff10 con 0x55f86f2aad40 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c654b5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f86f2ada90 con 0x55f86f29fb60 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c654b5740 10 client.0 _ll_register_callbacks cb 0x55f86f188a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54228/0 (socket says 172.21.15.60:54228) 2024-09-12T00:04:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c5bfff640 1 -- 172.21.15.60:0/802386241 learned_addr learned my addr 172.21.15.60:0/802386241 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c60e78640 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f2af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.653+0000 7f8c61679640 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c5bfff640 1 -- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 msgr2=0x55f86f2af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f2af1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c5bfff640 1 -- 172.21.15.60:0/802386241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 msgr2=0x55f86f2b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c5bfff640 1 -- 172.21.15.60:0/802386241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86ef766a0 con 0x55f86f2a0480 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c60e78640 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f2af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af700 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8c50003f90 tx=0x7f8c5000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cb570f7856e3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c3bfff640 1 -- 172.21.15.60:0/802386241 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5001f860 con 0x55f86f2a0480 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c654b5740 1 -- 172.21.15.60:0/802386241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c4c00be30 con 0x55f86f2a0480 2024-09-12T00:04:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c3bfff640 1 -- 172.21.15.60:0/802386241 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8c5001fa00 con 0x55f86f2a0480 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c3bfff640 1 -- 172.21.15.60:0/802386241 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8c50010e40 con 0x55f86f2a0480 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c654b5740 10 client.16716 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c654b5740 1 -- 172.21.15.60:0/802386241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f86f2bd8a0 con 0x55f86f2a0480 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.654+0000 7f8c3bfff640 1 -- 172.21.15.60:0/802386241 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c4c00be30 con 0x55f86f2a0480 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c3bfff640 1 -- 172.21.15.60:0/802386241 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f8c5001c040 con 0x55f86f2a0480 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c654b5740 10 client.16716 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c654b5740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c654b5740 20 client.16716 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c654b5740 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55f86f2bedb0 0x55f86f2c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c654b5740 4 client.16716 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c654b5740 1 -- 172.21.15.60:0/802386241 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f86f2127f0 con 0x55f86f2bedb0 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c60e78640 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55f86f2bedb0 0x55f86f2c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c60e78640 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55f86f2bedb0 0x55f86f2c1200 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62a9e4c0f52c4e97 server_cookie=f6556d8c6bc45eed in_seq=0 out_seq=0 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.655+0000 7f8c3bfff640 10 client.16716 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c3bfff640 1 -- 172.21.15.60:0/802386241 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f86f2127f0 con 0x55f86f2bedb0 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c3bfff640 10 client.16716 handle_command_reply: tid=0 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 client.16716 shutdown 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 -- 172.21.15.60:0/802386241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 msgr2=0x55f86f2af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af700 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8c50003f90 tx=0x7f8c5000b390 comp rx=0 tx=0).stop 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 -- 172.21.15.60:0/802386241 shutdown_connections 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55f86f2bedb0 0x55f86f2c1200 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af700 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 --2- 172.21.15.60:0/802386241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f2af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c3bfff640 0 client.16716 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:26.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.656+0000 7f8c654b5740 1 -- 172.21.15.60:0/802386241 >> 172.21.15.60:0/802386241 conn(0x55f86f29c0f0 msgr2=0x55f86f2a1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:26.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.657+0000 7f8c654b5740 1 -- 172.21.15.60:0/802386241 shutdown_connections 2024-09-12T00:04:26.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.657+0000 7f8c654b5740 1 -- 172.21.15.60:0/802386241 wait complete. 2024-09-12T00:04:26.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.657+0000 7f8c654b5740 20 client.16716 trim_cache size 0 max 16384 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c654b5740 1 Processor -- start 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c654b5740 1 -- start start 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f2b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c654b5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1ab5b0 con 0x55f86f2a0480 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c654b5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1ad3f0 con 0x55f86f2aad40 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c654b5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1abd40 con 0x55f86f29fb60 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54230/0 (socket says 172.21.15.60:54230) 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c5bfff640 1 -- 172.21.15.60:0/2910309969 learned_addr learned my addr 172.21.15.60:0/2910309969 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.674+0000 7f8c61679640 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c5bfff640 1 -- 172.21.15.60:0/2910309969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 msgr2=0x55f86f2b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f2b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c5bfff640 1 -- 172.21.15.60:0/2910309969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 msgr2=0x55f86f2af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c5bfff640 1 -- 172.21.15.60:0/2910309969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86f29ccf0 con 0x55f86f2a0480 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c61679640 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af1c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000b520 tx=0x7f8c50004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbee02a4de2aa4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c427fc640 1 -- 172.21.15.60:0/2910309969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c50036070 con 0x55f86f2a0480 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c427fc640 1 -- 172.21.15.60:0/2910309969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c50010c90 con 0x55f86f2a0480 2024-09-12T00:04:26.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.675+0000 7f8c427fc640 1 -- 172.21.15.60:0/2910309969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5001f8c0 con 0x55f86f2a0480 2024-09-12T00:04:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 -- 172.21.15.60:0/2910309969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 msgr2=0x55f86f2af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af1c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000b520 tx=0x7f8c50004350 comp rx=0 tx=0).stop 2024-09-12T00:04:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 -- 172.21.15.60:0/2910309969 shutdown_connections 2024-09-12T00:04:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f2a0480 0x55f86f2af1c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 --2- 172.21.15.60:0/2910309969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f29fb60 0x55f86f2b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 -- 172.21.15.60:0/2910309969 >> 172.21.15.60:0/2910309969 conn(0x55f86f29c0f0 msgr2=0x55f86f2a73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 -- 172.21.15.60:0/2910309969 shutdown_connections 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 -- 172.21.15.60:0/2910309969 wait complete. 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 -- start start 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 Processor -- start 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f29fb60 0x55f86f2bb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f2a0480 0x55f86f2b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.676+0000 7f8c654b5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c654b5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1acc60 con 0x55f86f29fb60 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c654b5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1ac4d0 con 0x55f86f2aad40 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c654b5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1a9590 con 0x55f86f2a0480 2024-09-12T00:04:26.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c654b5740 10 client.0 _ll_register_callbacks cb 0x7f8c5000b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f29fb60 0x55f86f2bb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f29fb60 0x55f86f2bb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54238/0 (socket says 172.21.15.60:54238) 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 -- 172.21.15.60:0/1029895214 learned_addr learned my addr 172.21.15.60:0/1029895214 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f2a0480 0x55f86f2b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c61679640 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 -- 172.21.15.60:0/1029895214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f2a0480 msgr2=0x55f86f2b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f2a0480 0x55f86f2b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 -- 172.21.15.60:0/1029895214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 msgr2=0x55f86f2b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 -- 172.21.15.60:0/1029895214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86f2b7150 con 0x55f86f29fb60 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c60e78640 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f29fb60 0x55f86f2bb100 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c011790 tx=0x7f8c4c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b538fa768bf810 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:26.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c3bfff640 1 -- 172.21.15.60:0/1029895214 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c02a020 con 0x55f86f29fb60 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c3bfff640 1 -- 172.21.15.60:0/1029895214 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f8c4c004440 con 0x55f86f29fb60 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.677+0000 7f8c654b5740 1 -- 172.21.15.60:0/1029895214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c50010c90 con 0x55f86f29fb60 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c3bfff640 1 -- 172.21.15.60:0/1029895214 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8c4c015040 con 0x55f86f29fb60 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c654b5740 10 client.16722 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c654b5740 1 -- 172.21.15.60:0/1029895214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f86f3299e0 con 0x55f86f29fb60 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c3bfff640 1 -- 172.21.15.60:0/1029895214 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c50010c90 con 0x55f86f29fb60 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c3bfff640 1 -- 172.21.15.60:0/1029895214 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f8c4c004680 con 0x55f86f29fb60 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c654b5740 10 client.16722 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c654b5740 10 client.16722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c654b5740 20 client.16722 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c654b5740 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55f86f329ed0 0x55f86f32c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c654b5740 4 client.16722 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:04:26.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c654b5740 1 -- 172.21.15.60:0/1029895214 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f86f20cd00 con 0x55f86f329ed0 2024-09-12T00:04:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.678+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55f86f329ed0 0x55f86f32c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.679+0000 7f8c5bfff640 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55f86f329ed0 0x55f86f32c2f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85ab06ff283beca server_cookie=818785b3ca99d0cb in_seq=0 out_seq=0 2024-09-12T00:04:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.679+0000 7f8c3bfff640 10 client.16722 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c3bfff640 1 -- 172.21.15.60:0/1029895214 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f86f20cd00 con 0x55f86f329ed0 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c3bfff640 10 client.16722 handle_command_reply: tid=0 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 client.16722 shutdown 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 -- 172.21.15.60:0/1029895214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f29fb60 msgr2=0x55f86f2bb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f29fb60 0x55f86f2bb100 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c011790 tx=0x7f8c4c00b480 comp rx=0 tx=0).stop 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 -- 172.21.15.60:0/1029895214 shutdown_connections 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55f86f329ed0 0x55f86f32c2f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f86f2aad40 0x55f86f2b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f86f2a0480 0x55f86f2b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 --2- 172.21.15.60:0/1029895214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f86f29fb60 0x55f86f2bb100 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 -- 172.21.15.60:0/1029895214 >> 172.21.15.60:0/1029895214 conn(0x55f86f29c0f0 msgr2=0x55f86f2af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c3bfff640 0 client.16722 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 -- 172.21.15.60:0/1029895214 shutdown_connections 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 1 -- 172.21.15.60:0/1029895214 wait complete. 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.680+0000 7f8c654b5740 20 client.16722 trim_cache size 0 max 16384 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:04:26.684 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "9a23be20-047f-449e-a40c-ce57df470628", 2024-09-12T00:04:26.685 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:04:26.685 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:04:26.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 -- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c440a2cf0 msgr2=0x7f8c440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c440a2cf0 0x7f8c440a51b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x55f86f29cf50 tx=0x7f8c50004150 comp rx=0 tx=0).stop 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 -- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 msgr2=0x7f8c5c19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 0x7f8c5c19cd70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8c54006010 tx=0x7f8c540319f0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 -- 172.21.15.60:0/2666580435 shutdown_connections 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8c440a2cf0 0x7f8c440a51b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c5c106f10 0x7f8c5c19cd70 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c5c102790 0x7f8c5c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 --2- 172.21.15.60:0/2666580435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c5c101de0 0x7f8c5c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 -- 172.21.15.60:0/2666580435 >> 172.21.15.60:0/2666580435 conn(0x7f8c5c0fd8c0 msgr2=0x7f8c5c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 -- 172.21.15.60:0/2666580435 shutdown_connections 2024-09-12T00:04:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:26.681+0000 7f8c630dc640 1 -- 172.21.15.60:0/2666580435 wait complete. 2024-09-12T00:04:27.463 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:27 smithi060 ceph-mon[30953]: pgmap v155: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:27.464 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:27 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:04:27.464 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:27 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:04:27.464 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:27 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:04:27.464 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:27 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:04:27.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:04:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:27 smithi105 ceph-mon[34805]: pgmap v155: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:27 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:04:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:27 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:04:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:27 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:04:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:27 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:04:27.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:27 smithi192 ceph-mon[35487]: pgmap v155: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:27.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:27 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:04:27.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:27 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:04:27.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:27 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:04:27.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:27 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:04:27.727 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:28.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 -- 172.21.15.60:0/1685791494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 msgr2=0x7f744010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1685791494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 0x7f744010bbb0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f742c009900 tx=0x7f742c02a480 comp rx=0 tx=0).stop 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 -- 172.21.15.60:0/1685791494 shutdown_connections 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1685791494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f744010c180 0x7f744010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1685791494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 0x7f744010bbb0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1685791494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7440102da0 0x7f7440103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 -- 172.21.15.60:0/1685791494 >> 172.21.15.60:0/1685791494 conn(0x7f74400fc7a0 msgr2=0x7f74400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 -- 172.21.15.60:0/1685791494 shutdown_connections 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 -- 172.21.15.60:0/1685791494 wait complete. 2024-09-12T00:04:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 Processor -- start 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.195+0000 7f7446dd4640 1 -- start start 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7446dd4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7440102da0 0x7f74401a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7446dd4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 0x7f74401a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7446dd4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f744010c180 0x7f744019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7446dd4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7440112080 con 0x7f74401036c0 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7446dd4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7440111f00 con 0x7f7440102da0 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7446dd4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7440112200 con 0x7f744010c180 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 0x7f74401a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 0x7f74401a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54250/0 (socket says 172.21.15.60:54250) 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 -- 172.21.15.60:0/1478068260 learned_addr learned my addr 172.21.15.60:0/1478068260 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7444b70640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7440102da0 0x7f74401a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7445371640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f744010c180 0x7f744019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 -- 172.21.15.60:0/1478068260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f744010c180 msgr2=0x7f744019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f744010c180 0x7f744019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 -- 172.21.15.60:0/1478068260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7440102da0 msgr2=0x7f74401a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7440102da0 0x7f74401a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 -- 172.21.15.60:0/1478068260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744019ada0 con 0x7f74401036c0 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7445371640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f744010c180 0x7f744019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743ffff640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 0x7f74401a0a70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f742c006010 tx=0x7f742c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743dffb640 1 -- 172.21.15.60:0/1478068260 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c03f030 con 0x7f74401036c0 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743dffb640 1 -- 172.21.15.60:0/1478068260 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f742c003d00 con 0x7f74401036c0 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f7446dd4640 1 -- 172.21.15.60:0/1478068260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744019b030 con 0x7f74401036c0 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.196+0000 7f743dffb640 1 -- 172.21.15.60:0/1478068260 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c035070 con 0x7f74401036c0 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.197+0000 7f7446dd4640 1 -- 172.21.15.60:0/1478068260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74401a72e0 con 0x7f74401036c0 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.199+0000 7f743dffb640 1 -- 172.21.15.60:0/1478068260 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f742c042030 con 0x7f74401036c0 2024-09-12T00:04:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.199+0000 7f74491ad740 1 Processor -- start 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.199+0000 7f74491ad740 1 -- start start 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f74491ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762ced4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f74491ad740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f74491ad740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cee1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f74491ad740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55762ce3a2e0 con 0x55762ced4dc0 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f74491ad740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55762cde1ce0 con 0x55762cedf680 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f74491ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55762ce362a0 con 0x55762ced44a0 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f743dffb640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74300a2d70 0x7f74300a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54264/0 (socket says 172.21.15.60:54264) 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 -- 172.21.15.60:0/4210804541 learned_addr learned my addr 172.21.15.60:0/4210804541 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f743ffff640 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cee1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7445371640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74300a2d70 0x7f74300a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7445371640 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762ced4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f743dffb640 1 -- 172.21.15.60:0/1478068260 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f742c0efa10 con 0x7f74401036c0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 -- 172.21.15.60:0/4210804541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 msgr2=0x55762ced4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762ced4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 -- 172.21.15.60:0/4210804541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 msgr2=0x55762cee1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cee1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 -- 172.21.15.60:0/4210804541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762cdc6440 con 0x55762ced4dc0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.200+0000 7f7444b70640 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedf140 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f743400bd10 tx=0x7f74340107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d51c7fdf2fc81cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f7445371640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74300a2d70 0x7f74300a5230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7438009370 tx=0x7f7438009590 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f742affd640 1 -- 172.21.15.60:0/4210804541 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434004030 con 0x55762ced4dc0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f742affd640 1 -- 172.21.15.60:0/4210804541 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74340041d0 con 0x55762ced4dc0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f742affd640 1 -- 172.21.15.60:0/4210804541 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434011920 con 0x55762ced4dc0 2024-09-12T00:04:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 -- 172.21.15.60:0/4210804541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 msgr2=0x55762cedf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedf140 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f743400bd10 tx=0x7f74340107a0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 -- 172.21.15.60:0/4210804541 shutdown_connections 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cee1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedf140 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 --2- 172.21.15.60:0/4210804541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762ced4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 -- 172.21.15.60:0/4210804541 >> 172.21.15.60:0/4210804541 conn(0x55762ced0a30 msgr2=0x55762ced0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 -- 172.21.15.60:0/4210804541 shutdown_connections 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.201+0000 7f74491ad740 1 -- 172.21.15.60:0/4210804541 wait complete. 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 1 -- start start 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 1 Processor -- start 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762cedef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cedc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55762cee2250 con 0x55762ced4dc0 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55762cdf5050 con 0x55762cedf680 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55762cee23d0 con 0x55762ced44a0 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f74491ad740 10 client.0 _ll_register_callbacks cb 0x55762ce35160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f743ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f743ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54280/0 (socket says 172.21.15.60:54280) 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.202+0000 7f743ffff640 1 -- 172.21.15.60:0/1793900764 learned_addr learned my addr 172.21.15.60:0/1793900764 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f7444b70640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762cedef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f7445371640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cedc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f743ffff640 1 -- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 msgr2=0x55762cedef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f743ffff640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762cedef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f743ffff640 1 -- 172.21.15.60:0/1793900764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 msgr2=0x55762cedc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f743ffff640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cedc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f743ffff640 1 -- 172.21.15.60:0/1793900764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55762cbab3c0 con 0x55762ced4dc0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f7445371640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cedc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f7444b70640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762cedef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f743ffff640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedc210 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f742c0b8440 tx=0x7f742c08afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4eebad876dbc91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f741ffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f741ffff640 1 -- 172.21.15.60:0/1793900764 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c049040 con 0x55762ced4dc0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f741ffff640 1 -- 172.21.15.60:0/1793900764 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f742c03b460 con 0x55762ced4dc0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f74491ad740 1 -- 172.21.15.60:0/1793900764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74340041d0 con 0x55762ced4dc0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f741ffff640 1 -- 172.21.15.60:0/1793900764 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f742c0bc6e0 con 0x55762ced4dc0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f74491ad740 10 client.16734 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f74491ad740 1 -- 172.21.15.60:0/1793900764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55762ceedbc0 con 0x55762ced4dc0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.203+0000 7f741ffff640 1 -- 172.21.15.60:0/1793900764 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74340041d0 con 0x55762ced4dc0 2024-09-12T00:04:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.204+0000 7f741ffff640 1 -- 172.21.15.60:0/1793900764 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f742c0ed3d0 con 0x55762ced4dc0 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.204+0000 7f74491ad740 10 client.16734 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.204+0000 7f74491ad740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.204+0000 7f74491ad740 20 client.16734 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.204+0000 7f74491ad740 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55762ceeef90 0x55762cef1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.204+0000 7f74491ad740 4 client.16734 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.204+0000 7f74491ad740 1 -- 172.21.15.60:0/1793900764 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55762ce47850 con 0x55762ceeef90 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.204+0000 7f7444b70640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55762ceeef90 0x55762cef1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f741ffff640 10 client.16734 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f7444b70640 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55762ceeef90 0x55762cef1450 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a181bf8c14a9886 server_cookie=f167cf0c66f908df in_seq=0 out_seq=0 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f741ffff640 1 -- 172.21.15.60:0/1793900764 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55762ce47850 con 0x55762ceeef90 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f741ffff640 10 client.16734 handle_command_reply: tid=0 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 client.16734 shutdown 2024-09-12T00:04:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 -- 172.21.15.60:0/1793900764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 msgr2=0x55762cedc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedc210 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f742c0b8440 tx=0x7f742c08afd0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 -- 172.21.15.60:0/1793900764 shutdown_connections 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55762ceeef90 0x55762cef1450 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cedc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f741ffff640 0 client.16734 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced4dc0 0x55762cedc210 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 --2- 172.21.15.60:0/1793900764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ced44a0 0x55762cedef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.205+0000 7f74491ad740 1 -- 172.21.15.60:0/1793900764 >> 172.21.15.60:0/1793900764 conn(0x55762ced0a30 msgr2=0x55762ced6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.206+0000 7f74491ad740 1 -- 172.21.15.60:0/1793900764 shutdown_connections 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.206+0000 7f74491ad740 1 -- 172.21.15.60:0/1793900764 wait complete. 2024-09-12T00:04:28.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.206+0000 7f74491ad740 20 client.16734 trim_cache size 0 max 16384 2024-09-12T00:04:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f74491ad740 1 Processor -- start 2024-09-12T00:04:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f74491ad740 1 -- start start 2024-09-12T00:04:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f74491ad740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced44a0 0x55762ceeb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f74491ad740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cef6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f74491ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 0x55762cef7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f74491ad740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f74401af9f0 con 0x55762ced44a0 2024-09-12T00:04:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f74491ad740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74401b1830 con 0x55762cedf680 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f74491ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f74401b0180 con 0x55762ceeef90 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f7444b70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced44a0 0x55762ceeb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f7444b70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced44a0 0x55762ceeb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54290/0 (socket says 172.21.15.60:54290) 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.223+0000 7f7444b70640 1 -- 172.21.15.60:0/2936512388 learned_addr learned my addr 172.21.15.60:0/2936512388 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f7445371640 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 0x55762cef7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f743ffff640 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cef6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f7444b70640 1 -- 172.21.15.60:0/2936512388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 msgr2=0x55762cef7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f7444b70640 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 0x55762cef7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f7444b70640 1 -- 172.21.15.60:0/2936512388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 msgr2=0x55762cef6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f7444b70640 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cef6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f7444b70640 1 -- 172.21.15.60:0/2936512388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55762cee2130 con 0x55762ced44a0 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f743ffff640 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cef6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:04:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f7444b70640 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced44a0 0x55762ceeb4b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7434000c00 tx=0x7f74340114e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cf202339548961 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f742a7fc640 1 -- 172.21.15.60:0/2936512388 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74340037f0 con 0x55762ced44a0 2024-09-12T00:04:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f742a7fc640 1 -- 172.21.15.60:0/2936512388 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7434005540 con 0x55762ced44a0 2024-09-12T00:04:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.224+0000 7f742a7fc640 1 -- 172.21.15.60:0/2936512388 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434011c00 con 0x55762ced44a0 2024-09-12T00:04:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 -- 172.21.15.60:0/2936512388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced44a0 msgr2=0x55762ceeb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced44a0 0x55762ceeb4b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7434000c00 tx=0x7f74340114e0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 -- 172.21.15.60:0/2936512388 shutdown_connections 2024-09-12T00:04:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 0x55762cef7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762cedf680 0x55762cef6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 --2- 172.21.15.60:0/2936512388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762ced44a0 0x55762ceeb4b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 -- 172.21.15.60:0/2936512388 >> 172.21.15.60:0/2936512388 conn(0x55762ced0a30 msgr2=0x55762cedb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 -- 172.21.15.60:0/2936512388 shutdown_connections 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 -- 172.21.15.60:0/2936512388 wait complete. 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 -- start start 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.225+0000 7f74491ad740 1 Processor -- start 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f74491ad740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762ced44a0 0x55762cee7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f74491ad740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762cedf680 0x55762cee4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f74491ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 0x55762cee53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f74491ad740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f74401b10a0 con 0x55762cedf680 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f74491ad740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74401b0910 con 0x55762ced44a0 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f74491ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f74401ad9d0 con 0x55762ceeef90 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f74491ad740 10 client.0 _ll_register_callbacks cb 0x7f742c032bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:04:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762cedf680 0x55762cee4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762cedf680 0x55762cee4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54302/0 (socket says 172.21.15.60:54302) 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 -- 172.21.15.60:0/3812232663 learned_addr learned my addr 172.21.15.60:0/3812232663 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f7444b70640 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762ced44a0 0x55762cee7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f7445371640 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 0x55762cee53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 -- 172.21.15.60:0/3812232663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 msgr2=0x55762cee53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 0x55762cee53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 -- 172.21.15.60:0/3812232663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762ced44a0 msgr2=0x55762cee7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762ced44a0 0x55762cee7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 -- 172.21.15.60:0/3812232663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55762cee5990 con 0x55762cedf680 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f743ffff640 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762cedf680 0x55762cee4e90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f742c004590 tx=0x7f742c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c250dbc10bd6a099 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.226+0000 7f741ffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f741ffff640 1 -- 172.21.15.60:0/3812232663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c049070 con 0x55762cedf680 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f741ffff640 1 -- 172.21.15.60:0/3812232663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f742c0dab60 con 0x55762cedf680 2024-09-12T00:04:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 1 -- 172.21.15.60:0/3812232663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7434005540 con 0x55762cedf680 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f741ffff640 1 -- 172.21.15.60:0/3812232663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f742c0d7080 con 0x55762cedf680 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 10 client.16740 fetch_fsmap learned FSMap version 39 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 1 -- 172.21.15.60:0/3812232663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55762cf59a80 con 0x55762cedf680 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f741ffff640 1 -- 172.21.15.60:0/3812232663 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7434005540 con 0x55762cedf680 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f741ffff640 1 -- 172.21.15.60:0/3812232663 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 39) ==== 8442+0+0 (secure 0 0 0) 0x7f742c0b6b50 con 0x55762cedf680 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 10 client.16740 fetch_fsmap finished waiting for FSMap version 39 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 20 client.16740 populate_metadata read hostname 'smithi060' 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55762cf5a0b0 0x55762cf5c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 4 client.16740 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.227+0000 7f74491ad740 1 -- 172.21.15.60:0/3812232663 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55762ce41d60 con 0x55762cf5a0b0 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.228+0000 7f7444b70640 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55762cf5a0b0 0x55762cf5c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:04:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.228+0000 7f7444b70640 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55762cf5a0b0 0x55762cf5c4d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce5ad1861f7b86e4 server_cookie=9c64e1f2d4cb1535 in_seq=0 out_seq=0 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.228+0000 7f741ffff640 10 client.16740 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.228+0000 7f741ffff640 1 -- 172.21.15.60:0/3812232663 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55762ce41d60 con 0x55762cf5a0b0 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.228+0000 7f741ffff640 10 client.16740 handle_command_reply: tid=0 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.228+0000 7f74491ad740 1 client.16740 shutdown 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.228+0000 7f74491ad740 1 -- 172.21.15.60:0/3812232663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762cedf680 msgr2=0x55762cee4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.228+0000 7f74491ad740 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762cedf680 0x55762cee4e90 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f742c004590 tx=0x7f742c0045e0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 1 -- 172.21.15.60:0/3812232663 shutdown_connections 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55762cf5a0b0 0x55762cf5c4d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55762ceeef90 0x55762cee53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55762cedf680 0x55762cee4e90 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f741ffff640 0 client.16740 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 1 --2- 172.21.15.60:0/3812232663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55762ced44a0 0x55762cee7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 1 -- 172.21.15.60:0/3812232663 >> 172.21.15.60:0/3812232663 conn(0x55762ced0a30 msgr2=0x55762cedda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 1 -- 172.21.15.60:0/3812232663 shutdown_connections 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 1 -- 172.21.15.60:0/3812232663 wait complete. 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f74491ad740 20 client.16740 trim_cache size 0 max 16384 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "9a23be20-047f-449e-a40c-ce57df470628": { 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:04:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "9a23be20-047f-449e-a40c-ce57df470628", 2024-09-12T00:04:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:04:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:04:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:04:28.234 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:04:28.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f7446dd4640 1 -- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74300a2d70 msgr2=0x7f74300a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74300a2d70 0x7f74300a5230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7438009370 tx=0x7f7438009590 comp rx=0 tx=0).stop 2024-09-12T00:04:28.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f7446dd4640 1 -- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 msgr2=0x7f74401a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:04:28.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.229+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 0x7f74401a0a70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f742c006010 tx=0x7f742c0042f0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.230+0000 7f7446dd4640 1 -- 172.21.15.60:0/1478068260 shutdown_connections 2024-09-12T00:04:28.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.230+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74300a2d70 0x7f74300a5230 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.230+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f744010c180 0x7f744019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.230+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f74401036c0 0x7f74401a0a70 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.230+0000 7f7446dd4640 1 --2- 172.21.15.60:0/1478068260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7440102da0 0x7f74401a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:04:28.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.230+0000 7f7446dd4640 1 -- 172.21.15.60:0/1478068260 >> 172.21.15.60:0/1478068260 conn(0x7f74400fc7a0 msgr2=0x7f7440101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:04:28.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.230+0000 7f7446dd4640 1 -- 172.21.15.60:0/1478068260 shutdown_connections 2024-09-12T00:04:28.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:04:28.230+0000 7f7446dd4640 1 -- 172.21.15.60:0/1478068260 wait complete. 2024-09-12T00:04:29.104 INFO:tasks.cephfs.filesystem:scrub status for tag:9a23be20-047f-449e-a40c-ce57df470628 - {'path': '/', 'tag': '9a23be20-047f-449e-a40c-ce57df470628', 'options': 'recursive,force'} 2024-09-12T00:04:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:29 smithi060 ceph-mon[30953]: pgmap v156: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-12T00:04:29.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:29 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:04:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:29 smithi105 ceph-mon[34805]: pgmap v156: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-12T00:04:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:29 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:04:29.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:29 smithi192 ceph-mon[35487]: pgmap v156: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-12T00:04:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:29 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:04:31.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:31 smithi105 ceph-mon[34805]: pgmap v157: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T00:04:31.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:31 smithi192 ceph-mon[35487]: pgmap v157: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T00:04:31.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:31 smithi060 ceph-mon[30953]: pgmap v157: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-12T00:04:33.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:33 smithi105 ceph-mon[34805]: pgmap v158: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:04:33.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:04:33.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:33 smithi192 ceph-mon[35487]: pgmap v158: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:04:33.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:04:33.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:33 smithi060 ceph-mon[30953]: pgmap v158: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:04:33.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:04:34.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:04:34.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:04:34.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:04:34.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:04:34.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:04:34.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:04:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:04:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:04:34.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:04:35.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:35 smithi105 ceph-mon[34805]: pgmap v159: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:04:35.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:35 smithi192 ceph-mon[35487]: pgmap v159: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:04:35.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:35 smithi060 ceph-mon[30953]: pgmap v159: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:04:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:37 smithi105 ceph-mon[34805]: pgmap v160: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:04:37.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:37 smithi192 ceph-mon[35487]: pgmap v160: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:04:37.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:37 smithi060 ceph-mon[30953]: pgmap v160: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:04:39.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:39 smithi105 ceph-mon[34805]: pgmap v161: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-12T00:04:39.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:39 smithi192 ceph-mon[35487]: pgmap v161: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-12T00:04:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:39 smithi060 ceph-mon[30953]: pgmap v161: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-12T00:04:41.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:41 smithi105 ceph-mon[34805]: pgmap v162: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2024-09-12T00:04:41.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:41 smithi192 ceph-mon[35487]: pgmap v162: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2024-09-12T00:04:41.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:41 smithi060 ceph-mon[30953]: pgmap v162: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 12 op/s 2024-09-12T00:04:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:43 smithi105 ceph-mon[34805]: pgmap v163: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:43.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:43 smithi192 ceph-mon[35487]: pgmap v163: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:43.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:43 smithi060 ceph-mon[30953]: pgmap v163: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:45 smithi105 ceph-mon[34805]: pgmap v164: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:04:45.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:45 smithi192 ceph-mon[35487]: pgmap v164: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:04:45.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:45 smithi060 ceph-mon[30953]: pgmap v164: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:04:47.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:47 smithi105 ceph-mon[34805]: pgmap v165: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:47.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:47 smithi192 ceph-mon[35487]: pgmap v165: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:47 smithi060 ceph-mon[30953]: pgmap v165: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:49 smithi105 ceph-mon[34805]: pgmap v166: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:04:49.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:49 smithi192 ceph-mon[35487]: pgmap v166: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:04:49.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:49 smithi060 ceph-mon[30953]: pgmap v166: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:04:51.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:51 smithi105 ceph-mon[34805]: pgmap v167: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T00:04:51.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:51 smithi192 ceph-mon[35487]: pgmap v167: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T00:04:51.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:51 smithi060 ceph-mon[30953]: pgmap v167: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-12T00:04:53.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:53 smithi192 ceph-mon[35487]: pgmap v168: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:53 smithi060 ceph-mon[30953]: pgmap v168: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:53.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:53 smithi105 ceph-mon[34805]: pgmap v168: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:04:55.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:55 smithi192 ceph-mon[35487]: pgmap v169: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T00:04:55.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:55 smithi060 ceph-mon[30953]: pgmap v169: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T00:04:55.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:55 smithi105 ceph-mon[34805]: pgmap v169: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T00:04:57.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:57 smithi192 ceph-mon[35487]: pgmap v170: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T00:04:57.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:57 smithi060 ceph-mon[30953]: pgmap v170: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T00:04:57.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:57 smithi105 ceph-mon[34805]: pgmap v170: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T00:04:58.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:58 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:04:58.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:58 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:04:59.218 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:04:59.220 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:58 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:04:59.494 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:04:59.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:04:59 smithi192 ceph-mon[35487]: pgmap v171: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-12T00:04:59.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:04:59 smithi060 ceph-mon[30953]: pgmap v171: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-12T00:04:59.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:04:59 smithi105 ceph-mon[34805]: pgmap v171: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-12T00:05:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 -- 172.21.15.60:0/2140388414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 msgr2=0x7f64c0074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 --2- 172.21.15.60:0/2140388414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 0x7f64c0074a00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009900 tx=0x7f64b802a480 comp rx=0 tx=0).stop 2024-09-12T00:05:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 -- 172.21.15.60:0/2140388414 shutdown_connections 2024-09-12T00:05:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 --2- 172.21.15.60:0/2140388414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c010e3c0 0x7f64c0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 --2- 172.21.15.60:0/2140388414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c0074f40 0x7f64c010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 --2- 172.21.15.60:0/2140388414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 0x7f64c0074a00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 -- 172.21.15.60:0/2140388414 >> 172.21.15.60:0/2140388414 conn(0x7f64c00fd8c0 msgr2=0x7f64c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:00.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 -- 172.21.15.60:0/2140388414 shutdown_connections 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.125+0000 7f64c7679640 1 -- 172.21.15.60:0/2140388414 wait complete. 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c7679640 1 Processor -- start 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c7679640 1 -- start start 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c7679640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 0x7f64c01a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c7679640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c0074f40 0x7f64c01a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c7679640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c010e3c0 0x7f64c019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c7679640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f64c01142f0 con 0x7f64c0074620 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c7679640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64c0114170 con 0x7f64c0074f40 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c7679640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64c0114470 con 0x7f64c010e3c0 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c5415640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 0x7f64c01a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.126+0000 7f64c5415640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 0x7f64c01a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49578/0 (socket says 172.21.15.60:49578) 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5415640 1 -- 172.21.15.60:0/4066794836 learned_addr learned my addr 172.21.15.60:0/4066794836 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c4c14640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c0074f40 0x7f64c01a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5c16640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c010e3c0 0x7f64c019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5415640 1 -- 172.21.15.60:0/4066794836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c010e3c0 msgr2=0x7f64c019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5415640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c010e3c0 0x7f64c019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5415640 1 -- 172.21.15.60:0/4066794836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c0074f40 msgr2=0x7f64c01a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5415640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c0074f40 0x7f64c01a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5415640 1 -- 172.21.15.60:0/4066794836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c019aec0 con 0x7f64c0074620 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5c16640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c010e3c0 0x7f64c019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c5415640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 0x7f64c01a0580 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f64b8006010 tx=0x7f64b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64be7fc640 1 -- 172.21.15.60:0/4066794836 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b803f030 con 0x7f64c0074620 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c7679640 1 -- 172.21.15.60:0/4066794836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c019b150 con 0x7f64c0074620 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64be7fc640 1 -- 172.21.15.60:0/4066794836 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f64b8003d00 con 0x7f64c0074620 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64c7679640 1 -- 172.21.15.60:0/4066794836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c01a7330 con 0x7f64c0074620 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.127+0000 7f64be7fc640 1 -- 172.21.15.60:0/4066794836 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8049060 con 0x7f64c0074620 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.129+0000 7f64be7fc640 1 -- 172.21.15.60:0/4066794836 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f64b8042030 con 0x7f64c0074620 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64c9a52740 1 Processor -- start 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64c9a52740 1 -- start start 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc6564a0 0x557cdc656880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc656dc0 0x557cdc661140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64be7fc640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f64a80a2cf0 0x7f64a80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc661680 0x557cdc663a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64c9a52740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557cdc5bc2e0 con 0x557cdc6564a0 2024-09-12T00:05:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64c9a52740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557cdc563ce0 con 0x557cdc656dc0 2024-09-12T00:05:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.130+0000 7f64c9a52740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557cdc5b82a0 con 0x557cdc661680 2024-09-12T00:05:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc6564a0 0x557cdc656880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc6564a0 0x557cdc656880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49582/0 (socket says 172.21.15.60:49582) 2024-09-12T00:05:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 -- 172.21.15.60:0/1368490437 learned_addr learned my addr 172.21.15.60:0/1368490437 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5415640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f64a80a2cf0 0x7f64a80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64be7fc640 1 -- 172.21.15.60:0/4066794836 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f64b80efd20 con 0x7f64c0074620 2024-09-12T00:05:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c4c14640 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc656dc0 0x557cdc661140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc661680 0x557cdc663a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 -- 172.21.15.60:0/1368490437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc661680 msgr2=0x557cdc663a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc661680 0x557cdc663a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 -- 172.21.15.60:0/1368490437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc656dc0 msgr2=0x557cdc661140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc656dc0 0x557cdc661140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 -- 172.21.15.60:0/1368490437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdc548440 con 0x557cdc6564a0 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5415640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f64a80a2cf0 0x7f64a80a51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f64b8000c00 tx=0x7f64b80b16c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64c5c16640 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc6564a0 0x557cdc656880 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f64b0014660 tx=0x7f64b00099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474f1a521758eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64a77fe640 1 -- 172.21.15.60:0/1368490437 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b00127d0 con 0x557cdc6564a0 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64a77fe640 1 -- 172.21.15.60:0/1368490437 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f64b0018070 con 0x557cdc6564a0 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.131+0000 7f64a77fe640 1 -- 172.21.15.60:0/1368490437 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b00103d0 con 0x557cdc6564a0 2024-09-12T00:05:00.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 -- 172.21.15.60:0/1368490437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc6564a0 msgr2=0x557cdc656880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc6564a0 0x557cdc656880 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f64b0014660 tx=0x7f64b00099a0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 -- 172.21.15.60:0/1368490437 shutdown_connections 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc661680 0x557cdc663a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc656dc0 0x557cdc661140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 --2- 172.21.15.60:0/1368490437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc6564a0 0x557cdc656880 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 -- 172.21.15.60:0/1368490437 >> 172.21.15.60:0/1368490437 conn(0x557cdc652a30 msgr2=0x557cdc652e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 -- 172.21.15.60:0/1368490437 shutdown_connections 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.132+0000 7f64c9a52740 1 -- 172.21.15.60:0/1368490437 wait complete. 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 1 -- start start 2024-09-12T00:05:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 1 Processor -- start 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc661020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc65e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc65e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557cdc664250 con 0x557cdc661680 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557cdc577050 con 0x557cdc6564a0 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557cdc6643d0 con 0x557cdc656dc0 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.133+0000 7f64c9a52740 10 client.0 _ll_register_callbacks cb 0x557cdc5b7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc65e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc65e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49586/0 (socket says 172.21.15.60:49586) 2024-09-12T00:05:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 -- 172.21.15.60:0/2750861201 learned_addr learned my addr 172.21.15.60:0/2750861201 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c4c14640 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc65e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc661020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 -- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 msgr2=0x557cdc65e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc65e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 -- 172.21.15.60:0/2750861201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 msgr2=0x557cdc661020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc661020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 -- 172.21.15.60:0/2750861201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cdc32d3c0 con 0x557cdc661680 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c4c14640 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc65e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c5c16640 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc65e870 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f64b00094c0 tx=0x7f64b001db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f182ad0dae6bb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64a4ff9640 1 -- 172.21.15.60:0/2750861201 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b00129b0 con 0x557cdc661680 2024-09-12T00:05:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64a4ff9640 1 -- 172.21.15.60:0/2750861201 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f64b0012b50 con 0x557cdc661680 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.134+0000 7f64c9a52740 1 -- 172.21.15.60:0/2750861201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64b0018070 con 0x557cdc661680 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64a4ff9640 1 -- 172.21.15.60:0/2750861201 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f64b0012d50 con 0x557cdc661680 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c9a52740 10 client.16752 fetch_fsmap learned FSMap version 40 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c9a52740 1 -- 172.21.15.60:0/2750861201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x557cdc66fc90 con 0x557cdc661680 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64a4ff9640 1 -- 172.21.15.60:0/2750861201 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f64b0018070 con 0x557cdc661680 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64a4ff9640 1 -- 172.21.15.60:0/2750861201 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f64b000f040 con 0x557cdc661680 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c9a52740 10 client.16752 fetch_fsmap finished waiting for FSMap version 40 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c9a52740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c9a52740 20 client.16752 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c9a52740 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557cdc670fe0 0x557cdc6733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c9a52740 4 client.16752 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c9a52740 1 -- 172.21.15.60:0/2750861201 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cdc5c9850 con 0x557cdc670fe0 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.135+0000 7f64c4c14640 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557cdc670fe0 0x557cdc6733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.136+0000 7f64a4ff9640 10 client.16752 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.136+0000 7f64c4c14640 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557cdc670fe0 0x557cdc6733d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=848afc6c6f5ad05d server_cookie=1642cb8d9d7897e3 in_seq=0 out_seq=0 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64a4ff9640 1 -- 172.21.15.60:0/2750861201 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cdc5c9850 con 0x557cdc670fe0 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64a4ff9640 10 client.16752 handle_command_reply: tid=0 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 client.16752 shutdown 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 -- 172.21.15.60:0/2750861201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 msgr2=0x557cdc65e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc65e870 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f64b00094c0 tx=0x7f64b001db50 comp rx=0 tx=0).stop 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 -- 172.21.15.60:0/2750861201 shutdown_connections 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557cdc670fe0 0x557cdc6733d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc65e870 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc65e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64a4ff9640 0 client.16752 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:00.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 --2- 172.21.15.60:0/2750861201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc661020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 -- 172.21.15.60:0/2750861201 >> 172.21.15.60:0/2750861201 conn(0x557cdc652a30 msgr2=0x557cdc658760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:00.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 -- 172.21.15.60:0/2750861201 shutdown_connections 2024-09-12T00:05:00.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 1 -- 172.21.15.60:0/2750861201 wait complete. 2024-09-12T00:05:00.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.137+0000 7f64c9a52740 20 client.16752 trim_cache size 0 max 16384 2024-09-12T00:05:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.154+0000 7f64c9a52740 1 Processor -- start 2024-09-12T00:05:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.154+0000 7f64c9a52740 1 -- start start 2024-09-12T00:05:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc660240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc678bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc679130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c9a52740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f64c01afaf0 con 0x557cdc661680 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c9a52740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64c01b18d0 con 0x557cdc6564a0 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c9a52740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64c01b0220 con 0x557cdc656dc0 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c5c16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc679130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c5c16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc679130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49598/0 (socket says 172.21.15.60:49598) 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c5c16640 1 -- 172.21.15.60:0/180406771 learned_addr learned my addr 172.21.15.60:0/180406771 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c4c14640 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc678bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.155+0000 7f64c5c16640 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc660240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64c5c16640 1 -- 172.21.15.60:0/180406771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 msgr2=0x557cdc678bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64c5c16640 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc678bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64c5c16640 1 -- 172.21.15.60:0/180406771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 msgr2=0x557cdc660240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64c5c16640 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc660240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64c5c16640 1 -- 172.21.15.60:0/180406771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdc673960 con 0x557cdc661680 2024-09-12T00:05:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64c5c16640 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc679130 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f64b0005d70 tx=0x7f64b001dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d83e1bd04ceaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64a6ffd640 1 -- 172.21.15.60:0/180406771 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b0039070 con 0x557cdc661680 2024-09-12T00:05:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64a6ffd640 1 -- 172.21.15.60:0/180406771 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f64b0018070 con 0x557cdc661680 2024-09-12T00:05:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.156+0000 7f64a6ffd640 1 -- 172.21.15.60:0/180406771 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b00129b0 con 0x557cdc661680 2024-09-12T00:05:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 -- 172.21.15.60:0/180406771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 msgr2=0x557cdc679130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc679130 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f64b0005d70 tx=0x7f64b001dbc0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 -- 172.21.15.60:0/180406771 shutdown_connections 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc679130 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc678bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 --2- 172.21.15.60:0/180406771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc660240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 -- 172.21.15.60:0/180406771 >> 172.21.15.60:0/180406771 conn(0x557cdc652a30 msgr2=0x557cdc65fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 -- 172.21.15.60:0/180406771 shutdown_connections 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 -- 172.21.15.60:0/180406771 wait complete. 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.157+0000 7f64c9a52740 1 -- start start 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c9a52740 1 Processor -- start 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc666da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc6672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c9a52740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc6d9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c9a52740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f64c01b1140 con 0x557cdc661680 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c9a52740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64c01b09b0 con 0x557cdc6564a0 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c9a52740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64c01adad0 con 0x557cdc656dc0 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c9a52740 10 client.0 _ll_register_callbacks cb 0x7f64b00144c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c5c16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc6d9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c5c16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc6d9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49612/0 (socket says 172.21.15.60:49612) 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.158+0000 7f64c5c16640 1 -- 172.21.15.60:0/3900710634 learned_addr learned my addr 172.21.15.60:0/3900710634 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c5c16640 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc666da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c4c14640 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc6672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c5c16640 1 -- 172.21.15.60:0/3900710634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 msgr2=0x557cdc6672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c5c16640 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc6672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c5c16640 1 -- 172.21.15.60:0/3900710634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 msgr2=0x557cdc666da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c5c16640 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc666da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c5c16640 1 -- 172.21.15.60:0/3900710634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cdc6da200 con 0x557cdc661680 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c5c16640 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc6d9bc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x557cdc65c1d0 tx=0x7f64b002b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa728264fde02cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64a4ff9640 1 -- 172.21.15.60:0/3900710634 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b0039070 con 0x557cdc661680 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64a4ff9640 1 -- 172.21.15.60:0/3900710634 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f64b002ba80 con 0x557cdc661680 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.159+0000 7f64c9a52740 1 -- 172.21.15.60:0/3900710634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64b0018070 con 0x557cdc661680 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64a4ff9640 1 -- 172.21.15.60:0/3900710634 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f64b002bc80 con 0x557cdc661680 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c9a52740 10 client.16758 fetch_fsmap learned FSMap version 40 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c9a52740 1 -- 172.21.15.60:0/3900710634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x557cdc6db460 con 0x557cdc661680 2024-09-12T00:05:00.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64a4ff9640 1 -- 172.21.15.60:0/3900710634 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f64b0018070 con 0x557cdc661680 2024-09-12T00:05:00.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64a4ff9640 1 -- 172.21.15.60:0/3900710634 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f64b0035430 con 0x557cdc661680 2024-09-12T00:05:00.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c9a52740 10 client.16758 fetch_fsmap finished waiting for FSMap version 40 2024-09-12T00:05:00.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c9a52740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:00.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c9a52740 20 client.16758 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:00.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c9a52740 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557cdc6dba00 0x557cdc6dde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:00.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c9a52740 4 client.16758 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:05:00.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c9a52740 1 -- 172.21.15.60:0/3900710634 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557cdc5c3d60 con 0x557cdc6dba00 2024-09-12T00:05:00.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.160+0000 7f64c4c14640 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557cdc6dba00 0x557cdc6dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:00.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.161+0000 7f64a4ff9640 10 client.16758 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.161+0000 7f64c4c14640 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557cdc6dba00 0x557cdc6dde20 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd11d3b0e67e2701 server_cookie=92b5fd92895fa5e1 in_seq=0 out_seq=0 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.161+0000 7f64a4ff9640 1 -- 172.21.15.60:0/3900710634 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557cdc5c3d60 con 0x557cdc6dba00 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.161+0000 7f64a4ff9640 10 client.16758 handle_command_reply: tid=0 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.161+0000 7f64c9a52740 1 client.16758 shutdown 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 -- 172.21.15.60:0/3900710634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 msgr2=0x557cdc6d9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc6d9bc0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x557cdc65c1d0 tx=0x7f64b002b890 comp rx=0 tx=0).stop 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 -- 172.21.15.60:0/3900710634 shutdown_connections 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557cdc6dba00 0x557cdc6dde20 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557cdc661680 0x557cdc6d9bc0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557cdc656dc0 0x557cdc6672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64a4ff9640 0 client.16758 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 --2- 172.21.15.60:0/3900710634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557cdc6564a0 0x557cdc666da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 -- 172.21.15.60:0/3900710634 >> 172.21.15.60:0/3900710634 conn(0x557cdc652a30 msgr2=0x557cdc651350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:00.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 -- 172.21.15.60:0/3900710634 shutdown_connections 2024-09-12T00:05:00.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 1 -- 172.21.15.60:0/3900710634 wait complete. 2024-09-12T00:05:00.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.162+0000 7f64c9a52740 20 client.16758 trim_cache size 0 max 16384 2024-09-12T00:05:00.166 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:05:00.166 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:05:00.166 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:05:00.166 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:05:00.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 -- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f64a80a2cf0 msgr2=0x7f64a80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f64a80a2cf0 0x7f64a80a51b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f64b8000c00 tx=0x7f64b80b16c0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 -- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 msgr2=0x7f64c01a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:00.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 0x7f64c01a0580 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f64b8006010 tx=0x7f64b80042f0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 -- 172.21.15.60:0/4066794836 shutdown_connections 2024-09-12T00:05:00.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f64a80a2cf0 0x7f64a80a51b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c010e3c0 0x7f64c019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c0074f40 0x7f64c01a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 --2- 172.21.15.60:0/4066794836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64c0074620 0x7f64c01a0580 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:00.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 -- 172.21.15.60:0/4066794836 >> 172.21.15.60:0/4066794836 conn(0x7f64c00fd8c0 msgr2=0x7f64c00fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:00.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 -- 172.21.15.60:0/4066794836 shutdown_connections 2024-09-12T00:05:00.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:00.163+0000 7f64c7679640 1 -- 172.21.15.60:0/4066794836 wait complete. 2024-09-12T00:05:00.965 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:05:00.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:05:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:01.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:01 smithi105 ceph-mon[34805]: pgmap v172: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-12T00:05:01.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:01 smithi192 ceph-mon[35487]: pgmap v172: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-12T00:05:01.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:01 smithi060 ceph-mon[30953]: pgmap v172: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 -- 172.21.15.60:0/2537921201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 msgr2=0x7fa64010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 --2- 172.21.15.60:0/2537921201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 0x7fa64010e610 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa638009ca0 tx=0x7fa63802a950 comp rx=0 tx=0).stop 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 -- 172.21.15.60:0/2537921201 shutdown_connections 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 --2- 172.21.15.60:0/2537921201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 0x7fa64010e610 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 --2- 172.21.15.60:0/2537921201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa640103660 0x7fa64010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 --2- 172.21.15.60:0/2537921201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa640102d40 0x7fa640103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 -- 172.21.15.60:0/2537921201 >> 172.21.15.60:0/2537921201 conn(0x7fa6400fc7a0 msgr2=0x7fa6400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 -- 172.21.15.60:0/2537921201 shutdown_connections 2024-09-12T00:05:01.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.717+0000 7fa646689640 1 -- 172.21.15.60:0/2537921201 wait complete. 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.718+0000 7fa646689640 1 Processor -- start 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.718+0000 7fa646689640 1 -- start start 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.718+0000 7fa646689640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa640102d40 0x7fa6401009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.718+0000 7fa646689640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa640103660 0x7fa640100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.718+0000 7fa646689640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 0x7fa640101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.718+0000 7fa646689640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa640112090 con 0x7fa64010c170 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.718+0000 7fa646689640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa640111f10 con 0x7fa640103660 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.718+0000 7fa646689640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa640112210 con 0x7fa640102d40 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 0x7fa640101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 0x7fa640101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41028/0 (socket says 172.21.15.60:41028) 2024-09-12T00:05:01.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 -- 172.21.15.60:0/3216873457 learned_addr learned my addr 172.21.15.60:0/3216873457 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa63f7fe640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa640103660 0x7fa640100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa63ffff640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa640102d40 0x7fa6401009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 -- 172.21.15.60:0/3216873457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa640102d40 msgr2=0x7fa6401009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa640102d40 0x7fa6401009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 -- 172.21.15.60:0/3216873457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa640103660 msgr2=0x7fa640100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa640103660 0x7fa640100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 -- 172.21.15.60:0/3216873457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6401a6970 con 0x7fa64010c170 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa63ffff640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa640102d40 0x7fa6401009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa644c26640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 0x7fa640101420 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa638005cc0 tx=0x7fa63802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa63d7fa640 1 -- 172.21.15.60:0/3216873457 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638034040 con 0x7fa64010c170 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa63d7fa640 1 -- 172.21.15.60:0/3216873457 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa638030940 con 0x7fa64010c170 2024-09-12T00:05:01.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa63d7fa640 1 -- 172.21.15.60:0/3216873457 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6380456e0 con 0x7fa64010c170 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.719+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6401a6c00 con 0x7fa64010c170 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.720+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6401a7090 con 0x7fa64010c170 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.720+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa640103120 con 0x7fa64010c170 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.722+0000 7fa63d7fa640 1 -- 172.21.15.60:0/3216873457 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa638037020 con 0x7fa64010c170 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.723+0000 7fa63d7fa640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa6280a2cf0 0x7fa6280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.723+0000 7fa63ffff640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa6280a2cf0 0x7fa6280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.723+0000 7fa63d7fa640 1 -- 172.21.15.60:0/3216873457 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa6380f02f0 con 0x7fa64010c170 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.723+0000 7fa63ffff640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa6280a2cf0 0x7fa6280a51b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa6300058c0 tx=0x7fa630005ec0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:01.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.726+0000 7fa63d7fa640 1 -- 172.21.15.60:0/3216873457 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6380bd0e0 con 0x7fa64010c170 2024-09-12T00:05:01.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.941+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6401a7390 con 0x7fa64010c170 2024-09-12T00:05:01.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.942+0000 7fa63d7fa640 1 -- 172.21.15.60:0/3216873457 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+12005 (secure 0 0 0) 0x7fa6380bc9e0 con 0x7fa64010c170 2024-09-12T00:05:01.941 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:05:01.942 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":40,"btime":"2024-09-12T00:04:57:238402+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:04:56.350907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:05:01.942 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 40 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.944+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa6280a2cf0 msgr2=0x7fa6280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.944+0000 7fa646689640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa6280a2cf0 0x7fa6280a51b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa6300058c0 tx=0x7fa630005ec0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.944+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 msgr2=0x7fa640101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.944+0000 7fa646689640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 0x7fa640101420 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa638005cc0 tx=0x7fa63802f790 comp rx=0 tx=0).stop 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.945+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 shutdown_connections 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.945+0000 7fa646689640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa6280a2cf0 0x7fa6280a51b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.945+0000 7fa646689640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa64010c170 0x7fa640101420 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.945+0000 7fa646689640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa640103660 0x7fa640100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.945+0000 7fa646689640 1 --2- 172.21.15.60:0/3216873457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa640102d40 0x7fa6401009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.945+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 >> 172.21.15.60:0/3216873457 conn(0x7fa6400fc7a0 msgr2=0x7fa6400fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.945+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 shutdown_connections 2024-09-12T00:05:01.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:01.945+0000 7fa646689640 1 -- 172.21.15.60:0/3216873457 wait complete. 2024-09-12T00:05:02.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:02 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3216873457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:05:02.547 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:02 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3216873457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:05:02.577 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:05:02.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:02 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3216873457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:05:02.836 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.313+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/1409884038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 msgr2=0x7f6fa010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.313+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/1409884038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 0x7f6fa010ea90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009ca0 tx=0x7f6f9802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.313+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/1409884038 shutdown_connections 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.313+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/1409884038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 0x7f6fa010ea90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.314+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/1409884038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa0102790 0x7f6fa01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.314+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/1409884038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa0101de0 0x7f6fa01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.314+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/1409884038 >> 172.21.15.60:0/1409884038 conn(0x7f6fa00fd8c0 msgr2=0x7f6fa00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.314+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/1409884038 shutdown_connections 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.314+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/1409884038 wait complete. 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.314+0000 7f6fa5cf3640 1 Processor -- start 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.314+0000 7f6fa5cf3640 1 -- start start 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6fa5cf3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa0101de0 0x7f6fa01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6fa5cf3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa0102790 0x7f6fa01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6fa5cf3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 0x7f6fa019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6fa5cf3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0112090 con 0x7f6fa0106f10 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6fa5cf3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0111f10 con 0x7f6fa0101de0 2024-09-12T00:05:03.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6fa5cf3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0112210 con 0x7f6fa0102790 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 0x7f6fa019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 0x7f6fa019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41046/0 (socket says 172.21.15.60:41046) 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 -- 172.21.15.60:0/2651221577 learned_addr learned my addr 172.21.15.60:0/2651221577 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa0101de0 0x7f6fa01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9effd640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa0102790 0x7f6fa01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 -- 172.21.15.60:0/2651221577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa0102790 msgr2=0x7f6fa01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa0102790 0x7f6fa01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 -- 172.21.15.60:0/2651221577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa0101de0 msgr2=0x7f6fa01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa0101de0 0x7f6fa01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 -- 172.21.15.60:0/2651221577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa019d460 con 0x7f6fa0106f10 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa0101de0 0x7f6fa01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:03.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.315+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 0x7f6fa019cd80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6f98006010 tx=0x7f6f980319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.316+0000 7f6f9cff9640 1 -- 172.21.15.60:0/2651221577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9802fa20 con 0x7f6fa0106f10 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.316+0000 7f6f9cff9640 1 -- 172.21.15.60:0/2651221577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f9802fbc0 con 0x7f6fa0106f10 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.316+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/2651221577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa019d6f0 con 0x7f6fa0106f10 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.316+0000 7f6f9cff9640 1 -- 172.21.15.60:0/2651221577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f980467f0 con 0x7f6fa0106f10 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.316+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/2651221577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa01a5030 con 0x7f6fa0106f10 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.318+0000 7f6f9cff9640 1 -- 172.21.15.60:0/2651221577 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6f98046990 con 0x7f6fa0106f10 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.318+0000 7f6fa80cc740 1 Processor -- start 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.318+0000 7f6fa80cc740 1 -- start start 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9cff9640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f880a2cf0 0x7f6f880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525fa5b40 0x55b525fa4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fa4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525faf370 0x55b525fb1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b525f0a2f0 con 0x55b525faf370 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b525eb1cf0 con 0x55b525fa45d0 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b525f062b0 con 0x55b525fa5b40 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9cff9640 1 -- 172.21.15.60:0/2651221577 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6f980f0750 con 0x7f6fa0106f10 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9effd640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f880a2cf0 0x7f6f880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525faf370 0x55b525fb1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525faf370 0x55b525fb1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41050/0 (socket says 172.21.15.60:41050) 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 -- 172.21.15.60:0/874732865 learned_addr learned my addr 172.21.15.60:0/874732865 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525fa5b40 0x55b525fa4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9effd640 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fa4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 -- 172.21.15.60:0/874732865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525fa5b40 msgr2=0x55b525fa4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525fa5b40 0x55b525fa4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 -- 172.21.15.60:0/874732865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 msgr2=0x55b525fa4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fa4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 -- 172.21.15.60:0/874732865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b525e963a0 con 0x55b525faf370 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9effd640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f880a2cf0 0x7f6f880a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6fa01088e0 tx=0x7f6f940127c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.319+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525faf370 0x55b525fb1760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6f980c54b0 tx=0x7f6f980bc790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13165abf74e68f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6f85ffb640 1 -- 172.21.15.60:0/874732865 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f980c1120 con 0x55b525faf370 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6f85ffb640 1 -- 172.21.15.60:0/874732865 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f98036040 con 0x55b525faf370 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6f85ffb640 1 -- 172.21.15.60:0/874732865 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f980ee110 con 0x55b525faf370 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6fa80cc740 1 -- 172.21.15.60:0/874732865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525faf370 msgr2=0x55b525fb1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525faf370 0x55b525fb1760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6f980c54b0 tx=0x7f6f980bc790 comp rx=0 tx=0).stop 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6fa80cc740 1 -- 172.21.15.60:0/874732865 shutdown_connections 2024-09-12T00:05:03.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525faf370 0x55b525fb1760 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fa4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/874732865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525fa5b40 0x55b525fa4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6fa80cc740 1 -- 172.21.15.60:0/874732865 >> 172.21.15.60:0/874732865 conn(0x55b525f6d310 msgr2=0x55b525fa0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.320+0000 7f6fa80cc740 1 -- 172.21.15.60:0/874732865 shutdown_connections 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 -- 172.21.15.60:0/874732865 wait complete. 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 -- start start 2024-09-12T00:05:03.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 Processor -- start 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525faedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fac080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fac810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b525f0a2f0 con 0x55b525fa5b40 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b525ec5060 con 0x55b525fa45d0 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b525fb1e30 con 0x55b525faf370 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.321+0000 7f6fa80cc740 10 client.0 _ll_register_callbacks cb 0x55b525c188c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41060/0 (socket says 172.21.15.60:41060) 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 -- 172.21.15.60:0/635323987 learned_addr learned my addr 172.21.15.60:0/635323987 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525faedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 -- 172.21.15.60:0/635323987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 msgr2=0x55b525fac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 -- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 msgr2=0x55b525faedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:03.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525faedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 -- 172.21.15.60:0/635323987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b525c7b3c0 con 0x55b525fa5b40 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525faedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f9effd640 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fac080 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6f94010880 tx=0x7f6f9401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948bbf047326e8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f7effd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f7effd640 1 -- 172.21.15.60:0/635323987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94025070 con 0x55b525fa5b40 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f7effd640 1 -- 172.21.15.60:0/635323987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6f9401cb30 con 0x55b525fa5b40 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6fa80cc740 1 -- 172.21.15.60:0/635323987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f98036040 con 0x55b525fa5b40 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6f7effd640 1 -- 172.21.15.60:0/635323987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f6f94031050 con 0x55b525fa5b40 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6fa80cc740 10 client.16776 fetch_fsmap learned FSMap version 41 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.322+0000 7f6fa80cc740 1 -- 172.21.15.60:0/635323987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55b525fbd710 con 0x55b525fa5b40 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6f7effd640 1 -- 172.21.15.60:0/635323987 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f98036040 con 0x55b525fa5b40 2024-09-12T00:05:03.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6f7effd640 1 -- 172.21.15.60:0/635323987 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7f6f9401e070 con 0x55b525fa5b40 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6fa80cc740 10 client.16776 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6fa80cc740 10 client.16776 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6fa80cc740 20 client.16776 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b525fbeb70 0x55b525fc0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6fa80cc740 4 client.16776 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6fa80cc740 1 -- 172.21.15.60:0/635323987 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b525f17860 con 0x55b525fbeb70 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.323+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b525fbeb70 0x55b525fc0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.324+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b525fbeb70 0x55b525fc0fe0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ffbc6daad89a0ce3 server_cookie=b4ba05bceeb82634 in_seq=0 out_seq=0 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.324+0000 7f6f7effd640 10 client.16776 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6f7effd640 1 -- 172.21.15.60:0/635323987 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b525f17860 con 0x55b525fbeb70 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6f7effd640 10 client.16776 handle_command_reply: tid=0 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 client.16776 shutdown 2024-09-12T00:05:03.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 -- 172.21.15.60:0/635323987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 msgr2=0x55b525fac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fac080 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6f94010880 tx=0x7f6f9401a000 comp rx=0 tx=0).stop 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 -- 172.21.15.60:0/635323987 shutdown_connections 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fac080 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b525fbeb70 0x55b525fc0fe0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/635323987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525faedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6f7effd640 0 client.16776 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:05:03.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 -- 172.21.15.60:0/635323987 >> 172.21.15.60:0/635323987 conn(0x55b525f6d310 msgr2=0x55b525fa6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 -- 172.21.15.60:0/635323987 shutdown_connections 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 1 -- 172.21.15.60:0/635323987 wait complete. 2024-09-12T00:05:03.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.325+0000 7f6fa80cc740 20 client.16776 trim_cache size 0 max 16384 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.338+0000 7f6fa80cc740 1 Processor -- start 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.338+0000 7f6fa80cc740 1 -- start start 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.338+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fa0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.338+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.338+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fc68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.338+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01ad7e0 con 0x55b525fa5b40 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.338+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01af590 con 0x55b525fa45d0 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.338+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01adee0 con 0x55b525faf370 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41072/0 (socket says 172.21.15.60:41072) 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 -- 172.21.15.60:0/2876156814 learned_addr learned my addr 172.21.15.60:0/2876156814 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/2876156814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fa0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 -- 172.21.15.60:0/2876156814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 msgr2=0x55b525fc68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 --2- 172.21.15.60:0/2876156814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fc68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 -- 172.21.15.60:0/2876156814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 msgr2=0x55b525fa0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 --2- 172.21.15.60:0/2876156814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fa0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 -- 172.21.15.60:0/2876156814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b525fa1180 con 0x55b525fa5b40 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f9effd640 1 --2- 172.21.15.60:0/2876156814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa0c40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6f94010850 tx=0x7f6f94012d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4890947a75c6ebf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f857fa640 1 -- 172.21.15.60:0/2876156814 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94025050 con 0x55b525fa5b40 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f857fa640 1 -- 172.21.15.60:0/2876156814 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f9402e070 con 0x55b525fa5b40 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.339+0000 7f6f857fa640 1 -- 172.21.15.60:0/2876156814 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9401eab0 con 0x55b525fa5b40 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 -- 172.21.15.60:0/2876156814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 msgr2=0x55b525fa0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/2876156814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa0c40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6f94010850 tx=0x7f6f94012d70 comp rx=0 tx=0).stop 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 -- 172.21.15.60:0/2876156814 shutdown_connections 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/2876156814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fc68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/2876156814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa0c40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/2876156814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fa0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 -- 172.21.15.60:0/2876156814 >> 172.21.15.60:0/2876156814 conn(0x55b525f6d310 msgr2=0x55b525fa72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 -- 172.21.15.60:0/2876156814 shutdown_connections 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 -- 172.21.15.60:0/2876156814 wait complete. 2024-09-12T00:05:03.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 -- start start 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.340+0000 7f6fa80cc740 1 Processor -- start 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fb7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6fa80cc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fa92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01aee00 con 0x55b525fa5b40 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01ae670 con 0x55b525fa45d0 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6fa80cc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01ab7c0 con 0x55b525faf370 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6fa80cc740 10 client.0 _ll_register_callbacks cb 0x7f6f9400b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41076/0 (socket says 172.21.15.60:41076) 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 -- 172.21.15.60:0/3791939400 learned_addr learned my addr 172.21.15.60:0/3791939400 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fb7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fa92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 -- 172.21.15.60:0/3791939400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 msgr2=0x55b525fa92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fa92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 -- 172.21.15.60:0/3791939400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 msgr2=0x55b525fb7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fb7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 -- 172.21.15.60:0/3791939400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b525fa9b20 con 0x55b525fa5b40 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9ffff640 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fa92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f9effd640 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa8db0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6f94037040 tx=0x7f6f94005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7834898a21936515 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f7effd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.341+0000 7f6f7effd640 1 -- 172.21.15.60:0/3791939400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94043060 con 0x55b525fa5b40 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 1 -- 172.21.15.60:0/3791939400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f9402e070 con 0x55b525fa5b40 2024-09-12T00:05:03.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6f7effd640 1 -- 172.21.15.60:0/3791939400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6f9401cd40 con 0x55b525fa5b40 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6f7effd640 1 -- 172.21.15.60:0/3791939400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f6f94025050 con 0x55b525fa5b40 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 10 client.16782 fetch_fsmap learned FSMap version 41 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 1 -- 172.21.15.60:0/3791939400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55b526029890 con 0x55b525fa5b40 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6f7effd640 1 -- 172.21.15.60:0/3791939400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f9402e070 con 0x55b525fa5b40 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6f7effd640 1 -- 172.21.15.60:0/3791939400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7f6f9401e040 con 0x55b525fa5b40 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 10 client.16782 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 10 client.16782 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 20 client.16782 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b526029ed0 0x55b52602c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 4 client.16782 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6fa80cc740 1 -- 172.21.15.60:0/3791939400 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b525f11d70 con 0x55b526029ed0 2024-09-12T00:05:03.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.342+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b526029ed0 0x55b52602c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6f9f7fe640 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b526029ed0 0x55b52602c2f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b44ebe606a312f89 server_cookie=176b7a0fc487d24d in_seq=0 out_seq=0 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6f7effd640 10 client.16782 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6f7effd640 1 -- 172.21.15.60:0/3791939400 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b525f11d70 con 0x55b526029ed0 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6f7effd640 10 client.16782 handle_command_reply: tid=0 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 client.16782 shutdown 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 -- 172.21.15.60:0/3791939400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 msgr2=0x55b525fa8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa8db0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6f94037040 tx=0x7f6f94005940 comp rx=0 tx=0).stop 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 -- 172.21.15.60:0/3791939400 shutdown_connections 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b525faf370 0x55b525fa92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b525fa5b40 0x55b525fa8db0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55b526029ed0 0x55b52602c2f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 --2- 172.21.15.60:0/3791939400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b525fa45d0 0x55b525fb7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 -- 172.21.15.60:0/3791939400 >> 172.21.15.60:0/3791939400 conn(0x55b525f6d310 msgr2=0x55b525fa72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6f7effd640 0 client.16782 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 -- 172.21.15.60:0/3791939400 shutdown_connections 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 1 -- 172.21.15.60:0/3791939400 wait complete. 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.343+0000 7f6fa80cc740 20 client.16782 trim_cache size 0 max 16384 2024-09-12T00:05:03.351 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f880a2cf0 msgr2=0x7f6f880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f880a2cf0 0x7f6f880a51b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6fa01088e0 tx=0x7f6f940127c0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 msgr2=0x7f6fa019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 0x7f6fa019cd80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f6f98006010 tx=0x7f6f980319f0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/2651221577 shutdown_connections 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f880a2cf0 0x7f6f880a51b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6fa0106f10 0x7f6fa019cd80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa0102790 0x7f6fa01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 --2- 172.21.15.60:0/2651221577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa0101de0 0x7f6fa01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/2651221577 >> 172.21.15.60:0/2651221577 conn(0x7f6fa00fd8c0 msgr2=0x7f6fa00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/2651221577 shutdown_connections 2024-09-12T00:05:03.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:03.344+0000 7f6fa5cf3640 1 -- 172.21.15.60:0/2651221577 wait complete. 2024-09-12T00:05:03.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:03 smithi060 ceph-mon[30953]: pgmap v173: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T00:05:03.353 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:03 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:03 smithi192 ceph-mon[35487]: pgmap v173: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T00:05:03.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:03 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:03.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:03 smithi105 ceph-mon[34805]: pgmap v173: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-12T00:05:03.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:03 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:04.115 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:05:04.377 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 -- 172.21.15.60:0/4125521243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40101de0 msgr2=0x7fcd401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 --2- 172.21.15.60:0/4125521243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40101de0 0x7fcd401021c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009900 tx=0x7fcd3c02a410 comp rx=0 tx=0).stop 2024-09-12T00:05:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 -- 172.21.15.60:0/4125521243 shutdown_connections 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 --2- 172.21.15.60:0/4125521243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd40106f10 0x7fcd4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 --2- 172.21.15.60:0/4125521243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd40102790 0x7fcd401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 --2- 172.21.15.60:0/4125521243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40101de0 0x7fcd401021c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 -- 172.21.15.60:0/4125521243 >> 172.21.15.60:0/4125521243 conn(0x7fcd400fd8c0 msgr2=0x7fcd400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 -- 172.21.15.60:0/4125521243 shutdown_connections 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.830+0000 7fcd47340640 1 -- 172.21.15.60:0/4125521243 wait complete. 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.831+0000 7fcd47340640 1 Processor -- start 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.831+0000 7fcd47340640 1 -- start start 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.831+0000 7fcd47340640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd40101de0 0x7fcd40198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.831+0000 7fcd47340640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd40102790 0x7fcd40198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd47340640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40106f10 0x7fcd4019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd47340640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcd40112050 con 0x7fcd40106f10 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd47340640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd40111ed0 con 0x7fcd40101de0 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd47340640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd401121d0 con 0x7fcd40102790 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40106f10 0x7fcd4019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40106f10 0x7fcd4019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41098/0 (socket says 172.21.15.60:41098) 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 -- 172.21.15.60:0/409430853 learned_addr learned my addr 172.21.15.60:0/409430853 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd450dc640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd40101de0 0x7fcd40198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd448db640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd40102790 0x7fcd40198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 -- 172.21.15.60:0/409430853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd40102790 msgr2=0x7fcd40198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd40102790 0x7fcd40198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 -- 172.21.15.60:0/409430853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd40101de0 msgr2=0x7fcd40198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd40101de0 0x7fcd40198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 -- 172.21.15.60:0/409430853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4019d540 con 0x7fcd40106f10 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd450dc640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd40101de0 0x7fcd40198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd458dd640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40106f10 0x7fcd4019ce60 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800cad0 tx=0x7fcd3800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd367fc640 1 -- 172.21.15.60:0/409430853 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800ae20 con 0x7fcd40106f10 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd367fc640 1 -- 172.21.15.60:0/409430853 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcd38004b20 con 0x7fcd40106f10 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd47340640 1 -- 172.21.15.60:0/409430853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4019d830 con 0x7fcd40106f10 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.832+0000 7fcd367fc640 1 -- 172.21.15.60:0/409430853 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800f780 con 0x7fcd40106f10 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.833+0000 7fcd47340640 1 -- 172.21.15.60:0/409430853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd401a5110 con 0x7fcd40106f10 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.835+0000 7fcd367fc640 1 -- 172.21.15.60:0/409430853 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcd38004cd0 con 0x7fcd40106f10 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.835+0000 7fcd49719740 1 Processor -- start 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.835+0000 7fcd49719740 1 -- start start 2024-09-12T00:05:04.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.835+0000 7fcd49719740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9256b40 0x5586c9255090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.835+0000 7fcd49719740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c92555d0 0x5586c9255a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd49719740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c9266b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd49719740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5586c91bb2f0 con 0x5586c92555d0 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd49719740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5586c9162cf0 con 0x5586c9256b40 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd49719740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5586c91b72b0 con 0x5586c9264780 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd367fc640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcd2c0a2cf0 0x7fcd2c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c92555d0 0x5586c9255a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c92555d0 0x5586c9255a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41102/0 (socket says 172.21.15.60:41102) 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 -- 172.21.15.60:0/3255132107 learned_addr learned my addr 172.21.15.60:0/3255132107 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd458dd640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcd2c0a2cf0 0x7fcd2c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd448db640 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9256b40 0x5586c9255090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd448db640 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c9266b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 -- 172.21.15.60:0/3255132107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 msgr2=0x5586c9266b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c9266b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd367fc640 1 -- 172.21.15.60:0/409430853 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fcd380cf450 con 0x7fcd40106f10 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 -- 172.21.15.60:0/3255132107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9256b40 msgr2=0x5586c9255090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9256b40 0x5586c9255090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 -- 172.21.15.60:0/3255132107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c91473a0 con 0x5586c92555d0 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd448db640 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c9266b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd450dc640 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c92555d0 0x5586c9255a10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009900 tx=0x7fcd3c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e20afdccf734a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd458dd640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcd2c0a2cf0 0x7fcd2c0a51b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd38097dc0 tx=0x7fcd380975a0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.836+0000 7fcd2b7fe640 1 -- 172.21.15.60:0/3255132107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c040070 con 0x5586c92555d0 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd2b7fe640 1 -- 172.21.15.60:0/3255132107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcd3c005520 con 0x5586c92555d0 2024-09-12T00:05:04.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd2b7fe640 1 -- 172.21.15.60:0/3255132107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c035040 con 0x5586c92555d0 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 -- 172.21.15.60:0/3255132107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c92555d0 msgr2=0x5586c9255a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c92555d0 0x5586c9255a10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009900 tx=0x7fcd3c0319f0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 -- 172.21.15.60:0/3255132107 shutdown_connections 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c9266b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c92555d0 0x5586c9255a10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 --2- 172.21.15.60:0/3255132107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9256b40 0x5586c9255090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 -- 172.21.15.60:0/3255132107 >> 172.21.15.60:0/3255132107 conn(0x5586c921e310 msgr2=0x5586c9251c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 -- 172.21.15.60:0/3255132107 shutdown_connections 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.837+0000 7fcd49719740 1 -- 172.21.15.60:0/3255132107 wait complete. 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 1 -- start start 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 1 Processor -- start 2024-09-12T00:05:04.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 0x5586c9264040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9256b40 0x5586c92612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9264780 0x5586c9261830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5586c9267420 con 0x5586c9264780 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5586c9176060 con 0x5586c92555d0 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5586c92675a0 con 0x5586c9256b40 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd49719740 10 client.0 _ll_register_callbacks cb 0x5586c8ec98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd448db640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9264780 0x5586c9261830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd448db640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9264780 0x5586c9261830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41104/0 (socket says 172.21.15.60:41104) 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd448db640 1 -- 172.21.15.60:0/2593935028 learned_addr learned my addr 172.21.15.60:0/2593935028 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd450dc640 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9256b40 0x5586c92612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.838+0000 7fcd448db640 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 0x5586c9264040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd448db640 1 -- 172.21.15.60:0/2593935028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9256b40 msgr2=0x5586c92612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd448db640 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9256b40 0x5586c92612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd448db640 1 -- 172.21.15.60:0/2593935028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 msgr2=0x5586c9264040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd448db640 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 0x5586c9264040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd448db640 1 -- 172.21.15.60:0/2593935028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c8f2c3c0 con 0x5586c9264780 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd448db640 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9264780 0x5586c9261830 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c640 tx=0x7fcd30016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a68beb69c10907 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd28ff9640 1 -- 172.21.15.60:0/2593935028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30014e60 con 0x5586c9264780 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd49719740 1 -- 172.21.15.60:0/2593935028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd3c005520 con 0x5586c9264780 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd28ff9640 1 -- 172.21.15.60:0/2593935028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fcd30014110 con 0x5586c9264780 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd28ff9640 1 -- 172.21.15.60:0/2593935028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcd30024020 con 0x5586c9264780 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd49719740 10 client.16794 fetch_fsmap learned FSMap version 42 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd49719740 1 -- 172.21.15.60:0/2593935028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5586c9272e60 con 0x5586c9264780 2024-09-12T00:05:04.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.839+0000 7fcd28ff9640 1 -- 172.21.15.60:0/2593935028 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcd3c005520 con 0x5586c9264780 2024-09-12T00:05:04.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.840+0000 7fcd28ff9640 1 -- 172.21.15.60:0/2593935028 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 42) ==== 8422+0+0 (secure 0 0 0) 0x7fcd30003ca0 con 0x5586c9264780 2024-09-12T00:05:04.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.840+0000 7fcd49719740 10 client.16794 fetch_fsmap finished waiting for FSMap version 42 2024-09-12T00:05:04.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.840+0000 7fcd49719740 10 client.16794 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:05:04.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.840+0000 7fcd49719740 20 client.16794 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:04.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.840+0000 7fcd49719740 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5586c9274270 0x5586c9276680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.840+0000 7fcd49719740 4 client.16794 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:04.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.840+0000 7fcd49719740 1 -- 172.21.15.60:0/2593935028 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586c91c8860 con 0x5586c9274270 2024-09-12T00:05:04.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.840+0000 7fcd450dc640 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5586c9274270 0x5586c9276680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.841+0000 7fcd28ff9640 10 client.16794 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:05:04.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.841+0000 7fcd450dc640 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5586c9274270 0x5586c9276680 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=abb0574ddda8e3d9 server_cookie=28b60660e9e53bf in_seq=0 out_seq=0 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.841+0000 7fcd28ff9640 1 -- 172.21.15.60:0/2593935028 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586c91c8860 con 0x5586c9274270 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.841+0000 7fcd28ff9640 10 client.16794 handle_command_reply: tid=0 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.841+0000 7fcd49719740 1 client.16794 shutdown 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 -- 172.21.15.60:0/2593935028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9264780 msgr2=0x5586c9261830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9264780 0x5586c9261830 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c640 tx=0x7fcd30016040 comp rx=0 tx=0).stop 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 -- 172.21.15.60:0/2593935028 shutdown_connections 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5586c9274270 0x5586c9276680 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9264780 0x5586c9261830 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9256b40 0x5586c92612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 --2- 172.21.15.60:0/2593935028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 0x5586c9264040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd28ff9640 0 client.16794 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:05:04.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 -- 172.21.15.60:0/2593935028 >> 172.21.15.60:0/2593935028 conn(0x5586c921e310 msgr2=0x5586c9257930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:04.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 -- 172.21.15.60:0/2593935028 shutdown_connections 2024-09-12T00:05:04.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 1 -- 172.21.15.60:0/2593935028 wait complete. 2024-09-12T00:05:04.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.842+0000 7fcd49719740 20 client.16794 trim_cache size 0 max 16384 2024-09-12T00:05:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd49719740 1 Processor -- start 2024-09-12T00:05:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd49719740 1 -- start start 2024-09-12T00:05:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd49719740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 0x5586c92706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd49719740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92612b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd49719740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c92617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd49719740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcd401ab6b0 con 0x5586c9256b40 2024-09-12T00:05:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd49719740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd401ad400 con 0x5586c92555d0 2024-09-12T00:05:04.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd49719740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd401abdb0 con 0x5586c9264780 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd450dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd450dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41120/0 (socket says 172.21.15.60:41120) 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd450dc640 1 -- 172.21.15.60:0/935178652 learned_addr learned my addr 172.21.15.60:0/935178652 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.855+0000 7fcd448db640 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c92617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd448db640 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 0x5586c92706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd450dc640 1 -- 172.21.15.60:0/935178652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 msgr2=0x5586c92617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd450dc640 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c92617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd450dc640 1 -- 172.21.15.60:0/935178652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 msgr2=0x5586c92706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd450dc640 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 0x5586c92706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd450dc640 1 -- 172.21.15.60:0/935178652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c9276d00 con 0x5586c9256b40 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd448db640 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c92617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:04.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd450dc640 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92612b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c004a00 tx=0x7fcd3c047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a3d0df553e8005 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:04.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd2affd640 1 -- 172.21.15.60:0/935178652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c040040 con 0x5586c9256b40 2024-09-12T00:05:04.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd2affd640 1 -- 172.21.15.60:0/935178652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcd3c004230 con 0x5586c9256b40 2024-09-12T00:05:04.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.856+0000 7fcd2affd640 1 -- 172.21.15.60:0/935178652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c035040 con 0x5586c9256b40 2024-09-12T00:05:04.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 -- 172.21.15.60:0/935178652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 msgr2=0x5586c92612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92612b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c004a00 tx=0x7fcd3c047040 comp rx=0 tx=0).stop 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 -- 172.21.15.60:0/935178652 shutdown_connections 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c9264780 0x5586c92617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92612b0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 --2- 172.21.15.60:0/935178652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c92555d0 0x5586c92706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 -- 172.21.15.60:0/935178652 >> 172.21.15.60:0/935178652 conn(0x5586c921e310 msgr2=0x5586c9266740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 -- 172.21.15.60:0/935178652 shutdown_connections 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 -- 172.21.15.60:0/935178652 wait complete. 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 -- start start 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.857+0000 7fcd49719740 1 Processor -- start 2024-09-12T00:05:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd49719740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c92555d0 0x5586c92653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd49719740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92658f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd49719740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9264780 0x5586c926b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd49719740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcd401acc70 con 0x5586c9256b40 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd49719740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd401ac540 con 0x5586c9264780 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd49719740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd401a96b0 con 0x5586c92555d0 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd49719740 10 client.0 _ll_register_callbacks cb 0x7fcd30014920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92658f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41124/0 (socket says 172.21.15.60:41124) 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 -- 172.21.15.60:0/1833798480 learned_addr learned my addr 172.21.15.60:0/1833798480 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd448db640 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9264780 0x5586c926b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd448db640 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c92555d0 0x5586c92653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 -- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c92555d0 msgr2=0x5586c92653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c92555d0 0x5586c92653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 -- 172.21.15.60:0/1833798480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9264780 msgr2=0x5586c926b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9264780 0x5586c926b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 -- 172.21.15.60:0/1833798480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c926bd70 con 0x5586c9256b40 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd448db640 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c92555d0 0x5586c92653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd450dc640 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92658f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c000c00 tx=0x7fcd3c004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee9c6ff1069ac50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd28ff9640 1 -- 172.21.15.60:0/1833798480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c05f060 con 0x5586c9256b40 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd28ff9640 1 -- 172.21.15.60:0/1833798480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fcd3c004030 con 0x5586c9256b40 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.858+0000 7fcd49719740 1 -- 172.21.15.60:0/1833798480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd3c004230 con 0x5586c9256b40 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd28ff9640 1 -- 172.21.15.60:0/1833798480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcd3c040070 con 0x5586c9256b40 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd49719740 10 client.16800 fetch_fsmap learned FSMap version 42 2024-09-12T00:05:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd49719740 1 -- 172.21.15.60:0/1833798480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5586c926d030 con 0x5586c9256b40 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd28ff9640 1 -- 172.21.15.60:0/1833798480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcd3c004230 con 0x5586c9256b40 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd28ff9640 1 -- 172.21.15.60:0/1833798480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 42) ==== 8422+0+0 (secure 0 0 0) 0x7fcd3c003960 con 0x5586c9256b40 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd49719740 10 client.16800 fetch_fsmap finished waiting for FSMap version 42 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd49719740 10 client.16800 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd49719740 20 client.16800 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd49719740 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5586c926d2c0 0x5586c92e0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd49719740 4 client.16800 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd49719740 1 -- 172.21.15.60:0/1833798480 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586c91c2d70 con 0x5586c926d2c0 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.859+0000 7fcd448db640 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5586c926d2c0 0x5586c92e0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd28ff9640 10 client.16800 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd448db640 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5586c926d2c0 0x5586c92e0f30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cd5339a0f08f6ea4 server_cookie=5ba9c1c15d396b0e in_seq=0 out_seq=0 2024-09-12T00:05:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd28ff9640 1 -- 172.21.15.60:0/1833798480 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586c91c2d70 con 0x5586c926d2c0 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd28ff9640 10 client.16800 handle_command_reply: tid=0 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 client.16800 shutdown 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 -- 172.21.15.60:0/1833798480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 msgr2=0x5586c92658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92658f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c000c00 tx=0x7fcd3c004990 comp rx=0 tx=0).stop 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 -- 172.21.15.60:0/1833798480 shutdown_connections 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5586c926d2c0 0x5586c92e0f30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd28ff9640 0 client.16800 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5586c9264780 0x5586c926b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5586c9256b40 0x5586c92658f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 --2- 172.21.15.60:0/1833798480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5586c92555d0 0x5586c92653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 -- 172.21.15.60:0/1833798480 >> 172.21.15.60:0/1833798480 conn(0x5586c921e310 msgr2=0x5586c925fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 -- 172.21.15.60:0/1833798480 shutdown_connections 2024-09-12T00:05:04.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 1 -- 172.21.15.60:0/1833798480 wait complete. 2024-09-12T00:05:04.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.860+0000 7fcd49719740 20 client.16800 trim_cache size 0 max 16384 2024-09-12T00:05:04.866 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:04.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 -- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcd2c0a2cf0 msgr2=0x7fcd2c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcd2c0a2cf0 0x7fcd2c0a51b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd38097dc0 tx=0x7fcd380975a0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 -- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40106f10 msgr2=0x7fcd4019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40106f10 0x7fcd4019ce60 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800cad0 tx=0x7fcd3800cf90 comp rx=0 tx=0).stop 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 -- 172.21.15.60:0/409430853 shutdown_connections 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcd2c0a2cf0 0x7fcd2c0a51b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd40106f10 0x7fcd4019ce60 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd40102790 0x7fcd40198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 --2- 172.21.15.60:0/409430853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd40101de0 0x7fcd40198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 -- 172.21.15.60:0/409430853 >> 172.21.15.60:0/409430853 conn(0x7fcd400fd8c0 msgr2=0x7fcd400febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 -- 172.21.15.60:0/409430853 shutdown_connections 2024-09-12T00:05:04.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:04.861+0000 7fcd47340640 1 -- 172.21.15.60:0/409430853 wait complete. 2024-09-12T00:05:05.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:05 smithi192 ceph-mon[35487]: pgmap v174: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:05:05.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:05 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:05.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:05 smithi060 ceph-mon[30953]: pgmap v174: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:05:05.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:05 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:05.633 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:05:05.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:05 smithi105 ceph-mon[34805]: pgmap v174: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:05:05.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:05 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.377+0000 7fa77b6b5640 1 -- 172.21.15.60:0/2301498946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa77410c170 msgr2=0x7fa77410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.377+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/2301498946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa77410c170 0x7fa77410e610 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009ca0 tx=0x7fa76c02a950 comp rx=0 tx=0).stop 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 -- 172.21.15.60:0/2301498946 shutdown_connections 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/2301498946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa77410c170 0x7fa77410e610 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/2301498946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa774103660 0x7fa77410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/2301498946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa774102d40 0x7fa774103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 -- 172.21.15.60:0/2301498946 >> 172.21.15.60:0/2301498946 conn(0x7fa7740fc7a0 msgr2=0x7fa7740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 -- 172.21.15.60:0/2301498946 shutdown_connections 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 -- 172.21.15.60:0/2301498946 wait complete. 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 Processor -- start 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.378+0000 7fa77b6b5640 1 -- start start 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa77b6b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa774102d40 0x7fa7741009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa77b6b5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa774103660 0x7fa774100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa77b6b5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa77410c170 0x7fa774101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa77b6b5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa774112090 con 0x7fa774102d40 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa77b6b5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa774111f10 con 0x7fa774103660 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa77b6b5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa774112210 con 0x7fa77410c170 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa774102d40 0x7fa7741009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa774102d40 0x7fa7741009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41144/0 (socket says 172.21.15.60:41144) 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 -- 172.21.15.60:0/807304970 learned_addr learned my addr 172.21.15.60:0/807304970 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa778c50640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa774103660 0x7fa774100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 -- 172.21.15.60:0/807304970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa77410c170 msgr2=0x7fa774101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa77410c170 0x7fa774101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 -- 172.21.15.60:0/807304970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa774103660 msgr2=0x7fa774100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa774103660 0x7fa774100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 -- 172.21.15.60:0/807304970 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7741a6990 con 0x7fa774102d40 2024-09-12T00:05:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa779451640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa774102d40 0x7fa7741009a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa77000d770 tx=0x7fa77000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.379+0000 7fa7667fc640 1 -- 172.21.15.60:0/807304970 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770017070 con 0x7fa774102d40 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.380+0000 7fa77b6b5640 1 -- 172.21.15.60:0/807304970 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7741a6c80 con 0x7fa774102d40 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.380+0000 7fa7667fc640 1 -- 172.21.15.60:0/807304970 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa770005520 con 0x7fa774102d40 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.380+0000 7fa7667fc640 1 -- 172.21.15.60:0/807304970 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770010460 con 0x7fa774102d40 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.380+0000 7fa77b6b5640 1 -- 172.21.15.60:0/807304970 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7741a7170 con 0x7fa774102d40 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.382+0000 7fa7667fc640 1 -- 172.21.15.60:0/807304970 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa770004ea0 con 0x7fa774102d40 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.382+0000 7fa77da8e740 1 Processor -- start 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.382+0000 7fa77da8e740 1 -- start start 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b45b40 0x564426b44090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b44a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b51760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa77da8e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564426aaa2f0 con 0x564426b45b40 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa77da8e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564426a51cf0 con 0x564426b445d0 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa77da8e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564426aa62b0 con 0x564426b4f370 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b45b40 0x564426b44090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa7667fc640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa7600a2cf0 0x7fa7600a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b45b40 0x564426b44090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41160/0 (socket says 172.21.15.60:41160) 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 -- 172.21.15.60:0/3214790691 learned_addr learned my addr 172.21.15.60:0/3214790691 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa778c50640 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b51760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779451640 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b44a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa7600a2cf0 0x7fa7600a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa7667fc640 1 -- 172.21.15.60:0/807304970 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa7700cf000 con 0x7fa774102d40 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 -- 172.21.15.60:0/3214790691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 msgr2=0x564426b51760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b51760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 -- 172.21.15.60:0/3214790691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 msgr2=0x564426b44a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b44a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 -- 172.21.15.60:0/3214790691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564426a363a0 con 0x564426b45b40 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779451640 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b44a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.383+0000 7fa779c52640 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b45b40 0x564426b44090 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009430 tx=0x7fa76c02fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797868123a1151b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.384+0000 7fa75f7fe640 1 -- 172.21.15.60:0/3214790691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c034040 con 0x564426b45b40 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.384+0000 7fa779c52640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa7600a2cf0 0x7fa7600a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa76c04b000 tx=0x7fa76c04c000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.384+0000 7fa75f7fe640 1 -- 172.21.15.60:0/3214790691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa76c04c070 con 0x564426b45b40 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.384+0000 7fa75f7fe640 1 -- 172.21.15.60:0/3214790691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c03b6d0 con 0x564426b45b40 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.384+0000 7fa77da8e740 1 -- 172.21.15.60:0/3214790691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b45b40 msgr2=0x564426b44090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.384+0000 7fa77da8e740 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b45b40 0x564426b44090 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009430 tx=0x7fa76c02fdc0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 -- 172.21.15.60:0/3214790691 shutdown_connections 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b51760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b44a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 --2- 172.21.15.60:0/3214790691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b45b40 0x564426b44090 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 -- 172.21.15.60:0/3214790691 >> 172.21.15.60:0/3214790691 conn(0x564426b0d310 msgr2=0x564426b40c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 -- 172.21.15.60:0/3214790691 shutdown_connections 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 -- 172.21.15.60:0/3214790691 wait complete. 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 -- start start 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 Processor -- start 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b445d0 0x564426b4ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b4c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b4c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564426b52070 con 0x564426b4f370 2024-09-12T00:05:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564426a65060 con 0x564426b45b40 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564426b521f0 con 0x564426b445d0 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.385+0000 7fa77da8e740 10 client.0 _ll_register_callbacks cb 0x5644267b88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b4c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b4c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41172/0 (socket says 172.21.15.60:41172) 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 -- 172.21.15.60:0/2419921611 learned_addr learned my addr 172.21.15.60:0/2419921611 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779451640 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b445d0 0x564426b4ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa778c50640 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b4c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 -- 172.21.15.60:0/2419921611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b445d0 msgr2=0x564426b4ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b445d0 0x564426b4ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 -- 172.21.15.60:0/2419921611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 msgr2=0x564426b4c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b4c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 -- 172.21.15.60:0/2419921611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56442681b3c0 con 0x564426b4f370 2024-09-12T00:05:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa779c52640 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b4c610 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa76c004810 tx=0x7fa76c02f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca0a700fbe9bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa75cff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa75cff9640 1 -- 172.21.15.60:0/2419921611 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c058070 con 0x564426b4f370 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa75cff9640 1 -- 172.21.15.60:0/2419921611 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa76c004000 con 0x564426b4f370 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa77da8e740 1 -- 172.21.15.60:0/2419921611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa76c04c070 con 0x564426b4f370 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa75cff9640 1 -- 172.21.15.60:0/2419921611 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa76c064050 con 0x564426b4f370 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa77da8e740 10 client.16812 fetch_fsmap learned FSMap version 43 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.386+0000 7fa77da8e740 1 -- 172.21.15.60:0/2419921611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x564426b5db10 con 0x564426b4f370 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa75cff9640 1 -- 172.21.15.60:0/2419921611 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa76c04c070 con 0x564426b4f370 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa75cff9640 1 -- 172.21.15.60:0/2419921611 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) ==== 8414+0+0 (secure 0 0 0) 0x7fa76c03c450 con 0x564426b4f370 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa77da8e740 10 client.16812 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa77da8e740 10 client.16812 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:05:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa77da8e740 20 client.16812 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564426b5ee60 0x564426b61250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa77da8e740 4 client.16812 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa77da8e740 1 -- 172.21.15.60:0/2419921611 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564426ab7860 con 0x564426b5ee60 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.387+0000 7fa779451640 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564426b5ee60 0x564426b61250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.388+0000 7fa779451640 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564426b5ee60 0x564426b61250 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a5e13c4134f36521 server_cookie=154b44442bb120cc in_seq=0 out_seq=0 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.388+0000 7fa75cff9640 10 client.16812 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.388+0000 7fa75cff9640 1 -- 172.21.15.60:0/2419921611 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564426ab7860 con 0x564426b5ee60 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.388+0000 7fa75cff9640 10 client.16812 handle_command_reply: tid=0 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.388+0000 7fa77da8e740 1 client.16812 shutdown 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.388+0000 7fa77da8e740 1 -- 172.21.15.60:0/2419921611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 msgr2=0x564426b4c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.388+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b4c610 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa76c004810 tx=0x7fa76c02f420 comp rx=0 tx=0).stop 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 1 -- 172.21.15.60:0/2419921611 shutdown_connections 2024-09-12T00:05:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564426b5ee60 0x564426b61250 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa75cff9640 0 client.16812 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:05:06.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b4c610 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b4c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2419921611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b445d0 0x564426b4ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 1 -- 172.21.15.60:0/2419921611 >> 172.21.15.60:0/2419921611 conn(0x564426b0d310 msgr2=0x564426b46930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:06.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 1 -- 172.21.15.60:0/2419921611 shutdown_connections 2024-09-12T00:05:06.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 1 -- 172.21.15.60:0/2419921611 wait complete. 2024-09-12T00:05:06.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.389+0000 7fa77da8e740 20 client.16812 trim_cache size 0 max 16384 2024-09-12T00:05:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa77da8e740 1 Processor -- start 2024-09-12T00:05:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa77da8e740 1 -- start start 2024-09-12T00:05:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b4e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b45b40 0x564426b47120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b47660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa77da8e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741af9b0 con 0x564426b4f370 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa77da8e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741b1700 con 0x564426b445d0 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa77da8e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741b00b0 con 0x564426b45b40 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa779c52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b47660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa779c52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b47660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41186/0 (socket says 172.21.15.60:41186) 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa779c52640 1 -- 172.21.15.60:0/2402612521 learned_addr learned my addr 172.21.15.60:0/2402612521 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa778c50640 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b45b40 0x564426b47120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.402+0000 7fa779451640 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b4e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa779c52640 1 -- 172.21.15.60:0/2402612521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b45b40 msgr2=0x564426b47120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa779c52640 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b45b40 0x564426b47120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa779c52640 1 -- 172.21.15.60:0/2402612521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 msgr2=0x564426b4e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:06.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa779c52640 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b4e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa779c52640 1 -- 172.21.15.60:0/2402612521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564426b521b0 con 0x564426b4f370 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa779c52640 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b47660 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa76c03c870 tx=0x7fa76c0099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e64eb0b2d739720 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa75effd640 1 -- 172.21.15.60:0/2402612521 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c058040 con 0x564426b4f370 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa75effd640 1 -- 172.21.15.60:0/2402612521 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa76c03c650 con 0x564426b4f370 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.403+0000 7fa75effd640 1 -- 172.21.15.60:0/2402612521 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c034040 con 0x564426b4f370 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 -- 172.21.15.60:0/2402612521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 msgr2=0x564426b47660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b47660 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa76c03c870 tx=0x7fa76c0099a0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 -- 172.21.15.60:0/2402612521 shutdown_connections 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b4f370 0x564426b47660 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b45b40 0x564426b47120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2402612521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b445d0 0x564426b4e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 -- 172.21.15.60:0/2402612521 >> 172.21.15.60:0/2402612521 conn(0x564426b0d310 msgr2=0x564426b3fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 -- 172.21.15.60:0/2402612521 shutdown_connections 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 -- 172.21.15.60:0/2402612521 wait complete. 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 -- start start 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.404+0000 7fa77da8e740 1 Processor -- start 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b445d0 0x564426b57c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b48d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa77da8e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b49290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa77da8e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741b0f70 con 0x564426b445d0 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa77da8e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741b0840 con 0x564426b45b40 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa77da8e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741ad990 con 0x564426b4f370 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa77da8e740 10 client.0 _ll_register_callbacks cb 0x7fa77406b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b445d0 0x564426b57c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa778c50640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b48d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b445d0 0x564426b57c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41190/0 (socket says 172.21.15.60:41190) 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 -- 172.21.15.60:0/2552185504 learned_addr learned my addr 172.21.15.60:0/2552185504 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779c52640 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b49290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 -- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 msgr2=0x564426b49290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b49290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 -- 172.21.15.60:0/2552185504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 msgr2=0x564426b48d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b48d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 -- 172.21.15.60:0/2552185504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564426b49ac0 con 0x564426b445d0 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa778c50640 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b48d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779c52640 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b49290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:06.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa779451640 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b445d0 0x564426b57c20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa77009b270 tx=0x7fa77006b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce51f34e9334e450 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa75cff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa75cff9640 1 -- 172.21.15.60:0/2552185504 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770020040 con 0x564426b445d0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa75cff9640 1 -- 172.21.15.60:0/2552185504 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fa7700cca20 con 0x564426b445d0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.405+0000 7fa77da8e740 1 -- 172.21.15.60:0/2552185504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa76c03c650 con 0x564426b445d0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa75cff9640 1 -- 172.21.15.60:0/2552185504 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fa77009b570 con 0x564426b445d0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa77da8e740 10 client.16818 fetch_fsmap learned FSMap version 43 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa77da8e740 1 -- 172.21.15.60:0/2552185504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x564426bc98e0 con 0x564426b445d0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa75cff9640 1 -- 172.21.15.60:0/2552185504 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa76c03c650 con 0x564426b445d0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa75cff9640 1 -- 172.21.15.60:0/2552185504 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) ==== 8414+0+0 (secure 0 0 0) 0x7fa770005190 con 0x564426b445d0 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa77da8e740 10 client.16818 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa77da8e740 10 client.16818 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:05:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa77da8e740 20 client.16818 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564426b5ee60 0x564426bcc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa77da8e740 4 client.16818 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa77da8e740 1 -- 172.21.15.60:0/2552185504 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564426ab1d70 con 0x564426b5ee60 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.406+0000 7fa778c50640 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564426b5ee60 0x564426bcc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa778c50640 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564426b5ee60 0x564426bcc060 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dfa0394521a29477 server_cookie=abb95419f99e5ada in_seq=0 out_seq=0 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa75cff9640 10 client.16818 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa75cff9640 1 -- 172.21.15.60:0/2552185504 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564426ab1d70 con 0x564426b5ee60 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa75cff9640 10 client.16818 handle_command_reply: tid=0 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 client.16818 shutdown 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 -- 172.21.15.60:0/2552185504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b445d0 msgr2=0x564426b57c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b445d0 0x564426b57c20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa77009b270 tx=0x7fa77006b3d0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 -- 172.21.15.60:0/2552185504 shutdown_connections 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564426b5ee60 0x564426bcc060 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564426b4f370 0x564426b49290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564426b45b40 0x564426b48d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 --2- 172.21.15.60:0/2552185504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564426b445d0 0x564426b57c20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 -- 172.21.15.60:0/2552185504 >> 172.21.15.60:0/2552185504 conn(0x564426b0d310 msgr2=0x564426b4b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa75cff9640 0 client.16818 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 -- 172.21.15.60:0/2552185504 shutdown_connections 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 1 -- 172.21.15.60:0/2552185504 wait complete. 2024-09-12T00:05:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.407+0000 7fa77da8e740 20 client.16818 trim_cache size 0 max 16384 2024-09-12T00:05:06.415 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 -- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa7600a2cf0 msgr2=0x7fa7600a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa7600a2cf0 0x7fa7600a51b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa76c04b000 tx=0x7fa76c04c000 comp rx=0 tx=0).stop 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 -- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa774102d40 msgr2=0x7fa7741009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa774102d40 0x7fa7741009a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa77000d770 tx=0x7fa77000dc30 comp rx=0 tx=0).stop 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 -- 172.21.15.60:0/807304970 shutdown_connections 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa7600a2cf0 0x7fa7600a51b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa77410c170 0x7fa774101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa774103660 0x7fa774100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 --2- 172.21.15.60:0/807304970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa774102d40 0x7fa7741009a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 -- 172.21.15.60:0/807304970 >> 172.21.15.60:0/807304970 conn(0x7fa7740fc7a0 msgr2=0x7fa7740fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 -- 172.21.15.60:0/807304970 shutdown_connections 2024-09-12T00:05:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:06.408+0000 7fa77b6b5640 1 -- 172.21.15.60:0/807304970 wait complete. 2024-09-12T00:05:07.088 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:05:07.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:07 smithi060 ceph-mon[30953]: pgmap v175: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:05:07.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:07 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:07.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:07 smithi192 ceph-mon[35487]: pgmap v175: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:05:07.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:07 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:07.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:07 smithi105 ceph-mon[34805]: pgmap v175: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:05:07.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:07 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:07.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 -- 172.21.15.60:0/2108678583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc1009b0 msgr2=0x7feebc100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 --2- 172.21.15.60:0/2108678583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc1009b0 0x7feebc100d90 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7feeac009ca0 tx=0x7feeac02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 -- 172.21.15.60:0/2108678583 shutdown_connections 2024-09-12T00:05:07.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 --2- 172.21.15.60:0/2108678583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feebc10e4d0 0x7feebc1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 --2- 172.21.15.60:0/2108678583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feebc101360 0x7feebc10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 --2- 172.21.15.60:0/2108678583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc1009b0 0x7feebc100d90 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 -- 172.21.15.60:0/2108678583 >> 172.21.15.60:0/2108678583 conn(0x7feebc0fc7d0 msgr2=0x7feebc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:07.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 -- 172.21.15.60:0/2108678583 shutdown_connections 2024-09-12T00:05:07.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.829+0000 7feec34d6640 1 -- 172.21.15.60:0/2108678583 wait complete. 2024-09-12T00:05:07.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec34d6640 1 Processor -- start 2024-09-12T00:05:07.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec34d6640 1 -- start start 2024-09-12T00:05:07.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec34d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feebc1009b0 0x7feebc1a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec34d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc101360 0x7feebc1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec34d6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feebc10e4d0 0x7feebc19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec34d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feebc114360 con 0x7feebc101360 2024-09-12T00:05:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec34d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1141e0 con 0x7feebc1009b0 2024-09-12T00:05:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec34d6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1144e0 con 0x7feebc10e4d0 2024-09-12T00:05:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec0a71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc101360 0x7feebc1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec0a71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc101360 0x7feebc1a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41210/0 (socket says 172.21.15.60:41210) 2024-09-12T00:05:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec0a71640 1 -- 172.21.15.60:0/3869384509 learned_addr learned my addr 172.21.15.60:0/3869384509 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec1272640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feebc1009b0 0x7feebc1a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec1a73640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feebc10e4d0 0x7feebc19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec0a71640 1 -- 172.21.15.60:0/3869384509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feebc10e4d0 msgr2=0x7feebc19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec0a71640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feebc10e4d0 0x7feebc19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec0a71640 1 -- 172.21.15.60:0/3869384509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feebc1009b0 msgr2=0x7feebc1a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec0a71640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feebc1009b0 0x7feebc1a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec0a71640 1 -- 172.21.15.60:0/3869384509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc19aec0 con 0x7feebc101360 2024-09-12T00:05:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec1a73640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feebc10e4d0 0x7feebc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:07.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.830+0000 7feec1272640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feebc1009b0 0x7feebc1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:07.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.831+0000 7feec0a71640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc101360 0x7feebc1a0ac0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e9f0 tx=0x7feeb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:07.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.831+0000 7feeba7fc640 1 -- 172.21.15.60:0/3869384509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb000cd80 con 0x7feebc101360 2024-09-12T00:05:07.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.831+0000 7feec34d6640 1 -- 172.21.15.60:0/3869384509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feebc19b1b0 con 0x7feebc101360 2024-09-12T00:05:07.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.831+0000 7feeba7fc640 1 -- 172.21.15.60:0/3869384509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feeb0010930 con 0x7feebc101360 2024-09-12T00:05:07.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.831+0000 7feeba7fc640 1 -- 172.21.15.60:0/3869384509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0018b00 con 0x7feebc101360 2024-09-12T00:05:07.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.831+0000 7feec34d6640 1 -- 172.21.15.60:0/3869384509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feebc1a7500 con 0x7feebc101360 2024-09-12T00:05:07.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.833+0000 7feeba7fc640 1 -- 172.21.15.60:0/3869384509 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7feeb0018ca0 con 0x7feebc101360 2024-09-12T00:05:07.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec58af740 1 Processor -- start 2024-09-12T00:05:07.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec58af740 1 -- start start 2024-09-12T00:05:07.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feeba7fc640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feea40a2cf0 0x7feea40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec58af740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f02b40 0x5557e0f01090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec58af740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f015d0 0x5557e0f01a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec58af740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 0x5557e0f0e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec58af740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5557e0e672f0 con 0x5557e0f015d0 2024-09-12T00:05:07.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec58af740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5557e0e0ecf0 con 0x5557e0f0c370 2024-09-12T00:05:07.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec58af740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557e0e632b0 con 0x5557e0f02b40 2024-09-12T00:05:07.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec1a73640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feea40a2cf0 0x7feea40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec0a71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f015d0 0x5557e0f01a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feeba7fc640 1 -- 172.21.15.60:0/3869384509 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7feeb00cf980 con 0x7feebc101360 2024-09-12T00:05:07.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec0a71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f015d0 0x5557e0f01a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41218/0 (socket says 172.21.15.60:41218) 2024-09-12T00:05:07.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec0a71640 1 -- 172.21.15.60:0/32016418 learned_addr learned my addr 172.21.15.60:0/32016418 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:07.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec1272640 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f02b40 0x5557e0f01090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec1a73640 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 0x5557e0f0e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec0a71640 1 -- 172.21.15.60:0/32016418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f02b40 msgr2=0x5557e0f01090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:07.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec0a71640 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f02b40 0x5557e0f01090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec0a71640 1 -- 172.21.15.60:0/32016418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 msgr2=0x5557e0f0e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:07.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.834+0000 7feec0a71640 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 0x5557e0f0e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.835+0000 7feec0a71640 1 -- 172.21.15.60:0/32016418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557e0df33a0 con 0x5557e0f015d0 2024-09-12T00:05:07.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.835+0000 7feec1a73640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feea40a2cf0 0x7feea40a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005d80 tx=0x7feeb40157f0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:07.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.835+0000 7feec0a71640 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f015d0 0x5557e0f01a10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7feeb00cd120 tx=0x7feeb0079750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba6cd38393d54fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:07.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.835+0000 7feea37fe640 1 -- 172.21.15.60:0/32016418 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb009c590 con 0x5557e0f015d0 2024-09-12T00:05:07.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.835+0000 7feea37fe640 1 -- 172.21.15.60:0/32016418 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feeb0079160 con 0x5557e0f015d0 2024-09-12T00:05:07.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.835+0000 7feea37fe640 1 -- 172.21.15.60:0/32016418 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb00cd340 con 0x5557e0f015d0 2024-09-12T00:05:07.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 -- 172.21.15.60:0/32016418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f015d0 msgr2=0x5557e0f01a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f015d0 0x5557e0f01a10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7feeb00cd120 tx=0x7feeb0079750 comp rx=0 tx=0).stop 2024-09-12T00:05:07.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 -- 172.21.15.60:0/32016418 shutdown_connections 2024-09-12T00:05:07.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 0x5557e0f0e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f015d0 0x5557e0f01a10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 --2- 172.21.15.60:0/32016418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f02b40 0x5557e0f01090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 -- 172.21.15.60:0/32016418 >> 172.21.15.60:0/32016418 conn(0x5557e0eca310 msgr2=0x5557e0efdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:07.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 -- 172.21.15.60:0/32016418 shutdown_connections 2024-09-12T00:05:07.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 -- 172.21.15.60:0/32016418 wait complete. 2024-09-12T00:05:07.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 -- start start 2024-09-12T00:05:07.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.836+0000 7feec58af740 1 Processor -- start 2024-09-12T00:05:07.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec58af740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec58af740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 0x5557e0f09040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec58af740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f09650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec58af740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5557e0f0f070 con 0x5557e0f0c370 2024-09-12T00:05:07.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec58af740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5557e0e22060 con 0x5557e0f02b40 2024-09-12T00:05:07.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec58af740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557e0f0f1f0 con 0x5557e0f015d0 2024-09-12T00:05:07.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec58af740 10 client.0 _ll_register_callbacks cb 0x5557e0b758c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:07.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f09650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f09650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41220/0 (socket says 172.21.15.60:41220) 2024-09-12T00:05:07.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 -- 172.21.15.60:0/654529252 learned_addr learned my addr 172.21.15.60:0/654529252 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:07.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec0a71640 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 0x5557e0f09040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1272640 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 -- 172.21.15.60:0/654529252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 msgr2=0x5557e0f0bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:07.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 -- 172.21.15.60:0/654529252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 msgr2=0x5557e0f09040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:07.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 0x5557e0f09040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 -- 172.21.15.60:0/654529252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557e0bd83c0 con 0x5557e0f0c370 2024-09-12T00:05:07.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1272640 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:07.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec1a73640 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f09650 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7feeb4013820 tx=0x7feeb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5e1f99c9614d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:07.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feea0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:07.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feea0ff9640 1 -- 172.21.15.60:0/654529252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4023070 con 0x5557e0f0c370 2024-09-12T00:05:07.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feec58af740 1 -- 172.21.15.60:0/654529252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeb0079160 con 0x5557e0f0c370 2024-09-12T00:05:07.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.837+0000 7feea0ff9640 1 -- 172.21.15.60:0/654529252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7feeb4012cf0 con 0x5557e0f0c370 2024-09-12T00:05:07.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feea0ff9640 1 -- 172.21.15.60:0/654529252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7feeb402f050 con 0x5557e0f0c370 2024-09-12T00:05:07.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec58af740 10 client.16830 fetch_fsmap learned FSMap version 43 2024-09-12T00:05:07.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec58af740 1 -- 172.21.15.60:0/654529252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5557e0f1ab40 con 0x5557e0f0c370 2024-09-12T00:05:07.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feea0ff9640 1 -- 172.21.15.60:0/654529252 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feeb0079160 con 0x5557e0f0c370 2024-09-12T00:05:07.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feea0ff9640 1 -- 172.21.15.60:0/654529252 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) ==== 8414+0+0 (secure 0 0 0) 0x7feeb401e390 con 0x5557e0f0c370 2024-09-12T00:05:07.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec58af740 10 client.16830 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T00:05:07.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec58af740 10 client.16830 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:05:07.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec58af740 20 client.16830 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec58af740 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5557e0f1bfa0 0x5557e0f1e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec58af740 4 client.16830 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec58af740 1 -- 172.21.15.60:0/654529252 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557e0e74860 con 0x5557e0f1bfa0 2024-09-12T00:05:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.838+0000 7feec1272640 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5557e0f1bfa0 0x5557e0f1e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.839+0000 7feec1272640 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5557e0f1bfa0 0x5557e0f1e3f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f5aa197f0e3dfc0 server_cookie=7b6a310003c6f0d6 in_seq=0 out_seq=0 2024-09-12T00:05:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.839+0000 7feea0ff9640 10 client.16830 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:05:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feea0ff9640 1 -- 172.21.15.60:0/654529252 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5557e0e74860 con 0x5557e0f1bfa0 2024-09-12T00:05:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feea0ff9640 10 client.16830 handle_command_reply: tid=0 2024-09-12T00:05:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 client.16830 shutdown 2024-09-12T00:05:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 -- 172.21.15.60:0/654529252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 msgr2=0x5557e0f09650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f09650 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7feeb4013820 tx=0x7feeb4004730 comp rx=0 tx=0).stop 2024-09-12T00:05:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 -- 172.21.15.60:0/654529252 shutdown_connections 2024-09-12T00:05:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5557e0f1bfa0 0x5557e0f1e3f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f09650 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 0x5557e0f09040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feea0ff9640 0 client.16830 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:05:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 --2- 172.21.15.60:0/654529252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 -- 172.21.15.60:0/654529252 >> 172.21.15.60:0/654529252 conn(0x5557e0eca310 msgr2=0x5557e0f03990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 -- 172.21.15.60:0/654529252 shutdown_connections 2024-09-12T00:05:07.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 1 -- 172.21.15.60:0/654529252 wait complete. 2024-09-12T00:05:07.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.840+0000 7feec58af740 20 client.16830 trim_cache size 0 max 16384 2024-09-12T00:05:07.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec58af740 1 Processor -- start 2024-09-12T00:05:07.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec58af740 1 -- start start 2024-09-12T00:05:07.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec58af740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec58af740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f02b40 0x5557e0f04180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec58af740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 0x5557e0f046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec58af740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1afae0 con 0x5557e0f02b40 2024-09-12T00:05:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec58af740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1b1830 con 0x5557e0f0c370 2024-09-12T00:05:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec58af740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1b01e0 con 0x5557e0f015d0 2024-09-12T00:05:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec0a71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f02b40 0x5557e0f04180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec0a71640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f02b40 0x5557e0f04180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41228/0 (socket says 172.21.15.60:41228) 2024-09-12T00:05:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec0a71640 1 -- 172.21.15.60:0/1118119378 learned_addr learned my addr 172.21.15.60:0/1118119378 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec1272640 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec1a73640 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 0x5557e0f046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec0a71640 1 -- 172.21.15.60:0/1118119378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 msgr2=0x5557e0f0afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec0a71640 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec0a71640 1 -- 172.21.15.60:0/1118119378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 msgr2=0x5557e0f046c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec0a71640 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 0x5557e0f046c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.854+0000 7feec0a71640 1 -- 172.21.15.60:0/1118119378 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557e0f04c00 con 0x5557e0f02b40 2024-09-12T00:05:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec0a71640 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f02b40 0x5557e0f04180 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7feeb00982a0 tx=0x7feeb0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ad872c24573f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feea2ffd640 1 -- 172.21.15.60:0/1118119378 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0079120 con 0x5557e0f02b40 2024-09-12T00:05:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feea2ffd640 1 -- 172.21.15.60:0/1118119378 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feeb00a4b00 con 0x5557e0f02b40 2024-09-12T00:05:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feea2ffd640 1 -- 172.21.15.60:0/1118119378 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb007c910 con 0x5557e0f02b40 2024-09-12T00:05:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec58af740 1 -- 172.21.15.60:0/1118119378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f02b40 msgr2=0x5557e0f04180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec58af740 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f02b40 0x5557e0f04180 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7feeb00982a0 tx=0x7feeb0000bc0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec58af740 1 -- 172.21.15.60:0/1118119378 shutdown_connections 2024-09-12T00:05:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec58af740 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f0c370 0x5557e0f046c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec58af740 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f02b40 0x5557e0f04180 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec58af740 1 --2- 172.21.15.60:0/1118119378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f0afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec58af740 1 -- 172.21.15.60:0/1118119378 >> 172.21.15.60:0/1118119378 conn(0x5557e0eca310 msgr2=0x5557e0f0a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.855+0000 7feec58af740 1 -- 172.21.15.60:0/1118119378 shutdown_connections 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 -- 172.21.15.60:0/1118119378 wait complete. 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 -- start start 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 Processor -- start 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f10380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 0x5557e0f108c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f10e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1b10a0 con 0x5557e0f0c370 2024-09-12T00:05:07.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1b0970 con 0x5557e0f02b40 2024-09-12T00:05:07.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1adac0 con 0x5557e0f015d0 2024-09-12T00:05:07.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.856+0000 7feec58af740 10 client.0 _ll_register_callbacks cb 0x7feeb4009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:07.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f10e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1272640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f10380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f10e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41230/0 (socket says 172.21.15.60:41230) 2024-09-12T00:05:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 -- 172.21.15.60:0/1575778752 learned_addr learned my addr 172.21.15.60:0/1575778752 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec0a71640 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 0x5557e0f108c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 -- 172.21.15.60:0/1575778752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 msgr2=0x5557e0f10380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f10380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 -- 172.21.15.60:0/1575778752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 msgr2=0x5557e0f108c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 0x5557e0f108c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 -- 172.21.15.60:0/1575778752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557e0f85df0 con 0x5557e0f0c370 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec1a73640 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f10e00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feeb401e760 tx=0x7feeb401e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bbc3de4981cfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feea0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feea0ff9640 1 -- 172.21.15.60:0/1575778752 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb403a020 con 0x5557e0f0c370 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feea0ff9640 1 -- 172.21.15.60:0/1575778752 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7feeb4012d00 con 0x5557e0f0c370 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec58af740 1 -- 172.21.15.60:0/1575778752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeb00a4b00 con 0x5557e0f0c370 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feea0ff9640 1 -- 172.21.15.60:0/1575778752 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7feeb4045050 con 0x5557e0f0c370 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec58af740 10 client.16836 fetch_fsmap learned FSMap version 43 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.857+0000 7feec58af740 1 -- 172.21.15.60:0/1575778752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5557e0f870b0 con 0x5557e0f0c370 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feea0ff9640 1 -- 172.21.15.60:0/1575778752 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feeb00a4b00 con 0x5557e0f0c370 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feea0ff9640 1 -- 172.21.15.60:0/1575778752 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 43) ==== 8414+0+0 (secure 0 0 0) 0x7feeb4028640 con 0x5557e0f0c370 2024-09-12T00:05:07.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feec58af740 10 client.16836 fetch_fsmap finished waiting for FSMap version 43 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feec58af740 10 client.16836 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feec58af740 20 client.16836 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feec58af740 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5557e0f87850 0x5557e0f89c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feec58af740 4 client.16836 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feec58af740 1 -- 172.21.15.60:0/1575778752 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557e0e6ed70 con 0x5557e0f87850 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.858+0000 7feec1272640 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5557e0f87850 0x5557e0f89c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec1272640 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5557e0f87850 0x5557e0f89c70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7861729929d17099 server_cookie=cbfb7654a440d3a6 in_seq=0 out_seq=0 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feea0ff9640 10 client.16836 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feea0ff9640 1 -- 172.21.15.60:0/1575778752 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557e0e6ed70 con 0x5557e0f87850 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feea0ff9640 10 client.16836 handle_command_reply: tid=0 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 client.16836 shutdown 2024-09-12T00:05:07.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 -- 172.21.15.60:0/1575778752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 msgr2=0x5557e0f10e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f10e00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feeb401e760 tx=0x7feeb401e640 comp rx=0 tx=0).stop 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 -- 172.21.15.60:0/1575778752 shutdown_connections 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5557e0f87850 0x5557e0f89c70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feea0ff9640 0 client.16836 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5557e0f0c370 0x5557e0f10e00 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5557e0f02b40 0x5557e0f108c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 --2- 172.21.15.60:0/1575778752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557e0f015d0 0x5557e0f10380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 -- 172.21.15.60:0/1575778752 >> 172.21.15.60:0/1575778752 conn(0x5557e0eca310 msgr2=0x5557e0f0b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 -- 172.21.15.60:0/1575778752 shutdown_connections 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 1 -- 172.21.15.60:0/1575778752 wait complete. 2024-09-12T00:05:07.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.859+0000 7feec58af740 20 client.16836 trim_cache size 0 max 16384 2024-09-12T00:05:07.892 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 -- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feea40a2cf0 msgr2=0x7feea40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feea40a2cf0 0x7feea40a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005d80 tx=0x7feeb40157f0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 -- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc101360 msgr2=0x7feebc1a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc101360 0x7feebc1a0ac0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7feeb000e9f0 tx=0x7feeb000eeb0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 -- 172.21.15.60:0/3869384509 shutdown_connections 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feea40a2cf0 0x7feea40a51b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feebc10e4d0 0x7feebc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc101360 0x7feebc1a0ac0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 --2- 172.21.15.60:0/3869384509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feebc1009b0 0x7feebc1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:07.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 -- 172.21.15.60:0/3869384509 >> 172.21.15.60:0/3869384509 conn(0x7feebc0fc7d0 msgr2=0x7feebc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:07.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 -- 172.21.15.60:0/3869384509 shutdown_connections 2024-09-12T00:05:07.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:07.860+0000 7feec34d6640 1 -- 172.21.15.60:0/3869384509 wait complete. 2024-09-12T00:05:08.581 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:05:08.836 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:09.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2876203041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 msgr2=0x7f7a3810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2876203041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 0x7f7a3810d950 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009cd0 tx=0x7f7a3002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2876203041 shutdown_connections 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2876203041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 0x7f7a3810d950 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2876203041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38100a80 0x7f7a38100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2876203041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38106a80 0x7f7a38106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2876203041 >> 172.21.15.60:0/2876203041 conn(0x7f7a380fc780 msgr2=0x7f7a380feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2876203041 shutdown_connections 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.281+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2876203041 wait complete. 2024-09-12T00:05:09.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.282+0000 7f7a3ef57640 1 Processor -- start 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.282+0000 7f7a3ef57640 1 -- start start 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.282+0000 7f7a3ef57640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38100a80 0x7f7a380fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.282+0000 7f7a3ef57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 0x7f7a380fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.282+0000 7f7a3ef57640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38106a80 0x7f7a380fd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.282+0000 7f7a3ef57640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38110fa0 con 0x7f7a38101420 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.282+0000 7f7a3ef57640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38110e20 con 0x7f7a38106a80 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.282+0000 7f7a3ef57640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38111120 con 0x7f7a38100a80 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a3ccf3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38100a80 0x7f7a380fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a3d4f4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38106a80 0x7f7a380fd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a3ccf3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38100a80 0x7f7a380fcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:46708/0 (socket says 172.21.15.60:46708) 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 0x7f7a380fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a3ccf3640 1 -- 172.21.15.60:0/2585360096 learned_addr learned my addr 172.21.15.60:0/2585360096 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:09.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a37fff640 1 -- 172.21.15.60:0/2585360096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38100a80 msgr2=0x7f7a380fcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a37fff640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38100a80 0x7f7a380fcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a37fff640 1 -- 172.21.15.60:0/2585360096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38106a80 msgr2=0x7f7a380fd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a37fff640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38106a80 0x7f7a380fd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a37fff640 1 -- 172.21.15.60:0/2585360096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a381a69a0 con 0x7f7a38101420 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.283+0000 7f7a37fff640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 0x7f7a380fd2b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d6d0 tx=0x7f7a2400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.285+0000 7f7a35ffb640 1 -- 172.21.15.60:0/2585360096 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24017070 con 0x7f7a38101420 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.285+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2585360096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a381a6c90 con 0x7f7a38101420 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.285+0000 7f7a35ffb640 1 -- 172.21.15.60:0/2585360096 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a24009820 con 0x7f7a38101420 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.285+0000 7f7a35ffb640 1 -- 172.21.15.60:0/2585360096 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24004e00 con 0x7f7a38101420 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.285+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2585360096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a381a71c0 con 0x7f7a38101420 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.287+0000 7f7a35ffb640 1 -- 172.21.15.60:0/2585360096 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7a240099d0 con 0x7f7a38101420 2024-09-12T00:05:09.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a41330740 1 Processor -- start 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a41330740 1 -- start start 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a41330740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 0x559bff223090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a41330740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff2235d0 0x559bff223a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a41330740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 0x559bff230760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a41330740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559bff1892f0 con 0x559bff2235d0 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a41330740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559bff130cf0 con 0x559bff22e370 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a41330740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559bff1852b0 con 0x559bff224b40 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a35ffb640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7a280a2cf0 0x7f7a280a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a3ccf3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff2235d0 0x559bff223a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a3d4f4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 0x559bff223090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a3ccf3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff2235d0 0x559bff223a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41256/0 (socket says 172.21.15.60:41256) 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a3ccf3640 1 -- 172.21.15.60:0/3920794750 learned_addr learned my addr 172.21.15.60:0/3920794750 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a3d4f4640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7a280a2cf0 0x7f7a280a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a37fff640 1 --2- 172.21.15.60:0/3920794750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 0x559bff230760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a35ffb640 1 -- 172.21.15.60:0/2585360096 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7a240ceee0 con 0x7f7a38101420 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a3ccf3640 1 -- 172.21.15.60:0/3920794750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 msgr2=0x559bff223090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/3920794750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 0x559bff223090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.288+0000 7f7a3ccf3640 1 -- 172.21.15.60:0/3920794750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 msgr2=0x559bff230760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.289+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/3920794750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 0x559bff230760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.289+0000 7f7a3ccf3640 1 -- 172.21.15.60:0/3920794750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bff1153a0 con 0x559bff2235d0 2024-09-12T00:05:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.289+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/3920794750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff2235d0 0x559bff223a10 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0045e0 tx=0x7f7a2c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60218a28f366540e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:09.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.289+0000 7f7a3d4f4640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7a280a2cf0 0x7f7a280a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a30006010 tx=0x7f7a30009360 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.289+0000 7f7a22ffd640 1 -- 172.21.15.60:0/3920794750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c003dd0 con 0x559bff2235d0 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.289+0000 7f7a22ffd640 1 -- 172.21.15.60:0/3920794750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a2c015070 con 0x559bff2235d0 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.289+0000 7f7a22ffd640 1 -- 172.21.15.60:0/3920794750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c011820 con 0x559bff2235d0 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 -- 172.21.15.60:0/3920794750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff2235d0 msgr2=0x559bff223a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 --2- 172.21.15.60:0/3920794750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff2235d0 0x559bff223a10 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0045e0 tx=0x7f7a2c004610 comp rx=0 tx=0).stop 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 -- 172.21.15.60:0/3920794750 shutdown_connections 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 --2- 172.21.15.60:0/3920794750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 0x559bff230760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 --2- 172.21.15.60:0/3920794750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff2235d0 0x559bff223a10 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 --2- 172.21.15.60:0/3920794750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 0x559bff223090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 -- 172.21.15.60:0/3920794750 >> 172.21.15.60:0/3920794750 conn(0x559bff1ec310 msgr2=0x559bff21fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 -- 172.21.15.60:0/3920794750 shutdown_connections 2024-09-12T00:05:09.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 -- 172.21.15.60:0/3920794750 wait complete. 2024-09-12T00:05:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 -- start start 2024-09-12T00:05:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.290+0000 7f7a41330740 1 Processor -- start 2024-09-12T00:05:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a41330740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff22dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a41330740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 0x559bff22afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a41330740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff22e370 0x559bff22b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a41330740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559bff231070 con 0x559bff22e370 2024-09-12T00:05:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a41330740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559bff144060 con 0x559bff2235d0 2024-09-12T00:05:09.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a41330740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559bff2311f0 con 0x559bff224b40 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a41330740 10 client.0 _ll_register_callbacks cb 0x559bfee978c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff22e370 0x559bff22b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3ccf3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff22dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff22e370 0x559bff22b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41272/0 (socket says 172.21.15.60:41272) 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3ccf3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff22dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:45086/0 (socket says 172.21.15.60:45086) 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 -- 172.21.15.60:0/2244351271 learned_addr learned my addr 172.21.15.60:0/2244351271 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a37fff640 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 0x559bff22afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 -- 172.21.15.60:0/2244351271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 msgr2=0x559bff22afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 0x559bff22afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 -- 172.21.15.60:0/2244351271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 msgr2=0x559bff22dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff22dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 -- 172.21.15.60:0/2244351271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bfeefa3c0 con 0x559bff22e370 2024-09-12T00:05:09.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a3d4f4640 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff22e370 0x559bff22b5d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f7a30035000 tx=0x7f7a300095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead75a7f1592e8bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a17fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a17fff640 1 -- 172.21.15.60:0/2244351271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3004a820 con 0x559bff22e370 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a17fff640 1 -- 172.21.15.60:0/2244351271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7a3004a9c0 con 0x559bff22e370 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.291+0000 7f7a41330740 1 -- 172.21.15.60:0/2244351271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a2c015070 con 0x559bff22e370 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a17fff640 1 -- 172.21.15.60:0/2244351271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f7a300098a0 con 0x559bff22e370 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a41330740 10 client.16848 fetch_fsmap learned FSMap version 44 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a41330740 1 -- 172.21.15.60:0/2244351271 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559bff23cad0 con 0x559bff22e370 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a17fff640 1 -- 172.21.15.60:0/2244351271 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a2c015070 con 0x559bff22e370 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a17fff640 1 -- 172.21.15.60:0/2244351271 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 44) ==== 8398+0+0 (secure 0 0 0) 0x7f7a30030070 con 0x559bff22e370 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a41330740 10 client.16848 fetch_fsmap finished waiting for FSMap version 44 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a41330740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:09.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a41330740 20 client.16848 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a41330740 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559bff23df60 0x559bff2403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a41330740 4 client.16848 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a41330740 1 -- 172.21.15.60:0/2244351271 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bff196860 con 0x559bff23df60 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.292+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559bff23df60 0x559bff2403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.293+0000 7f7a17fff640 10 client.16848 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.293+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559bff23df60 0x559bff2403c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afeb0bae20ee2bef server_cookie=17b9c0a46946370a in_seq=0 out_seq=0 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.293+0000 7f7a17fff640 1 -- 172.21.15.60:0/2244351271 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bff196860 con 0x559bff23df60 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.293+0000 7f7a17fff640 10 client.16848 handle_command_reply: tid=0 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 client.16848 shutdown 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 -- 172.21.15.60:0/2244351271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff22e370 msgr2=0x559bff22b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff22e370 0x559bff22b5d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f7a30035000 tx=0x7f7a300095c0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 -- 172.21.15.60:0/2244351271 shutdown_connections 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559bff23df60 0x559bff2403c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff22e370 0x559bff22b5d0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff224b40 0x559bff22afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a17fff640 0 client.16848 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 --2- 172.21.15.60:0/2244351271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff22dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 -- 172.21.15.60:0/2244351271 >> 172.21.15.60:0/2244351271 conn(0x559bff1ec310 msgr2=0x559bff225960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 -- 172.21.15.60:0/2244351271 shutdown_connections 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 1 -- 172.21.15.60:0/2244351271 wait complete. 2024-09-12T00:05:09.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.294+0000 7f7a41330740 20 client.16848 trim_cache size 0 max 16384 2024-09-12T00:05:09.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.307+0000 7f7a41330740 1 Processor -- start 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.307+0000 7f7a41330740 1 -- start start 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.307+0000 7f7a41330740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff226120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.307+0000 7f7a41330740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff226660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.307+0000 7f7a41330740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff22e370 0x559bff245c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.307+0000 7f7a41330740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381afa60 con 0x559bff224b40 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.307+0000 7f7a41330740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381b16f0 con 0x559bff2235d0 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.307+0000 7f7a41330740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381b0160 con 0x559bff22e370 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff226660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff226660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41274/0 (socket says 172.21.15.60:41274) 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 -- 172.21.15.60:0/3622233937 learned_addr learned my addr 172.21.15.60:0/3622233937 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff226120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a3d4f4640 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff22e370 0x559bff245c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 -- 172.21.15.60:0/3622233937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff22e370 msgr2=0x559bff245c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff22e370 0x559bff245c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 -- 172.21.15.60:0/3622233937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 msgr2=0x559bff226120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff226120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 -- 172.21.15.60:0/3622233937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bff22e0a0 con 0x559bff224b40 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a3d4f4640 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff22e370 0x559bff245c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a37fff640 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff226660 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d6a0 tx=0x7f7a2409f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb130687500391d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:09.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a227fc640 1 -- 172.21.15.60:0/3622233937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240b4070 con 0x559bff224b40 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a227fc640 1 -- 172.21.15.60:0/3622233937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a2409f7a0 con 0x559bff224b40 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.308+0000 7f7a227fc640 1 -- 172.21.15.60:0/3622233937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24020040 con 0x559bff224b40 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 -- 172.21.15.60:0/3622233937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 msgr2=0x559bff226660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff226660 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d6a0 tx=0x7f7a2409f040 comp rx=0 tx=0).stop 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 -- 172.21.15.60:0/3622233937 shutdown_connections 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff22e370 0x559bff245c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff226660 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 --2- 172.21.15.60:0/3622233937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff2235d0 0x559bff226120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 -- 172.21.15.60:0/3622233937 >> 172.21.15.60:0/3622233937 conn(0x559bff1ec310 msgr2=0x559bff22d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 -- 172.21.15.60:0/3622233937 shutdown_connections 2024-09-12T00:05:09.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 -- 172.21.15.60:0/3622233937 wait complete. 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.309+0000 7f7a41330740 1 -- start start 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a41330740 1 Processor -- start 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a41330740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff2235d0 0x559bff236900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a41330740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff233450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a41330740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 0x559bff233990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a41330740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381b0f60 con 0x559bff224b40 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a41330740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381b0860 con 0x559bff22e370 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a41330740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a381ada40 con 0x559bff2235d0 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a41330740 10 client.0 _ll_register_callbacks cb 0x7f7a30031da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff233450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a37fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff233450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41284/0 (socket says 172.21.15.60:41284) 2024-09-12T00:05:09.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a37fff640 1 -- 172.21.15.60:0/4172525367 learned_addr learned my addr 172.21.15.60:0/4172525367 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a3d4f4640 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 0x559bff233990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff2235d0 0x559bff236900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a37fff640 1 -- 172.21.15.60:0/4172525367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff2235d0 msgr2=0x559bff236900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a37fff640 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff2235d0 0x559bff236900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a37fff640 1 -- 172.21.15.60:0/4172525367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 msgr2=0x559bff233990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.310+0000 7f7a37fff640 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 0x559bff233990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a37fff640 1 -- 172.21.15.60:0/4172525367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bff233ed0 con 0x559bff224b40 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a37fff640 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff233450 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009610 tx=0x7f7a240977b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cad64f3e4c95fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a17fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a17fff640 1 -- 172.21.15.60:0/4172525367 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240b8020 con 0x559bff224b40 2024-09-12T00:05:09.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a17fff640 1 -- 172.21.15.60:0/4172525367 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7a240cc8a0 con 0x559bff224b40 2024-09-12T00:05:09.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 1 -- 172.21.15.60:0/4172525367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a2409f7a0 con 0x559bff224b40 2024-09-12T00:05:09.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a17fff640 1 -- 172.21.15.60:0/4172525367 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f7a24020070 con 0x559bff224b40 2024-09-12T00:05:09.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 10 client.16854 fetch_fsmap learned FSMap version 44 2024-09-12T00:05:09.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 1 -- 172.21.15.60:0/4172525367 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559bff2a9930 con 0x559bff224b40 2024-09-12T00:05:09.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a17fff640 1 -- 172.21.15.60:0/4172525367 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a2409f7a0 con 0x559bff224b40 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a17fff640 1 -- 172.21.15.60:0/4172525367 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 44) ==== 8398+0+0 (secure 0 0 0) 0x7f7a2409a8f0 con 0x559bff224b40 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 10 client.16854 fetch_fsmap finished waiting for FSMap version 44 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 10 client.16854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 20 client.16854 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559bff2aa050 0x559bff2ac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 4 client.16854 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.311+0000 7f7a41330740 1 -- 172.21.15.60:0/4172525367 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bff190d70 con 0x559bff2aa050 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.312+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559bff2aa050 0x559bff2ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.312+0000 7f7a3ccf3640 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559bff2aa050 0x559bff2ac470 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76573c77592a62ad server_cookie=11c383f3af0a12c2 in_seq=0 out_seq=0 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.312+0000 7f7a17fff640 10 client.16854 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.312+0000 7f7a17fff640 1 -- 172.21.15.60:0/4172525367 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bff190d70 con 0x559bff2aa050 2024-09-12T00:05:09.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.312+0000 7f7a17fff640 10 client.16854 handle_command_reply: tid=0 2024-09-12T00:05:09.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.312+0000 7f7a41330740 1 client.16854 shutdown 2024-09-12T00:05:09.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 -- 172.21.15.60:0/4172525367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 msgr2=0x559bff233450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff233450 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009610 tx=0x7f7a240977b0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 -- 172.21.15.60:0/4172525367 shutdown_connections 2024-09-12T00:05:09.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559bff2aa050 0x559bff2ac470 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559bff22e370 0x559bff233990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559bff224b40 0x559bff233450 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 --2- 172.21.15.60:0/4172525367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559bff2235d0 0x559bff236900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 -- 172.21.15.60:0/4172525367 >> 172.21.15.60:0/4172525367 conn(0x559bff1ec310 msgr2=0x559bff21e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a17fff640 0 client.16854 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 -- 172.21.15.60:0/4172525367 shutdown_connections 2024-09-12T00:05:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 1 -- 172.21.15.60:0/4172525367 wait complete. 2024-09-12T00:05:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a41330740 20 client.16854 trim_cache size 0 max 16384 2024-09-12T00:05:09.328 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7a280a2cf0 msgr2=0x7f7a280a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.313+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7a280a2cf0 0x7f7a280a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7a30006010 tx=0x7f7a30009360 comp rx=0 tx=0).stop 2024-09-12T00:05:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 msgr2=0x7f7a380fd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 0x7f7a380fd2b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d6d0 tx=0x7f7a2400db90 comp rx=0 tx=0).stop 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2585360096 shutdown_connections 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7a280a2cf0 0x7f7a280a51b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a38106a80 0x7f7a380fd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a38101420 0x7f7a380fd2b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 --2- 172.21.15.60:0/2585360096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38100a80 0x7f7a380fcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2585360096 >> 172.21.15.60:0/2585360096 conn(0x7f7a380fc780 msgr2=0x7f7a3806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2585360096 shutdown_connections 2024-09-12T00:05:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:09.314+0000 7f7a3ef57640 1 -- 172.21.15.60:0/2585360096 wait complete. 2024-09-12T00:05:09.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:09 smithi192 ceph-mon[35487]: pgmap v176: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-12T00:05:09.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:09 smithi060 ceph-mon[30953]: pgmap v176: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-12T00:05:09.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:09 smithi105 ceph-mon[34805]: pgmap v176: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-12T00:05:10.478 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:10 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:10.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:10 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:10.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:10 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:11.224 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:05:11.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:05:11.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:11 smithi060 ceph-mon[30953]: pgmap v177: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-12T00:05:11.489 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:11.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:11 smithi105 ceph-mon[34805]: pgmap v177: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-12T00:05:11.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:11 smithi192 ceph-mon[35487]: pgmap v177: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-12T00:05:12.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.996+0000 7fbaf663e640 1 -- 172.21.15.60:0/3967654235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf010c170 msgr2=0x7fbaf010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.996+0000 7fbaf663e640 1 --2- 172.21.15.60:0/3967654235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf010c170 0x7fbaf010e610 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009ca0 tx=0x7fbae802a950 comp rx=0 tx=0).stop 2024-09-12T00:05:12.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 -- 172.21.15.60:0/3967654235 shutdown_connections 2024-09-12T00:05:12.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 --2- 172.21.15.60:0/3967654235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf010c170 0x7fbaf010e610 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 --2- 172.21.15.60:0/3967654235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf0103660 0x7fbaf010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 --2- 172.21.15.60:0/3967654235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0102d40 0x7fbaf0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 -- 172.21.15.60:0/3967654235 >> 172.21.15.60:0/3967654235 conn(0x7fbaf00fc7a0 msgr2=0x7fbaf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:12.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 -- 172.21.15.60:0/3967654235 shutdown_connections 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 -- 172.21.15.60:0/3967654235 wait complete. 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 Processor -- start 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.997+0000 7fbaf663e640 1 -- start start 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaf663e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0102d40 0x7fbaf0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaf663e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0103660 0x7fbaf0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaf663e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf010c170 0x7fbaf019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaf663e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0112140 con 0x7fbaf0102d40 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaf663e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0111fc0 con 0x7fbaf010c170 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaf663e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf01122c0 con 0x7fbaf0103660 2024-09-12T00:05:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0102d40 0x7fbaf0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0102d40 0x7fbaf0198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56672/0 (socket says 172.21.15.60:56672) 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 -- 172.21.15.60:0/1134728676 learned_addr learned my addr 172.21.15.60:0/1134728676 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf010c170 0x7fbaf019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbae7fff640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0103660 0x7fbaf0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 -- 172.21.15.60:0/1134728676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0103660 msgr2=0x7fbaf0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0103660 0x7fbaf0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 -- 172.21.15.60:0/1134728676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf010c170 msgr2=0x7fbaf019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf010c170 0x7fbaf019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 -- 172.21.15.60:0/1134728676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf019d530 con 0x7fbaf0102d40 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbae7fff640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0103660 0x7fbaf0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaeffff640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0102d40 0x7fbaf0198580 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbae000b4a0 tx=0x7fbae000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaedffb640 1 -- 172.21.15.60:0/1134728676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0014070 con 0x7fbaf0102d40 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaf663e640 1 -- 172.21.15.60:0/1134728676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf019d820 con 0x7fbaf0102d40 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaedffb640 1 -- 172.21.15.60:0/1134728676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbae0010b10 con 0x7fbaf0102d40 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.998+0000 7fbaedffb640 1 -- 172.21.15.60:0/1134728676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0017d60 con 0x7fbaf0102d40 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:11.999+0000 7fbaf663e640 1 -- 172.21.15.60:0/1134728676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf01a5100 con 0x7fbaf0102d40 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaedffb640 1 -- 172.21.15.60:0/1134728676 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fbae0017070 con 0x7fbaf0102d40 2024-09-12T00:05:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaf8a17740 1 Processor -- start 2024-09-12T00:05:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaf8a17740 1 -- start start 2024-09-12T00:05:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff808a40 0x555eff808e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff817c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaedffb640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbadc0a2cf0 0x7fbadc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 0x555eff81a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555eff76e280 con 0x555eff808a40 2024-09-12T00:05:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555eff715b10 con 0x555eff818150 2024-09-12T00:05:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.001+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555eff76a240 con 0x555eff809360 2024-09-12T00:05:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff808a40 0x555eff808e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff808a40 0x555eff808e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56678/0 (socket says 172.21.15.60:56678) 2024-09-12T00:05:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 -- 172.21.15.60:0/2386700220 learned_addr learned my addr 172.21.15.60:0/2386700220 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbae7fff640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbadc0a2cf0 0x7fbadc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaedffb640 1 -- 172.21.15.60:0/1134728676 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbae00ce6f0 con 0x7fbaf0102d40 2024-09-12T00:05:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaeffff640 1 --2- 172.21.15.60:0/2386700220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff817c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 -- 172.21.15.60:0/2386700220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 msgr2=0x555eff817c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:12.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/2386700220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff817c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 -- 172.21.15.60:0/2386700220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 msgr2=0x555eff81a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:12.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/2386700220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 0x555eff81a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 -- 172.21.15.60:0/2386700220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eff7221f0 con 0x555eff808a40 2024-09-12T00:05:12.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbae7fff640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbadc0a2cf0 0x7fbadc0a51b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbaf010e9d0 tx=0x7fbad8005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:12.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/2386700220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff808a40 0x555eff808e20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbae8005fe0 tx=0x7fbae8009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d395f3bce5159528 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:12.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbae67fc640 1 -- 172.21.15.60:0/2386700220 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8034040 con 0x555eff808a40 2024-09-12T00:05:12.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbae67fc640 1 -- 172.21.15.60:0/2386700220 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbae8041070 con 0x555eff808a40 2024-09-12T00:05:12.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.002+0000 7fbae67fc640 1 -- 172.21.15.60:0/2386700220 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8004410 con 0x555eff808a40 2024-09-12T00:05:12.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2386700220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff808a40 msgr2=0x555eff808e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/2386700220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff808a40 0x555eff808e20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbae8005fe0 tx=0x7fbae8009940 comp rx=0 tx=0).stop 2024-09-12T00:05:12.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2386700220 shutdown_connections 2024-09-12T00:05:12.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/2386700220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 0x555eff81a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/2386700220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff817c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/2386700220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff808a40 0x555eff808e20 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2386700220 >> 172.21.15.60:0/2386700220 conn(0x555eff8050f0 msgr2=0x555eff8054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:12.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2386700220 shutdown_connections 2024-09-12T00:05:12.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.003+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2386700220 wait complete. 2024-09-12T00:05:12.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 1 -- start start 2024-09-12T00:05:12.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 1 Processor -- start 2024-09-12T00:05:12.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff815100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff815640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff818150 0x555eff815b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555eff81ad20 con 0x555eff818150 2024-09-12T00:05:12.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555eff728f10 con 0x555eff808a40 2024-09-12T00:05:12.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555eff81aea0 con 0x555eff809360 2024-09-12T00:05:12.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf8a17740 10 client.0 _ll_register_callbacks cb 0x555eff6f1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:12.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf4bdb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff818150 0x555eff815b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf4bdb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff818150 0x555eff815b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56680/0 (socket says 172.21.15.60:56680) 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaf4bdb640 1 -- 172.21.15.60:0/916587750 learned_addr learned my addr 172.21.15.60:0/916587750 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbaeffff640 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff815100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.004+0000 7fbae7fff640 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff815640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf4bdb640 1 -- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 msgr2=0x555eff815640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff815640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf4bdb640 1 -- 172.21.15.60:0/916587750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 msgr2=0x555eff815100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff815100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf4bdb640 1 -- 172.21.15.60:0/916587750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eff4df6a0 con 0x555eff818150 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbae7fff640 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff815640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:12.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff818150 0x555eff815b80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009a60 tx=0x7fbae8003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b99c58f2a8be7f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbacf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbacf7fe640 1 -- 172.21.15.60:0/916587750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8054060 con 0x555eff818150 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbacf7fe640 1 -- 172.21.15.60:0/916587750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbae8004110 con 0x555eff818150 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf8a17740 1 -- 172.21.15.60:0/916587750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbae8041070 con 0x555eff818150 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbacf7fe640 1 -- 172.21.15.60:0/916587750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fbae8034050 con 0x555eff818150 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf8a17740 10 client.16866 fetch_fsmap learned FSMap version 45 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbaf8a17740 1 -- 172.21.15.60:0/916587750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x555eff81ad20 con 0x555eff818150 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.005+0000 7fbacf7fe640 1 -- 172.21.15.60:0/916587750 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbae8041070 con 0x555eff818150 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.006+0000 7fbacf7fe640 1 -- 172.21.15.60:0/916587750 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 45) ==== 8394+0+0 (secure 0 0 0) 0x7fbae804e030 con 0x555eff818150 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.006+0000 7fbaf8a17740 10 client.16866 fetch_fsmap finished waiting for FSMap version 45 2024-09-12T00:05:12.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.006+0000 7fbaf8a17740 10 client.16866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.006+0000 7fbaf8a17740 20 client.16866 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.006+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555eff827bc0 0x555eff829fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.006+0000 7fbaf8a17740 4 client.16866 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.006+0000 7fbaf8a17740 1 -- 172.21.15.60:0/916587750 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eff77b7f0 con 0x555eff827bc0 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.007+0000 7fbaeffff640 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555eff827bc0 0x555eff829fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.011+0000 7fbaeffff640 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555eff827bc0 0x555eff829fb0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cca5fdec190edc6 server_cookie=4c3aea4c2eedf2c2 in_seq=0 out_seq=0 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.011+0000 7fbacf7fe640 10 client.16866 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.012+0000 7fbacf7fe640 1 -- 172.21.15.60:0/916587750 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555eff77b7f0 con 0x555eff827bc0 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.012+0000 7fbacf7fe640 10 client.16866 handle_command_reply: tid=0 2024-09-12T00:05:12.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.012+0000 7fbaf8a17740 1 client.16866 shutdown 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 -- 172.21.15.60:0/916587750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff818150 msgr2=0x555eff815b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff818150 0x555eff815b80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009a60 tx=0x7fbae8003e00 comp rx=0 tx=0).stop 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 -- 172.21.15.60:0/916587750 shutdown_connections 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555eff827bc0 0x555eff829fb0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbacf7fe640 0 client.16866 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff818150 0x555eff815b80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff809360 0x555eff815640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/916587750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff815100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 -- 172.21.15.60:0/916587750 >> 172.21.15.60:0/916587750 conn(0x555eff8050f0 msgr2=0x555eff80ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:12.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 -- 172.21.15.60:0/916587750 shutdown_connections 2024-09-12T00:05:12.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 1 -- 172.21.15.60:0/916587750 wait complete. 2024-09-12T00:05:12.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.013+0000 7fbaf8a17740 20 client.16866 trim_cache size 0 max 16384 2024-09-12T00:05:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbaf8a17740 1 Processor -- start 2024-09-12T00:05:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbaf8a17740 1 -- start start 2024-09-12T00:05:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff808a40 0x555eff815a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff82f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 0x555eff82fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf01ab610 con 0x555eff809360 2024-09-12T00:05:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf01ad2a0 con 0x555eff818150 2024-09-12T00:05:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf01abd10 con 0x555eff808a40 2024-09-12T00:05:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbae7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff82f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbae7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff82f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56692/0 (socket says 172.21.15.60:56692) 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.030+0000 7fbae7fff640 1 -- 172.21.15.60:0/2894381759 learned_addr learned my addr 172.21.15.60:0/2894381759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbaeffff640 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff808a40 0x555eff815a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 0x555eff82fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae7fff640 1 -- 172.21.15.60:0/2894381759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff808a40 msgr2=0x555eff815a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae7fff640 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff808a40 0x555eff815a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae7fff640 1 -- 172.21.15.60:0/2894381759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 msgr2=0x555eff82fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae7fff640 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 0x555eff82fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae7fff640 1 -- 172.21.15.60:0/2894381759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eff8179d0 con 0x555eff809360 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 0x555eff82fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae7fff640 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff82f790 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbad8004130 tx=0x7fbad8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f37c7a33171d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae5ffb640 1 -- 172.21.15.60:0/2894381759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8025070 con 0x555eff809360 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae5ffb640 1 -- 172.21.15.60:0/2894381759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbad8016070 con 0x555eff809360 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.031+0000 7fbae5ffb640 1 -- 172.21.15.60:0/2894381759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad80216a0 con 0x555eff809360 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2894381759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 msgr2=0x555eff82f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff82f790 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbad8004130 tx=0x7fbad8014000 comp rx=0 tx=0).stop 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2894381759 shutdown_connections 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff818150 0x555eff82fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff82f790 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/2894381759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff808a40 0x555eff815a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2894381759 >> 172.21.15.60:0/2894381759 conn(0x555eff8050f0 msgr2=0x555eff817070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2894381759 shutdown_connections 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 -- 172.21.15.60:0/2894381759 wait complete. 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.032+0000 7fbaf8a17740 1 -- start start 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf8a17740 1 Processor -- start 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff812c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff820130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf8a17740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff818150 0x555eff820670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf01acb10 con 0x555eff809360 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf01ac410 con 0x555eff808a40 2024-09-12T00:05:12.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf8a17740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf01a95f0 con 0x555eff818150 2024-09-12T00:05:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf8a17740 10 client.0 _ll_register_callbacks cb 0x7fbae802f5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbae7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff820130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbae7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff820130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56698/0 (socket says 172.21.15.60:56698) 2024-09-12T00:05:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbae7fff640 1 -- 172.21.15.60:0/66550691 learned_addr learned my addr 172.21.15.60:0/66550691 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaeffff640 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff812c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaf4bdb640 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff818150 0x555eff820670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbae7fff640 1 -- 172.21.15.60:0/66550691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff818150 msgr2=0x555eff820670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:12.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbae7fff640 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff818150 0x555eff820670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbae7fff640 1 -- 172.21.15.60:0/66550691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 msgr2=0x555eff812c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbae7fff640 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff812c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbae7fff640 1 -- 172.21.15.60:0/66550691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eff80d670 con 0x555eff809360 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.033+0000 7fbaeffff640 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff812c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbae7fff640 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff820130 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbad8012fd0 tx=0x7fbad8012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcde8b9379c4a8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbacf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbacf7fe640 1 -- 172.21.15.60:0/66550691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8025040 con 0x555eff809360 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 1 -- 172.21.15.60:0/66550691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbad8016070 con 0x555eff809360 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbacf7fe640 1 -- 172.21.15.60:0/66550691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fbad8012a00 con 0x555eff809360 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbacf7fe640 1 -- 172.21.15.60:0/66550691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fbad8009d80 con 0x555eff809360 2024-09-12T00:05:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 10 client.16872 fetch_fsmap learned FSMap version 45 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 1 -- 172.21.15.60:0/66550691 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x555eff897010 con 0x555eff809360 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbacf7fe640 1 -- 172.21.15.60:0/66550691 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbad8016070 con 0x555eff809360 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbacf7fe640 1 -- 172.21.15.60:0/66550691 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 45) ==== 8394+0+0 (secure 0 0 0) 0x7fbad803f730 con 0x555eff809360 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 10 client.16872 fetch_fsmap finished waiting for FSMap version 45 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 20 client.16872 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555eff827bc0 0x555eff899760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 4 client.16872 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.034+0000 7fbaf8a17740 1 -- 172.21.15.60:0/66550691 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555eff775d00 con 0x555eff827bc0 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.035+0000 7fbaeffff640 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555eff827bc0 0x555eff899760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.035+0000 7fbaeffff640 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555eff827bc0 0x555eff899760 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40beec22ea07327b server_cookie=aab896ff4ea2df04 in_seq=0 out_seq=0 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.035+0000 7fbacf7fe640 10 client.16872 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbacf7fe640 1 -- 172.21.15.60:0/66550691 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555eff775d00 con 0x555eff827bc0 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbacf7fe640 10 client.16872 handle_command_reply: tid=0 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 client.16872 shutdown 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 -- 172.21.15.60:0/66550691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 msgr2=0x555eff820130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff820130 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbad8012fd0 tx=0x7fbad8012680 comp rx=0 tx=0).stop 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 -- 172.21.15.60:0/66550691 shutdown_connections 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x555eff827bc0 0x555eff899760 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eff818150 0x555eff820670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555eff809360 0x555eff820130 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 --2- 172.21.15.60:0/66550691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555eff808a40 0x555eff812c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbacf7fe640 0 client.16872 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.036+0000 7fbaf8a17740 1 -- 172.21.15.60:0/66550691 >> 172.21.15.60:0/66550691 conn(0x555eff8050f0 msgr2=0x555eff80a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf8a17740 1 -- 172.21.15.60:0/66550691 shutdown_connections 2024-09-12T00:05:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf8a17740 1 -- 172.21.15.60:0/66550691 wait complete. 2024-09-12T00:05:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf8a17740 20 client.16872 trim_cache size 0 max 16384 2024-09-12T00:05:12.048 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:05:12.048 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:05:12.049 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "4e806ff1-6f60-4886-9330-12a5b88f0c39", 2024-09-12T00:05:12.049 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:05:12.049 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:05:12.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 -- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbadc0a2cf0 msgr2=0x7fbadc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbadc0a2cf0 0x7fbadc0a51b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbaf010e9d0 tx=0x7fbad8005f90 comp rx=0 tx=0).stop 2024-09-12T00:05:12.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 -- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0102d40 msgr2=0x7fbaf0198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0102d40 0x7fbaf0198580 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbae000b4a0 tx=0x7fbae000b960 comp rx=0 tx=0).stop 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 -- 172.21.15.60:0/1134728676 shutdown_connections 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbadc0a2cf0 0x7fbadc0a51b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf010c170 0x7fbaf019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaf0103660 0x7fbaf0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 --2- 172.21.15.60:0/1134728676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0102d40 0x7fbaf0198580 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 -- 172.21.15.60:0/1134728676 >> 172.21.15.60:0/1134728676 conn(0x7fbaf00fc7a0 msgr2=0x7fbaf00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 -- 172.21.15.60:0/1134728676 shutdown_connections 2024-09-12T00:05:12.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:12.037+0000 7fbaf663e640 1 -- 172.21.15.60:0/1134728676 wait complete. 2024-09-12T00:05:12.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:12 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:12.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:12 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:12.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:12 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:12.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:05:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:13.481 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:13 smithi060 ceph-mon[30953]: pgmap v178: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:05:13.481 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:13 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:05:13.481 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:13 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:13.481 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:13 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:05:13.481 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:13 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 -- 172.21.15.60:0/2113340055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324101de0 msgr2=0x7f13241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 --2- 172.21.15.60:0/2113340055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324101de0 0x7f13241021c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1320009900 tx=0x7f132002a410 comp rx=0 tx=0).stop 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 -- 172.21.15.60:0/2113340055 shutdown_connections 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 --2- 172.21.15.60:0/2113340055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1324106f10 0x7f132410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 --2- 172.21.15.60:0/2113340055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1324102790 0x7f13241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 --2- 172.21.15.60:0/2113340055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324101de0 0x7f13241021c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 -- 172.21.15.60:0/2113340055 >> 172.21.15.60:0/2113340055 conn(0x7f13240fd8c0 msgr2=0x7f13240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 -- 172.21.15.60:0/2113340055 shutdown_connections 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 -- 172.21.15.60:0/2113340055 wait complete. 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 Processor -- start 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 -- start start 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1324101de0 0x7f13241984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1324102790 0x7f1324198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.566+0000 7f132c1ec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324106f10 0x7f132419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132c1ec640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13241120d0 con 0x7f1324106f10 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132c1ec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1324111f50 con 0x7f1324102790 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132c1ec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1324112250 con 0x7f1324101de0 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324106f10 0x7f132419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324106f10 0x7f132419cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56718/0 (socket says 172.21.15.60:56718) 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 -- 172.21.15.60:0/3933898871 learned_addr learned my addr 172.21.15.60:0/3933898871 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f1329787640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1324102790 0x7f1324198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f1329f88640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1324101de0 0x7f13241984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 -- 172.21.15.60:0/3933898871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1324101de0 msgr2=0x7f13241984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1324101de0 0x7f13241984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 -- 172.21.15.60:0/3933898871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1324102790 msgr2=0x7f1324198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1324102790 0x7f1324198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 -- 172.21.15.60:0/3933898871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132419d4a0 con 0x7f1324106f10 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132a789640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324106f10 0x7f132419cdc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f131c00cce0 tx=0x7f131c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f131affd640 1 -- 172.21.15.60:0/3933898871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c00f450 con 0x7f1324106f10 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f131affd640 1 -- 172.21.15.60:0/3933898871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f131c00faf0 con 0x7f1324106f10 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132c1ec640 1 -- 172.21.15.60:0/3933898871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132419d790 con 0x7f1324106f10 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f131affd640 1 -- 172.21.15.60:0/3933898871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c018c50 con 0x7f1324106f10 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.567+0000 7f132c1ec640 1 -- 172.21.15.60:0/3933898871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13241a5070 con 0x7f1324106f10 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f131affd640 1 -- 172.21.15.60:0/3933898871 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f131c00fca0 con 0x7f1324106f10 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f132e5c5740 1 Processor -- start 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f132e5c5740 1 -- start start 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424124760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424133550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424135e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f132e5c5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d42408a2e0 con 0x55d424124ca0 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f132e5c5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d424031ce0 con 0x55d424133a90 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f132e5c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d4240862a0 con 0x55d424124380 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f1329f88640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424133550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f1329f88640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424133550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56734/0 (socket says 172.21.15.60:56734) 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.570+0000 7f1329f88640 1 -- 172.21.15.60:0/3848354091 learned_addr learned my addr 172.21.15.60:0/3848354091 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329787640 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424124760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f131affd640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13100a2cf0 0x7f13100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329787640 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424135e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329f88640 1 -- 172.21.15.60:0/3848354091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 msgr2=0x55d424124760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329f88640 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424124760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329f88640 1 -- 172.21.15.60:0/3848354091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 msgr2=0x55d424135e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329f88640 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424135e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329f88640 1 -- 172.21.15.60:0/3848354091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d424016440 con 0x55d424124ca0 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f132a789640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13100a2cf0 0x7f13100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329787640 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424124760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f131affd640 1 -- 172.21.15.60:0/3933898871 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f131c0cfa80 con 0x7f1324106f10 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f1329f88640 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424133550 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1320009900 tx=0x7f1320031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b5459029028962 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f130ffff640 1 -- 172.21.15.60:0/3848354091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132003f070 con 0x55d424124ca0 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f132a789640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13100a2cf0 0x7f13100a51b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f131c0a4730 tx=0x7f131c0186f0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f130ffff640 1 -- 172.21.15.60:0/3848354091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1320031a30 con 0x55d424124ca0 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.571+0000 7f130ffff640 1 -- 172.21.15.60:0/3848354091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1320035070 con 0x55d424124ca0 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 -- 172.21.15.60:0/3848354091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 msgr2=0x55d424133550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424133550 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1320009900 tx=0x7f1320031640 comp rx=0 tx=0).stop 2024-09-12T00:05:13.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 -- 172.21.15.60:0/3848354091 shutdown_connections 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424135e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424133550 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3848354091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424124760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 -- 172.21.15.60:0/3848354091 >> 172.21.15.60:0/3848354091 conn(0x55d424120a30 msgr2=0x55d424120e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 -- 172.21.15.60:0/3848354091 shutdown_connections 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 -- 172.21.15.60:0/3848354091 wait complete. 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.572+0000 7f132e5c5740 1 -- start start 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f132e5c5740 1 Processor -- start 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d424133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124ca0 0x55d424130650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424130b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f132e5c5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d424136660 con 0x55d424124380 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f132e5c5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d424045050 con 0x55d424133a90 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f132e5c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d4241367e0 con 0x55d424124ca0 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f132e5c5740 10 client.0 _ll_register_callbacks cb 0x55d424085160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f1329787640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d424133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f1329787640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d424133350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56736/0 (socket says 172.21.15.60:56736) 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f1329787640 1 -- 172.21.15.60:0/3829747937 learned_addr learned my addr 172.21.15.60:0/3829747937 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f1329f88640 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124ca0 0x55d424130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f1329787640 1 -- 172.21.15.60:0/3829747937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124ca0 msgr2=0x55d424130650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f1329787640 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124ca0 0x55d424130650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f1329787640 1 -- 172.21.15.60:0/3829747937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 msgr2=0x55d424130b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.573+0000 7f1329787640 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424130b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f1329787640 1 -- 172.21.15.60:0/3829747937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d423dfb3c0 con 0x55d424124380 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f1329787640 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d424133350 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1314015360 tx=0x7f1314015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97727ace5bf19215 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f130d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f130d7fa640 1 -- 172.21.15.60:0/3829747937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131401b070 con 0x55d424124380 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f130d7fa640 1 -- 172.21.15.60:0/3829747937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1314013760 con 0x55d424124380 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f132e5c5740 1 -- 172.21.15.60:0/3829747937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1320031a30 con 0x55d424124380 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f130d7fa640 1 -- 172.21.15.60:0/3829747937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1314027050 con 0x55d424124380 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f132e5c5740 10 client.16884 fetch_fsmap learned FSMap version 45 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f132e5c5740 1 -- 172.21.15.60:0/3829747937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55d4241420d0 con 0x55d424124380 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f130d7fa640 1 -- 172.21.15.60:0/3829747937 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1320031a30 con 0x55d424124380 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.574+0000 7f130d7fa640 1 -- 172.21.15.60:0/3829747937 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 45) ==== 8394+0+0 (secure 0 0 0) 0x7f1314017b70 con 0x55d424124380 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f132e5c5740 10 client.16884 fetch_fsmap finished waiting for FSMap version 45 2024-09-12T00:05:13.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f132e5c5740 10 client.16884 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f132e5c5740 20 client.16884 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d4241434e0 0x55d424145980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f132e5c5740 4 client.16884 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f132e5c5740 1 -- 172.21.15.60:0/3829747937 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d424097850 con 0x55d4241434e0 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f1329f88640 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d4241434e0 0x55d424145980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f130d7fa640 10 client.16884 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.575+0000 7f1329f88640 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d4241434e0 0x55d424145980 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcd8813de0bbeb6a server_cookie=5012713d15484b5d in_seq=0 out_seq=0 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f130d7fa640 1 -- 172.21.15.60:0/3829747937 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d424097850 con 0x55d4241434e0 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f130d7fa640 10 client.16884 handle_command_reply: tid=0 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 client.16884 shutdown 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 -- 172.21.15.60:0/3829747937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 msgr2=0x55d424133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d424133350 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1314015360 tx=0x7f1314015820 comp rx=0 tx=0).stop 2024-09-12T00:05:13.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 -- 172.21.15.60:0/3829747937 shutdown_connections 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d4241434e0 0x55d424145980 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424130b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124ca0 0x55d424130650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 --2- 172.21.15.60:0/3829747937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d424133350 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f130d7fa640 0 client.16884 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 -- 172.21.15.60:0/3829747937 >> 172.21.15.60:0/3829747937 conn(0x55d424120a30 msgr2=0x55d424126790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 -- 172.21.15.60:0/3829747937 shutdown_connections 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 1 -- 172.21.15.60:0/3829747937 wait complete. 2024-09-12T00:05:13.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.576+0000 7f132e5c5740 20 client.16884 trim_cache size 0 max 16384 2024-09-12T00:05:13.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f132e5c5740 1 Processor -- start 2024-09-12T00:05:13.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f132e5c5740 1 -- start start 2024-09-12T00:05:13.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d42413f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424124ca0 0x55d42414b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424133a90 0x55d42414b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f132e5c5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13241ab4c0 con 0x55d424124380 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f132e5c5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13241ad150 con 0x55d424124ca0 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f132e5c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13241abbc0 con 0x55d424133a90 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d42413f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d42413f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56738/0 (socket says 172.21.15.60:56738) 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 -- 172.21.15.60:0/1804374876 learned_addr learned my addr 172.21.15.60:0/1804374876 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329f88640 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424124ca0 0x55d42414b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 -- 172.21.15.60:0/1804374876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424133a90 msgr2=0x55d42414b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424133a90 0x55d42414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 -- 172.21.15.60:0/1804374876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424124ca0 msgr2=0x55d42414b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424124ca0 0x55d42414b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 -- 172.21.15.60:0/1804374876 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d424123c70 con 0x55d424124380 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329f88640 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424124ca0 0x55d42414b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:13.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.594+0000 7f1329787640 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d42413f900 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1314019040 tx=0x7f1314006e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481bef2523746042 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f130f7fe640 1 -- 172.21.15.60:0/1804374876 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314030070 con 0x55d424124380 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f130f7fe640 1 -- 172.21.15.60:0/1804374876 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1314016740 con 0x55d424124380 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f130f7fe640 1 -- 172.21.15.60:0/1804374876 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131401b040 con 0x55d424124380 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 -- 172.21.15.60:0/1804374876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 msgr2=0x55d42413f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d42413f900 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1314019040 tx=0x7f1314006e60 comp rx=0 tx=0).stop 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 -- 172.21.15.60:0/1804374876 shutdown_connections 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424133a90 0x55d42414b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424124ca0 0x55d42414b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 --2- 172.21.15.60:0/1804374876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124380 0x55d42413f900 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 -- 172.21.15.60:0/1804374876 >> 172.21.15.60:0/1804374876 conn(0x55d424120a30 msgr2=0x55d42412bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 -- 172.21.15.60:0/1804374876 shutdown_connections 2024-09-12T00:05:13.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.595+0000 7f132e5c5740 1 -- 172.21.15.60:0/1804374876 wait complete. 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 1 -- start start 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 1 Processor -- start 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424137710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424137c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13241ac9c0 con 0x55d424124ca0 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13241ac2c0 con 0x55d424133a90 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13241a94c0 con 0x55d424124380 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f132e5c5740 10 client.0 _ll_register_callbacks cb 0x7f13140097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f1329f88640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f1329f88640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424137c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56750/0 (socket says 172.21.15.60:56750) 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f1329f88640 1 -- 172.21.15.60:0/2605058161 learned_addr learned my addr 172.21.15.60:0/2605058161 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:13.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.596+0000 7f1329787640 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f1329787640 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f1329f88640 1 -- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 msgr2=0x55d424137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f1329f88640 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424137710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f1329f88640 1 -- 172.21.15.60:0/2605058161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 msgr2=0x55d424138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f1329f88640 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f1329f88640 1 -- 172.21.15.60:0/2605058161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4241ad220 con 0x55d424124ca0 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f1329787640 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f1329f88640 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424137c50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1320005790 tx=0x7f1320005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756306649ae70734 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f130d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f130d7fa640 1 -- 172.21.15.60:0/2605058161 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132003f040 con 0x55d424124ca0 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f130d7fa640 1 -- 172.21.15.60:0/2605058161 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f1320004340 con 0x55d424124ca0 2024-09-12T00:05:13.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f132e5c5740 1 -- 172.21.15.60:0/2605058161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1314016740 con 0x55d424124ca0 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f130d7fa640 1 -- 172.21.15.60:0/2605058161 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f132005a050 con 0x55d424124ca0 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f132e5c5740 10 client.16890 fetch_fsmap learned FSMap version 45 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f132e5c5740 1 -- 172.21.15.60:0/2605058161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55d4241ae410 con 0x55d424124ca0 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.597+0000 7f130d7fa640 1 -- 172.21.15.60:0/2605058161 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1314016740 con 0x55d424124ca0 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f130d7fa640 1 -- 172.21.15.60:0/2605058161 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 45) ==== 8394+0+0 (secure 0 0 0) 0x7f132004c480 con 0x55d424124ca0 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f132e5c5740 10 client.16890 fetch_fsmap finished waiting for FSMap version 45 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f132e5c5740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f132e5c5740 20 client.16890 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f132e5c5740 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d4241ae8c0 0x55d4241b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f132e5c5740 4 client.16890 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f132e5c5740 1 -- 172.21.15.60:0/2605058161 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d424091d60 con 0x55d4241ae8c0 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f1329787640 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d4241ae8c0 0x55d4241b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:13.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f1329787640 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d4241ae8c0 0x55d4241b0ce0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afb958b723fc0b56 server_cookie=be5fd685127d238f in_seq=0 out_seq=0 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.598+0000 7f130d7fa640 10 client.16890 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f130d7fa640 1 -- 172.21.15.60:0/2605058161 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d424091d60 con 0x55d4241ae8c0 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f130d7fa640 10 client.16890 handle_command_reply: tid=0 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 client.16890 shutdown 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 -- 172.21.15.60:0/2605058161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 msgr2=0x55d424137c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424137c50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1320005790 tx=0x7f1320005fd0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 -- 172.21.15.60:0/2605058161 shutdown_connections 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d4241ae8c0 0x55d4241b0ce0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d424133a90 0x55d424138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d424124ca0 0x55d424137c50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 --2- 172.21.15.60:0/2605058161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d424124380 0x55d424137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f130d7fa640 0 client.16890 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:13.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 -- 172.21.15.60:0/2605058161 >> 172.21.15.60:0/2605058161 conn(0x55d424120a30 msgr2=0x55d42411f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 -- 172.21.15.60:0/2605058161 shutdown_connections 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 1 -- 172.21.15.60:0/2605058161 wait complete. 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132e5c5740 20 client.16890 trim_cache size 0 max 16384 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stdout: "4e806ff1-6f60-4886-9330-12a5b88f0c39": { 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:05:13.612 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "4e806ff1-6f60-4886-9330-12a5b88f0c39", 2024-09-12T00:05:13.613 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:05:13.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:05:13.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:05:13.613 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:05:13.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132c1ec640 1 -- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13100a2cf0 msgr2=0x7f13100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132c1ec640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13100a2cf0 0x7f13100a51b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f131c0a4730 tx=0x7f131c0186f0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132c1ec640 1 -- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324106f10 msgr2=0x7f132419cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.599+0000 7f132c1ec640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324106f10 0x7f132419cdc0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f131c00cce0 tx=0x7f131c00a620 comp rx=0 tx=0).stop 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.600+0000 7f132c1ec640 1 -- 172.21.15.60:0/3933898871 shutdown_connections 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.600+0000 7f132c1ec640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f13100a2cf0 0x7f13100a51b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.600+0000 7f132c1ec640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1324106f10 0x7f132419cdc0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.600+0000 7f132c1ec640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1324102790 0x7f1324198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.600+0000 7f132c1ec640 1 --2- 172.21.15.60:0/3933898871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1324101de0 0x7f13241984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.600+0000 7f132c1ec640 1 -- 172.21.15.60:0/3933898871 >> 172.21.15.60:0/3933898871 conn(0x7f13240fd8c0 msgr2=0x7f13240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.600+0000 7f132c1ec640 1 -- 172.21.15.60:0/3933898871 shutdown_connections 2024-09-12T00:05:13.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:13.600+0000 7f132c1ec640 1 -- 172.21.15.60:0/3933898871 wait complete. 2024-09-12T00:05:13.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:13 smithi105 ceph-mon[34805]: pgmap v178: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:05:13.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:13 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:05:13.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:13 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:13.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:13 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:05:13.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:13 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:13.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:13 smithi192 ceph-mon[35487]: pgmap v178: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T00:05:13.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:13 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:05:13.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:13 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:13.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:13 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:05:13.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:13 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:14.379 INFO:tasks.cephfs.filesystem:scrub status for tag:4e806ff1-6f60-4886-9330-12a5b88f0c39 - {'path': '/', 'tag': '4e806ff1-6f60-4886-9330-12a5b88f0c39', 'options': 'recursive,force'} 2024-09-12T00:05:14.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:14 smithi060 ceph-mon[30953]: pgmap v179: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:05:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:14 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:05:14.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:14 smithi105 ceph-mon[34805]: pgmap v179: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:05:14.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:14 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:05:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:14 smithi192 ceph-mon[35487]: pgmap v179: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T00:05:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:14 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:05:16.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:16 smithi060 ceph-mon[30953]: pgmap v180: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T00:05:16.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:16 smithi105 ceph-mon[34805]: pgmap v180: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T00:05:17.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:16 smithi192 ceph-mon[35487]: pgmap v180: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T00:05:18.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:18 smithi060 ceph-mon[30953]: pgmap v181: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-12T00:05:18.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:18 smithi105 ceph-mon[34805]: pgmap v181: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-12T00:05:19.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:18 smithi192 ceph-mon[35487]: pgmap v181: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-12T00:05:20.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:20 smithi060 ceph-mon[30953]: pgmap v182: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-12T00:05:20.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:20 smithi105 ceph-mon[34805]: pgmap v182: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-12T00:05:21.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:20 smithi192 ceph-mon[35487]: pgmap v182: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-12T00:05:22.836 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:22 smithi192 ceph-mon[35487]: pgmap v183: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:05:22.836 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:22 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:22.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:22 smithi060 ceph-mon[30953]: pgmap v183: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:05:22.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:22 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:22.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:22 smithi105 ceph-mon[34805]: pgmap v183: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T00:05:22.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:22 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:24.841 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:24 smithi060 ceph-mon[30953]: pgmap v184: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:05:24.841 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:24 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:24.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:24 smithi105 ceph-mon[34805]: pgmap v184: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:05:24.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:24 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:25.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:24 smithi192 ceph-mon[35487]: pgmap v184: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T00:05:25.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:24 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:25.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:25 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:25.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:25 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:26.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:25 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:26.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:26 smithi060 ceph-mon[30953]: pgmap v185: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:26.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:26 smithi105 ceph-mon[34805]: pgmap v185: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:27.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:26 smithi192 ceph-mon[35487]: pgmap v185: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:28.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:28 smithi060 ceph-mon[30953]: pgmap v186: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T00:05:28.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:28 smithi105 ceph-mon[34805]: pgmap v186: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T00:05:29.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:28 smithi192 ceph-mon[35487]: pgmap v186: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-12T00:05:30.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:30 smithi105 ceph-mon[34805]: pgmap v187: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:05:30.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:30 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:31.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:30 smithi192 ceph-mon[35487]: pgmap v187: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:05:31.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:30 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:31.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:30 smithi060 ceph-mon[30953]: pgmap v187: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:05:31.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:30 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:32 smithi105 ceph-mon[34805]: pgmap v188: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:32.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:32 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:33.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:32 smithi192 ceph-mon[35487]: pgmap v188: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:33.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:32 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:33.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:32 smithi060 ceph-mon[30953]: pgmap v188: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:33.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:32 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:34.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:34 smithi105 ceph-mon[34805]: pgmap v189: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:34.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:05:34.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:05:34.980 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:05:34.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:05:35.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:34 smithi192 ceph-mon[35487]: pgmap v189: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:35.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:05:35.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:05:35.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:05:35.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:05:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:34 smithi060 ceph-mon[30953]: pgmap v189: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:05:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:05:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:05:35.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:05:35.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:35 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:36.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:35 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:36.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:35 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:36.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:36 smithi105 ceph-mon[34805]: pgmap v190: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:37.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:36 smithi192 ceph-mon[35487]: pgmap v190: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:37.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:36 smithi060 ceph-mon[30953]: pgmap v190: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:38.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:38 smithi105 ceph-mon[34805]: pgmap v191: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T00:05:39.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:38 smithi192 ceph-mon[35487]: pgmap v191: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T00:05:39.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:38 smithi060 ceph-mon[30953]: pgmap v191: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T00:05:40.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:40 smithi105 ceph-mon[34805]: pgmap v192: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T00:05:41.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:40 smithi192 ceph-mon[35487]: pgmap v192: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T00:05:41.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:40 smithi060 ceph-mon[30953]: pgmap v192: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-12T00:05:42.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:42 smithi105 ceph-mon[34805]: pgmap v193: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:05:43.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:42 smithi192 ceph-mon[35487]: pgmap v193: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:05:43.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:42 smithi060 ceph-mon[30953]: pgmap v193: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:05:44.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:05:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:44.779 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:44 smithi060 ceph-mon[30953]: pgmap v194: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:44.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:44 smithi105 ceph-mon[34805]: pgmap v194: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:45.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:44 smithi192 ceph-mon[35487]: pgmap v194: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 -- 172.21.15.60:0/3012867869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 msgr2=0x7f2c00074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 --2- 172.21.15.60:0/3012867869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 0x7f2c00074a00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009900 tx=0x7f2bf002a480 comp rx=0 tx=0).stop 2024-09-12T00:05:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 -- 172.21.15.60:0/3012867869 shutdown_connections 2024-09-12T00:05:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 --2- 172.21.15.60:0/3012867869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c0010e3c0 0x7f2c00110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 --2- 172.21.15.60:0/3012867869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c00074f40 0x7f2c0010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 --2- 172.21.15.60:0/3012867869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 0x7f2c00074a00 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 -- 172.21.15.60:0/3012867869 >> 172.21.15.60:0/3012867869 conn(0x7f2c000fd8c0 msgr2=0x7f2c000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 -- 172.21.15.60:0/3012867869 shutdown_connections 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.253+0000 7f2c05148640 1 -- 172.21.15.60:0/3012867869 wait complete. 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.254+0000 7f2c05148640 1 Processor -- start 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.254+0000 7f2c05148640 1 -- start start 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.254+0000 7f2c05148640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 0x7f2c0019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2c05148640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00074f40 0x7f2c0019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2c05148640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0010e3c0 0x7f2c0019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2c05148640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2c001142f0 con 0x7f2c00074620 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2c05148640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00114170 con 0x7f2c0010e3c0 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2c05148640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00114470 con 0x7f2c00074f40 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 0x7f2c0019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 0x7f2c0019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37478/0 (socket says 172.21.15.60:37478) 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 -- 172.21.15.60:0/4138946129 learned_addr learned my addr 172.21.15.60:0/4138946129 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bff59e640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0010e3c0 0x7f2c0019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00074f40 0x7f2c0019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 -- 172.21.15.60:0/4138946129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00074f40 msgr2=0x7f2c0019ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00074f40 0x7f2c0019ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 -- 172.21.15.60:0/4138946129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0010e3c0 msgr2=0x7f2c0019dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0010e3c0 0x7f2c0019dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 -- 172.21.15.60:0/4138946129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0019e720 con 0x7f2c00074620 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 0x7f2c0019a7d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006010 tx=0x7f2bf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2be7fff640 1 -- 172.21.15.60:0/4138946129 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf003f030 con 0x7f2c00074620 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2c05148640 1 -- 172.21.15.60:0/4138946129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0019e9b0 con 0x7f2c00074620 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2be7fff640 1 -- 172.21.15.60:0/4138946129 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2bf0003d00 con 0x7f2c00074620 2024-09-12T00:05:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2be7fff640 1 -- 172.21.15.60:0/4138946129 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0035070 con 0x7f2c00074620 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.255+0000 7f2c05148640 1 -- 172.21.15.60:0/4138946129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c001a7380 con 0x7f2c00074620 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2be7fff640 1 -- 172.21.15.60:0/4138946129 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2bf0042030 con 0x7f2c00074620 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2c07521740 1 Processor -- start 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2c07521740 1 -- start start 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2c07521740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 0x559c9a9a6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2c07521740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 0x559c9a9b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2c07521740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2c07521740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559c9a90c2e0 con 0x559c9a9b1680 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2c07521740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559c9a8b3ce0 con 0x559c9a9a6dc0 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.258+0000 7f2c07521740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559c9a9082a0 con 0x559c9a9a64a0 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfe59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfe59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37494/0 (socket says 172.21.15.60:37494) 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfe59c640 1 -- 172.21.15.60:0/1327192945 learned_addr learned my addr 172.21.15.60:0/1327192945 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bff59e640 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 0x559c9a9a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 0x559c9a9b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfe59c640 1 -- 172.21.15.60:0/1327192945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 msgr2=0x559c9a9a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 0x559c9a9a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfe59c640 1 -- 172.21.15.60:0/1327192945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 msgr2=0x559c9a9b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 0x559c9a9b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bfe59c640 1 -- 172.21.15.60:0/1327192945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c9a898440 con 0x559c9a9b1680 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2be7fff640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2be80a2cf0 0x7f2be80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2bff59e640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2be80a2cf0 0x7f2be80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.259+0000 7f2be7fff640 1 -- 172.21.15.60:0/4138946129 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2bf00efb00 con 0x7f2c00074620 2024-09-12T00:05:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.260+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9b3a70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009b10 tx=0x7f2bf400e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be6f9cb629807a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.260+0000 7f2bff59e640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2be80a2cf0 0x7f2be80a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800b4d0 tx=0x7f2bf800e040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.260+0000 7f2be57fa640 1 -- 172.21.15.60:0/1327192945 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4016070 con 0x559c9a9b1680 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.260+0000 7f2be57fa640 1 -- 172.21.15.60:0/1327192945 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2bf4005520 con 0x559c9a9b1680 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.260+0000 7f2be57fa640 1 -- 172.21.15.60:0/1327192945 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4011470 con 0x559c9a9b1680 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 -- 172.21.15.60:0/1327192945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 msgr2=0x559c9a9b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9b3a70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009b10 tx=0x7f2bf400e2f0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 -- 172.21.15.60:0/1327192945 shutdown_connections 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9b3a70 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 0x559c9a9b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 --2- 172.21.15.60:0/1327192945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 0x559c9a9a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 -- 172.21.15.60:0/1327192945 >> 172.21.15.60:0/1327192945 conn(0x559c9a9a2a30 msgr2=0x559c9a9a2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 -- 172.21.15.60:0/1327192945 shutdown_connections 2024-09-12T00:05:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 -- 172.21.15.60:0/1327192945 wait complete. 2024-09-12T00:05:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 -- start start 2024-09-12T00:05:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.261+0000 7f2c07521740 1 Processor -- start 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2c07521740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2c07521740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 0x559c9a9ae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2c07521740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 0x559c9a9ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2c07521740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559c9a9b4250 con 0x559c9a9a64a0 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2c07521740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559c9a8c7050 con 0x559c9a9b1680 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2c07521740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559c9a9b43d0 con 0x559c9a9a6dc0 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2c07521740 10 client.0 _ll_register_callbacks cb 0x559c9a907160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37498/0 (socket says 172.21.15.60:37498) 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 -- 172.21.15.60:0/2814254496 learned_addr learned my addr 172.21.15.60:0/2814254496 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bff59e640 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 0x559c9a9ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 0x559c9a9ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 -- 172.21.15.60:0/2814254496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 msgr2=0x559c9a9ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 0x559c9a9ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 -- 172.21.15.60:0/2814254496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 msgr2=0x559c9a9ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 0x559c9a9ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 -- 172.21.15.60:0/2814254496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c9a67d3c0 con 0x559c9a9a64a0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b0ec0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00ed8a0 tx=0x7f2bf0005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75d207e4891cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2be2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2be2ff5640 1 -- 172.21.15.60:0/2814254496 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0049070 con 0x559c9a9a64a0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2be2ff5640 1 -- 172.21.15.60:0/2814254496 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2bf00ba430 con 0x559c9a9a64a0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.262+0000 7f2c07521740 1 -- 172.21.15.60:0/2814254496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bf4005520 con 0x559c9a9a64a0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2be2ff5640 1 -- 172.21.15.60:0/2814254496 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2bf00b83d0 con 0x559c9a9a64a0 2024-09-12T00:05:45.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2c07521740 10 client.16902 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2c07521740 1 -- 172.21.15.60:0/2814254496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559c9a9bfb40 con 0x559c9a9a64a0 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2be2ff5640 1 -- 172.21.15.60:0/2814254496 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2bf4005520 con 0x559c9a9a64a0 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2be2ff5640 1 -- 172.21.15.60:0/2814254496 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f2bf00d7080 con 0x559c9a9a64a0 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2c07521740 10 client.16902 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2c07521740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2c07521740 20 client.16902 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2c07521740 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c9a9c0e90 0x559c9a9c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2c07521740 4 client.16902 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2c07521740 1 -- 172.21.15.60:0/2814254496 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c9a919850 con 0x559c9a9c0e90 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.263+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c9a9c0e90 0x559c9a9c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.264+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c9a9c0e90 0x559c9a9c32a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fadf3378bc2a40 server_cookie=eac597e3f9db56dc in_seq=0 out_seq=0 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.264+0000 7f2be2ff5640 10 client.16902 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:45.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.264+0000 7f2be2ff5640 1 -- 172.21.15.60:0/2814254496 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c9a919850 con 0x559c9a9c0e90 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.264+0000 7f2be2ff5640 10 client.16902 handle_command_reply: tid=0 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.264+0000 7f2c07521740 1 client.16902 shutdown 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 -- 172.21.15.60:0/2814254496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 msgr2=0x559c9a9b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b0ec0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00ed8a0 tx=0x7f2bf0005c90 comp rx=0 tx=0).stop 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 -- 172.21.15.60:0/2814254496 shutdown_connections 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c9a9c0e90 0x559c9a9c32a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 0x559c9a9ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 0x559c9a9ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2be2ff5640 0 client.16902 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 --2- 172.21.15.60:0/2814254496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b0ec0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 -- 172.21.15.60:0/2814254496 >> 172.21.15.60:0/2814254496 conn(0x559c9a9a2a30 msgr2=0x559c9a9a8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 -- 172.21.15.60:0/2814254496 shutdown_connections 2024-09-12T00:05:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 1 -- 172.21.15.60:0/2814254496 wait complete. 2024-09-12T00:05:45.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.265+0000 7f2c07521740 20 client.16902 trim_cache size 0 max 16384 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2c07521740 1 Processor -- start 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2c07521740 1 -- start start 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2c07521740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 0x559c9a9a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2c07521740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 0x559c9a9c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2c07521740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2c07521740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2c001afa70 con 0x559c9a9b1680 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2c07521740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c001b15b0 con 0x559c9a9a6dc0 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2c07521740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c001b0140 con 0x559c9a9a64a0 2024-09-12T00:05:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2bff59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2bff59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37500/0 (socket says 172.21.15.60:37500) 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.282+0000 7f2bff59e640 1 -- 172.21.15.60:0/1932012860 learned_addr learned my addr 172.21.15.60:0/1932012860 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 0x559c9a9a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 0x559c9a9c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2bff59e640 1 -- 172.21.15.60:0/1932012860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 msgr2=0x559c9a9a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2bff59e640 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 0x559c9a9a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2bff59e640 1 -- 172.21.15.60:0/1932012860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 msgr2=0x559c9a9c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2bff59e640 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 0x559c9a9c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2bff59e640 1 -- 172.21.15.60:0/1932012860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c9a9a2860 con 0x559c9a9b1680 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2bff59e640 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9c9080 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8018970 tx=0x7f2bf8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ad0322f49f33b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2be4ff9640 1 -- 172.21.15.60:0/1932012860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8015ce0 con 0x559c9a9b1680 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2be4ff9640 1 -- 172.21.15.60:0/1932012860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2bf802a070 con 0x559c9a9b1680 2024-09-12T00:05:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.283+0000 7f2be4ff9640 1 -- 172.21.15.60:0/1932012860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8023930 con 0x559c9a9b1680 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- 172.21.15.60:0/1932012860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 msgr2=0x559c9a9c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9c9080 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8018970 tx=0x7f2bf8013000 comp rx=0 tx=0).stop 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- 172.21.15.60:0/1932012860 shutdown_connections 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9b1680 0x559c9a9c9080 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9a6dc0 0x559c9a9c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 --2- 172.21.15.60:0/1932012860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a64a0 0x559c9a9a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- 172.21.15.60:0/1932012860 >> 172.21.15.60:0/1932012860 conn(0x559c9a9a2a30 msgr2=0x559c9a9a1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- 172.21.15.60:0/1932012860 shutdown_connections 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- 172.21.15.60:0/1932012860 wait complete. 2024-09-12T00:05:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- start start 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 Processor -- start 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 0x559c9a9b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 0x559c9a9b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2c001b0ee0 con 0x559c9a9a64a0 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c001b0810 con 0x559c9a9b1680 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.284+0000 7f2c07521740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c001ada50 con 0x559c9a9a6dc0 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2c07521740 10 client.0 _ll_register_callbacks cb 0x7f2bf0032bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37516/0 (socket says 172.21.15.60:37516) 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 -- 172.21.15.60:0/67894190 learned_addr learned my addr 172.21.15.60:0/67894190 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bff59e640 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 0x559c9a9b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 0x559c9a9b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 -- 172.21.15.60:0/67894190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 msgr2=0x559c9a9b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 0x559c9a9b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 -- 172.21.15.60:0/67894190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 msgr2=0x559c9a9b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 0x559c9a9b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 -- 172.21.15.60:0/67894190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c9aa2ab10 con 0x559c9a9a64a0 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2bfed9d640 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b52c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005940 tx=0x7f2bf00ba640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25eddd1caee829f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2be2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2be2ff5640 1 -- 172.21.15.60:0/67894190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0049040 con 0x559c9a9a64a0 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2be2ff5640 1 -- 172.21.15.60:0/67894190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2bf00c4910 con 0x559c9a9a64a0 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2c07521740 1 -- 172.21.15.60:0/67894190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bf802a070 con 0x559c9a9a64a0 2024-09-12T00:05:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2be2ff5640 1 -- 172.21.15.60:0/67894190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2bf00bba90 con 0x559c9a9a64a0 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2c07521740 10 client.16908 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.285+0000 7f2c07521740 1 -- 172.21.15.60:0/67894190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x559c9aa2bd20 con 0x559c9a9a64a0 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2be2ff5640 1 -- 172.21.15.60:0/67894190 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2bf802a070 con 0x559c9a9a64a0 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2be2ff5640 1 -- 172.21.15.60:0/67894190 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f2bf00bb580 con 0x559c9a9a64a0 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2c07521740 10 client.16908 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2c07521740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2c07521740 20 client.16908 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2c07521740 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c9aa2c260 0x559c9aa2e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2c07521740 4 client.16908 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2c07521740 1 -- 172.21.15.60:0/67894190 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559c9a913d60 con 0x559c9aa2c260 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c9aa2c260 0x559c9aa2e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2bfe59c640 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c9aa2c260 0x559c9aa2e650 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d340048852d69223 server_cookie=eb4b800ba65c261 in_seq=0 out_seq=0 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.286+0000 7f2be2ff5640 10 client.16908 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2be2ff5640 1 -- 172.21.15.60:0/67894190 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559c9a913d60 con 0x559c9aa2c260 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2be2ff5640 10 client.16908 handle_command_reply: tid=0 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 client.16908 shutdown 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 -- 172.21.15.60:0/67894190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 msgr2=0x559c9a9b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b52c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005940 tx=0x7f2bf00ba640 comp rx=0 tx=0).stop 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 -- 172.21.15.60:0/67894190 shutdown_connections 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559c9aa2c260 0x559c9aa2e650 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559c9a9b1680 0x559c9a9b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559c9a9a6dc0 0x559c9a9b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 --2- 172.21.15.60:0/67894190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559c9a9a64a0 0x559c9a9b52c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 -- 172.21.15.60:0/67894190 >> 172.21.15.60:0/67894190 conn(0x559c9a9a2a30 msgr2=0x559c9a9a1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2be2ff5640 0 client.16908 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 -- 172.21.15.60:0/67894190 shutdown_connections 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 1 -- 172.21.15.60:0/67894190 wait complete. 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.287+0000 7f2c07521740 20 client.16908 trim_cache size 0 max 16384 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:05:45.293 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 -- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2be80a2cf0 msgr2=0x7f2be80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2be80a2cf0 0x7f2be80a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800b4d0 tx=0x7f2bf800e040 comp rx=0 tx=0).stop 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 -- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 msgr2=0x7f2c0019a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 0x7f2c0019a7d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006010 tx=0x7f2bf00042f0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 -- 172.21.15.60:0/4138946129 shutdown_connections 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2be80a2cf0 0x7f2be80a51b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0010e3c0 0x7f2c0019dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c00074f40 0x7f2c0019ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 --2- 172.21.15.60:0/4138946129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c00074620 0x7f2c0019a7d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 -- 172.21.15.60:0/4138946129 >> 172.21.15.60:0/4138946129 conn(0x7f2c000fd8c0 msgr2=0x7f2c000fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 -- 172.21.15.60:0/4138946129 shutdown_connections 2024-09-12T00:05:45.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:45.288+0000 7f2c05148640 1 -- 172.21.15.60:0/4138946129 wait complete. 2024-09-12T00:05:45.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:45 smithi060 ceph-mon[30953]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:45.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:45 smithi105 ceph-mon[34805]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:46.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:45 smithi192 ceph-mon[35487]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T00:05:46.136 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:05:46.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:05:46.396 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:46.804 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:46 smithi060 ceph-mon[30953]: pgmap v195: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:05:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 -- 172.21.15.60:0/834876403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 msgr2=0x7f7e0010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 --2- 172.21.15.60:0/834876403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 0x7f7e0010bb50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009900 tx=0x7f7df402a480 comp rx=0 tx=0).stop 2024-09-12T00:05:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 -- 172.21.15.60:0/834876403 shutdown_connections 2024-09-12T00:05:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 --2- 172.21.15.60:0/834876403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e0010c170 0x7f7e0010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 --2- 172.21.15.60:0/834876403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 0x7f7e0010bb50 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 --2- 172.21.15.60:0/834876403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e00102d40 0x7f7e00103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 -- 172.21.15.60:0/834876403 >> 172.21.15.60:0/834876403 conn(0x7f7e000fc7a0 msgr2=0x7f7e000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 -- 172.21.15.60:0/834876403 shutdown_connections 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 -- 172.21.15.60:0/834876403 wait complete. 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 Processor -- start 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.888+0000 7f7e0829d640 1 -- start start 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e0829d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e00102d40 0x7f7e001009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e0829d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 0x7f7e00100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e0829d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0010c170 0x7f7e00101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e0829d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7e00112090 con 0x7f7e00103660 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e0829d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e00111f10 con 0x7f7e00102d40 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e0829d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e00112210 con 0x7f7e0010c170 2024-09-12T00:05:46.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 0x7f7e00100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e06039640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e00102d40 0x7f7e001009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 0x7f7e00100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37536/0 (socket says 172.21.15.60:37536) 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e06039640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e00102d40 0x7f7e001009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:41858/0 (socket says 172.21.15.60:41858) 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 -- 172.21.15.60:0/4231905934 learned_addr learned my addr 172.21.15.60:0/4231905934 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e0683a640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0010c170 0x7f7e00101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 -- 172.21.15.60:0/4231905934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0010c170 msgr2=0x7f7e00101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0010c170 0x7f7e00101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 -- 172.21.15.60:0/4231905934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e00102d40 msgr2=0x7f7e001009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e00102d40 0x7f7e001009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 -- 172.21.15.60:0/4231905934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e001a6990 con 0x7f7e00103660 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e06039640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e00102d40 0x7f7e001009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:46.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.889+0000 7f7e05838640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 0x7f7e00100ee0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7df4006010 tx=0x7f7df40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.890+0000 7f7dff7fe640 1 -- 172.21.15.60:0/4231905934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df403f030 con 0x7f7e00103660 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.890+0000 7f7dff7fe640 1 -- 172.21.15.60:0/4231905934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7df40044c0 con 0x7f7e00103660 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.890+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e001a6c20 con 0x7f7e00103660 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.890+0000 7f7dff7fe640 1 -- 172.21.15.60:0/4231905934 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4035070 con 0x7f7e00103660 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.890+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e001a7100 con 0x7f7e00103660 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.891+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e00103120 con 0x7f7e00103660 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.892+0000 7f7dff7fe640 1 -- 172.21.15.60:0/4231905934 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7df4042030 con 0x7f7e00103660 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.893+0000 7f7dff7fe640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7de80a2cf0 0x7f7de80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.893+0000 7f7e06039640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7de80a2cf0 0x7f7de80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.893+0000 7f7dff7fe640 1 -- 172.21.15.60:0/4231905934 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f7df40ef960 con 0x7f7e00103660 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.893+0000 7f7e06039640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7de80a2cf0 0x7f7de80a51b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009fd0 tx=0x7f7df0009680 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:46.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:46.896+0000 7f7dff7fe640 1 -- 172.21.15.60:0/4231905934 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7df40bbf20 con 0x7f7e00103660 2024-09-12T00:05:46.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:46 smithi105 ceph-mon[34805]: pgmap v195: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:05:47.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:46 smithi192 ceph-mon[35487]: pgmap v195: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:05:47.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.108+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e001a72d0 con 0x7f7e00103660 2024-09-12T00:05:47.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.108+0000 7f7dff7fe640 1 -- 172.21.15.60:0/4231905934 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7f7df40c0220 con 0x7f7e00103660 2024-09-12T00:05:47.109 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:05:47.109 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:05:47.109 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:05:47.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.110+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7de80a2cf0 msgr2=0x7f7de80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.110+0000 7f7e0829d640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7de80a2cf0 0x7f7de80a51b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009fd0 tx=0x7f7df0009680 comp rx=0 tx=0).stop 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.110+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 msgr2=0x7f7e00100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.110+0000 7f7e0829d640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 0x7f7e00100ee0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7df4006010 tx=0x7f7df40040c0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.111+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 shutdown_connections 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.111+0000 7f7e0829d640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f7de80a2cf0 0x7f7de80a51b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.111+0000 7f7e0829d640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0010c170 0x7f7e00101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.111+0000 7f7e0829d640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e00103660 0x7f7e00100ee0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.111+0000 7f7e0829d640 1 --2- 172.21.15.60:0/4231905934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e00102d40 0x7f7e001009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.111+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 >> 172.21.15.60:0/4231905934 conn(0x7f7e000fc7a0 msgr2=0x7f7e000fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:47.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.111+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 shutdown_connections 2024-09-12T00:05:47.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:47.111+0000 7f7e0829d640 1 -- 172.21.15.60:0/4231905934 wait complete. 2024-09-12T00:05:47.812 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:47 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4231905934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:05:47.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:05:47.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:47 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4231905934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:05:48.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:47 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4231905934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:05:48.104 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 -- 172.21.15.60:0/3429212572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358106a80 msgr2=0x7f9358106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 --2- 172.21.15.60:0/3429212572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358106a80 0x7f9358106e60 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9348009930 tx=0x7f934802a420 comp rx=0 tx=0).stop 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 -- 172.21.15.60:0/3429212572 shutdown_connections 2024-09-12T00:05:48.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 --2- 172.21.15.60:0/3429212572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9358101420 0x7f935810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 --2- 172.21.15.60:0/3429212572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9358100a80 0x7f9358100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 --2- 172.21.15.60:0/3429212572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358106a80 0x7f9358106e60 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 -- 172.21.15.60:0/3429212572 >> 172.21.15.60:0/3429212572 conn(0x7f93580fc7a0 msgr2=0x7f93580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 -- 172.21.15.60:0/3429212572 shutdown_connections 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.599+0000 7f935d3a5640 1 -- 172.21.15.60:0/3429212572 wait complete. 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f935d3a5640 1 Processor -- start 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f935d3a5640 1 -- start start 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f935d3a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9358100a80 0x7f93581984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f935d3a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358101420 0x7f9358198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f935d3a5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9358106a80 0x7f935819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f935d3a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93581120c0 con 0x7f9358101420 2024-09-12T00:05:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f935d3a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9358111f40 con 0x7f9358100a80 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f935d3a5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9358112240 con 0x7f9358106a80 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f934ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358101420 0x7f9358198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f934ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358101420 0x7f9358198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37556/0 (socket says 172.21.15.60:37556) 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f934ffff640 1 -- 172.21.15.60:0/2259327448 learned_addr learned my addr 172.21.15.60:0/2259327448 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f93577fe640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9358106a80 0x7f935819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.600+0000 7f9356ffd640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9358100a80 0x7f93581984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f934ffff640 1 -- 172.21.15.60:0/2259327448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9358106a80 msgr2=0x7f935819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f934ffff640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9358106a80 0x7f935819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f934ffff640 1 -- 172.21.15.60:0/2259327448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9358100a80 msgr2=0x7f93581984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f934ffff640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9358100a80 0x7f93581984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f934ffff640 1 -- 172.21.15.60:0/2259327448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935819d470 con 0x7f9358101420 2024-09-12T00:05:48.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f934ffff640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358101420 0x7f9358198a00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f934000d950 tx=0x7f934000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f9354ff9640 1 -- 172.21.15.60:0/2259327448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340017030 con 0x7f9358101420 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f9354ff9640 1 -- 172.21.15.60:0/2259327448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9340004020 con 0x7f9358101420 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f935d3a5640 1 -- 172.21.15.60:0/2259327448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935819d760 con 0x7f9358101420 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f9354ff9640 1 -- 172.21.15.60:0/2259327448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340004a00 con 0x7f9358101420 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.601+0000 7f935d3a5640 1 -- 172.21.15.60:0/2259327448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93581a5040 con 0x7f9358101420 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f9354ff9640 1 -- 172.21.15.60:0/2259327448 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f93400041d0 con 0x7f9358101420 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f935f77e740 1 Processor -- start 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f935f77e740 1 -- start start 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f935f77e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f935f77e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c127efa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f935f77e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127fe780 0x561c12800b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f935f77e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561c127552f0 con 0x561c127f0b40 2024-09-12T00:05:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f935f77e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561c126fccf0 con 0x561c127ef5d0 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f935f77e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561c127512b0 con 0x561c127fe780 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f93577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f93577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37566/0 (socket says 172.21.15.60:37566) 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f93577fe640 1 -- 172.21.15.60:0/483450079 learned_addr learned my addr 172.21.15.60:0/483450079 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.604+0000 7f9356ffd640 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c127efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f9354ff9640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93440a2cf0 0x7f93440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f934ffff640 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127fe780 0x561c12800b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f93577fe640 1 -- 172.21.15.60:0/483450079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127fe780 msgr2=0x561c12800b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f93577fe640 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127fe780 0x561c12800b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f9354ff9640 1 -- 172.21.15.60:0/2259327448 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f93400ced90 con 0x7f9358101420 2024-09-12T00:05:48.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f93577fe640 1 -- 172.21.15.60:0/483450079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 msgr2=0x561c127efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f93577fe640 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c127efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f93577fe640 1 -- 172.21.15.60:0/483450079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c126e13a0 con 0x561c127f0b40 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f93577fe640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93440a2cf0 0x7f93440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f93577fe640 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127ef090 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f93500072e0 tx=0x7f935000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6be9267d80452b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f934d7fa640 1 -- 172.21.15.60:0/483450079 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350019870 con 0x561c127f0b40 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f93577fe640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93440a2cf0 0x7f93440a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9350020000 tx=0x7f935001d000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f934d7fa640 1 -- 172.21.15.60:0/483450079 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9350010430 con 0x561c127f0b40 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.605+0000 7f934d7fa640 1 -- 172.21.15.60:0/483450079 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935001a670 con 0x561c127f0b40 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 -- 172.21.15.60:0/483450079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 msgr2=0x561c127ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127ef090 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f93500072e0 tx=0x7f935000f850 comp rx=0 tx=0).stop 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 -- 172.21.15.60:0/483450079 shutdown_connections 2024-09-12T00:05:48.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127fe780 0x561c12800b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c127efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 --2- 172.21.15.60:0/483450079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127ef090 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 -- 172.21.15.60:0/483450079 >> 172.21.15.60:0/483450079 conn(0x561c127b8310 msgr2=0x561c127ebc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 -- 172.21.15.60:0/483450079 shutdown_connections 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.606+0000 7f935f77e740 1 -- 172.21.15.60:0/483450079 wait complete. 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 1 -- start start 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 1 Processor -- start 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c127fe1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127fb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c127fba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561c12801480 con 0x561c127f0b40 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561c12710060 con 0x561c127fe780 2024-09-12T00:05:48.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561c12801600 con 0x561c127ef5d0 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f935f77e740 10 client.0 _ll_register_callbacks cb 0x561c124638c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f934ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127fb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f934ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127fb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37582/0 (socket says 172.21.15.60:37582) 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f934ffff640 1 -- 172.21.15.60:0/2570105485 learned_addr learned my addr 172.21.15.60:0/2570105485 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f9356ffd640 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c127fe1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f93577fe640 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c127fba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f934ffff640 1 -- 172.21.15.60:0/2570105485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 msgr2=0x561c127fe1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f934ffff640 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c127fe1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f934ffff640 1 -- 172.21.15.60:0/2570105485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 msgr2=0x561c127fba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f934ffff640 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c127fba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.607+0000 7f934ffff640 1 -- 172.21.15.60:0/2570105485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c124c63c0 con 0x561c127f0b40 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f934ffff640 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127fb450 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f93400ccb30 tx=0x7f9340065f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1353d7577f38df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:48.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f933e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f933e7fc640 1 -- 172.21.15.60:0/2570105485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934009b300 con 0x561c127f0b40 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f933e7fc640 1 -- 172.21.15.60:0/2570105485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f93400cc7b0 con 0x561c127f0b40 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 1 -- 172.21.15.60:0/2570105485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9350010430 con 0x561c127f0b40 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f933e7fc640 1 -- 172.21.15.60:0/2570105485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f934009f6b0 con 0x561c127f0b40 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 10 client.16926 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 1 -- 172.21.15.60:0/2570105485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x561c1280cfb0 con 0x561c127f0b40 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f933e7fc640 1 -- 172.21.15.60:0/2570105485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9350010430 con 0x561c127f0b40 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f933e7fc640 1 -- 172.21.15.60:0/2570105485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f93400a3ae0 con 0x561c127f0b40 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 10 client.16926 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 10 client.16926 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:05:48.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 20 client.16926 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x561c1280e350 0x561c12810740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 4 client.16926 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.608+0000 7f935f77e740 1 -- 172.21.15.60:0/2570105485 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c12762860 con 0x561c1280e350 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.609+0000 7f9356ffd640 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x561c1280e350 0x561c12810740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.609+0000 7f9356ffd640 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x561c1280e350 0x561c12810740 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c474fd26a75f3aa2 server_cookie=26d0b2f903e9d217 in_seq=0 out_seq=0 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.609+0000 7f933e7fc640 10 client.16926 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f933e7fc640 1 -- 172.21.15.60:0/2570105485 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c12762860 con 0x561c1280e350 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f933e7fc640 10 client.16926 handle_command_reply: tid=0 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 client.16926 shutdown 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 -- 172.21.15.60:0/2570105485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 msgr2=0x561c127fb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127fb450 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f93400ccb30 tx=0x7f9340065f30 comp rx=0 tx=0).stop 2024-09-12T00:05:48.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 -- 172.21.15.60:0/2570105485 shutdown_connections 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x561c1280e350 0x561c12810740 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c127fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c127fb450 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 --2- 172.21.15.60:0/2570105485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c127fe1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 -- 172.21.15.60:0/2570105485 >> 172.21.15.60:0/2570105485 conn(0x561c127b8310 msgr2=0x561c127f1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f933e7fc640 0 client.16926 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 -- 172.21.15.60:0/2570105485 shutdown_connections 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 1 -- 172.21.15.60:0/2570105485 wait complete. 2024-09-12T00:05:48.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.610+0000 7f935f77e740 20 client.16926 trim_cache size 0 max 16384 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.623+0000 7f935f77e740 1 Processor -- start 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.623+0000 7f935f77e740 1 -- start start 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f935f77e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c1280a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f935f77e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127f0b40 0x561c12816010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f935f77e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127fe780 0x561c12816550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f935f77e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93581ab560 con 0x561c127fe780 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f935f77e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f93581ad0a0 con 0x561c127ef5d0 2024-09-12T00:05:48.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f935f77e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93581abc30 con 0x561c127f0b40 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127fe780 0x561c12816550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127fe780 0x561c12816550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37592/0 (socket says 172.21.15.60:37592) 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 -- 172.21.15.60:0/3200121358 learned_addr learned my addr 172.21.15.60:0/3200121358 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f9356ffd640 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c1280a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f934ffff640 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127f0b40 0x561c12816010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 -- 172.21.15.60:0/3200121358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127f0b40 msgr2=0x561c12816010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127f0b40 0x561c12816010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 -- 172.21.15.60:0/3200121358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 msgr2=0x561c1280a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c1280a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 -- 172.21.15.60:0/3200121358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c127fc3f0 con 0x561c127fe780 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f9356ffd640 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c1280a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:48.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.624+0000 7f93577fe640 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127fe780 0x561c12816550 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9350007790 tx=0x7f9350010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fae422ff4588e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f934cff9640 1 -- 172.21.15.60:0/3200121358 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350012050 con 0x561c127fe780 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f934cff9640 1 -- 172.21.15.60:0/3200121358 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93500121f0 con 0x561c127fe780 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f934cff9640 1 -- 172.21.15.60:0/3200121358 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350019a30 con 0x561c127fe780 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f935f77e740 1 -- 172.21.15.60:0/3200121358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127fe780 msgr2=0x561c12816550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f935f77e740 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127fe780 0x561c12816550 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9350007790 tx=0x7f9350010e00 comp rx=0 tx=0).stop 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f935f77e740 1 -- 172.21.15.60:0/3200121358 shutdown_connections 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f935f77e740 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127fe780 0x561c12816550 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f935f77e740 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127f0b40 0x561c12816010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f935f77e740 1 --2- 172.21.15.60:0/3200121358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127ef5d0 0x561c1280a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.625+0000 7f935f77e740 1 -- 172.21.15.60:0/3200121358 >> 172.21.15.60:0/3200121358 conn(0x561c127b8310 msgr2=0x561c127fa540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 -- 172.21.15.60:0/3200121358 shutdown_connections 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 -- 172.21.15.60:0/3200121358 wait complete. 2024-09-12T00:05:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 -- start start 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 Processor -- start 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c128028d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c12802e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c12803370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93581ac9d0 con 0x561c127f0b40 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f93581ac300 con 0x561c127fe780 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93581a9540 con 0x561c127ef5d0 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f935f77e740 10 client.0 _ll_register_callbacks cb 0x7f93400046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f934ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c12802e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f934ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c12802e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37598/0 (socket says 172.21.15.60:37598) 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.626+0000 7f934ffff640 1 -- 172.21.15.60:0/1519416421 learned_addr learned my addr 172.21.15.60:0/1519416421 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f9356ffd640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c128028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f93577fe640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c12803370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f934ffff640 1 -- 172.21.15.60:0/1519416421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 msgr2=0x561c128028d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f934ffff640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c128028d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f934ffff640 1 -- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 msgr2=0x561c12803370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f934ffff640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c12803370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f934ffff640 1 -- 172.21.15.60:0/1519416421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c128782b0 con 0x561c127f0b40 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f9356ffd640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c128028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f93577fe640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c12803370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f934ffff640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c12802e10 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f934009b000 tx=0x7f93400cca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d2718f96f2fefa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f933e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f933e7fc640 1 -- 172.21.15.60:0/1519416421 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934009ac60 con 0x561c127f0b40 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f933e7fc640 1 -- 172.21.15.60:0/1519416421 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f934009f380 con 0x561c127f0b40 2024-09-12T00:05:48.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f935f77e740 1 -- 172.21.15.60:0/1519416421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93500121f0 con 0x561c127f0b40 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f933e7fc640 1 -- 172.21.15.60:0/1519416421 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f93400b4050 con 0x561c127f0b40 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f935f77e740 10 client.16932 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f935f77e740 1 -- 172.21.15.60:0/1519416421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x561c128795b0 con 0x561c127f0b40 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.627+0000 7f933e7fc640 1 -- 172.21.15.60:0/1519416421 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93500121f0 con 0x561c127f0b40 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f933e7fc640 1 -- 172.21.15.60:0/1519416421 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f934009a750 con 0x561c127f0b40 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f935f77e740 10 client.16932 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f935f77e740 10 client.16932 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f935f77e740 20 client.16932 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f935f77e740 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x561c12879cf0 0x561c1287c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f935f77e740 4 client.16932 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f935f77e740 1 -- 172.21.15.60:0/1519416421 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c1275cd70 con 0x561c12879cf0 2024-09-12T00:05:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f9356ffd640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x561c12879cf0 0x561c1287c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f9356ffd640 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x561c12879cf0 0x561c1287c110 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7705f1a0725ebc3a server_cookie=6d31e6ec99997e1d in_seq=0 out_seq=0 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.628+0000 7f933e7fc640 10 client.16932 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f933e7fc640 1 -- 172.21.15.60:0/1519416421 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c1275cd70 con 0x561c12879cf0 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f933e7fc640 10 client.16932 handle_command_reply: tid=0 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 client.16932 shutdown 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 -- 172.21.15.60:0/1519416421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 msgr2=0x561c12802e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c12802e10 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f934009b000 tx=0x7f93400cca60 comp rx=0 tx=0).stop 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 -- 172.21.15.60:0/1519416421 shutdown_connections 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x561c12879cf0 0x561c1287c110 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561c127fe780 0x561c12803370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561c127f0b40 0x561c12802e10 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 --2- 172.21.15.60:0/1519416421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c127ef5d0 0x561c128028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f933e7fc640 0 client.16932 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 -- 172.21.15.60:0/1519416421 >> 172.21.15.60:0/1519416421 conn(0x561c127b8310 msgr2=0x561c127ea4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 -- 172.21.15.60:0/1519416421 shutdown_connections 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 1 -- 172.21.15.60:0/1519416421 wait complete. 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.629+0000 7f935f77e740 20 client.16932 trim_cache size 0 max 16384 2024-09-12T00:05:48.638 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 -- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93440a2cf0 msgr2=0x7f93440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93440a2cf0 0x7f93440a51b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9350020000 tx=0x7f935001d000 comp rx=0 tx=0).stop 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 -- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358101420 msgr2=0x7f9358198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358101420 0x7f9358198a00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f934000d950 tx=0x7f934000de10 comp rx=0 tx=0).stop 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 -- 172.21.15.60:0/2259327448 shutdown_connections 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93440a2cf0 0x7f93440a51b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9358106a80 0x7f935819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9358101420 0x7f9358198a00 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 --2- 172.21.15.60:0/2259327448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9358100a80 0x7f93581984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 -- 172.21.15.60:0/2259327448 >> 172.21.15.60:0/2259327448 conn(0x7f93580fc7a0 msgr2=0x7f93580fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 -- 172.21.15.60:0/2259327448 shutdown_connections 2024-09-12T00:05:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:48.630+0000 7f935d3a5640 1 -- 172.21.15.60:0/2259327448 wait complete. 2024-09-12T00:05:49.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:48 smithi105 ceph-mon[34805]: pgmap v196: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T00:05:49.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:48 smithi192 ceph-mon[35487]: pgmap v196: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T00:05:49.296 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:48 smithi060 ceph-mon[30953]: pgmap v196: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-12T00:05:49.329 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:05:49.591 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.068+0000 7f324f0ec640 1 -- 172.21.15.60:0/2385186648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248106f10 msgr2=0x7f324810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.068+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2385186648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248106f10 0x7f324810ea90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3240009ca0 tx=0x7f324002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.068+0000 7f324f0ec640 1 -- 172.21.15.60:0/2385186648 shutdown_connections 2024-09-12T00:05:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.068+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2385186648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248106f10 0x7f324810ea90 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.068+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2385186648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3248102790 0x7f32481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.068+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2385186648 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3248101de0 0x7f32481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.068+0000 7f324f0ec640 1 -- 172.21.15.60:0/2385186648 >> 172.21.15.60:0/2385186648 conn(0x7f32480fd8c0 msgr2=0x7f32480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.069+0000 7f324f0ec640 1 -- 172.21.15.60:0/2385186648 shutdown_connections 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.069+0000 7f324f0ec640 1 -- 172.21.15.60:0/2385186648 wait complete. 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.069+0000 7f324f0ec640 1 Processor -- start 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.069+0000 7f324f0ec640 1 -- start start 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.069+0000 7f324f0ec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3248101de0 0x7f3248198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f324f0ec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248102790 0x7f3248198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f324f0ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3248106f10 0x7f324819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f324f0ec640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3248112090 con 0x7f3248102790 2024-09-12T00:05:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f324f0ec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3248111f10 con 0x7f3248101de0 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f324f0ec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3248112210 con 0x7f3248106f10 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248102790 0x7f3248198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248102790 0x7f3248198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37612/0 (socket says 172.21.15.60:37612) 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 -- 172.21.15.60:0/2316827326 learned_addr learned my addr 172.21.15.60:0/2316827326 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f324ce88640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3248101de0 0x7f3248198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f324d689640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3248106f10 0x7f324819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 -- 172.21.15.60:0/2316827326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3248106f10 msgr2=0x7f324819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3248106f10 0x7f324819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 -- 172.21.15.60:0/2316827326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3248101de0 msgr2=0x7f3248198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3248101de0 0x7f3248198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 -- 172.21.15.60:0/2316827326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324819d400 con 0x7f3248102790 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3247fff640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248102790 0x7f3248198990 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c970 tx=0x7f323c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3245ffb640 1 -- 172.21.15.60:0/2316827326 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c007bb0 con 0x7f3248102790 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3245ffb640 1 -- 172.21.15.60:0/2316827326 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f323c007d50 con 0x7f3248102790 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f324f0ec640 1 -- 172.21.15.60:0/2316827326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f324819d6f0 con 0x7f3248102790 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.070+0000 7f3245ffb640 1 -- 172.21.15.60:0/2316827326 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c00f4b0 con 0x7f3248102790 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.071+0000 7f324f0ec640 1 -- 172.21.15.60:0/2316827326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32481a4fd0 con 0x7f3248102790 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.073+0000 7f3245ffb640 1 -- 172.21.15.60:0/2316827326 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f323c0046c0 con 0x7f3248102790 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.073+0000 7f32514c5740 1 Processor -- start 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.073+0000 7f32514c5740 1 -- start start 2024-09-12T00:05:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.073+0000 7f3245ffb640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f32300a2cf0 0x7f32300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3245ffb640 1 -- 172.21.15.60:0/2316827326 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f323c0cf230 con 0x7f3248102790 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f32514c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e46ab40 0x56001e469090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f324d689640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f32300a2cf0 0x7f32300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f32514c5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e4695d0 0x56001e469a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f32514c5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e474370 0x56001e476760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f32514c5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56001e3cf2f0 con 0x56001e4695d0 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f32514c5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56001e376cf0 con 0x56001e474370 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f32514c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56001e3cb2b0 con 0x56001e46ab40 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e4695d0 0x56001e469a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e4695d0 0x56001e469a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37628/0 (socket says 172.21.15.60:37628) 2024-09-12T00:05:50.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 -- 172.21.15.60:0/150191917 learned_addr learned my addr 172.21.15.60:0/150191917 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:50.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f324ce88640 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e46ab40 0x56001e469090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f324d689640 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e474370 0x56001e476760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 -- 172.21.15.60:0/150191917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e46ab40 msgr2=0x56001e469090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:50.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e46ab40 0x56001e469090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 -- 172.21.15.60:0/150191917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e474370 msgr2=0x56001e476760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:50.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e474370 0x56001e476760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 -- 172.21.15.60:0/150191917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001e35b3a0 con 0x56001e4695d0 2024-09-12T00:05:50.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f324d689640 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e474370 0x56001e476760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:50.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f324d689640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f32300a2cf0 0x7f32300a51b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3240006010 tx=0x7f3240009800 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:50.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.074+0000 7f3247fff640 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e4695d0 0x56001e469a10 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f323c0a3ee0 tx=0x7f323c09bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fe58955adb766b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:50.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f322effd640 1 -- 172.21.15.60:0/150191917 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c01d040 con 0x56001e4695d0 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f322effd640 1 -- 172.21.15.60:0/150191917 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f323c0a4410 con 0x56001e4695d0 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f322effd640 1 -- 172.21.15.60:0/150191917 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c09adf0 con 0x56001e4695d0 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 -- 172.21.15.60:0/150191917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e4695d0 msgr2=0x56001e469a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e4695d0 0x56001e469a10 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f323c0a3ee0 tx=0x7f323c09bea0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 -- 172.21.15.60:0/150191917 shutdown_connections 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e474370 0x56001e476760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e4695d0 0x56001e469a10 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 --2- 172.21.15.60:0/150191917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e46ab40 0x56001e469090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 -- 172.21.15.60:0/150191917 >> 172.21.15.60:0/150191917 conn(0x56001e432310 msgr2=0x56001e465c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:50.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 -- 172.21.15.60:0/150191917 shutdown_connections 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.075+0000 7f32514c5740 1 -- 172.21.15.60:0/150191917 wait complete. 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 1 -- start start 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 1 Processor -- start 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 0x56001e473d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e471030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e471640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56001e47b420 con 0x56001e474370 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56001e38a060 con 0x56001e46ab40 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56001e47b5a0 con 0x56001e4695d0 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f32514c5740 10 client.0 _ll_register_callbacks cb 0x56001e0dd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f324d689640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e471640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f324d689640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e471640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37644/0 (socket says 172.21.15.60:37644) 2024-09-12T00:05:50.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f324d689640 1 -- 172.21.15.60:0/76078463 learned_addr learned my addr 172.21.15.60:0/76078463 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f324ce88640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 0x56001e473d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.076+0000 7f3247fff640 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e471030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f324d689640 1 -- 172.21.15.60:0/76078463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 msgr2=0x56001e473d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f324d689640 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 0x56001e473d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f324d689640 1 -- 172.21.15.60:0/76078463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 msgr2=0x56001e471030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f324d689640 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e471030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f324d689640 1 -- 172.21.15.60:0/76078463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56001e1403c0 con 0x56001e474370 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f324d689640 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e471640 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3240003d60 tx=0x7f324002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2338dfe1c901c31c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f3227fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f3227fff640 1 -- 172.21.15.60:0/76078463 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324004e070 con 0x56001e474370 2024-09-12T00:05:50.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f3227fff640 1 -- 172.21.15.60:0/76078463 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f32400047c0 con 0x56001e474370 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f32514c5740 1 -- 172.21.15.60:0/76078463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f323c0a4410 con 0x56001e474370 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f3227fff640 1 -- 172.21.15.60:0/76078463 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f324005a050 con 0x56001e474370 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f32514c5740 10 client.16944 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.077+0000 7f32514c5740 1 -- 172.21.15.60:0/76078463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56001e486e60 con 0x56001e474370 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f3227fff640 1 -- 172.21.15.60:0/76078463 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f323c0a4410 con 0x56001e474370 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f3227fff640 1 -- 172.21.15.60:0/76078463 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f3240030890 con 0x56001e474370 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f32514c5740 10 client.16944 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f32514c5740 10 client.16944 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f32514c5740 20 client.16944 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f32514c5740 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56001e488270 0x56001e48a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f32514c5740 4 client.16944 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:50.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f32514c5740 1 -- 172.21.15.60:0/76078463 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56001e3dc860 con 0x56001e488270 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.078+0000 7f324ce88640 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56001e488270 0x56001e48a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f324ce88640 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56001e488270 0x56001e48a6d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ec06b5a6a8e879de server_cookie=daf86f166cac111a in_seq=0 out_seq=0 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f3227fff640 10 client.16944 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f3227fff640 1 -- 172.21.15.60:0/76078463 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56001e3dc860 con 0x56001e488270 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f3227fff640 10 client.16944 handle_command_reply: tid=0 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f32514c5740 1 client.16944 shutdown 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f32514c5740 1 -- 172.21.15.60:0/76078463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 msgr2=0x56001e471640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f32514c5740 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e471640 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f3240003d60 tx=0x7f324002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f32514c5740 1 -- 172.21.15.60:0/76078463 shutdown_connections 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f32514c5740 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56001e488270 0x56001e48a6d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.079+0000 7f32514c5740 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e471640 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.080+0000 7f3227fff640 0 client.16944 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:05:50.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.080+0000 7f32514c5740 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e471030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.080+0000 7f32514c5740 1 --2- 172.21.15.60:0/76078463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 0x56001e473d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.080+0000 7f32514c5740 1 -- 172.21.15.60:0/76078463 >> 172.21.15.60:0/76078463 conn(0x56001e432310 msgr2=0x56001e46b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.080+0000 7f32514c5740 1 -- 172.21.15.60:0/76078463 shutdown_connections 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.080+0000 7f32514c5740 1 -- 172.21.15.60:0/76078463 wait complete. 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.080+0000 7f32514c5740 20 client.16944 trim_cache size 0 max 16384 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f32514c5740 1 Processor -- start 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f32514c5740 1 -- start start 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f32514c5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e4695d0 0x56001e472fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f32514c5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e46ab40 0x56001e46c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f32514c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e474370 0x56001e46c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f32514c5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32481ab5f0 con 0x56001e46ab40 2024-09-12T00:05:50.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f32514c5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32481ad130 con 0x56001e4695d0 2024-09-12T00:05:50.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f32514c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f32481abcc0 con 0x56001e474370 2024-09-12T00:05:50.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e46ab40 0x56001e46c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e46ab40 0x56001e46c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37650/0 (socket says 172.21.15.60:37650) 2024-09-12T00:05:50.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 -- 172.21.15.60:0/4227844272 learned_addr learned my addr 172.21.15.60:0/4227844272 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:50.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f324ce88640 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e4695d0 0x56001e472fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f324d689640 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e474370 0x56001e46c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 -- 172.21.15.60:0/4227844272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e474370 msgr2=0x56001e46c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e474370 0x56001e46c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 -- 172.21.15.60:0/4227844272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e4695d0 msgr2=0x56001e472fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e4695d0 0x56001e472fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 -- 172.21.15.60:0/4227844272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001e46ffe0 con 0x56001e46ab40 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f3247fff640 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e46ab40 0x56001e46c120 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f323c097c00 tx=0x7f323c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc562ac848d069f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.093+0000 7f322e7fc640 1 -- 172.21.15.60:0/4227844272 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c065070 con 0x56001e46ab40 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f322e7fc640 1 -- 172.21.15.60:0/4227844272 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f323c0a4410 con 0x56001e46ab40 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f322e7fc640 1 -- 172.21.15.60:0/4227844272 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c01d040 con 0x56001e46ab40 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 -- 172.21.15.60:0/4227844272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e46ab40 msgr2=0x56001e46c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e46ab40 0x56001e46c120 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f323c097c00 tx=0x7f323c005740 comp rx=0 tx=0).stop 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 -- 172.21.15.60:0/4227844272 shutdown_connections 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e474370 0x56001e46c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e46ab40 0x56001e46c120 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 --2- 172.21.15.60:0/4227844272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e4695d0 0x56001e472fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 -- 172.21.15.60:0/4227844272 >> 172.21.15.60:0/4227844272 conn(0x56001e432310 msgr2=0x56001e472890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 -- 172.21.15.60:0/4227844272 shutdown_connections 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 -- 172.21.15.60:0/4227844272 wait complete. 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.094+0000 7f32514c5740 1 -- start start 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f32514c5740 1 Processor -- start 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f32514c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 0x56001e47c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f32514c5740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e47ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f32514c5740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e47cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f32514c5740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32481aca60 con 0x56001e474370 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f32514c5740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32481ac390 con 0x56001e46ab40 2024-09-12T00:05:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f32514c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f32481a95d0 con 0x56001e4695d0 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f32514c5740 10 client.0 _ll_register_callbacks cb 0x7f3240009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f324d689640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e47cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f324d689640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e47cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37666/0 (socket says 172.21.15.60:37666) 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f3247fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e47ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f324d689640 1 -- 172.21.15.60:0/2770561257 learned_addr learned my addr 172.21.15.60:0/2770561257 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.095+0000 7f324ce88640 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 0x56001e47c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f324d689640 1 -- 172.21.15.60:0/2770561257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 msgr2=0x56001e47c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f324d689640 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 0x56001e47c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f324d689640 1 -- 172.21.15.60:0/2770561257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 msgr2=0x56001e47ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f324d689640 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e47ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f324d689640 1 -- 172.21.15.60:0/2770561257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56001e4740f0 con 0x56001e474370 2024-09-12T00:05:50.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f3247fff640 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e47ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f324d689640 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e47cfd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3240030cb0 tx=0x7f32400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b1dc7e816011d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f3227fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f3227fff640 1 -- 172.21.15.60:0/2770561257 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240062070 con 0x56001e474370 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f3227fff640 1 -- 172.21.15.60:0/2770561257 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f32400309d0 con 0x56001e474370 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f32514c5740 1 -- 172.21.15.60:0/2770561257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f323c0a4410 con 0x56001e474370 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f3227fff640 1 -- 172.21.15.60:0/2770561257 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f324006e050 con 0x56001e474370 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f32514c5740 10 client.16950 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f32514c5740 1 -- 172.21.15.60:0/2770561257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56001e4f3050 con 0x56001e474370 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.096+0000 7f3227fff640 1 -- 172.21.15.60:0/2770561257 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f323c0a4410 con 0x56001e474370 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f3227fff640 1 -- 172.21.15.60:0/2770561257 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f324002fd40 con 0x56001e474370 2024-09-12T00:05:50.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f32514c5740 10 client.16950 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f32514c5740 10 client.16950 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f32514c5740 20 client.16950 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f32514c5740 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56001e4f3710 0x56001e4f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f32514c5740 4 client.16950 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f32514c5740 1 -- 172.21.15.60:0/2770561257 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56001e3d6d70 con 0x56001e4f3710 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f324ce88640 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56001e4f3710 0x56001e4f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f324ce88640 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56001e4f3710 0x56001e4f5b30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ba80225d7ac6bc8 server_cookie=a959b2805a47d3e6 in_seq=0 out_seq=0 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f3227fff640 10 client.16950 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f3227fff640 1 -- 172.21.15.60:0/2770561257 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56001e3d6d70 con 0x56001e4f3710 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f3227fff640 10 client.16950 handle_command_reply: tid=0 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.097+0000 7f32514c5740 1 client.16950 shutdown 2024-09-12T00:05:50.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 -- 172.21.15.60:0/2770561257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 msgr2=0x56001e47cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e47cfd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f3240030cb0 tx=0x7f32400046c0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 -- 172.21.15.60:0/2770561257 shutdown_connections 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x56001e4f3710 0x56001e4f5b30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56001e474370 0x56001e47cfd0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56001e46ab40 0x56001e47ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 --2- 172.21.15.60:0/2770561257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56001e4695d0 0x56001e47c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 -- 172.21.15.60:0/2770561257 >> 172.21.15.60:0/2770561257 conn(0x56001e432310 msgr2=0x56001e4730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f3227fff640 0 client.16950 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 -- 172.21.15.60:0/2770561257 shutdown_connections 2024-09-12T00:05:50.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 1 -- 172.21.15.60:0/2770561257 wait complete. 2024-09-12T00:05:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.098+0000 7f32514c5740 20 client.16950 trim_cache size 0 max 16384 2024-09-12T00:05:50.123 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 -- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f32300a2cf0 msgr2=0x7f32300a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f32300a2cf0 0x7f32300a51b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3240006010 tx=0x7f3240009800 comp rx=0 tx=0).stop 2024-09-12T00:05:50.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 -- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248102790 msgr2=0x7f3248198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248102790 0x7f3248198990 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c970 tx=0x7f323c00ce30 comp rx=0 tx=0).stop 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 -- 172.21.15.60:0/2316827326 shutdown_connections 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f32300a2cf0 0x7f32300a51b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3248106f10 0x7f324819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3248102790 0x7f3248198990 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 --2- 172.21.15.60:0/2316827326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3248101de0 0x7f3248198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 -- 172.21.15.60:0/2316827326 >> 172.21.15.60:0/2316827326 conn(0x7f32480fd8c0 msgr2=0x7f32480fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 -- 172.21.15.60:0/2316827326 shutdown_connections 2024-09-12T00:05:50.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:50.099+0000 7f324f0ec640 1 -- 172.21.15.60:0/2316827326 wait complete. 2024-09-12T00:05:50.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:05:51.070 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:51.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:50 smithi060 ceph-mon[30953]: pgmap v197: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:05:51.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:50 smithi105 ceph-mon[34805]: pgmap v197: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:05:51.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:50 smithi192 ceph-mon[35487]: pgmap v197: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:05:51.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.545+0000 7fe12e540640 1 -- 172.21.15.60:0/3809652837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe128102d40 msgr2=0x7fe128103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.545+0000 7fe12e540640 1 --2- 172.21.15.60:0/3809652837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe128102d40 0x7fe128103120 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe118009900 tx=0x7fe11802a480 comp rx=0 tx=0).stop 2024-09-12T00:05:51.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.545+0000 7fe12e540640 1 -- 172.21.15.60:0/3809652837 shutdown_connections 2024-09-12T00:05:51.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.545+0000 7fe12e540640 1 --2- 172.21.15.60:0/3809652837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe12810c170 0x7fe12810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.545+0000 7fe12e540640 1 --2- 172.21.15.60:0/3809652837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe128103660 0x7fe12810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.545+0000 7fe12e540640 1 --2- 172.21.15.60:0/3809652837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe128102d40 0x7fe128103120 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.546+0000 7fe12e540640 1 -- 172.21.15.60:0/3809652837 >> 172.21.15.60:0/3809652837 conn(0x7fe1280fc7a0 msgr2=0x7fe1280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.546+0000 7fe12e540640 1 -- 172.21.15.60:0/3809652837 shutdown_connections 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.546+0000 7fe12e540640 1 -- 172.21.15.60:0/3809652837 wait complete. 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.546+0000 7fe12e540640 1 Processor -- start 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.546+0000 7fe12e540640 1 -- start start 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.546+0000 7fe12e540640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe128102d40 0x7fe1281009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12e540640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe128103660 0x7fe128100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12e540640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe12810c170 0x7fe128101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12e540640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281120f0 con 0x7fe12810c170 2024-09-12T00:05:51.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12e540640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe128111f70 con 0x7fe128103660 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12e540640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe128112270 con 0x7fe128102d40 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe12810c170 0x7fe128101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe12810c170 0x7fe128101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37736/0 (socket says 172.21.15.60:37736) 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 -- 172.21.15.60:0/2235420663 learned_addr learned my addr 172.21.15.60:0/2235420663 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe127fff640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe128102d40 0x7fe1281009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe1277fe640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe128103660 0x7fe128100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 -- 172.21.15.60:0/2235420663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe128102d40 msgr2=0x7fe1281009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe128102d40 0x7fe1281009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 -- 172.21.15.60:0/2235420663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe128103660 msgr2=0x7fe128100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe128103660 0x7fe128100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 -- 172.21.15.60:0/2235420663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1281a69e0 con 0x7fe12810c170 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe1277fe640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe128103660 0x7fe128100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe12cadd640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe12810c170 0x7fe128101420 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe12000cce0 tx=0x7fe12000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe1257fa640 1 -- 172.21.15.60:0/2235420663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12000f450 con 0x7fe12810c170 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.547+0000 7fe1257fa640 1 -- 172.21.15.60:0/2235420663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe12000faf0 con 0x7fe12810c170 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.548+0000 7fe12e540640 1 -- 172.21.15.60:0/2235420663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1281a6cd0 con 0x7fe12810c170 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.548+0000 7fe1257fa640 1 -- 172.21.15.60:0/2235420663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe120018cc0 con 0x7fe12810c170 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.548+0000 7fe12e540640 1 -- 172.21.15.60:0/2235420663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1281a71c0 con 0x7fe12810c170 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe130919740 1 Processor -- start 2024-09-12T00:05:51.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1257fa640 1 -- 172.21.15.60:0/2235420663 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe12000f5f0 con 0x7fe12810c170 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe130919740 1 -- start start 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe130919740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6ed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe130919740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6eda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe130919740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6f8370 0x563bdb6fa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe130919740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563bdb6532f0 con 0x563bdb6eeb40 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe130919740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563bdb5facf0 con 0x563bdb6f8370 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe130919740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563bdb64f2b0 con 0x563bdb6ed5d0 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6ed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37740/0 (socket says 172.21.15.60:37740) 2024-09-12T00:05:51.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1277fe640 1 -- 172.21.15.60:0/3480262676 learned_addr learned my addr 172.21.15.60:0/3480262676 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe127fff640 1 --2- 172.21.15.60:0/3480262676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1277fe640 1 -- 172.21.15.60:0/3480262676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 msgr2=0x563bdb6eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3480262676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1257fa640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe1100a2cf0 0x7fe1100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1277fe640 1 -- 172.21.15.60:0/3480262676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6f8370 msgr2=0x563bdb6fa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3480262676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6f8370 0x563bdb6fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.551+0000 7fe1277fe640 1 -- 172.21.15.60:0/3480262676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bdb5df3a0 con 0x563bdb6eeb40 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.552+0000 7fe12cadd640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe1100a2cf0 0x7fe1100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.552+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3480262676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6ed090 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe11c007a00 tx=0x7fe11c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba830cd4f9d671 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.552+0000 7fe1257fa640 1 -- 172.21.15.60:0/2235420663 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe1200cf8c0 con 0x7fe12810c170 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.552+0000 7fe10e7fc640 1 -- 172.21.15.60:0/3480262676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00fc90 con 0x563bdb6eeb40 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.552+0000 7fe10e7fc640 1 -- 172.21.15.60:0/3480262676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe11c010040 con 0x563bdb6eeb40 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.552+0000 7fe10e7fc640 1 -- 172.21.15.60:0/3480262676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c013710 con 0x563bdb6eeb40 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 -- 172.21.15.60:0/3480262676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 msgr2=0x563bdb6ed090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe12cadd640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe1100a2cf0 0x7fe1100a51b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1200cd110 tx=0x7fe12000af30 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 --2- 172.21.15.60:0/3480262676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6ed090 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe11c007a00 tx=0x7fe11c007ec0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 -- 172.21.15.60:0/3480262676 shutdown_connections 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 --2- 172.21.15.60:0/3480262676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6f8370 0x563bdb6fa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 --2- 172.21.15.60:0/3480262676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 --2- 172.21.15.60:0/3480262676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6ed090 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 -- 172.21.15.60:0/3480262676 >> 172.21.15.60:0/3480262676 conn(0x563bdb6b6310 msgr2=0x563bdb6e9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 -- 172.21.15.60:0/3480262676 shutdown_connections 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 -- 172.21.15.60:0/3480262676 wait complete. 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 -- start start 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.553+0000 7fe130919740 1 Processor -- start 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe130919740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6ed5d0 0x563bdb6f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe130919740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe130919740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6f8370 0x563bdb6f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe130919740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563bdb6fb070 con 0x563bdb6eeb40 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe130919740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563bdb60e060 con 0x563bdb6ed5d0 2024-09-12T00:05:51.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe130919740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563bdb6fb1f0 con 0x563bdb6f8370 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe130919740 10 client.0 _ll_register_callbacks cb 0x563bdb3618c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37746/0 (socket says 172.21.15.60:37746) 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 -- 172.21.15.60:0/2289808797 learned_addr learned my addr 172.21.15.60:0/2289808797 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe1277fe640 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6ed5d0 0x563bdb6f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 -- 172.21.15.60:0/2289808797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6f8370 msgr2=0x563bdb6f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6f8370 0x563bdb6f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 -- 172.21.15.60:0/2289808797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6ed5d0 msgr2=0x563bdb6f7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:51.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6ed5d0 0x563bdb6f7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 -- 172.21.15.60:0/2289808797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bdb3c43c0 con 0x563bdb6eeb40 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe1277fe640 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6ed5d0 0x563bdb6f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe127fff640 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6f4f60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe118009900 tx=0x7fe118031990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8f76bd573d113d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe1077fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe1077fe640 1 -- 172.21.15.60:0/2289808797 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118035040 con 0x563bdb6eeb40 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe1077fe640 1 -- 172.21.15.60:0/2289808797 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe118004300 con 0x563bdb6eeb40 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.554+0000 7fe130919740 1 -- 172.21.15.60:0/2289808797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe11c010040 con 0x563bdb6eeb40 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe1077fe640 1 -- 172.21.15.60:0/2289808797 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fe1180035f0 con 0x563bdb6eeb40 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe130919740 10 client.16962 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe130919740 1 -- 172.21.15.60:0/2289808797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563bdb706a60 con 0x563bdb6eeb40 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe1077fe640 1 -- 172.21.15.60:0/2289808797 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe11c010040 con 0x563bdb6eeb40 2024-09-12T00:05:51.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe1077fe640 1 -- 172.21.15.60:0/2289808797 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fe11803c830 con 0x563bdb6eeb40 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe130919740 10 client.16962 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe130919740 10 client.16962 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe130919740 20 client.16962 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe130919740 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x563bdb707f70 0x563bdb70a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe130919740 4 client.16962 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe130919740 1 -- 172.21.15.60:0/2289808797 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bdb660860 con 0x563bdb707f70 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.555+0000 7fe1277fe640 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x563bdb707f70 0x563bdb70a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.556+0000 7fe1077fe640 10 client.16962 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.556+0000 7fe1277fe640 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x563bdb707f70 0x563bdb70a3d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8a95f332caffc0f server_cookie=f7cfdf588164a969 in_seq=0 out_seq=0 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.556+0000 7fe1077fe640 1 -- 172.21.15.60:0/2289808797 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bdb660860 con 0x563bdb707f70 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe1077fe640 10 client.16962 handle_command_reply: tid=0 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 client.16962 shutdown 2024-09-12T00:05:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 -- 172.21.15.60:0/2289808797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 msgr2=0x563bdb6f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6f4f60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe118009900 tx=0x7fe118031990 comp rx=0 tx=0).stop 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 -- 172.21.15.60:0/2289808797 shutdown_connections 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x563bdb707f70 0x563bdb70a3d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6f8370 0x563bdb6f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb6f4f60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe1077fe640 0 client.16962 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 --2- 172.21.15.60:0/2289808797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6ed5d0 0x563bdb6f7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 -- 172.21.15.60:0/2289808797 >> 172.21.15.60:0/2289808797 conn(0x563bdb6b6310 msgr2=0x563bdb6ef960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 -- 172.21.15.60:0/2289808797 shutdown_connections 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 1 -- 172.21.15.60:0/2289808797 wait complete. 2024-09-12T00:05:51.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.557+0000 7fe130919740 20 client.16962 trim_cache size 0 max 16384 2024-09-12T00:05:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.570+0000 7fe130919740 1 Processor -- start 2024-09-12T00:05:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.570+0000 7fe130919740 1 -- start start 2024-09-12T00:05:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe130919740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6b6310 0x563bdb6f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe130919740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6f0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe130919740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6eeb40 0x563bdb6f0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe130919740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281afa10 con 0x563bdb6b6310 2024-09-12T00:05:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe130919740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281b1550 con 0x563bdb6eeb40 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe130919740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281b00e0 con 0x563bdb6ed5d0 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6b6310 0x563bdb6f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6b6310 0x563bdb6f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37758/0 (socket says 172.21.15.60:37758) 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 -- 172.21.15.60:0/3340175600 learned_addr learned my addr 172.21.15.60:0/3340175600 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3340175600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6eeb40 0x563bdb6f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 -- 172.21.15.60:0/3340175600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 msgr2=0x563bdb6f0120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3340175600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6f0120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 -- 172.21.15.60:0/3340175600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6eeb40 msgr2=0x563bdb6f0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3340175600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6eeb40 0x563bdb6f0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 -- 172.21.15.60:0/3340175600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bdb6e94f0 con 0x563bdb6b6310 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.571+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3340175600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6b6310 0x563bdb6f6ed0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00f550 tx=0x7fe11c014f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dd1a1d4247af97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe10dffb640 1 -- 172.21.15.60:0/3340175600 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c005bc0 con 0x563bdb6b6310 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe10dffb640 1 -- 172.21.15.60:0/3340175600 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe11c005d60 con 0x563bdb6b6310 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe10dffb640 1 -- 172.21.15.60:0/3340175600 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c006600 con 0x563bdb6b6310 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 -- 172.21.15.60:0/3340175600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6b6310 msgr2=0x563bdb6f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 --2- 172.21.15.60:0/3340175600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6b6310 0x563bdb6f6ed0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00f550 tx=0x7fe11c014f50 comp rx=0 tx=0).stop 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 -- 172.21.15.60:0/3340175600 shutdown_connections 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 --2- 172.21.15.60:0/3340175600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6eeb40 0x563bdb6f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 --2- 172.21.15.60:0/3340175600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 --2- 172.21.15.60:0/3340175600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6b6310 0x563bdb6f6ed0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 -- 172.21.15.60:0/3340175600 >> 172.21.15.60:0/3340175600 conn(0x563bdb6f5600 msgr2=0x563bdb6f67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 -- 172.21.15.60:0/3340175600 shutdown_connections 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.572+0000 7fe130919740 1 -- 172.21.15.60:0/3340175600 wait complete. 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 1 -- start start 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 1 Processor -- start 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6b6310 0x563bdb6fc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb771c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281b0e80 con 0x563bdb6eeb40 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281b07b0 con 0x563bdb6b6310 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe1281ad9f0 con 0x563bdb6ed5d0 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe130919740 10 client.0 _ll_register_callbacks cb 0x7fe118009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:51.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe1277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb771c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe1277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb771c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37774/0 (socket says 172.21.15.60:37774) 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.573+0000 7fe1277fe640 1 -- 172.21.15.60:0/3481923285 learned_addr learned my addr 172.21.15.60:0/3481923285 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe127fff640 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6b6310 0x563bdb6fc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1277fe640 1 -- 172.21.15.60:0/3481923285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 msgr2=0x563bdb6fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1277fe640 1 -- 172.21.15.60:0/3481923285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6b6310 msgr2=0x563bdb6fc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6b6310 0x563bdb6fc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1277fe640 1 -- 172.21.15.60:0/3481923285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bdb7721b0 con 0x563bdb6eeb40 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1277fe640 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb771c70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe11c004700 tx=0x7fe11c0061e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c90ce45db6bde60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:51.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1077fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1077fe640 1 -- 172.21.15.60:0/3481923285 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11c006580 con 0x563bdb6eeb40 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1077fe640 1 -- 172.21.15.60:0/3481923285 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fe11c006720 con 0x563bdb6eeb40 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe130919740 1 -- 172.21.15.60:0/3481923285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe11c005d60 con 0x563bdb6eeb40 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe1077fe640 1 -- 172.21.15.60:0/3481923285 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fe11c006920 con 0x563bdb6eeb40 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe130919740 10 client.16968 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.574+0000 7fe130919740 1 -- 172.21.15.60:0/3481923285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563bdb773340 con 0x563bdb6eeb40 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe1077fe640 1 -- 172.21.15.60:0/3481923285 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe11c005d60 con 0x563bdb6eeb40 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe1077fe640 1 -- 172.21.15.60:0/3481923285 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fe11c0347e0 con 0x563bdb6eeb40 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe130919740 10 client.16968 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:51.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe130919740 10 client.16968 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe130919740 20 client.16968 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe130919740 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x563bdb6f8370 0x563bdb775770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe130919740 4 client.16968 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe130919740 1 -- 172.21.15.60:0/3481923285 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563bdb65ad70 con 0x563bdb6f8370 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe127fff640 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x563bdb6f8370 0x563bdb775770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe127fff640 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x563bdb6f8370 0x563bdb775770 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c95f3701eef383 server_cookie=a0b90005a07f8424 in_seq=0 out_seq=0 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.575+0000 7fe1077fe640 10 client.16968 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe1077fe640 1 -- 172.21.15.60:0/3481923285 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563bdb65ad70 con 0x563bdb6f8370 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe1077fe640 10 client.16968 handle_command_reply: tid=0 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 client.16968 shutdown 2024-09-12T00:05:51.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 -- 172.21.15.60:0/3481923285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 msgr2=0x563bdb771c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb771c70 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe11c004700 tx=0x7fe11c0061e0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 -- 172.21.15.60:0/3481923285 shutdown_connections 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x563bdb6f8370 0x563bdb775770 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe1077fe640 0 client.16968 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563bdb6eeb40 0x563bdb771c70 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563bdb6ed5d0 0x563bdb6fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 --2- 172.21.15.60:0/3481923285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563bdb6b6310 0x563bdb6fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 -- 172.21.15.60:0/3481923285 >> 172.21.15.60:0/3481923285 conn(0x563bdb6f5600 msgr2=0x563bdb6f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 -- 172.21.15.60:0/3481923285 shutdown_connections 2024-09-12T00:05:51.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 1 -- 172.21.15.60:0/3481923285 wait complete. 2024-09-12T00:05:51.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.576+0000 7fe130919740 20 client.16968 trim_cache size 0 max 16384 2024-09-12T00:05:51.586 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 -- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe1100a2cf0 msgr2=0x7fe1100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe1100a2cf0 0x7fe1100a51b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1200cd110 tx=0x7fe12000af30 comp rx=0 tx=0).stop 2024-09-12T00:05:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 -- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe12810c170 msgr2=0x7fe128101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe12810c170 0x7fe128101420 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe12000cce0 tx=0x7fe12000a620 comp rx=0 tx=0).stop 2024-09-12T00:05:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 -- 172.21.15.60:0/2235420663 shutdown_connections 2024-09-12T00:05:51.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe1100a2cf0 0x7fe1100a51b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe12810c170 0x7fe128101420 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe128103660 0x7fe128100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 --2- 172.21.15.60:0/2235420663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe128102d40 0x7fe1281009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:51.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 -- 172.21.15.60:0/2235420663 >> 172.21.15.60:0/2235420663 conn(0x7fe1280fc7a0 msgr2=0x7fe1280fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:51.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 -- 172.21.15.60:0/2235420663 shutdown_connections 2024-09-12T00:05:51.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:51.577+0000 7fe12e540640 1 -- 172.21.15.60:0/2235420663 wait complete. 2024-09-12T00:05:52.314 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:05:52.575 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 -- 172.21.15.60:0/3455782467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c102790 msgr2=0x7f2e0c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 --2- 172.21.15.60:0/3455782467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c102790 0x7f2e0c1067e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009900 tx=0x7f2df402a410 comp rx=0 tx=0).stop 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 -- 172.21.15.60:0/3455782467 shutdown_connections 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 --2- 172.21.15.60:0/3455782467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e0c106f10 0x7f2e0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 --2- 172.21.15.60:0/3455782467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c102790 0x7f2e0c1067e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 --2- 172.21.15.60:0/3455782467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c101de0 0x7f2e0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 -- 172.21.15.60:0/3455782467 >> 172.21.15.60:0/3455782467 conn(0x7f2e0c0fd8c0 msgr2=0x7f2e0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 -- 172.21.15.60:0/3455782467 shutdown_connections 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.067+0000 7f2e11516640 1 -- 172.21.15.60:0/3455782467 wait complete. 2024-09-12T00:05:53.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e11516640 1 Processor -- start 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e11516640 1 -- start start 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e11516640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c101de0 0x7f2e0c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e11516640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e0c102790 0x7f2e0c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e11516640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c106f10 0x7f2e0c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e11516640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1120e0 con 0x7f2e0c101de0 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e11516640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c111f60 con 0x7f2e0c106f10 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e11516640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c112260 con 0x7f2e0c102790 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e0affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c101de0 0x7f2e0c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e0affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c101de0 0x7f2e0c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37782/0 (socket says 172.21.15.60:37782) 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e0affd640 1 -- 172.21.15.60:0/2366147394 learned_addr learned my addr 172.21.15.60:0/2366147394 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:53.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.068+0000 7f2e03fff640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e0c102790 0x7f2e0c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c106f10 0x7f2e0c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e0affd640 1 -- 172.21.15.60:0/2366147394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e0c102790 msgr2=0x7f2e0c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e0affd640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e0c102790 0x7f2e0c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e0affd640 1 -- 172.21.15.60:0/2366147394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c106f10 msgr2=0x7f2e0c19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e0affd640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c106f10 0x7f2e0c19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e0affd640 1 -- 172.21.15.60:0/2366147394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c19d460 con 0x7f2e0c101de0 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e03fff640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e0c102790 0x7f2e0c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e0affd640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c101de0 0x7f2e0c1984b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c920 tx=0x7f2dfc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e08ff9640 1 -- 172.21.15.60:0/2366147394 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc007c70 con 0x7f2e0c101de0 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e08ff9640 1 -- 172.21.15.60:0/2366147394 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2dfc007e10 con 0x7f2e0c101de0 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e11516640 1 -- 172.21.15.60:0/2366147394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c19d750 con 0x7f2e0c101de0 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e08ff9640 1 -- 172.21.15.60:0/2366147394 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc018940 con 0x7f2e0c101de0 2024-09-12T00:05:53.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.069+0000 7f2e11516640 1 -- 172.21.15.60:0/2366147394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c1a5030 con 0x7f2e0c101de0 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e08ff9640 1 -- 172.21.15.60:0/2366147394 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2dfc018b20 con 0x7f2e0c101de0 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e138ef740 1 Processor -- start 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e138ef740 1 -- start start 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 0x5559e0ad0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 0x5559e0ad0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0add760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e138ef740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5559e0a362f0 con 0x5559e0adb370 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e138ef740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5559e09ddcf0 con 0x5559e0ad1b40 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e138ef740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5559e0a322b0 con 0x5559e0ad05d0 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0add760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0add760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37790/0 (socket says 172.21.15.60:37790) 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e03fff640 1 -- 172.21.15.60:0/3597786200 learned_addr learned my addr 172.21.15.60:0/3597786200 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e0affd640 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 0x5559e0ad0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.072+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 0x5559e0ad0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e08ff9640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2df80a2cf0 0x7f2df80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e03fff640 1 -- 172.21.15.60:0/3597786200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 msgr2=0x5559e0ad0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e03fff640 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 0x5559e0ad0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e03fff640 1 -- 172.21.15.60:0/3597786200 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 msgr2=0x5559e0ad0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e03fff640 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 0x5559e0ad0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e03fff640 1 -- 172.21.15.60:0/3597786200 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559e09c23a0 con 0x5559e0adb370 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2df80a2cf0 0x7f2df80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e08ff9640 1 -- 172.21.15.60:0/2366147394 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2dfc0cf650 con 0x7f2e0c101de0 2024-09-12T00:05:53.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e03fff640 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0add760 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009900 tx=0x7f2df40040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b70b72c9c78941 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e017fa640 1 -- 172.21.15.60:0/3597786200 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df403f070 con 0x5559e0adb370 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e017fa640 1 -- 172.21.15.60:0/3597786200 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2df4005520 con 0x5559e0adb370 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.073+0000 7f2e017fa640 1 -- 172.21.15.60:0/3597786200 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4035070 con 0x5559e0adb370 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 -- 172.21.15.60:0/3597786200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 msgr2=0x5559e0add760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0add760 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009900 tx=0x7f2df40040f0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2df80a2cf0 0x7f2df80a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400bd50 tx=0x7f2e04004a40 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 -- 172.21.15.60:0/3597786200 shutdown_connections 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0add760 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 0x5559e0ad0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 --2- 172.21.15.60:0/3597786200 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 0x5559e0ad0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 -- 172.21.15.60:0/3597786200 >> 172.21.15.60:0/3597786200 conn(0x5559e0a99310 msgr2=0x5559e0accc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 -- 172.21.15.60:0/3597786200 shutdown_connections 2024-09-12T00:05:53.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 -- 172.21.15.60:0/3597786200 wait complete. 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.074+0000 7f2e138ef740 1 -- start start 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e138ef740 1 Processor -- start 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 0x5559e0adad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0ad1b40 0x5559e0ad8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0adb370 0x5559e0ad8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e138ef740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5559e0ade010 con 0x5559e0ad1b40 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e138ef740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5559e09f1060 con 0x5559e0ad05d0 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e138ef740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5559e0ade190 con 0x5559e0adb370 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e138ef740 10 client.0 _ll_register_callbacks cb 0x5559e07448c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0ad1b40 0x5559e0ad8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0ad1b40 0x5559e0ad8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37796/0 (socket says 172.21.15.60:37796) 2024-09-12T00:05:53.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e03fff640 1 -- 172.21.15.60:0/1659103757 learned_addr learned my addr 172.21.15.60:0/1659103757 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e0affd640 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 0x5559e0adad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e03fff640 1 -- 172.21.15.60:0/1659103757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0adb370 msgr2=0x5559e0ad8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0adb370 0x5559e0ad8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e03fff640 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0adb370 0x5559e0ad8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e03fff640 1 -- 172.21.15.60:0/1659103757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 msgr2=0x5559e0adad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e03fff640 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 0x5559e0adad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.075+0000 7f2e03fff640 1 -- 172.21.15.60:0/1659103757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559e07a73c0 con 0x5559e0ad1b40 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e03fff640 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0ad1b40 0x5559e0ad8040 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2df4004d90 tx=0x7f2df4004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f0c2a04b311e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2df27fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2df27fc640 1 -- 172.21.15.60:0/1659103757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df404c060 con 0x5559e0ad1b40 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2df27fc640 1 -- 172.21.15.60:0/1659103757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2df4005300 con 0x5559e0ad1b40 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 1 -- 172.21.15.60:0/1659103757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2df4005520 con 0x5559e0ad1b40 2024-09-12T00:05:53.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2df27fc640 1 -- 172.21.15.60:0/1659103757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2df403f070 con 0x5559e0ad1b40 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 10 client.16980 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 1 -- 172.21.15.60:0/1659103757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5559e0ae9ae0 con 0x5559e0ad1b40 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2df27fc640 1 -- 172.21.15.60:0/1659103757 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2df4005520 con 0x5559e0ad1b40 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2df27fc640 1 -- 172.21.15.60:0/1659103757 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f2df4003890 con 0x5559e0ad1b40 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 10 client.16980 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 10 client.16980 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 20 client.16980 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5559e0aeae30 0x5559e0aed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 4 client.16980 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.076+0000 7f2e138ef740 1 -- 172.21.15.60:0/1659103757 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559e0a43860 con 0x5559e0aeae30 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.077+0000 7f2e0affd640 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5559e0aeae30 0x5559e0aed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.077+0000 7f2df27fc640 10 client.16980 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.077+0000 7f2e0affd640 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5559e0aeae30 0x5559e0aed220 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bcfdef7e12f7c51e server_cookie=9fc74193a62a2038 in_seq=0 out_seq=0 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2df27fc640 1 -- 172.21.15.60:0/1659103757 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559e0a43860 con 0x5559e0aeae30 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2df27fc640 10 client.16980 handle_command_reply: tid=0 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 client.16980 shutdown 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 -- 172.21.15.60:0/1659103757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0ad1b40 msgr2=0x5559e0ad8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0ad1b40 0x5559e0ad8040 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2df4004d90 tx=0x7f2df4004510 comp rx=0 tx=0).stop 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 -- 172.21.15.60:0/1659103757 shutdown_connections 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5559e0aeae30 0x5559e0aed220 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0adb370 0x5559e0ad8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2df27fc640 0 client.16980 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0ad1b40 0x5559e0ad8040 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1659103757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 0x5559e0adad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 -- 172.21.15.60:0/1659103757 >> 172.21.15.60:0/1659103757 conn(0x5559e0a99310 msgr2=0x5559e0ad2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 -- 172.21.15.60:0/1659103757 shutdown_connections 2024-09-12T00:05:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 1 -- 172.21.15.60:0/1659103757 wait complete. 2024-09-12T00:05:53.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.078+0000 7f2e138ef740 20 client.16980 trim_cache size 0 max 16384 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e138ef740 1 Processor -- start 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e138ef740 1 -- start start 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 0x5559e0ad9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 0x5559e0ad3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0ad3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e138ef740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1ad730 con 0x5559e0adb370 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e138ef740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1af270 con 0x5559e0ad1b40 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e138ef740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1ade00 con 0x5559e0ad05d0 2024-09-12T00:05:53.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0ad3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0ad3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37804/0 (socket says 172.21.15.60:37804) 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0b7fe640 1 -- 172.21.15.60:0/2806593406 learned_addr learned my addr 172.21.15.60:0/2806593406 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e03fff640 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 0x5559e0ad3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0affd640 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 0x5559e0ad9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0b7fe640 1 -- 172.21.15.60:0/2806593406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 msgr2=0x5559e0ad9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 0x5559e0ad9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0b7fe640 1 -- 172.21.15.60:0/2806593406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 msgr2=0x5559e0ad3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 0x5559e0ad3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.092+0000 7f2e0b7fe640 1 -- 172.21.15.60:0/2806593406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559e0acd960 con 0x5559e0adb370 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.093+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0ad3660 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400bf70 tx=0x7f2e04013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50972cbfa79a471e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:53.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.093+0000 7f2e00ff9640 1 -- 172.21.15.60:0/2806593406 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0401a840 con 0x5559e0adb370 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.093+0000 7f2e00ff9640 1 -- 172.21.15.60:0/2806593406 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e0401c420 con 0x5559e0adb370 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.093+0000 7f2e00ff9640 1 -- 172.21.15.60:0/2806593406 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400e690 con 0x5559e0adb370 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 -- 172.21.15.60:0/2806593406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 msgr2=0x5559e0ad3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0ad3660 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400bf70 tx=0x7f2e04013000 comp rx=0 tx=0).stop 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 -- 172.21.15.60:0/2806593406 shutdown_connections 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0ad3660 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad1b40 0x5559e0ad3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 --2- 172.21.15.60:0/2806593406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad05d0 0x5559e0ad9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 -- 172.21.15.60:0/2806593406 >> 172.21.15.60:0/2806593406 conn(0x5559e0a99310 msgr2=0x5559e0ad98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 -- 172.21.15.60:0/2806593406 shutdown_connections 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 -- 172.21.15.60:0/2806593406 wait complete. 2024-09-12T00:05:53.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 -- start start 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 Processor -- start 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.094+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 0x5559e0af0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad1b40 0x5559e0af0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e138ef740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0aed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e138ef740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1aeba0 con 0x5559e0adb370 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e138ef740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1ae4d0 con 0x5559e0ad05d0 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e138ef740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c1ab710 con 0x5559e0ad1b40 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e138ef740 10 client.0 _ll_register_callbacks cb 0x7f2dfc0d5420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0aed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0aed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37808/0 (socket says 172.21.15.60:37808) 2024-09-12T00:05:53.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 -- 172.21.15.60:0/1024362315 learned_addr learned my addr 172.21.15.60:0/1024362315 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0affd640 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 0x5559e0af0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e03fff640 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad1b40 0x5559e0af0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 -- 172.21.15.60:0/1024362315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad1b40 msgr2=0x5559e0af0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad1b40 0x5559e0af0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 -- 172.21.15.60:0/1024362315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 msgr2=0x5559e0af0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 0x5559e0af0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 -- 172.21.15.60:0/1024362315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559e0aed760 con 0x5559e0adb370 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e03fff640 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad1b40 0x5559e0af0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e0b7fe640 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0aed220 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2e04010c30 tx=0x7f2e0401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6620c6244dd945 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2df27fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2df27fc640 1 -- 172.21.15.60:0/1024362315 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04035060 con 0x5559e0adb370 2024-09-12T00:05:53.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2df27fc640 1 -- 172.21.15.60:0/1024362315 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f2e0401a850 con 0x5559e0adb370 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.095+0000 7f2e138ef740 1 -- 172.21.15.60:0/1024362315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e0401c420 con 0x5559e0adb370 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2df27fc640 1 -- 172.21.15.60:0/1024362315 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2e0401aa50 con 0x5559e0adb370 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e138ef740 10 client.16986 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e138ef740 1 -- 172.21.15.60:0/1024362315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5559e0b55f10 con 0x5559e0adb370 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2df27fc640 1 -- 172.21.15.60:0/1024362315 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e0401c420 con 0x5559e0adb370 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2df27fc640 1 -- 172.21.15.60:0/1024362315 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f2e04026cd0 con 0x5559e0adb370 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e138ef740 10 client.16986 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e138ef740 10 client.16986 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e138ef740 20 client.16986 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5559e0b56630 0x5559e0b58a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e138ef740 4 client.16986 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:53.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e138ef740 1 -- 172.21.15.60:0/1024362315 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559e0a3dd70 con 0x5559e0b56630 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.096+0000 7f2e0affd640 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5559e0b56630 0x5559e0b58a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e0affd640 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5559e0b56630 0x5559e0b58a50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0c8ea4269f68140 server_cookie=fbff9b38a454de1a in_seq=0 out_seq=0 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2df27fc640 10 client.16986 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2df27fc640 1 -- 172.21.15.60:0/1024362315 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559e0a3dd70 con 0x5559e0b56630 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2df27fc640 10 client.16986 handle_command_reply: tid=0 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 client.16986 shutdown 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 -- 172.21.15.60:0/1024362315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 msgr2=0x5559e0aed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0aed220 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2e04010c30 tx=0x7f2e0401cc00 comp rx=0 tx=0).stop 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 -- 172.21.15.60:0/1024362315 shutdown_connections 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5559e0b56630 0x5559e0b58a50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2df27fc640 0 client.16986 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:05:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5559e0adb370 0x5559e0aed220 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5559e0ad1b40 0x5559e0af0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 --2- 172.21.15.60:0/1024362315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5559e0ad05d0 0x5559e0af0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.097+0000 7f2e138ef740 1 -- 172.21.15.60:0/1024362315 >> 172.21.15.60:0/1024362315 conn(0x5559e0a99310 msgr2=0x5559e0ada0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e138ef740 1 -- 172.21.15.60:0/1024362315 shutdown_connections 2024-09-12T00:05:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e138ef740 1 -- 172.21.15.60:0/1024362315 wait complete. 2024-09-12T00:05:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e138ef740 20 client.16986 trim_cache size 0 max 16384 2024-09-12T00:05:53.107 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 -- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2df80a2cf0 msgr2=0x7f2df80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2df80a2cf0 0x7f2df80a51b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400bd50 tx=0x7f2e04004a40 comp rx=0 tx=0).stop 2024-09-12T00:05:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 -- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c101de0 msgr2=0x7f2e0c1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c101de0 0x7f2e0c1984b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c920 tx=0x7f2dfc00cde0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 -- 172.21.15.60:0/2366147394 shutdown_connections 2024-09-12T00:05:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2df80a2cf0 0x7f2df80a51b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e0c106f10 0x7f2e0c19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e0c102790 0x7f2e0c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 --2- 172.21.15.60:0/2366147394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e0c101de0 0x7f2e0c1984b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 -- 172.21.15.60:0/2366147394 >> 172.21.15.60:0/2366147394 conn(0x7f2e0c0fd8c0 msgr2=0x7f2e0c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.098+0000 7f2e11516640 1 -- 172.21.15.60:0/2366147394 shutdown_connections 2024-09-12T00:05:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:53.099+0000 7f2e11516640 1 -- 172.21.15.60:0/2366147394 wait complete. 2024-09-12T00:05:53.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:52 smithi105 ceph-mon[34805]: pgmap v198: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:53.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:52 smithi192 ceph-mon[35487]: pgmap v198: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:53.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:52 smithi060 ceph-mon[30953]: pgmap v198: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:53.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:05:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:54.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.518+0000 7fdcc88d0640 1 -- 172.21.15.60:0/4162429665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4100e20 msgr2=0x7fdcc4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.518+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/4162429665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4100e20 0x7fdcc4101200 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009ca0 tx=0x7fdcb402a950 comp rx=0 tx=0).stop 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.519+0000 7fdcc88d0640 1 -- 172.21.15.60:0/4162429665 shutdown_connections 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.519+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/4162429665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc4102ef0 0x7fdcc410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.519+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/4162429665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcc4102570 0x7fdcc41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.519+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/4162429665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4100e20 0x7fdcc4101200 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.519+0000 7fdcc88d0640 1 -- 172.21.15.60:0/4162429665 >> 172.21.15.60:0/4162429665 conn(0x7fdcc40fc7d0 msgr2=0x7fdcc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.519+0000 7fdcc88d0640 1 -- 172.21.15.60:0/4162429665 shutdown_connections 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.519+0000 7fdcc88d0640 1 -- 172.21.15.60:0/4162429665 wait complete. 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.519+0000 7fdcc88d0640 1 Processor -- start 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc88d0640 1 -- start start 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc88d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc4100e20 0x7fdcc4199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc88d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4102570 0x7fdcc4199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc88d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcc4102ef0 0x7fdcc41a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc88d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41110a0 con 0x7fdcc4102570 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc88d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4110f20 con 0x7fdcc4102ef0 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc88d0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc4111220 con 0x7fdcc4100e20 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4102570 0x7fdcc4199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4102570 0x7fdcc4199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37826/0 (socket says 172.21.15.60:37826) 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/3918794048 learned_addr learned my addr 172.21.15.60:0/3918794048 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc259c640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc4100e20 0x7fdcc4199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc2d9d640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcc4102ef0 0x7fdcc41a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/3918794048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc4100e20 msgr2=0x7fdcc4199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc4100e20 0x7fdcc4199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/3918794048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcc4102ef0 msgr2=0x7fdcc41a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcc4102ef0 0x7fdcc41a44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/3918794048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc41a49e0 con 0x7fdcc4102570 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.520+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4102570 0x7fdcc4199960 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00d950 tx=0x7fdcac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.521+0000 7fdcbb7fe640 1 -- 172.21.15.60:0/3918794048 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac017070 con 0x7fdcc4102570 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.521+0000 7fdcbb7fe640 1 -- 172.21.15.60:0/3918794048 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcac009c30 con 0x7fdcc4102570 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.521+0000 7fdcc88d0640 1 -- 172.21.15.60:0/3918794048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc41a4bb0 con 0x7fdcc4102570 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.521+0000 7fdcbb7fe640 1 -- 172.21.15.60:0/3918794048 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00f740 con 0x7fdcc4102570 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.521+0000 7fdcc88d0640 1 -- 172.21.15.60:0/3918794048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc41a50f0 con 0x7fdcc4102570 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.523+0000 7fdcbb7fe640 1 -- 172.21.15.60:0/3918794048 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdcac010a80 con 0x7fdcc4102570 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.523+0000 7fdccaca9740 1 Processor -- start 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdccaca9740 1 -- start start 2024-09-12T00:05:54.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcbb7fe640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdcb00a2cf0 0x7fdcb00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac0ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac18760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdccaca9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bc1ab712f0 con 0x55bc1ac0cb40 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdccaca9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55bc1ab18cf0 con 0x55bc1ac0b5d0 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdccaca9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bc1ab6d2b0 con 0x55bc1ac16370 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc2d9d640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdcb00a2cf0 0x7fdcb00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac0ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37840/0 (socket says 172.21.15.60:37840) 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc259c640 1 -- 172.21.15.60:0/3944830118 learned_addr learned my addr 172.21.15.60:0/3944830118 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcbb7fe640 1 -- 172.21.15.60:0/3918794048 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fdcac0cefe0 con 0x7fdcc4102570 2024-09-12T00:05:54.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc2d9d640 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac18760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc259c640 1 -- 172.21.15.60:0/3944830118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 msgr2=0x55bc1ac18760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc259c640 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac18760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc259c640 1 -- 172.21.15.60:0/3944830118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 msgr2=0x55bc1ac0ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc259c640 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac0ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc259c640 1 -- 172.21.15.60:0/3944830118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc1aafd3a0 con 0x55bc1ac0cb40 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc2d9d640 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac18760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.524+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac0ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.525+0000 7fdcc2d9d640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdcb00a2cf0 0x7fdcb00a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00b970 tx=0x7fdcbc00bd70 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:54.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.525+0000 7fdcc259c640 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0b090 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009ca0 tx=0x7fdcb40099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a633b0ec7e9d72f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.525+0000 7fdcb8ff9640 1 -- 172.21.15.60:0/3944830118 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4048070 con 0x55bc1ac0cb40 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.525+0000 7fdcb8ff9640 1 -- 172.21.15.60:0/3944830118 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcb402fa70 con 0x55bc1ac0cb40 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.525+0000 7fdcb8ff9640 1 -- 172.21.15.60:0/3944830118 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4034040 con 0x55bc1ac0cb40 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- 172.21.15.60:0/3944830118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 msgr2=0x55bc1ac0b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0b090 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009ca0 tx=0x7fdcb40099b0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- 172.21.15.60:0/3944830118 shutdown_connections 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac18760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac0ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3944830118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0b090 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- 172.21.15.60:0/3944830118 >> 172.21.15.60:0/3944830118 conn(0x55bc1abd4310 msgr2=0x55bc1ac07c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- 172.21.15.60:0/3944830118 shutdown_connections 2024-09-12T00:05:54.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- 172.21.15.60:0/3944830118 wait complete. 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- start start 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 Processor -- start 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac15d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac12fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac13570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55bc1ac1d420 con 0x55bc1ac0cb40 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55bc1ab2c060 con 0x55bc1ac0b5d0 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.526+0000 7fdccaca9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bc1ac1d5a0 con 0x55bc1ac16370 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdccaca9740 10 client.0 _ll_register_callbacks cb 0x55bc1a87f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac12fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac12fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37854/0 (socket says 172.21.15.60:37854) 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/3508933899 learned_addr learned my addr 172.21.15.60:0/3508933899 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:54.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc259c640 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac15d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/3508933899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 msgr2=0x55bc1ac13570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac13570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/3508933899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 msgr2=0x55bc1ac15d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac15d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/3508933899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc1a8e23c0 con 0x55bc1ac0cb40 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc259c640 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac15d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac12fd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fdcac010fd0 tx=0x7fdcac09afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15215af1ad2e7748 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdca9ffb640 1 -- 172.21.15.60:0/3508933899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac020040 con 0x55bc1ac0cb40 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdca9ffb640 1 -- 172.21.15.60:0/3508933899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fdcac075d70 con 0x55bc1ac0cb40 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdccaca9740 1 -- 172.21.15.60:0/3508933899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcb402fa70 con 0x55bc1ac0cb40 2024-09-12T00:05:54.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdca9ffb640 1 -- 172.21.15.60:0/3508933899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fdcac097040 con 0x55bc1ac0cb40 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdccaca9740 10 client.16998 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.527+0000 7fdccaca9740 1 -- 172.21.15.60:0/3508933899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55bc1ac28e70 con 0x55bc1ac0cb40 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdca9ffb640 1 -- 172.21.15.60:0/3508933899 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcac077080 con 0x55bc1ac0cb40 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdca9ffb640 1 -- 172.21.15.60:0/3508933899 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fdcac0731a0 con 0x55bc1ac0cb40 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdccaca9740 10 client.16998 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdccaca9740 10 client.16998 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdccaca9740 20 client.16998 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bc1ac2a2d0 0x55bc1ac2c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdccaca9740 4 client.16998 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdccaca9740 1 -- 172.21.15.60:0/3508933899 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc1ab7e860 con 0x55bc1ac2a2d0 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.528+0000 7fdcc259c640 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bc1ac2a2d0 0x55bc1ac2c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.529+0000 7fdca9ffb640 10 client.16998 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:54.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.529+0000 7fdcc259c640 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bc1ac2a2d0 0x55bc1ac2c760 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c3c2b4bf38dcd2d server_cookie=d6a4490e1ce2b4b4 in_seq=0 out_seq=0 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.529+0000 7fdca9ffb640 1 -- 172.21.15.60:0/3508933899 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc1ab7e860 con 0x55bc1ac2a2d0 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.529+0000 7fdca9ffb640 10 client.16998 handle_command_reply: tid=0 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 client.16998 shutdown 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 -- 172.21.15.60:0/3508933899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 msgr2=0x55bc1ac12fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac12fd0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fdcac010fd0 tx=0x7fdcac09afe0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 -- 172.21.15.60:0/3508933899 shutdown_connections 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bc1ac2a2d0 0x55bc1ac2c760 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac13570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac12fd0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdca9ffb640 0 client.16998 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 --2- 172.21.15.60:0/3508933899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac15d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 -- 172.21.15.60:0/3508933899 >> 172.21.15.60:0/3508933899 conn(0x55bc1abd4310 msgr2=0x55bc1ac0d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 -- 172.21.15.60:0/3508933899 shutdown_connections 2024-09-12T00:05:54.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 1 -- 172.21.15.60:0/3508933899 wait complete. 2024-09-12T00:05:54.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.530+0000 7fdccaca9740 20 client.16998 trim_cache size 0 max 16384 2024-09-12T00:05:54.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.543+0000 7fdccaca9740 1 Processor -- start 2024-09-12T00:05:54.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.543+0000 7fdccaca9740 1 -- start start 2024-09-12T00:05:54.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.543+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac266c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.543+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.543+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac0e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.543+0000 7fdccaca9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41ab5b0 con 0x55bc1ac0b5d0 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.543+0000 7fdccaca9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41ad0f0 con 0x55bc1ac0cb40 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.543+0000 7fdccaca9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41abc80 con 0x55bc1ac16370 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac266c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37864/0 (socket says 172.21.15.60:37864) 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 -- 172.21.15.60:0/1657217444 learned_addr learned my addr 172.21.15.60:0/1657217444 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 -- 172.21.15.60:0/1657217444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 msgr2=0x55bc1ac0e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 --2- 172.21.15.60:0/1657217444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac0e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 -- 172.21.15.60:0/1657217444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0cb40 msgr2=0x55bc1ac0e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 --2- 172.21.15.60:0/1657217444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 -- 172.21.15.60:0/1657217444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc1ac138e0 con 0x55bc1ac0b5d0 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcc259c640 1 --2- 172.21.15.60:0/1657217444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac266c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4006010 tx=0x7fdcb4003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be85ae097abd6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcabfff640 1 -- 172.21.15.60:0/1657217444 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4048040 con 0x55bc1ac0b5d0 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcabfff640 1 -- 172.21.15.60:0/1657217444 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcb4054070 con 0x55bc1ac0b5d0 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.544+0000 7fdcabfff640 1 -- 172.21.15.60:0/1657217444 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4034040 con 0x55bc1ac0b5d0 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 -- 172.21.15.60:0/1657217444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0b5d0 msgr2=0x55bc1ac266c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 --2- 172.21.15.60:0/1657217444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac266c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4006010 tx=0x7fdcb4003e90 comp rx=0 tx=0).stop 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 -- 172.21.15.60:0/1657217444 shutdown_connections 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 --2- 172.21.15.60:0/1657217444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac16370 0x55bc1ac0e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 --2- 172.21.15.60:0/1657217444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac0e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 --2- 172.21.15.60:0/1657217444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac266c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 -- 172.21.15.60:0/1657217444 >> 172.21.15.60:0/1657217444 conn(0x55bc1abd4310 msgr2=0x55bc1ac120c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 -- 172.21.15.60:0/1657217444 shutdown_connections 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 -- 172.21.15.60:0/1657217444 wait complete. 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 -- start start 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.545+0000 7fdccaca9740 1 Processor -- start 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac23060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac1e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdccaca9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac16370 0x55bc1ac1e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdccaca9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41aca20 con 0x55bc1ac0cb40 2024-09-12T00:05:54.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdccaca9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41ac350 con 0x55bc1ac16370 2024-09-12T00:05:54.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdccaca9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc41a95b0 con 0x55bc1ac0b5d0 2024-09-12T00:05:54.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdccaca9740 10 client.0 _ll_register_callbacks cb 0x7fdcac0971e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:54.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac1e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac1e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37866/0 (socket says 172.21.15.60:37866) 2024-09-12T00:05:54.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/2978065043 learned_addr learned my addr 172.21.15.60:0/2978065043 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:54.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc2d9d640 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac16370 0x55bc1ac1e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc259c640 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac23060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac0b5d0 msgr2=0x55bc1ac23060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac23060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/2978065043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac16370 msgr2=0x55bc1ac1e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac16370 0x55bc1ac1e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 -- 172.21.15.60:0/2978065043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc1ac1f1b0 con 0x55bc1ac0cb40 2024-09-12T00:05:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc259c640 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac23060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdcc1d9b640 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac1e390 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0ccd80 tx=0x7fdcac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d0fc003f608575 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:54.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdca9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:54.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdca9ffb640 1 -- 172.21.15.60:0/2978065043 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac014020 con 0x55bc1ac0cb40 2024-09-12T00:05:54.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdca9ffb640 1 -- 172.21.15.60:0/2978065043 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7fdcac09ac50 con 0x55bc1ac0cb40 2024-09-12T00:05:54.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.546+0000 7fdccaca9740 1 -- 172.21.15.60:0/2978065043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcb4054070 con 0x55bc1ac0cb40 2024-09-12T00:05:54.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdca9ffb640 1 -- 172.21.15.60:0/2978065043 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fdcac09af60 con 0x55bc1ac0cb40 2024-09-12T00:05:54.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdccaca9740 10 client.17004 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:54.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdccaca9740 1 -- 172.21.15.60:0/2978065043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55bc1ac950e0 con 0x55bc1ac0cb40 2024-09-12T00:05:54.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdca9ffb640 1 -- 172.21.15.60:0/2978065043 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdcb4054070 con 0x55bc1ac0cb40 2024-09-12T00:05:54.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdca9ffb640 1 -- 172.21.15.60:0/2978065043 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fdcac0b4200 con 0x55bc1ac0cb40 2024-09-12T00:05:54.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdccaca9740 10 client.17004 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:54.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdccaca9740 10 client.17004 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:54.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdccaca9740 20 client.17004 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:54.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdccaca9740 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bc1ac95680 0x55bc1ac97aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:54.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdccaca9740 4 client.17004 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:05:54.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdccaca9740 1 -- 172.21.15.60:0/2978065043 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc1ab78d70 con 0x55bc1ac95680 2024-09-12T00:05:54.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.547+0000 7fdcc259c640 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bc1ac95680 0x55bc1ac97aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:54.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdcc259c640 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bc1ac95680 0x55bc1ac97aa0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6450c794577aae server_cookie=d11eec9cc6082361 in_seq=0 out_seq=0 2024-09-12T00:05:54.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdca9ffb640 10 client.17004 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:54.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdca9ffb640 1 -- 172.21.15.60:0/2978065043 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc1ab78d70 con 0x55bc1ac95680 2024-09-12T00:05:54.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdca9ffb640 10 client.17004 handle_command_reply: tid=0 2024-09-12T00:05:54.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 client.17004 shutdown 2024-09-12T00:05:54.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 -- 172.21.15.60:0/2978065043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 msgr2=0x55bc1ac1e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac1e390 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0ccd80 tx=0x7fdcac000bc0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 -- 172.21.15.60:0/2978065043 shutdown_connections 2024-09-12T00:05:54.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55bc1ac95680 0x55bc1ac97aa0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55bc1ac16370 0x55bc1ac1e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdca9ffb640 0 client.17004 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:54.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55bc1ac0cb40 0x55bc1ac1e390 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 --2- 172.21.15.60:0/2978065043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc1ac0b5d0 0x55bc1ac23060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 -- 172.21.15.60:0/2978065043 >> 172.21.15.60:0/2978065043 conn(0x55bc1abd4310 msgr2=0x55bc1ac14830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:54.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 -- 172.21.15.60:0/2978065043 shutdown_connections 2024-09-12T00:05:54.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.548+0000 7fdccaca9740 1 -- 172.21.15.60:0/2978065043 wait complete. 2024-09-12T00:05:54.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdccaca9740 20 client.17004 trim_cache size 0 max 16384 2024-09-12T00:05:54.560 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:05:54.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 -- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdcb00a2cf0 msgr2=0x7fdcb00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdcb00a2cf0 0x7fdcb00a51b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00b970 tx=0x7fdcbc00bd70 comp rx=0 tx=0).stop 2024-09-12T00:05:54.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 -- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4102570 msgr2=0x7fdcc4199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:54.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4102570 0x7fdcc4199960 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00d950 tx=0x7fdcac00de10 comp rx=0 tx=0).stop 2024-09-12T00:05:54.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 -- 172.21.15.60:0/3918794048 shutdown_connections 2024-09-12T00:05:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdcb00a2cf0 0x7fdcb00a51b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcc4102ef0 0x7fdcc41a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4102570 0x7fdcc4199960 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 --2- 172.21.15.60:0/3918794048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc4100e20 0x7fdcc4199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 -- 172.21.15.60:0/3918794048 >> 172.21.15.60:0/3918794048 conn(0x7fdcc40fc7d0 msgr2=0x7fdcc40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 -- 172.21.15.60:0/3918794048 shutdown_connections 2024-09-12T00:05:54.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:54.549+0000 7fdcc88d0640 1 -- 172.21.15.60:0/3918794048 wait complete. 2024-09-12T00:05:55.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:54 smithi105 ceph-mon[34805]: pgmap v199: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:55.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:54 smithi192 ceph-mon[35487]: pgmap v199: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:55.341 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:54 smithi060 ceph-mon[30953]: pgmap v199: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:05:56.371 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:05:56.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:05:56.646 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:57.029 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:56 smithi060 ceph-mon[30953]: pgmap v200: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 -- 172.21.15.60:0/1667615373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6006a370 msgr2=0x7f6f601009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 --2- 172.21.15.60:0/1667615373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6006a370 0x7f6f601009c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009900 tx=0x7f6f4802a410 comp rx=0 tx=0).stop 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 -- 172.21.15.60:0/1667615373 shutdown_connections 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 --2- 172.21.15.60:0/1667615373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f60104e80 0x7f6f60105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 --2- 172.21.15.60:0/1667615373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f6006a370 0x7f6f601009c0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 --2- 172.21.15.60:0/1667615373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f60069f00 0x7f6f60100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 -- 172.21.15.60:0/1667615373 >> 172.21.15.60:0/1667615373 conn(0x7f6f60077210 msgr2=0x7f6f600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 -- 172.21.15.60:0/1667615373 shutdown_connections 2024-09-12T00:05:57.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.116+0000 7f6f6552e640 1 -- 172.21.15.60:0/1667615373 wait complete. 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f6552e640 1 Processor -- start 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f6552e640 1 -- start start 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f6552e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f60069f00 0x7f6f60198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f6552e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f6006a370 0x7f6f60198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f6552e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f60104e80 0x7f6f6019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f6552e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60110fd0 con 0x7f6f60104e80 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f6552e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60110e50 con 0x7f6f60069f00 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f6552e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60111150 con 0x7f6f6006a370 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f60104e80 0x7f6f6019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f60104e80 0x7f6f6019cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37876/0 (socket says 172.21.15.60:37876) 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.117+0000 7f6f5f7fe640 1 -- 172.21.15.60:0/4035069563 learned_addr learned my addr 172.21.15.60:0/4035069563 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f567fc640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f6006a370 0x7f6f60198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5effd640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f60069f00 0x7f6f60198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5f7fe640 1 -- 172.21.15.60:0/4035069563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f6006a370 msgr2=0x7f6f60198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5f7fe640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f6006a370 0x7f6f60198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5f7fe640 1 -- 172.21.15.60:0/4035069563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f60069f00 msgr2=0x7f6f60198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5f7fe640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f60069f00 0x7f6f60198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5f7fe640 1 -- 172.21.15.60:0/4035069563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6019d5e0 con 0x7f6f60104e80 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5f7fe640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f60104e80 0x7f6f6019cf00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800eaa0 tx=0x7f6f5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5cff9640 1 -- 172.21.15.60:0/4035069563 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800cdb0 con 0x7f6f60104e80 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5cff9640 1 -- 172.21.15.60:0/4035069563 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f58004b20 con 0x7f6f60104e80 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f6552e640 1 -- 172.21.15.60:0/4035069563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6019d8d0 con 0x7f6f60104e80 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f5cff9640 1 -- 172.21.15.60:0/4035069563 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58011760 con 0x7f6f60104e80 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.118+0000 7f6f6552e640 1 -- 172.21.15.60:0/4035069563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f601a51b0 con 0x7f6f60104e80 2024-09-12T00:05:57.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f5cff9640 1 -- 172.21.15.60:0/4035069563 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6f58004cd0 con 0x7f6f60104e80 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f67907740 1 Processor -- start 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f67907740 1 -- start start 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f67907740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb974ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f67907740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb975a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f67907740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb975d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f67907740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558eb96b5280 con 0x558eb975ad40 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f67907740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558eb965cb10 con 0x558eb974fb60 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f67907740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558eb96b1240 con 0x558eb9750480 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.121+0000 7f6f5cff9640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f4c0a2cf0 0x7f6f4c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb975d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb975d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37880/0 (socket says 172.21.15.60:37880) 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 -- 172.21.15.60:0/3040006034 learned_addr learned my addr 172.21.15.60:0/3040006034 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:57.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f5cff9640 1 -- 172.21.15.60:0/4035069563 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6f580cf610 con 0x7f6f60104e80 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f5f7fe640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f4c0a2cf0 0x7f6f4c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f5effd640 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb975a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb974ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 -- 172.21.15.60:0/3040006034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 msgr2=0x558eb975a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb975a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 -- 172.21.15.60:0/3040006034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 msgr2=0x558eb974ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb974ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 -- 172.21.15.60:0/3040006034 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eb96691f0 con 0x558eb975ad40 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f567fc640 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb975d130 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6f48000c00 tx=0x7f6f48005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab2f44f8ac11395 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f5f7fe640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f4c0a2cf0 0x7f6f4c0a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f5809bb10 tx=0x7f6f58009270 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f557fa640 1 -- 172.21.15.60:0/3040006034 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48035070 con 0x558eb975ad40 2024-09-12T00:05:57.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f557fa640 1 -- 172.21.15.60:0/3040006034 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f48031800 con 0x558eb975ad40 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.122+0000 7f6f557fa640 1 -- 172.21.15.60:0/3040006034 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48005630 con 0x558eb975ad40 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 -- 172.21.15.60:0/3040006034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 msgr2=0x558eb975d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb975d130 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6f48000c00 tx=0x7f6f48005d50 comp rx=0 tx=0).stop 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 -- 172.21.15.60:0/3040006034 shutdown_connections 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb975d130 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb975a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 --2- 172.21.15.60:0/3040006034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb974ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 -- 172.21.15.60:0/3040006034 >> 172.21.15.60:0/3040006034 conn(0x558eb974c0f0 msgr2=0x558eb974c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 -- 172.21.15.60:0/3040006034 shutdown_connections 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.123+0000 7f6f67907740 1 -- 172.21.15.60:0/3040006034 wait complete. 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 1 -- start start 2024-09-12T00:05:57.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 1 Processor -- start 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb9757cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb9758730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558eb975d910 con 0x558eb975ad40 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558eb966ff10 con 0x558eb974fb60 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558eb975da90 con 0x558eb9750480 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f67907740 10 client.0 _ll_register_callbacks cb 0x558eb9638a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb9758730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb9758730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37896/0 (socket says 172.21.15.60:37896) 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 -- 172.21.15.60:0/3282641726 learned_addr learned my addr 172.21.15.60:0/3282641726 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f5effd640 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb9757cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 -- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 msgr2=0x558eb97581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 -- 172.21.15.60:0/3282641726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 msgr2=0x558eb9757cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb9757cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f567fc640 1 -- 172.21.15.60:0/3282641726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eb94266a0 con 0x558eb975ad40 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.124+0000 7f6f5effd640 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f567fc640 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb9758730 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6f48005310 tx=0x7f6f48005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cb153f2e945c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f467fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f467fc640 1 -- 172.21.15.60:0/3282641726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48035070 con 0x558eb975ad40 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f467fc640 1 -- 172.21.15.60:0/3282641726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6f48004030 con 0x558eb975ad40 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 1 -- 172.21.15.60:0/3282641726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f48031800 con 0x558eb975ad40 2024-09-12T00:05:57.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f467fc640 1 -- 172.21.15.60:0/3282641726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6f48004250 con 0x558eb975ad40 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 10 client.17016 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 1 -- 172.21.15.60:0/3282641726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558eb97695a0 con 0x558eb975ad40 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f467fc640 1 -- 172.21.15.60:0/3282641726 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f48031800 con 0x558eb975ad40 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f467fc640 1 -- 172.21.15.60:0/3282641726 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f6f480046c0 con 0x558eb975ad40 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 10 client.17016 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 10 client.17016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 20 client.17016 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558eb976a8f0 0x558eb976cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 4 client.17016 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.125+0000 7f6f67907740 1 -- 172.21.15.60:0/3282641726 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eb96c27f0 con 0x558eb976a8f0 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.126+0000 7f6f5effd640 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558eb976a8f0 0x558eb976cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.126+0000 7f6f5effd640 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558eb976a8f0 0x558eb976cce0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc0fef1f83fc124b server_cookie=d004b3608929a142 in_seq=0 out_seq=0 2024-09-12T00:05:57.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.126+0000 7f6f467fc640 10 client.17016 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f467fc640 1 -- 172.21.15.60:0/3282641726 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558eb96c27f0 con 0x558eb976a8f0 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f467fc640 10 client.17016 handle_command_reply: tid=0 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 client.17016 shutdown 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 -- 172.21.15.60:0/3282641726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 msgr2=0x558eb9758730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb9758730 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6f48005310 tx=0x7f6f48005210 comp rx=0 tx=0).stop 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 -- 172.21.15.60:0/3282641726 shutdown_connections 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558eb976a8f0 0x558eb976cce0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb9758730 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 --2- 172.21.15.60:0/3282641726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb9757cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 -- 172.21.15.60:0/3282641726 >> 172.21.15.60:0/3282641726 conn(0x558eb974c0f0 msgr2=0x558eb9751dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:57.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f467fc640 0 client.17016 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:57.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 -- 172.21.15.60:0/3282641726 shutdown_connections 2024-09-12T00:05:57.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 1 -- 172.21.15.60:0/3282641726 wait complete. 2024-09-12T00:05:57.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.127+0000 7f6f67907740 20 client.17016 trim_cache size 0 max 16384 2024-09-12T00:05:57.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.144+0000 7f6f67907740 1 Processor -- start 2024-09-12T00:05:57.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.144+0000 7f6f67907740 1 -- start start 2024-09-12T00:05:57.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f67907740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb976fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f67907740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb9750480 0x558eb9770250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f67907740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb975ad40 0x558eb9765ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f67907740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f601ad7d0 con 0x558eb9750480 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f67907740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f601af310 con 0x558eb974fb60 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f67907740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6f601adea0 con 0x558eb975ad40 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb9750480 0x558eb9770250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb9750480 0x558eb9770250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37912/0 (socket says 172.21.15.60:37912) 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 -- 172.21.15.60:0/2105065277 learned_addr learned my addr 172.21.15.60:0/2105065277 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f567fc640 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb975ad40 0x558eb9765ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f567fc640 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb976fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 -- 172.21.15.60:0/2105065277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb975ad40 msgr2=0x558eb9765ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:57.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb975ad40 0x558eb9765ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 -- 172.21.15.60:0/2105065277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 msgr2=0x558eb976fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb976fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 -- 172.21.15.60:0/2105065277 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eb9747830 con 0x558eb9750480 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f567fc640 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb975ad40 0x558eb9765ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.145+0000 7f6f5effd640 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb9750480 0x558eb9770250 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6f50005920 tx=0x7f6f50005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2752cbc2bcb180 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f54ff9640 1 -- 172.21.15.60:0/2105065277 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50004250 con 0x558eb9750480 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f54ff9640 1 -- 172.21.15.60:0/2105065277 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f500043f0 con 0x558eb9750480 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f54ff9640 1 -- 172.21.15.60:0/2105065277 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50027b10 con 0x558eb9750480 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 -- 172.21.15.60:0/2105065277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb9750480 msgr2=0x558eb9770250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb9750480 0x558eb9770250 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6f50005920 tx=0x7f6f50005f90 comp rx=0 tx=0).stop 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 -- 172.21.15.60:0/2105065277 shutdown_connections 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb975ad40 0x558eb9765ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb9750480 0x558eb9770250 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 --2- 172.21.15.60:0/2105065277 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb976fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 -- 172.21.15.60:0/2105065277 >> 172.21.15.60:0/2105065277 conn(0x558eb974c0f0 msgr2=0x558eb9759c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 -- 172.21.15.60:0/2105065277 shutdown_connections 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.146+0000 7f6f67907740 1 -- 172.21.15.60:0/2105065277 wait complete. 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 1 -- start start 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 1 Processor -- start 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb97cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb97d8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f601aec40 con 0x558eb975ad40 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f601ae570 con 0x558eb974fb60 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6f601ab7b0 con 0x558eb9750480 2024-09-12T00:05:57.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f67907740 10 client.0 _ll_register_callbacks cb 0x7f6f50009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f567fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb97d8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f567fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb97d8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37922/0 (socket says 172.21.15.60:37922) 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f567fc640 1 -- 172.21.15.60:0/1245378633 learned_addr learned my addr 172.21.15.60:0/1245378633 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f5effd640 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.147+0000 7f6f567fc640 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb97cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f567fc640 1 -- 172.21.15.60:0/1245378633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 msgr2=0x558eb97cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f567fc640 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f567fc640 1 -- 172.21.15.60:0/1245378633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 msgr2=0x558eb97cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f567fc640 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb97cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f567fc640 1 -- 172.21.15.60:0/1245378633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eb97d88a0 con 0x558eb975ad40 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f567fc640 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb97d8260 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6f48051040 tx=0x7f6f48005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3c7cb2274eb5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:57.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f467fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f467fc640 1 -- 172.21.15.60:0/1245378633 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48035030 con 0x558eb975ad40 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f67907740 1 -- 172.21.15.60:0/1245378633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f500043f0 con 0x558eb975ad40 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f467fc640 1 -- 172.21.15.60:0/1245378633 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f6f48058490 con 0x558eb975ad40 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f467fc640 1 -- 172.21.15.60:0/1245378633 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6f48031800 con 0x558eb975ad40 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f67907740 10 client.17022 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f67907740 1 -- 172.21.15.60:0/1245378633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558eb97d9ba0 con 0x558eb975ad40 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.148+0000 7f6f467fc640 1 -- 172.21.15.60:0/1245378633 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f500043f0 con 0x558eb975ad40 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f467fc640 1 -- 172.21.15.60:0/1245378633 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f6f4803d4e0 con 0x558eb975ad40 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f67907740 10 client.17022 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f67907740 10 client.17022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f67907740 20 client.17022 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f67907740 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558eb97da150 0x558eb97dc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:57.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f67907740 4 client.17022 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:05:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f67907740 1 -- 172.21.15.60:0/1245378633 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558eb96bcd00 con 0x558eb97da150 2024-09-12T00:05:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f5effd640 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558eb97da150 0x558eb97dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f5effd640 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558eb97da150 0x558eb97dc570 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=902ff0d33619f56f server_cookie=6740c932ffb0f3e6 in_seq=0 out_seq=0 2024-09-12T00:05:57.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.149+0000 7f6f467fc640 10 client.17022 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.150+0000 7f6f467fc640 1 -- 172.21.15.60:0/1245378633 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558eb96bcd00 con 0x558eb97da150 2024-09-12T00:05:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.150+0000 7f6f467fc640 10 client.17022 handle_command_reply: tid=0 2024-09-12T00:05:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.150+0000 7f6f67907740 1 client.17022 shutdown 2024-09-12T00:05:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 -- 172.21.15.60:0/1245378633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 msgr2=0x558eb97d8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb97d8260 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6f48051040 tx=0x7f6f48005210 comp rx=0 tx=0).stop 2024-09-12T00:05:57.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 -- 172.21.15.60:0/1245378633 shutdown_connections 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558eb97da150 0x558eb97dc570 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558eb975ad40 0x558eb97d8260 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558eb9750480 0x558eb97cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 --2- 172.21.15.60:0/1245378633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558eb974fb60 0x558eb97cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f467fc640 0 client.17022 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 -- 172.21.15.60:0/1245378633 >> 172.21.15.60:0/1245378633 conn(0x558eb974c0f0 msgr2=0x558eb9756470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 -- 172.21.15.60:0/1245378633 shutdown_connections 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 1 -- 172.21.15.60:0/1245378633 wait complete. 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f67907740 20 client.17022 trim_cache size 0 max 16384 2024-09-12T00:05:57.156 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:05:57.157 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:05:57.157 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "46519cea-b997-49e0-876e-345d43d0df65", 2024-09-12T00:05:57.157 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:05:57.157 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:05:57.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f6552e640 1 -- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f4c0a2cf0 msgr2=0x7f6f4c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f6552e640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f4c0a2cf0 0x7f6f4c0a51b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f5809bb10 tx=0x7f6f58009270 comp rx=0 tx=0).stop 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f6552e640 1 -- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f60104e80 msgr2=0x7f6f6019cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.151+0000 7f6f6552e640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f60104e80 0x7f6f6019cf00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800eaa0 tx=0x7f6f5800ef60 comp rx=0 tx=0).stop 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.152+0000 7f6f6552e640 1 -- 172.21.15.60:0/4035069563 shutdown_connections 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.152+0000 7f6f6552e640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6f4c0a2cf0 0x7f6f4c0a51b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.152+0000 7f6f6552e640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f60104e80 0x7f6f6019cf00 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.152+0000 7f6f6552e640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f6006a370 0x7f6f60198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.152+0000 7f6f6552e640 1 --2- 172.21.15.60:0/4035069563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f60069f00 0x7f6f60198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.152+0000 7f6f6552e640 1 -- 172.21.15.60:0/4035069563 >> 172.21.15.60:0/4035069563 conn(0x7f6f60077210 msgr2=0x7f6f600fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.152+0000 7f6f6552e640 1 -- 172.21.15.60:0/4035069563 shutdown_connections 2024-09-12T00:05:57.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:57.152+0000 7f6f6552e640 1 -- 172.21.15.60:0/4035069563 wait complete. 2024-09-12T00:05:57.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:56 smithi105 ceph-mon[34805]: pgmap v200: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:57.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:56 smithi192 ceph-mon[35487]: pgmap v200: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:05:57.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:05:58.245 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:05:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.716+0000 7f509959e640 1 -- 172.21.15.60:0/3934541415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 msgr2=0x7f50941006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.716+0000 7f509959e640 1 --2- 172.21.15.60:0/3934541415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 0x7f50941006d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5084009930 tx=0x7f508402a420 comp rx=0 tx=0).stop 2024-09-12T00:05:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.716+0000 7f509959e640 1 -- 172.21.15.60:0/3934541415 shutdown_connections 2024-09-12T00:05:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.716+0000 7f509959e640 1 --2- 172.21.15.60:0/3934541415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5094106f50 0x7f509410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.716+0000 7f509959e640 1 --2- 172.21.15.60:0/3934541415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5094100ca0 0x7f5094106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.716+0000 7f509959e640 1 --2- 172.21.15.60:0/3934541415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 0x7f50941006d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.716+0000 7f509959e640 1 -- 172.21.15.60:0/3934541415 >> 172.21.15.60:0/3934541415 conn(0x7f5094077210 msgr2=0x7f50940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 -- 172.21.15.60:0/3934541415 shutdown_connections 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 -- 172.21.15.60:0/3934541415 wait complete. 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 Processor -- start 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 -- start start 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 0x7f5094101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5094100ca0 0x7f50941017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5094106f50 0x7f5094101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50941120e0 con 0x7f50941002f0 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5094111f60 con 0x7f5094106f50 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.717+0000 7f509959e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5094112260 con 0x7f5094100ca0 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 0x7f5094101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 0x7f5094101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37928/0 (socket says 172.21.15.60:37928) 2024-09-12T00:05:58.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 -- 172.21.15.60:0/3180620399 learned_addr learned my addr 172.21.15.60:0/3180620399 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f50937fe640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5094106f50 0x7f5094101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f508bfff640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5094100ca0 0x7f50941017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 -- 172.21.15.60:0/3180620399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5094100ca0 msgr2=0x7f50941017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5094100ca0 0x7f50941017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 -- 172.21.15.60:0/3180620399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5094106f50 msgr2=0x7f5094101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5094106f50 0x7f5094101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 -- 172.21.15.60:0/3180620399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50941a6a20 con 0x7f50941002f0 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f50937fe640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5094106f50 0x7f5094101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f508bfff640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5094100ca0 0x7f50941017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5092ffd640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 0x7f5094101270 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5084009230 tx=0x7f5084004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5090ff9640 1 -- 172.21.15.60:0/3180620399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508403f030 con 0x7f50941002f0 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5090ff9640 1 -- 172.21.15.60:0/3180620399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5084003af0 con 0x7f50941002f0 2024-09-12T00:05:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f509959e640 1 -- 172.21.15.60:0/3180620399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50941a6cb0 con 0x7f50941002f0 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f5090ff9640 1 -- 172.21.15.60:0/3180620399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084035070 con 0x7f50941002f0 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.718+0000 7f509959e640 1 -- 172.21.15.60:0/3180620399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50941a7190 con 0x7f50941002f0 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.720+0000 7f5090ff9640 1 -- 172.21.15.60:0/3180620399 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5084042030 con 0x7f50941002f0 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f509b977740 1 Processor -- start 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f509b977740 1 -- start start 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f509b977740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcac4a0 0x56083bcac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f509b977740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 0x56083bcb7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f5090ff9640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f50800a2d70 0x7f50800a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f509b977740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f509b977740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56083bc122e0 con 0x56083bcb7680 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f509b977740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56083bbb9ce0 con 0x56083bcac4a0 2024-09-12T00:05:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.721+0000 7f509b977740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56083bc0e2a0 con 0x56083bcacdc0 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f5092ffd640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f50800a2d70 0x7f50800a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37936/0 (socket says 172.21.15.60:37936) 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 -- 172.21.15.60:0/374840262 learned_addr learned my addr 172.21.15.60:0/374840262 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f508bfff640 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 0x56083bcb7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcac4a0 0x56083bcac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 -- 172.21.15.60:0/374840262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 msgr2=0x56083bcb7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 0x56083bcb7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 -- 172.21.15.60:0/374840262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcac4a0 msgr2=0x56083bcac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f5090ff9640 1 -- 172.21.15.60:0/3180620399 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f50840efcb0 con 0x7f50941002f0 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcac4a0 0x56083bcac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 -- 172.21.15.60:0/374840262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56083bb9e440 con 0x56083bcb7680 2024-09-12T00:05:58.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f5092ffd640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f50800a2d70 0x7f50800a5230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50840b8740 tx=0x7f50840b7e50 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50937fe640 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb9a70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f508c012a10 tx=0x7f508c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9753d34aa35cdb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50897fa640 1 -- 172.21.15.60:0/374840262 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c004b20 con 0x56083bcb7680 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50897fa640 1 -- 172.21.15.60:0/374840262 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f508c010d30 con 0x56083bcb7680 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.722+0000 7f50897fa640 1 -- 172.21.15.60:0/374840262 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c005680 con 0x56083bcb7680 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 -- 172.21.15.60:0/374840262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 msgr2=0x56083bcb9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb9a70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f508c012a10 tx=0x7f508c009750 comp rx=0 tx=0).stop 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 -- 172.21.15.60:0/374840262 shutdown_connections 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb9a70 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 0x56083bcb7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 --2- 172.21.15.60:0/374840262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcac4a0 0x56083bcac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 -- 172.21.15.60:0/374840262 >> 172.21.15.60:0/374840262 conn(0x56083bca8a30 msgr2=0x56083bca8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 -- 172.21.15.60:0/374840262 shutdown_connections 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.723+0000 7f509b977740 1 -- 172.21.15.60:0/374840262 wait complete. 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 1 -- start start 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 1 Processor -- start 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcb7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcacdc0 0x56083bcb42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56083bcba250 con 0x56083bcb7680 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56083bbcd050 con 0x56083bcacdc0 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56083bcba3d0 con 0x56083bcac4a0 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f509b977740 10 client.0 _ll_register_callbacks cb 0x56083bc0d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.724+0000 7f50937fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcb7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcb7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:57214/0 (socket says 172.21.15.60:57214) 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 -- 172.21.15.60:0/824907426 learned_addr learned my addr 172.21.15.60:0/824907426 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f508bfff640 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcacdc0 0x56083bcb42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 -- 172.21.15.60:0/824907426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcacdc0 msgr2=0x56083bcb42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcacdc0 0x56083bcb42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 -- 172.21.15.60:0/824907426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 msgr2=0x56083bcb4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 -- 172.21.15.60:0/824907426 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56083b9833c0 con 0x56083bcac4a0 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f50937fe640 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcb7000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f508c010740 tx=0x7f508c012460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86675f1e3f902e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.725+0000 7f507a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f507a7fc640 1 -- 172.21.15.60:0/824907426 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c004b00 con 0x56083bcac4a0 2024-09-12T00:05:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 1 -- 172.21.15.60:0/824907426 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f508c010d30 con 0x56083bcac4a0 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f507a7fc640 1 -- 172.21.15.60:0/824907426 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f508c004ca0 con 0x56083bcac4a0 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f507a7fc640 1 -- 172.21.15.60:0/824907426 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f508c02c8d0 con 0x56083bcac4a0 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 10 client.26308 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 1 -- 172.21.15.60:0/824907426 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56083bcc5c70 con 0x56083bcac4a0 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f507a7fc640 1 -- 172.21.15.60:0/824907426 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f508c010d30 con 0x56083bcac4a0 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f507a7fc640 1 -- 172.21.15.60:0/824907426 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f508c00c030 con 0x56083bcac4a0 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 10 client.26308 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 10 client.26308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 20 client.26308 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56083bcc7020 0x56083bcc9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 4 client.26308 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.726+0000 7f509b977740 1 -- 172.21.15.60:0/824907426 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56083bc1f850 con 0x56083bcc7020 2024-09-12T00:05:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.727+0000 7f508bfff640 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56083bcc7020 0x56083bcc9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.727+0000 7f508bfff640 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56083bcc7020 0x56083bcc9410 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2db081ea87baf26 server_cookie=2efb71633fb5231b in_seq=0 out_seq=0 2024-09-12T00:05:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.727+0000 7f507a7fc640 10 client.26308 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f507a7fc640 1 -- 172.21.15.60:0/824907426 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56083bc1f850 con 0x56083bcc7020 2024-09-12T00:05:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f507a7fc640 10 client.26308 handle_command_reply: tid=0 2024-09-12T00:05:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 client.26308 shutdown 2024-09-12T00:05:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 -- 172.21.15.60:0/824907426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 msgr2=0x56083bcb7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcb7000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f508c010740 tx=0x7f508c012460 comp rx=0 tx=0).stop 2024-09-12T00:05:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 -- 172.21.15.60:0/824907426 shutdown_connections 2024-09-12T00:05:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56083bcc7020 0x56083bcc9410 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcb7680 0x56083bcb4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcacdc0 0x56083bcb42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f507a7fc640 0 client.26308 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 --2- 172.21.15.60:0/824907426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcb7000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 -- 172.21.15.60:0/824907426 >> 172.21.15.60:0/824907426 conn(0x56083bca8a30 msgr2=0x56083bcae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 -- 172.21.15.60:0/824907426 shutdown_connections 2024-09-12T00:05:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 1 -- 172.21.15.60:0/824907426 wait complete. 2024-09-12T00:05:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.728+0000 7f509b977740 20 client.26308 trim_cache size 0 max 16384 2024-09-12T00:05:58.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f509b977740 1 Processor -- start 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f509b977740 1 -- start start 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f509b977740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcac4a0 0x56083bcc34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f509b977740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 0x56083bcb3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f509b977740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 0x56083bca8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f509b977740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50941ab710 con 0x56083bcac4a0 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f509b977740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50941ad250 con 0x56083bcb7680 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f509b977740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f50941abde0 con 0x56083bcacdc0 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f50937fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcac4a0 0x56083bcc34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f50937fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcac4a0 0x56083bcc34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37950/0 (socket says 172.21.15.60:37950) 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f50937fe640 1 -- 172.21.15.60:0/3317495728 learned_addr learned my addr 172.21.15.60:0/3317495728 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f508bfff640 1 --2- 172.21.15.60:0/3317495728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 0x56083bcb3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f50937fe640 1 -- 172.21.15.60:0/3317495728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 msgr2=0x56083bcb3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f50937fe640 1 --2- 172.21.15.60:0/3317495728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 0x56083bcb3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f50937fe640 1 -- 172.21.15.60:0/3317495728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 msgr2=0x56083bca8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f50937fe640 1 --2- 172.21.15.60:0/3317495728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 0x56083bca8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.746+0000 7f50937fe640 1 -- 172.21.15.60:0/3317495728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56083bcb4ba0 con 0x56083bcac4a0 2024-09-12T00:05:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.747+0000 7f50937fe640 1 --2- 172.21.15.60:0/3317495728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcac4a0 0x56083bcc34e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f508c01f6a0 tx=0x7f508c01f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fba88da9ff6d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.747+0000 7f5088ff9640 1 -- 172.21.15.60:0/3317495728 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c009e50 con 0x56083bcac4a0 2024-09-12T00:05:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.747+0000 7f5088ff9640 1 -- 172.21.15.60:0/3317495728 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f508c016040 con 0x56083bcac4a0 2024-09-12T00:05:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.747+0000 7f5088ff9640 1 -- 172.21.15.60:0/3317495728 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c005670 con 0x56083bcac4a0 2024-09-12T00:05:58.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.747+0000 7f509b977740 1 -- 172.21.15.60:0/3317495728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcac4a0 msgr2=0x56083bcc34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.747+0000 7f509b977740 1 --2- 172.21.15.60:0/3317495728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcac4a0 0x56083bcc34e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f508c01f6a0 tx=0x7f508c01f460 comp rx=0 tx=0).stop 2024-09-12T00:05:58.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 -- 172.21.15.60:0/3317495728 shutdown_connections 2024-09-12T00:05:58.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 --2- 172.21.15.60:0/3317495728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 0x56083bca8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 --2- 172.21.15.60:0/3317495728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcacdc0 0x56083bcb3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 --2- 172.21.15.60:0/3317495728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcac4a0 0x56083bcc34e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 -- 172.21.15.60:0/3317495728 >> 172.21.15.60:0/3317495728 conn(0x56083bca8a30 msgr2=0x56083bcb3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 -- 172.21.15.60:0/3317495728 shutdown_connections 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 -- 172.21.15.60:0/3317495728 wait complete. 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 -- start start 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 Processor -- start 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcba710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcacdc0 0x56083bcbac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 0x56083bd2fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.748+0000 7f509b977740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50941acb80 con 0x56083bcacdc0 2024-09-12T00:05:58.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f509b977740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50941ac4b0 con 0x56083bcb7680 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f509b977740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f50941a96f0 con 0x56083bcac4a0 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f509b977740 10 client.0 _ll_register_callbacks cb 0x7f508c0124d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcacdc0 0x56083bcbac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcacdc0 0x56083bcbac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37964/0 (socket says 172.21.15.60:37964) 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 -- 172.21.15.60:0/2939523833 learned_addr learned my addr 172.21.15.60:0/2939523833 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f50937fe640 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 0x56083bd2fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f50937fe640 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 -- 172.21.15.60:0/2939523833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 msgr2=0x56083bcba710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcba710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 -- 172.21.15.60:0/2939523833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 msgr2=0x56083bd2fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 0x56083bd2fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 -- 172.21.15.60:0/2939523833 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56083bd30000 con 0x56083bcacdc0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f50937fe640 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 0x56083bd2fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f508bfff640 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcacdc0 0x56083bcbac50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f507c004700 tx=0x7f507c00f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929113e79b21994d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f507a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f507a7fc640 1 -- 172.21.15.60:0/2939523833 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c01c940 con 0x56083bcacdc0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f507a7fc640 1 -- 172.21.15.60:0/2939523833 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8440+0+0 (secure 0 0 0) 0x7f507c01cae0 con 0x56083bcacdc0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.749+0000 7f509b977740 1 -- 172.21.15.60:0/2939523833 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f508c016040 con 0x56083bcacdc0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f507a7fc640 1 -- 172.21.15.60:0/2939523833 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f507c02b050 con 0x56083bcacdc0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f509b977740 10 client.17040 fetch_fsmap learned FSMap version 52 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f509b977740 1 -- 172.21.15.60:0/2939523833 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56083bd31220 con 0x56083bcacdc0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f507a7fc640 1 -- 172.21.15.60:0/2939523833 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f508c016040 con 0x56083bcacdc0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f507a7fc640 1 -- 172.21.15.60:0/2939523833 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f507c025520 con 0x56083bcacdc0 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f509b977740 10 client.17040 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:05:58.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f509b977740 10 client.17040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f509b977740 20 client.17040 populate_metadata read hostname 'smithi060' 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f509b977740 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56083bd31a20 0x56083bd33e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f509b977740 4 client.17040 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f509b977740 1 -- 172.21.15.60:0/2939523833 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56083bc19d60 con 0x56083bd31a20 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.750+0000 7f50937fe640 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56083bd31a20 0x56083bd33e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f50937fe640 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56083bd31a20 0x56083bd33e40 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d09e5a07d5db84cb server_cookie=354e4dbb7a6a24ad in_seq=0 out_seq=0 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f507a7fc640 10 client.17040 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f507a7fc640 1 -- 172.21.15.60:0/2939523833 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56083bc19d60 con 0x56083bd31a20 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f507a7fc640 10 client.17040 handle_command_reply: tid=0 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 client.17040 shutdown 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 -- 172.21.15.60:0/2939523833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcacdc0 msgr2=0x56083bcbac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcacdc0 0x56083bcbac50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f507c004700 tx=0x7f507c00f8b0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 -- 172.21.15.60:0/2939523833 shutdown_connections 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56083bd31a20 0x56083bd33e40 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56083bcb7680 0x56083bd2fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56083bcacdc0 0x56083bcbac50 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 --2- 172.21.15.60:0/2939523833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56083bcac4a0 0x56083bcba710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 -- 172.21.15.60:0/2939523833 >> 172.21.15.60:0/2939523833 conn(0x56083bca8a30 msgr2=0x56083bcb3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f507a7fc640 0 client.17040 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 -- 172.21.15.60:0/2939523833 shutdown_connections 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 1 -- 172.21.15.60:0/2939523833 wait complete. 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.751+0000 7f509b977740 20 client.17040 trim_cache size 0 max 16384 2024-09-12T00:05:58.756 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:05:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:05:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:05:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "46519cea-b997-49e0-876e-345d43d0df65": { 2024-09-12T00:05:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:05:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "46519cea-b997-49e0-876e-345d43d0df65", 2024-09-12T00:05:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:05:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:05:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:05:58.758 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:05:58.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 -- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f50800a2d70 msgr2=0x7f50800a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f50800a2d70 0x7f50800a5230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50840b8740 tx=0x7f50840b7e50 comp rx=0 tx=0).stop 2024-09-12T00:05:58.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 -- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 msgr2=0x7f5094101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:05:58.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 0x7f5094101270 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5084009230 tx=0x7f5084004270 comp rx=0 tx=0).stop 2024-09-12T00:05:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 -- 172.21.15.60:0/3180620399 shutdown_connections 2024-09-12T00:05:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f50800a2d70 0x7f50800a5230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5094106f50 0x7f5094101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5094100ca0 0x7f50941017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 --2- 172.21.15.60:0/3180620399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50941002f0 0x7f5094101270 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:05:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 -- 172.21.15.60:0/3180620399 >> 172.21.15.60:0/3180620399 conn(0x7f5094077210 msgr2=0x7f5094105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:05:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 -- 172.21.15.60:0/3180620399 shutdown_connections 2024-09-12T00:05:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:05:58.752+0000 7f509959e640 1 -- 172.21.15.60:0/3180620399 wait complete. 2024-09-12T00:05:59.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:58 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:05:59.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:58 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:59.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:58 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:05:59.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:58 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:59.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:58 smithi105 ceph-mon[34805]: pgmap v201: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-12T00:05:59.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:58 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:05:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:58 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:58 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:05:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:58 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:59.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:58 smithi192 ceph-mon[35487]: pgmap v201: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-12T00:05:59.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:58 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:05:59.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:58 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:59.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:58 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:05:59.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:58 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:05:59.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:58 smithi060 ceph-mon[30953]: pgmap v201: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-09-12T00:05:59.533 INFO:tasks.cephfs.filesystem:scrub status for tag:46519cea-b997-49e0-876e-345d43d0df65 - {'path': '/', 'tag': '46519cea-b997-49e0-876e-345d43d0df65', 'options': 'recursive,force'} 2024-09-12T00:06:00.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:05:59 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:06:00.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:05:59 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:06:00.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:05:59 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:06:01.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:00 smithi105 ceph-mon[34805]: pgmap v202: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T00:06:01.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:00 smithi192 ceph-mon[35487]: pgmap v202: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T00:06:01.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:00 smithi060 ceph-mon[30953]: pgmap v202: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T00:06:03.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:02 smithi105 ceph-mon[34805]: pgmap v203: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:03.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:02 smithi192 ceph-mon[35487]: pgmap v203: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:03.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:02 smithi060 ceph-mon[30953]: pgmap v203: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:05.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:04 smithi105 ceph-mon[34805]: pgmap v204: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-12T00:06:05.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:04 smithi192 ceph-mon[35487]: pgmap v204: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-12T00:06:05.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:04 smithi060 ceph-mon[30953]: pgmap v204: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-12T00:06:07.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:06 smithi105 ceph-mon[34805]: pgmap v205: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-12T00:06:07.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:06 smithi192 ceph-mon[35487]: pgmap v205: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-12T00:06:07.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:06 smithi060 ceph-mon[30953]: pgmap v205: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-12T00:06:09.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:08 smithi192 ceph-mon[35487]: pgmap v206: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-12T00:06:09.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:08 smithi060 ceph-mon[30953]: pgmap v206: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-12T00:06:09.478 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:08 smithi105 ceph-mon[34805]: pgmap v206: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-12T00:06:10.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:09 smithi192 ceph-mon[35487]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T00:06:10.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:09 smithi060 ceph-mon[30953]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T00:06:10.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:09 smithi105 ceph-mon[34805]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T00:06:11.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:10 smithi192 ceph-mon[35487]: pgmap v208: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-12T00:06:11.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:10 smithi060 ceph-mon[30953]: pgmap v208: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-12T00:06:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:10 smithi105 ceph-mon[34805]: pgmap v208: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-12T00:06:13.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:12 smithi192 ceph-mon[35487]: pgmap v209: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-12T00:06:13.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:12 smithi060 ceph-mon[30953]: pgmap v209: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-12T00:06:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:12 smithi105 ceph-mon[34805]: pgmap v209: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-12T00:06:15.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:15 smithi192 ceph-mon[35487]: pgmap v210: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:15.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:15 smithi060 ceph-mon[30953]: pgmap v210: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:15 smithi105 ceph-mon[34805]: pgmap v210: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:17.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:17 smithi192 ceph-mon[35487]: pgmap v211: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:17.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:17 smithi060 ceph-mon[30953]: pgmap v211: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:17.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:17 smithi105 ceph-mon[34805]: pgmap v211: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:19.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:18 smithi105 ceph-mon[34805]: pgmap v212: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:19.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:18 smithi105 ceph-mon[34805]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T00:06:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:18 smithi192 ceph-mon[35487]: pgmap v212: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:18 smithi192 ceph-mon[35487]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T00:06:19.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:18 smithi060 ceph-mon[30953]: pgmap v212: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:19.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:18 smithi060 ceph-mon[30953]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T00:06:21.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:20 smithi105 ceph-mon[34805]: pgmap v214: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:21.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:20 smithi192 ceph-mon[35487]: pgmap v214: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:21.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:20 smithi060 ceph-mon[30953]: pgmap v214: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:23.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:22 smithi105 ceph-mon[34805]: pgmap v215: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:23.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:22 smithi192 ceph-mon[35487]: pgmap v215: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:23.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:22 smithi060 ceph-mon[30953]: pgmap v215: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:06:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:24 smithi105 ceph-mon[34805]: pgmap v216: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:25.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:24 smithi192 ceph-mon[35487]: pgmap v216: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:25.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:24 smithi060 ceph-mon[30953]: pgmap v216: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:27.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:26 smithi105 ceph-mon[34805]: pgmap v217: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:27.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:26 smithi192 ceph-mon[35487]: pgmap v217: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:27.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:26 smithi060 ceph-mon[30953]: pgmap v217: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:29.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:28 smithi105 ceph-mon[34805]: pgmap v218: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:29.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:28 smithi192 ceph-mon[35487]: pgmap v218: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:29.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:28 smithi060 ceph-mon[30953]: pgmap v218: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:06:29.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:06:29.809 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:30.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 -- 172.21.15.60:0/2180526459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218074590 msgr2=0x7fd218074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 --2- 172.21.15.60:0/2180526459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218074590 0x7fd218074970 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd214009900 tx=0x7fd21402a480 comp rx=0 tx=0).stop 2024-09-12T00:06:30.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 -- 172.21.15.60:0/2180526459 shutdown_connections 2024-09-12T00:06:30.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 --2- 172.21.15.60:0/2180526459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd218112b90 0x7fd218114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 --2- 172.21.15.60:0/2180526459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd218074eb0 0x7fd218112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 --2- 172.21.15.60:0/2180526459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218074590 0x7fd218074970 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 -- 172.21.15.60:0/2180526459 >> 172.21.15.60:0/2180526459 conn(0x7fd2180fd8c0 msgr2=0x7fd2180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 -- 172.21.15.60:0/2180526459 shutdown_connections 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 -- 172.21.15.60:0/2180526459 wait complete. 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 Processor -- start 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.291+0000 7fd21f605640 1 -- start start 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21f605640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd218074590 0x7fd2181a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21f605640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd218074eb0 0x7fd2181a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21f605640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218112b90 0x7fd21819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21f605640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181186b0 con 0x7fd218112b90 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21f605640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd218118530 con 0x7fd218074eb0 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21f605640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd218118830 con 0x7fd218074590 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218112b90 0x7fd21819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218112b90 0x7fd21819e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50730/0 (socket says 172.21.15.60:50730) 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21d3a1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd218074590 0x7fd2181a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 -- 172.21.15.60:0/2782776683 learned_addr learned my addr 172.21.15.60:0/2782776683 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21cba0640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd218074eb0 0x7fd2181a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 -- 172.21.15.60:0/2782776683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd218074590 msgr2=0x7fd2181a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd218074590 0x7fd2181a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 -- 172.21.15.60:0/2782776683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd218074eb0 msgr2=0x7fd2181a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd218074eb0 0x7fd2181a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 -- 172.21.15.60:0/2782776683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21819f0b0 con 0x7fd218112b90 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21cba0640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd218074eb0 0x7fd2181a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.292+0000 7fd21dba2640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218112b90 0x7fd21819e980 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd21000cad0 tx=0x7fd21000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.293+0000 7fd20e7fc640 1 -- 172.21.15.60:0/2782776683 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21000ae20 con 0x7fd218112b90 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.293+0000 7fd20e7fc640 1 -- 172.21.15.60:0/2782776683 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd210004030 con 0x7fd218112b90 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.293+0000 7fd21f605640 1 -- 172.21.15.60:0/2782776683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21819f3a0 con 0x7fd218112b90 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.293+0000 7fd20e7fc640 1 -- 172.21.15.60:0/2782776683 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21000f830 con 0x7fd218112b90 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.293+0000 7fd21f605640 1 -- 172.21.15.60:0/2782776683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2181ab690 con 0x7fd218112b90 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.295+0000 7fd20e7fc640 1 -- 172.21.15.60:0/2782776683 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd2100041e0 con 0x7fd218112b90 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.295+0000 7fd2219de740 1 Processor -- start 2024-09-12T00:06:30.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.295+0000 7fd2219de740 1 -- start start 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd2219de740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd2219de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd2219de740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd2219de740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b3bb7322e0 con 0x55b3bb7d7680 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd2219de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b3bb6d9ce0 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd2219de740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b3bb72e2a0 con 0x55b3bb7cc4a0 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd20e7fc640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2040a2cf0 0x7fd2040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50742/0 (socket says 172.21.15.60:50742) 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 -- 172.21.15.60:0/800052736 learned_addr learned my addr 172.21.15.60:0/800052736 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21dba2640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2040a2cf0 0x7fd2040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21d3a1640 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd20e7fc640 1 -- 172.21.15.60:0/2782776683 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7fd2100cf760 con 0x7fd218112b90 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 -- 172.21.15.60:0/800052736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 msgr2=0x55b3bb7cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 -- 172.21.15.60:0/800052736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 msgr2=0x55b3bb7d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 -- 172.21.15.60:0/800052736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bb6be440 con 0x55b3bb7d7680 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21dba2640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2040a2cf0 0x7fd2040a51b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd210098670 tx=0x7fd210097900 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.296+0000 7fd21cba0640 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d9a70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd2080124f0 tx=0x7fd20800b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209bb9d49d1c19ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2037fe640 1 -- 172.21.15.60:0/800052736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208018030 con 0x55b3bb7d7680 2024-09-12T00:06:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2037fe640 1 -- 172.21.15.60:0/800052736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd208005020 con 0x55b3bb7d7680 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2037fe640 1 -- 172.21.15.60:0/800052736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208004b30 con 0x55b3bb7d7680 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 -- 172.21.15.60:0/800052736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 msgr2=0x55b3bb7d9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d9a70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd2080124f0 tx=0x7fd20800b640 comp rx=0 tx=0).stop 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 -- 172.21.15.60:0/800052736 shutdown_connections 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d9a70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 --2- 172.21.15.60:0/800052736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 -- 172.21.15.60:0/800052736 >> 172.21.15.60:0/800052736 conn(0x55b3bb7c8a30 msgr2=0x55b3bb7c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 -- 172.21.15.60:0/800052736 shutdown_connections 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.297+0000 7fd2219de740 1 -- 172.21.15.60:0/800052736 wait complete. 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 1 -- start start 2024-09-12T00:06:30.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 1 Processor -- start 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7d7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b3bb7da250 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b3bb6ed050 con 0x55b3bb7d7680 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b3bb7da3d0 con 0x55b3bb7cc4a0 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd2219de740 10 client.0 _ll_register_callbacks cb 0x55b3bb72d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd21d3a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd21d3a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50758/0 (socket says 172.21.15.60:50758) 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.298+0000 7fd21d3a1640 1 -- 172.21.15.60:0/3749858908 learned_addr learned my addr 172.21.15.60:0/3749858908 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21cba0640 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21cba0640 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21d3a1640 1 -- 172.21.15.60:0/3749858908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 msgr2=0x55b3bb7d7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21d3a1640 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7d7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21d3a1640 1 -- 172.21.15.60:0/3749858908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7d7680 msgr2=0x55b3bb7d4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21d3a1640 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21d3a1640 1 -- 172.21.15.60:0/3749858908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3bb4a33c0 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21cba0640 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd21d3a1640 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d4330 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd214009230 tx=0x7fd214031aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ec3fc084ec557f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd200ff9640 1 -- 172.21.15.60:0/3749858908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214035040 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd200ff9640 1 -- 172.21.15.60:0/3749858908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7fd214004380 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd2219de740 1 -- 172.21.15.60:0/3749858908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd208005020 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd200ff9640 1 -- 172.21.15.60:0/3749858908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fd214005020 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd2219de740 10 client.17052 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.299+0000 7fd2219de740 1 -- 172.21.15.60:0/3749858908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55b3bb7e5cb0 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd200ff9640 1 -- 172.21.15.60:0/3749858908 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd208005020 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd200ff9640 1 -- 172.21.15.60:0/3749858908 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fd2140035f0 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd2219de740 10 client.17052 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd2219de740 10 client.17052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd2219de740 20 client.17052 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd2219de740 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b3bb7e7170 0x55b3bb7e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd2219de740 4 client.17052 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd2219de740 1 -- 172.21.15.60:0/3749858908 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3bb73f850 con 0x55b3bb7e7170 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.300+0000 7fd21cba0640 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b3bb7e7170 0x55b3bb7e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.301+0000 7fd200ff9640 10 client.17052 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.301+0000 7fd21cba0640 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b3bb7e7170 0x55b3bb7e95b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c51e0dffdbdd2509 server_cookie=dad006e433ac5c7d in_seq=0 out_seq=0 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.301+0000 7fd200ff9640 1 -- 172.21.15.60:0/3749858908 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3bb73f850 con 0x55b3bb7e7170 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.301+0000 7fd200ff9640 10 client.17052 handle_command_reply: tid=0 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.301+0000 7fd2219de740 1 client.17052 shutdown 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 -- 172.21.15.60:0/3749858908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7ccdc0 msgr2=0x55b3bb7d4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d4330 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd214009230 tx=0x7fd214031aa0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 -- 172.21.15.60:0/3749858908 shutdown_connections 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b3bb7e7170 0x55b3bb7e95b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7d7680 0x55b3bb7d4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7d4330 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 --2- 172.21.15.60:0/3749858908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7d7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd200ff9640 0 client.17052 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:30.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 -- 172.21.15.60:0/3749858908 >> 172.21.15.60:0/3749858908 conn(0x55b3bb7c8a30 msgr2=0x55b3bb7ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:30.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 -- 172.21.15.60:0/3749858908 shutdown_connections 2024-09-12T00:06:30.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 1 -- 172.21.15.60:0/3749858908 wait complete. 2024-09-12T00:06:30.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.302+0000 7fd2219de740 20 client.17052 trim_cache size 0 max 16384 2024-09-12T00:06:30.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd2219de740 1 Processor -- start 2024-09-12T00:06:30.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd2219de740 1 -- start start 2024-09-12T00:06:30.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd2219de740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd2219de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd2219de740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7eee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd2219de740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181b3f30 con 0x55b3bb7d7680 2024-09-12T00:06:30.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd2219de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181b5a70 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd2219de740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181b4600 con 0x55b3bb7cc4a0 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd21cba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd21cba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7eee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50762/0 (socket says 172.21.15.60:50762) 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.319+0000 7fd21cba0640 1 -- 172.21.15.60:0/66949164 learned_addr learned my addr 172.21.15.60:0/66949164 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd21cba0640 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd21d3a1640 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd21cba0640 1 -- 172.21.15.60:0/66949164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 msgr2=0x55b3bb7e34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd21cba0640 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7e34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd21cba0640 1 -- 172.21.15.60:0/66949164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 msgr2=0x55b3bb7ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd21cba0640 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd21cba0640 1 -- 172.21.15.60:0/66949164 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bb7e9c30 con 0x55b3bb7d7680 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd21cba0640 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7eee80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd208012490 tx=0x7fd20800b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5277984109b79c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:30.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd202ffd640 1 -- 172.21.15.60:0/66949164 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208018040 con 0x55b3bb7d7680 2024-09-12T00:06:30.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd202ffd640 1 -- 172.21.15.60:0/66949164 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd208019040 con 0x55b3bb7d7680 2024-09-12T00:06:30.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.320+0000 7fd202ffd640 1 -- 172.21.15.60:0/66949164 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208029380 con 0x55b3bb7d7680 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 -- 172.21.15.60:0/66949164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 msgr2=0x55b3bb7eee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7eee80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd208012490 tx=0x7fd20800b640 comp rx=0 tx=0).stop 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 -- 172.21.15.60:0/66949164 shutdown_connections 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7eee80 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 --2- 172.21.15.60:0/66949164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 -- 172.21.15.60:0/66949164 >> 172.21.15.60:0/66949164 conn(0x55b3bb7c8a30 msgr2=0x55b3bb7cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 -- 172.21.15.60:0/66949164 shutdown_connections 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 -- 172.21.15.60:0/66949164 wait complete. 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 -- start start 2024-09-12T00:06:30.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.321+0000 7fd2219de740 1 Processor -- start 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd2219de740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd2219de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7dff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd2219de740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7daf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd2219de740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181b53a0 con 0x55b3bb7d7680 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd2219de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181b4cd0 con 0x55b3bb7ccdc0 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd2219de740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181b1f30 con 0x55b3bb7cc4a0 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd2219de740 10 client.0 _ll_register_callbacks cb 0x7fd214031420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7daf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7daf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50772/0 (socket says 172.21.15.60:50772) 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 -- 172.21.15.60:0/2268673913 learned_addr learned my addr 172.21.15.60:0/2268673913 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21d3a1640 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7df9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 -- 172.21.15.60:0/2268673913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 msgr2=0x55b3bb7df9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7df9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 -- 172.21.15.60:0/2268673913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 msgr2=0x55b3bb7dff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7dff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 -- 172.21.15.60:0/2268673913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3bb7db780 con 0x55b3bb7d7680 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd21cba0640 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7daf50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd208012fd0 tx=0x7fd20801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3ccde0d0ee6827 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd200ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.322+0000 7fd200ff9640 1 -- 172.21.15.60:0/2268673913 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208018070 con 0x55b3bb7d7680 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd200ff9640 1 -- 172.21.15.60:0/2268673913 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7fd2080121c0 con 0x55b3bb7d7680 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 1 -- 172.21.15.60:0/2268673913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd208019040 con 0x55b3bb7d7680 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd200ff9640 1 -- 172.21.15.60:0/2268673913 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fd2080052f0 con 0x55b3bb7d7680 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 10 client.17058 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:30.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 1 -- 172.21.15.60:0/2268673913 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55b3bb851ad0 con 0x55b3bb7d7680 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd200ff9640 1 -- 172.21.15.60:0/2268673913 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd208019040 con 0x55b3bb7d7680 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd200ff9640 1 -- 172.21.15.60:0/2268673913 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fd2080297d0 con 0x55b3bb7d7680 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 10 client.17058 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 10 client.17058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 20 client.17058 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b3bb851ef0 0x55b3bb8542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 4 client.17058 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd2219de740 1 -- 172.21.15.60:0/2268673913 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b3bb739d60 con 0x55b3bb851ef0 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.323+0000 7fd21d3a1640 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b3bb851ef0 0x55b3bb8542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd200ff9640 10 client.17058 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd21d3a1640 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b3bb851ef0 0x55b3bb8542e0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156df1c1f47e7fb6 server_cookie=a53b3ffd14e1accf in_seq=0 out_seq=0 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd200ff9640 1 -- 172.21.15.60:0/2268673913 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b3bb739d60 con 0x55b3bb851ef0 2024-09-12T00:06:30.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd200ff9640 10 client.17058 handle_command_reply: tid=0 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 client.17058 shutdown 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 -- 172.21.15.60:0/2268673913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 msgr2=0x55b3bb7daf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7daf50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd208012fd0 tx=0x7fd20801f040 comp rx=0 tx=0).stop 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 -- 172.21.15.60:0/2268673913 shutdown_connections 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b3bb851ef0 0x55b3bb8542e0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b3bb7d7680 0x55b3bb7daf50 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b3bb7ccdc0 0x55b3bb7dff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 --2- 172.21.15.60:0/2268673913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bb7cc4a0 0x55b3bb7df9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 -- 172.21.15.60:0/2268673913 >> 172.21.15.60:0/2268673913 conn(0x55b3bb7c8a30 msgr2=0x55b3bb7d63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd200ff9640 0 client.17058 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 -- 172.21.15.60:0/2268673913 shutdown_connections 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 1 -- 172.21.15.60:0/2268673913 wait complete. 2024-09-12T00:06:30.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.324+0000 7fd2219de740 20 client.17058 trim_cache size 0 max 16384 2024-09-12T00:06:30.330 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:06:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:06:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:06:30.330 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 -- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2040a2cf0 msgr2=0x7fd2040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2040a2cf0 0x7fd2040a51b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd210098670 tx=0x7fd210097900 comp rx=0 tx=0).stop 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 -- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218112b90 msgr2=0x7fd21819e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218112b90 0x7fd21819e980 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd21000cad0 tx=0x7fd21000cf90 comp rx=0 tx=0).stop 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 -- 172.21.15.60:0/2782776683 shutdown_connections 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd2040a2cf0 0x7fd2040a51b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd218112b90 0x7fd21819e980 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd218074eb0 0x7fd2181a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 --2- 172.21.15.60:0/2782776683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd218074590 0x7fd2181a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:30.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 -- 172.21.15.60:0/2782776683 >> 172.21.15.60:0/2782776683 conn(0x7fd2180fd8c0 msgr2=0x7fd2180fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:30.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 -- 172.21.15.60:0/2782776683 shutdown_connections 2024-09-12T00:06:30.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:30.325+0000 7fd21f605640 1 -- 172.21.15.60:0/2782776683 wait complete. 2024-09-12T00:06:31.179 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:06:31.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:06:31.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:30 smithi105 ceph-mon[34805]: pgmap v219: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:31.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:30 smithi192 ceph-mon[35487]: pgmap v219: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:31.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:30 smithi060 ceph-mon[30953]: pgmap v219: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:31.437 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:31.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 -- 172.21.15.60:0/1599253171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc102790 msgr2=0x7ff8fc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:31.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 --2- 172.21.15.60:0/1599253171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc102790 0x7ff8fc1067e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009ca0 tx=0x7ff8f002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 -- 172.21.15.60:0/1599253171 shutdown_connections 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 --2- 172.21.15.60:0/1599253171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc106f10 0x7ff8fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 --2- 172.21.15.60:0/1599253171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc102790 0x7ff8fc1067e0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 --2- 172.21.15.60:0/1599253171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc101de0 0x7ff8fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 -- 172.21.15.60:0/1599253171 >> 172.21.15.60:0/1599253171 conn(0x7ff8fc0fd8c0 msgr2=0x7ff8fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 -- 172.21.15.60:0/1599253171 shutdown_connections 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.896+0000 7ff9009c6640 1 -- 172.21.15.60:0/1599253171 wait complete. 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.897+0000 7ff9009c6640 1 Processor -- start 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.897+0000 7ff9009c6640 1 -- start start 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.897+0000 7ff9009c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc101de0 0x7ff8fc198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.897+0000 7ff9009c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc102790 0x7ff8fc198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.897+0000 7ff9009c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc106f10 0x7ff8fc19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.897+0000 7ff9009c6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc1120d0 con 0x7ff8fc101de0 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff9009c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc111f50 con 0x7ff8fc106f10 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff9009c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc112250 con 0x7ff8fc102790 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc101de0 0x7ff8fc198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc101de0 0x7ff8fc198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55570/0 (socket says 172.21.15.60:55570) 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 -- 172.21.15.60:0/2696479940 learned_addr learned my addr 172.21.15.60:0/2696479940 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fad9d640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc106f10 0x7ff8fc19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8f9d9b640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc102790 0x7ff8fc198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 -- 172.21.15.60:0/2696479940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc102790 msgr2=0x7ff8fc198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc102790 0x7ff8fc198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 -- 172.21.15.60:0/2696479940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc106f10 msgr2=0x7ff8fc19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc106f10 0x7ff8fc19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 -- 172.21.15.60:0/2696479940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc19d520 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8fa59c640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc101de0 0x7ff8fc198570 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00b4a0 tx=0x7ff8ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8eb7fe640 1 -- 172.21.15.60:0/2696479940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec014070 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8eb7fe640 1 -- 172.21.15.60:0/2696479940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff8ec010b10 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc19d810 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff8eb7fe640 1 -- 172.21.15.60:0/2696479940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec017d60 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.898+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc1a50f0 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.899+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc1021c0 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.901+0000 7ff8eb7fe640 1 -- 172.21.15.60:0/2696479940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff8ec017070 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.901+0000 7ff8eb7fe640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8e40a2cf0 0x7ff8e40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.901+0000 7ff8f9d9b640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8e40a2cf0 0x7ff8e40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.901+0000 7ff8eb7fe640 1 -- 172.21.15.60:0/2696479940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7ff8ec0ce6c0 con 0x7ff8fc101de0 2024-09-12T00:06:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.902+0000 7ff8f9d9b640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8e40a2cf0 0x7ff8e40a51b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8f002f540 tx=0x7ff8f0009920 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:31.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:31.905+0000 7ff8eb7fe640 1 -- 172.21.15.60:0/2696479940 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8ec09b410 con 0x7ff8fc101de0 2024-09-12T00:06:32.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.120+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8fc1998d0 con 0x7ff8fc101de0 2024-09-12T00:06:32.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.121+0000 7ff8eb7fe640 1 -- 172.21.15.60:0/2696479940 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7ff8ec09ad10 con 0x7ff8fc101de0 2024-09-12T00:06:32.120 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:06:32.120 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:06:32.120 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:06:32.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8e40a2cf0 msgr2=0x7ff8e40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:32.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8e40a2cf0 0x7ff8e40a51b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8f002f540 tx=0x7ff8f0009920 comp rx=0 tx=0).stop 2024-09-12T00:06:32.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc101de0 msgr2=0x7ff8fc198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:32.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc101de0 0x7ff8fc198570 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00b4a0 tx=0x7ff8ec00b960 comp rx=0 tx=0).stop 2024-09-12T00:06:32.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 shutdown_connections 2024-09-12T00:06:32.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff8e40a2cf0 0x7ff8e40a51b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:32.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc106f10 0x7ff8fc19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:32.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8fc102790 0x7ff8fc198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:32.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 --2- 172.21.15.60:0/2696479940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc101de0 0x7ff8fc198570 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:32.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 >> 172.21.15.60:0/2696479940 conn(0x7ff8fc0fd8c0 msgr2=0x7ff8fc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:32.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 shutdown_connections 2024-09-12T00:06:32.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:32.123+0000 7ff9009c6640 1 -- 172.21.15.60:0/2696479940 wait complete. 2024-09-12T00:06:32.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:06:33.058 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:33.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:32 smithi060 ceph-mon[30953]: pgmap v220: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:33.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:32 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2696479940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:06:33.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:32 smithi105 ceph-mon[34805]: pgmap v220: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:33.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:32 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2696479940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:06:33.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:32 smithi192 ceph-mon[35487]: pgmap v220: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:33.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:32 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2696479940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:06:33.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 -- 172.21.15.60:0/1247975296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 msgr2=0x7f7508100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 --2- 172.21.15.60:0/1247975296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 0x7f7508100ee0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009930 tx=0x7f74f002a420 comp rx=0 tx=0).stop 2024-09-12T00:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 -- 172.21.15.60:0/1247975296 shutdown_connections 2024-09-12T00:06:33.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 --2- 172.21.15.60:0/1247975296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7508101420 0x7f750810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 --2- 172.21.15.60:0/1247975296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 0x7f7508100ee0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 --2- 172.21.15.60:0/1247975296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7508106a80 0x7f7508106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 -- 172.21.15.60:0/1247975296 >> 172.21.15.60:0/1247975296 conn(0x7f75080fc7a0 msgr2=0x7f75080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 -- 172.21.15.60:0/1247975296 shutdown_connections 2024-09-12T00:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.559+0000 7f750cdf7640 1 -- 172.21.15.60:0/1247975296 wait complete. 2024-09-12T00:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750cdf7640 1 Processor -- start 2024-09-12T00:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750cdf7640 1 -- start start 2024-09-12T00:06:33.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750cdf7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 0x7f75081993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750cdf7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7508101420 0x7f7508199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750cdf7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7508106a80 0x7f75081a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750cdf7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7508110fe0 con 0x7f7508100a80 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750cdf7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7508110e60 con 0x7f7508106a80 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750cdf7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7508111160 con 0x7f7508101420 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 0x7f75081993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 0x7f75081993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55592/0 (socket says 172.21.15.60:55592) 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f750659c640 1 -- 172.21.15.60:0/2248517293 learned_addr learned my addr 172.21.15.60:0/2248517293 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f7506d9d640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7508106a80 0x7f75081a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.560+0000 7f74fffff640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7508101420 0x7f7508199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f750659c640 1 -- 172.21.15.60:0/2248517293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7508101420 msgr2=0x7f7508199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f750659c640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7508101420 0x7f7508199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f750659c640 1 -- 172.21.15.60:0/2248517293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7508106a80 msgr2=0x7f75081a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f750659c640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7508106a80 0x7f75081a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f750659c640 1 -- 172.21.15.60:0/2248517293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75081a49b0 con 0x7f7508100a80 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f750659c640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 0x7f75081993f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f74f800d950 tx=0x7f74f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f74ff7fe640 1 -- 172.21.15.60:0/2248517293 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8017070 con 0x7f7508100a80 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f750cdf7640 1 -- 172.21.15.60:0/2248517293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75081a4b80 con 0x7f7508100a80 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f74ff7fe640 1 -- 172.21.15.60:0/2248517293 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74f8009c30 con 0x7f7508100a80 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f74ff7fe640 1 -- 172.21.15.60:0/2248517293 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f800f740 con 0x7f7508100a80 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.561+0000 7f750cdf7640 1 -- 172.21.15.60:0/2248517293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75081a5040 con 0x7f7508100a80 2024-09-12T00:06:33.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.563+0000 7f74ff7fe640 1 -- 172.21.15.60:0/2248517293 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f74f8010a80 con 0x7f7508100a80 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750f1d0740 1 Processor -- start 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750f1d0740 1 -- start start 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 0x55a1388a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 0x55a1388af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750f1d0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a1388082f0 con 0x55a1388a25d0 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750f1d0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a1387afcf0 con 0x55a1388a3b40 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750f1d0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a1388042b0 con 0x55a1388ad370 2024-09-12T00:06:33.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.564+0000 7f750659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f74ff7fe640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74f40a2cf0 0x7f74f40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f750659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388a2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55594/0 (socket says 172.21.15.60:55594) 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f750659c640 1 -- 172.21.15.60:0/3464360218 learned_addr learned my addr 172.21.15.60:0/3464360218 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f7506d9d640 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 0x55a1388a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f74fffff640 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 0x55a1388af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f7506d9d640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74f40a2cf0 0x7f74f40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f74ff7fe640 1 -- 172.21.15.60:0/2248517293 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f74f80cf120 con 0x7f7508100a80 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f750659c640 1 -- 172.21.15.60:0/3464360218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 msgr2=0x55a1388af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f750659c640 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 0x55a1388af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f750659c640 1 -- 172.21.15.60:0/3464360218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 msgr2=0x55a1388a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:33.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f750659c640 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 0x55a1388a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f750659c640 1 -- 172.21.15.60:0/3464360218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1387943a0 con 0x55a1388a25d0 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f750659c640 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388a2a10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f74f8000c00 tx=0x7f74f8010e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a924572e7d238bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f7506d9d640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74f40a2cf0 0x7f74f40a51b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7500009900 tx=0x7f7500009650 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f74fcff9640 1 -- 172.21.15.60:0/3464360218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8020030 con 0x55a1388a25d0 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f74fcff9640 1 -- 172.21.15.60:0/3464360218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74f809bd00 con 0x55a1388a25d0 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.565+0000 7f74fcff9640 1 -- 172.21.15.60:0/3464360218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8097c70 con 0x55a1388a25d0 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 -- 172.21.15.60:0/3464360218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 msgr2=0x55a1388a2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388a2a10 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f74f8000c00 tx=0x7f74f8010e20 comp rx=0 tx=0).stop 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 -- 172.21.15.60:0/3464360218 shutdown_connections 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 0x55a1388af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388a2a10 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 --2- 172.21.15.60:0/3464360218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 0x55a1388a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 -- 172.21.15.60:0/3464360218 >> 172.21.15.60:0/3464360218 conn(0x55a13886b310 msgr2=0x55a13889ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 -- 172.21.15.60:0/3464360218 shutdown_connections 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.566+0000 7f750f1d0740 1 -- 172.21.15.60:0/3464360218 wait complete. 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 1 -- start start 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 1 Processor -- start 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a1388ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388aa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a1388b0070 con 0x55a1388a3b40 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a1387c3060 con 0x55a1388ad370 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a1388b01f0 con 0x55a1388a25d0 2024-09-12T00:06:33.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750f1d0740 10 client.0 _ll_register_callbacks cb 0x55a1385168c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f74fffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f74fffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388aa0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55602/0 (socket says 172.21.15.60:55602) 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f74fffff640 1 -- 172.21.15.60:0/976524357 learned_addr learned my addr 172.21.15.60:0/976524357 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f7506d9d640 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f750659c640 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a1388ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f74fffff640 1 -- 172.21.15.60:0/976524357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 msgr2=0x55a1388ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f74fffff640 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a1388ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f74fffff640 1 -- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 msgr2=0x55a1388aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f74fffff640 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f74fffff640 1 -- 172.21.15.60:0/976524357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1385793c0 con 0x55a1388a3b40 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.567+0000 7f7506d9d640 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:33.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f74fffff640 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388aa0b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009930 tx=0x7f74f0031990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35091e62ff63751 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f74edffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f74edffb640 1 -- 172.21.15.60:0/976524357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0035040 con 0x55a1388a3b40 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f74edffb640 1 -- 172.21.15.60:0/976524357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f74f0004240 con 0x55a1388a3b40 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 1 -- 172.21.15.60:0/976524357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74f809bd00 con 0x55a1388a3b40 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f74edffb640 1 -- 172.21.15.60:0/976524357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f74f0031a80 con 0x55a1388a3b40 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 10 client.17076 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 1 -- 172.21.15.60:0/976524357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55a1388bbc10 con 0x55a1388a3b40 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f74edffb640 1 -- 172.21.15.60:0/976524357 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74f809bd00 con 0x55a1388a3b40 2024-09-12T00:06:33.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f74edffb640 1 -- 172.21.15.60:0/976524357 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f74f004c020 con 0x55a1388a3b40 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 10 client.17076 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 10 client.17076 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 20 client.17076 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55a1388bd070 0x55a1388bf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 4 client.17076 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.568+0000 7f750f1d0740 1 -- 172.21.15.60:0/976524357 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a138815860 con 0x55a1388bd070 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.569+0000 7f750659c640 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55a1388bd070 0x55a1388bf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.569+0000 7f750659c640 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55a1388bd070 0x55a1388bf490 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ba33d85e5ab7b301 server_cookie=9dd0729248e48345 in_seq=0 out_seq=0 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.569+0000 7f74edffb640 10 client.17076 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:06:33.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f74edffb640 1 -- 172.21.15.60:0/976524357 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a138815860 con 0x55a1388bd070 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f74edffb640 10 client.17076 handle_command_reply: tid=0 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 client.17076 shutdown 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 -- 172.21.15.60:0/976524357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 msgr2=0x55a1388aa0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388aa0b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009930 tx=0x7f74f0031990 comp rx=0 tx=0).stop 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 -- 172.21.15.60:0/976524357 shutdown_connections 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55a1388bd070 0x55a1388bf490 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388aa0b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f74edffb640 0 client.17076 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 --2- 172.21.15.60:0/976524357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a1388ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 -- 172.21.15.60:0/976524357 >> 172.21.15.60:0/976524357 conn(0x55a13886b310 msgr2=0x55a1388a4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:33.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 -- 172.21.15.60:0/976524357 shutdown_connections 2024-09-12T00:06:33.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.570+0000 7f750f1d0740 1 -- 172.21.15.60:0/976524357 wait complete. 2024-09-12T00:06:33.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.571+0000 7f750f1d0740 20 client.17076 trim_cache size 0 max 16384 2024-09-12T00:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750f1d0740 1 Processor -- start 2024-09-12T00:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750f1d0740 1 -- start start 2024-09-12T00:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a13889ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750f1d0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f75081ad910 con 0x55a1388a3b40 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750f1d0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75081af450 con 0x55a1388ad370 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750f1d0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f75081adfe0 con 0x55a1388a25d0 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f74fffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f74fffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55606/0 (socket says 172.21.15.60:55606) 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f74fffff640 1 -- 172.21.15.60:0/3916598159 learned_addr learned my addr 172.21.15.60:0/3916598159 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f7506d9d640 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.584+0000 7f750659c640 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a13889ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74fffff640 1 -- 172.21.15.60:0/3916598159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 msgr2=0x55a13889ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74fffff640 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a13889ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74fffff640 1 -- 172.21.15.60:0/3916598159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 msgr2=0x55a1388c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74fffff640 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74fffff640 1 -- 172.21.15.60:0/3916598159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1388aabb0 con 0x55a1388a3b40 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f7506d9d640 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f750659c640 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a13889ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74fffff640 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388ac020 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f74f0033000 tx=0x7f74f002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7a331f4d7ca7f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74effff640 1 -- 172.21.15.60:0/3916598159 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0035040 con 0x55a1388a3b40 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74effff640 1 -- 172.21.15.60:0/3916598159 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74f0053070 con 0x55a1388a3b40 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.585+0000 7f74effff640 1 -- 172.21.15.60:0/3916598159 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0045860 con 0x55a1388a3b40 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 -- 172.21.15.60:0/3916598159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 msgr2=0x55a1388ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388ac020 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f74f0033000 tx=0x7f74f002a420 comp rx=0 tx=0).stop 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 -- 172.21.15.60:0/3916598159 shutdown_connections 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388ad370 0x55a1388c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a3b40 0x55a1388ac020 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 --2- 172.21.15.60:0/3916598159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388a25d0 0x55a13889ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 -- 172.21.15.60:0/3916598159 >> 172.21.15.60:0/3916598159 conn(0x55a13886b310 msgr2=0x55a1388ab910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 -- 172.21.15.60:0/3916598159 shutdown_connections 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 -- 172.21.15.60:0/3916598159 wait complete. 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 -- start start 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.586+0000 7f750f1d0740 1 Processor -- start 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 0x55a1388a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750f1d0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 0x55a1388a7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750f1d0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f75081aed80 con 0x55a1388a25d0 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750f1d0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75081ae6b0 con 0x55a1388a3b40 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750f1d0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f75081ab910 con 0x55a1388ad370 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750f1d0740 10 client.0 _ll_register_callbacks cb 0x7f74f0031640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55612/0 (socket says 172.21.15.60:55612) 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 -- 172.21.15.60:0/1230192486 learned_addr learned my addr 172.21.15.60:0/1230192486 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f74fffff640 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 0x55a1388a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f7506d9d640 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 0x55a1388a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 -- 172.21.15.60:0/1230192486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 msgr2=0x55a1388a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 0x55a1388a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 -- 172.21.15.60:0/1230192486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 msgr2=0x55a1388a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 0x55a1388a6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 -- 172.21.15.60:0/1230192486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1388a7b50 con 0x55a1388a25d0 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750659c640 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388b5c20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f74f809bc60 tx=0x7f74f80979d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd93df85f837c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f74edffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f74edffb640 1 -- 172.21.15.60:0/1230192486 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f80b3070 con 0x55a1388a25d0 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f74edffb640 1 -- 172.21.15.60:0/1230192486 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f74f801d0b0 con 0x55a1388a25d0 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.587+0000 7f750f1d0740 1 -- 172.21.15.60:0/1230192486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74f0053070 con 0x55a1388a25d0 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f74edffb640 1 -- 172.21.15.60:0/1230192486 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f74f8097020 con 0x55a1388a25d0 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f750f1d0740 10 client.17082 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f750f1d0740 1 -- 172.21.15.60:0/1230192486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55a138927ca0 con 0x55a1388a25d0 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f74edffb640 1 -- 172.21.15.60:0/1230192486 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74f0053070 con 0x55a1388a25d0 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f74edffb640 1 -- 172.21.15.60:0/1230192486 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f74f80ccab0 con 0x55a1388a25d0 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f750f1d0740 10 client.17082 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f750f1d0740 10 client.17082 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f750f1d0740 20 client.17082 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f750f1d0740 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55a138928000 0x55a13892a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f750f1d0740 4 client.17082 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.588+0000 7f750f1d0740 1 -- 172.21.15.60:0/1230192486 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a13880fd70 con 0x55a138928000 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f74fffff640 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55a138928000 0x55a13892a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f74edffb640 10 client.17082 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f74fffff640 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55a138928000 0x55a13892a420 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a53aa45cc5118ee9 server_cookie=3326b43597682fbb in_seq=0 out_seq=0 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f74edffb640 1 -- 172.21.15.60:0/1230192486 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a13880fd70 con 0x55a138928000 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f74edffb640 10 client.17082 handle_command_reply: tid=0 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 client.17082 shutdown 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 -- 172.21.15.60:0/1230192486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 msgr2=0x55a1388b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388b5c20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f74f809bc60 tx=0x7f74f80979d0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 -- 172.21.15.60:0/1230192486 shutdown_connections 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1388ad370 0x55a1388a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x55a138928000 0x55a13892a420 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1388a3b40 0x55a1388a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f74edffb640 0 client.17082 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 --2- 172.21.15.60:0/1230192486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1388a25d0 0x55a1388b5c20 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 -- 172.21.15.60:0/1230192486 >> 172.21.15.60:0/1230192486 conn(0x55a13886b310 msgr2=0x55a1388ab910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.589+0000 7f750f1d0740 1 -- 172.21.15.60:0/1230192486 shutdown_connections 2024-09-12T00:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750f1d0740 1 -- 172.21.15.60:0/1230192486 wait complete. 2024-09-12T00:06:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750f1d0740 20 client.17082 trim_cache size 0 max 16384 2024-09-12T00:06:33.599 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 -- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74f40a2cf0 msgr2=0x7f74f40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74f40a2cf0 0x7f74f40a51b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7500009900 tx=0x7f7500009650 comp rx=0 tx=0).stop 2024-09-12T00:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 -- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 msgr2=0x7f75081993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 0x7f75081993f0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f74f800d950 tx=0x7f74f800de10 comp rx=0 tx=0).stop 2024-09-12T00:06:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 -- 172.21.15.60:0/2248517293 shutdown_connections 2024-09-12T00:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f74f40a2cf0 0x7f74f40a51b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7508106a80 0x7f75081a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7508101420 0x7f7508199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 --2- 172.21.15.60:0/2248517293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508100a80 0x7f75081993f0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 -- 172.21.15.60:0/2248517293 >> 172.21.15.60:0/2248517293 conn(0x7f75080fc7a0 msgr2=0x7f75080fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 -- 172.21.15.60:0/2248517293 shutdown_connections 2024-09-12T00:06:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:33.590+0000 7f750cdf7640 1 -- 172.21.15.60:0/2248517293 wait complete. 2024-09-12T00:06:34.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:06:34.595 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:35.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 -- 172.21.15.60:0/2335614318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c103660 msgr2=0x7ff22c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2335614318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c103660 0x7ff22c10bb50 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff220009900 tx=0x7ff22002a480 comp rx=0 tx=0).stop 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 -- 172.21.15.60:0/2335614318 shutdown_connections 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2335614318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff22c10c170 0x7ff22c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2335614318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c103660 0x7ff22c10bb50 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2335614318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c102d40 0x7ff22c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 -- 172.21.15.60:0/2335614318 >> 172.21.15.60:0/2335614318 conn(0x7ff22c0fc7a0 msgr2=0x7ff22c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 -- 172.21.15.60:0/2335614318 shutdown_connections 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.103+0000 7ff2323c6640 1 -- 172.21.15.60:0/2335614318 wait complete. 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.104+0000 7ff2323c6640 1 Processor -- start 2024-09-12T00:06:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.104+0000 7ff2323c6640 1 -- start start 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.104+0000 7ff2323c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff22c102d40 0x7ff22c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.104+0000 7ff2323c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c103660 0x7ff22c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.104+0000 7ff2323c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c10c170 0x7ff22c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.104+0000 7ff2323c6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c112090 con 0x7ff22c10c170 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.104+0000 7ff2323c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c111f10 con 0x7ff22c103660 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.104+0000 7ff2323c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c112210 con 0x7ff22c102d40 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c10c170 0x7ff22c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c10c170 0x7ff22c19ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55630/0 (socket says 172.21.15.60:55630) 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 -- 172.21.15.60:0/2711984061 learned_addr learned my addr 172.21.15.60:0/2711984061 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c103660 0x7ff22c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff22bfff640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff22c102d40 0x7ff22c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 -- 172.21.15.60:0/2711984061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff22c102d40 msgr2=0x7ff22c198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff22c102d40 0x7ff22c198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 -- 172.21.15.60:0/2711984061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c103660 msgr2=0x7ff22c198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c103660 0x7ff22c198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 -- 172.21.15.60:0/2711984061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c19d540 con 0x7ff22c10c170 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff230963640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c10c170 0x7ff22c19ce60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff22400eaa0 tx=0x7ff22400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff2297fa640 1 -- 172.21.15.60:0/2711984061 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22400cdb0 con 0x7ff22c10c170 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff2323c6640 1 -- 172.21.15.60:0/2711984061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22c19d830 con 0x7ff22c10c170 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff2297fa640 1 -- 172.21.15.60:0/2711984061 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff224004b20 con 0x7ff22c10c170 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff2297fa640 1 -- 172.21.15.60:0/2711984061 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224011760 con 0x7ff22c10c170 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.105+0000 7ff2323c6640 1 -- 172.21.15.60:0/2711984061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22c1a5110 con 0x7ff22c10c170 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff23479f740 1 Processor -- start 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff2297fa640 1 -- 172.21.15.60:0/2711984061 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff224011900 con 0x7ff22c10c170 2024-09-12T00:06:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff23479f740 1 -- start start 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff23479f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x557602034090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff23479f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602034a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff23479f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602045b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff23479f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557601f9a2f0 con 0x5576020345d0 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff23479f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557601f41cf0 con 0x557602035b40 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff23479f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557601f962b0 con 0x557602043780 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff22bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602034a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff22bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602034a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55644/0 (socket says 172.21.15.60:55644) 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff22bfff640 1 -- 172.21.15.60:0/1934556424 learned_addr learned my addr 172.21.15.60:0/1934556424 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x557602034090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.108+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602045b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff22bfff640 1 -- 172.21.15.60:0/1934556424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 msgr2=0x557602045b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602045b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff22bfff640 1 -- 172.21.15.60:0/1934556424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 msgr2=0x557602034090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x557602034090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff22bfff640 1 -- 172.21.15.60:0/1934556424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557601f263a0 con 0x5576020345d0 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602045b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff2297fa640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2140a2cf0 0x7ff2140a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602034a10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00bd10 tx=0x7ff21c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff38a9d5c5719a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2140a2cf0 0x7ff2140a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff2297fa640 1 -- 172.21.15.60:0/2711984061 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7ff2240cf540 con 0x7ff22c10c170 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff2127fc640 1 -- 172.21.15.60:0/1934556424 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c004030 con 0x5576020345d0 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff2127fc640 1 -- 172.21.15.60:0/1934556424 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff21c0041d0 con 0x5576020345d0 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.109+0000 7ff2127fc640 1 -- 172.21.15.60:0/1934556424 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c011980 con 0x5576020345d0 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 -- 172.21.15.60:0/1934556424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 msgr2=0x557602034a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2140a2cf0 0x7ff2140a51b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff220009230 tx=0x7ff220005d50 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602034a10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00bd10 tx=0x7ff21c0107a0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 -- 172.21.15.60:0/1934556424 shutdown_connections 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602045b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602034a10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 --2- 172.21.15.60:0/1934556424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x557602034090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 -- 172.21.15.60:0/1934556424 >> 172.21.15.60:0/1934556424 conn(0x557601ffd310 msgr2=0x557602030c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 -- 172.21.15.60:0/1934556424 shutdown_connections 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 -- 172.21.15.60:0/1934556424 wait complete. 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.110+0000 7ff23479f740 1 -- start start 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff23479f740 1 Processor -- start 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff23479f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576020345d0 0x5576020431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff23479f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602040470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff23479f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602043780 0x557602040c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff23479f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557602046480 con 0x557602035b40 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff23479f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557601f55060 con 0x557602043780 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff23479f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557602046600 con 0x5576020345d0 2024-09-12T00:06:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff23479f740 10 client.0 _ll_register_callbacks cb 0x557601ca88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602040470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602040470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55652/0 (socket says 172.21.15.60:55652) 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22b7fe640 1 -- 172.21.15.60:0/1132495641 learned_addr learned my addr 172.21.15.60:0/1132495641 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff230963640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602043780 0x557602040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576020345d0 0x5576020431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22b7fe640 1 -- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576020345d0 msgr2=0x5576020431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576020345d0 0x5576020431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22b7fe640 1 -- 172.21.15.60:0/1132495641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602043780 msgr2=0x557602040c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:35.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602043780 0x557602040c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22b7fe640 1 -- 172.21.15.60:0/1132495641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557601d0b3c0 con 0x557602035b40 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576020345d0 0x5576020431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.111+0000 7ff230963640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602043780 0x557602040c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602040470 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff220032fd0 tx=0x7ff22002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8317c1a10cf5ad8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff20b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1132495641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22004f030 con 0x557602035b40 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1132495641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7ff220005020 con 0x557602035b40 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff23479f740 1 -- 172.21.15.60:0/1132495641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff21c0041d0 con 0x557602035b40 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1132495641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff22005b050 con 0x557602035b40 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff23479f740 10 client.17094 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff23479f740 1 -- 172.21.15.60:0/1132495641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x557602051f70 con 0x557602035b40 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1132495641 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff21c0041d0 con 0x557602035b40 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.112+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1132495641 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7ff2200048c0 con 0x557602035b40 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff23479f740 10 client.17094 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff23479f740 10 client.17094 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff23479f740 20 client.17094 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff23479f740 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x557602053380 0x557602055810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff23479f740 4 client.17094 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff23479f740 1 -- 172.21.15.60:0/1132495641 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557601fa7860 con 0x557602053380 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x557602053380 0x557602055810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x557602053380 0x557602055810 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2887dca03d2c531f server_cookie=6d4b4ab19efe2429 in_seq=0 out_seq=0 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.113+0000 7ff20b7fe640 10 client.17094 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1132495641 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557601fa7860 con 0x557602053380 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff20b7fe640 10 client.17094 handle_command_reply: tid=0 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 client.17094 shutdown 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 -- 172.21.15.60:0/1132495641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 msgr2=0x557602040470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602040470 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff220032fd0 tx=0x7ff22002a480 comp rx=0 tx=0).stop 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 -- 172.21.15.60:0/1132495641 shutdown_connections 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x557602053380 0x557602055810 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602043780 0x557602040c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602040470 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 --2- 172.21.15.60:0/1132495641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576020345d0 0x5576020431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff20b7fe640 0 client.17094 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:06:35.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 -- 172.21.15.60:0/1132495641 >> 172.21.15.60:0/1132495641 conn(0x557601ffd310 msgr2=0x557602036960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:35.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 -- 172.21.15.60:0/1132495641 shutdown_connections 2024-09-12T00:06:35.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 1 -- 172.21.15.60:0/1132495641 wait complete. 2024-09-12T00:06:35.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.114+0000 7ff23479f740 20 client.17094 trim_cache size 0 max 16384 2024-09-12T00:06:35.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.127+0000 7ff23479f740 1 Processor -- start 2024-09-12T00:06:35.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.127+0000 7ff23479f740 1 -- start start 2024-09-12T00:06:35.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.127+0000 7ff23479f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602030e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.127+0000 7ff23479f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x55760203fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.127+0000 7ff23479f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x55760205b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.127+0000 7ff23479f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c1ab710 con 0x5576020345d0 2024-09-12T00:06:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff23479f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c1ad250 con 0x557602035b40 2024-09-12T00:06:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff23479f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c1abde0 con 0x557602043780 2024-09-12T00:06:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602030e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602030e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55656/0 (socket says 172.21.15.60:55656) 2024-09-12T00:06:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 -- 172.21.15.60:0/2557792701 learned_addr learned my addr 172.21.15.60:0/2557792701 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff230963640 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x55760205b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x55760203fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 -- 172.21.15.60:0/2557792701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 msgr2=0x55760205b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x55760205b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 -- 172.21.15.60:0/2557792701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 msgr2=0x55760203fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x55760203fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 -- 172.21.15.60:0/2557792701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760203f420 con 0x5576020345d0 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x55760203fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff22bfff640 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602030e10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x557602031ac0 tx=0x7ff21c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b175f30aa79afbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff211ffb640 1 -- 172.21.15.60:0/2557792701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0052c0 con 0x5576020345d0 2024-09-12T00:06:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff211ffb640 1 -- 172.21.15.60:0/2557792701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff21c003af0 con 0x5576020345d0 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.128+0000 7ff211ffb640 1 -- 172.21.15.60:0/2557792701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0119e0 con 0x5576020345d0 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 -- 172.21.15.60:0/2557792701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 msgr2=0x557602030e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602030e10 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x557602031ac0 tx=0x7ff21c011440 comp rx=0 tx=0).stop 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 -- 172.21.15.60:0/2557792701 shutdown_connections 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x55760205b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557602035b40 0x55760203fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 --2- 172.21.15.60:0/2557792701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5576020345d0 0x557602030e10 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 -- 172.21.15.60:0/2557792701 >> 172.21.15.60:0/2557792701 conn(0x557601ffd310 msgr2=0x557602030700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 -- 172.21.15.60:0/2557792701 shutdown_connections 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 -- 172.21.15.60:0/2557792701 wait complete. 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.129+0000 7ff23479f740 1 -- start start 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff23479f740 1 Processor -- start 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff23479f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5576020345d0 0x557602047550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff23479f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602047a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff23479f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602047fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff23479f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c1acb80 con 0x557602035b40 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff23479f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c1ac4b0 con 0x5576020345d0 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff23479f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c1a9710 con 0x557602043780 2024-09-12T00:06:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff23479f740 10 client.0 _ll_register_callbacks cb 0x7ff220005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602047a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5576020345d0 0x557602047550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602047a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55662/0 (socket says 172.21.15.60:55662) 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22b7fe640 1 -- 172.21.15.60:0/1364834841 learned_addr learned my addr 172.21.15.60:0/1364834841 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff230963640 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602047fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22b7fe640 1 -- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 msgr2=0x557602047fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602047fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22b7fe640 1 -- 172.21.15.60:0/1364834841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5576020345d0 msgr2=0x557602047550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:35.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5576020345d0 0x557602047550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff22b7fe640 1 -- 172.21.15.60:0/1364834841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557602045ee0 con 0x557602035b40 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.130+0000 7ff230963640 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602047fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff22b7fe640 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602047a90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff220006010 tx=0x7ff220031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a04950c3d998bfd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff20b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1364834841 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22004f040 con 0x557602035b40 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1364834841 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7ff220004970 con 0x557602035b40 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 1 -- 172.21.15.60:0/1364834841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff21c003af0 con 0x557602035b40 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1364834841 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff220046070 con 0x557602035b40 2024-09-12T00:06:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 10 client.17100 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 1 -- 172.21.15.60:0/1364834841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5576020be120 con 0x557602035b40 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1364834841 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff21c003af0 con 0x557602035b40 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1364834841 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7ff220005380 con 0x557602035b40 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 10 client.17100 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 10 client.17100 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 20 client.17100 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5576020be840 0x5576020c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 4 client.17100 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff23479f740 1 -- 172.21.15.60:0/1364834841 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557601fa1d70 con 0x5576020be840 2024-09-12T00:06:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.131+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5576020be840 0x5576020c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff22bfff640 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5576020be840 0x5576020c0c60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=db0138426e27bbdb server_cookie=29510e99ebe7b432 in_seq=0 out_seq=0 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff20b7fe640 10 client.17100 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff20b7fe640 1 -- 172.21.15.60:0/1364834841 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557601fa1d70 con 0x5576020be840 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff20b7fe640 10 client.17100 handle_command_reply: tid=0 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 client.17100 shutdown 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 -- 172.21.15.60:0/1364834841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 msgr2=0x557602047a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602047a90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff220006010 tx=0x7ff220031640 comp rx=0 tx=0).stop 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 -- 172.21.15.60:0/1364834841 shutdown_connections 2024-09-12T00:06:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x5576020be840 0x5576020c0c60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557602043780 0x557602047fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557602035b40 0x557602047a90 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 --2- 172.21.15.60:0/1364834841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5576020345d0 0x557602047550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 -- 172.21.15.60:0/1364834841 >> 172.21.15.60:0/1364834841 conn(0x557601ffd310 msgr2=0x557602036930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff20b7fe640 0 client.17100 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:06:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 -- 172.21.15.60:0/1364834841 shutdown_connections 2024-09-12T00:06:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.132+0000 7ff23479f740 1 -- 172.21.15.60:0/1364834841 wait complete. 2024-09-12T00:06:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff23479f740 20 client.17100 trim_cache size 0 max 16384 2024-09-12T00:06:35.144 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:06:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 -- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2140a2cf0 msgr2=0x7ff2140a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2140a2cf0 0x7ff2140a51b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff220009230 tx=0x7ff220005d50 comp rx=0 tx=0).stop 2024-09-12T00:06:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 -- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c10c170 msgr2=0x7ff22c19ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c10c170 0x7ff22c19ce60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff22400eaa0 tx=0x7ff22400ef60 comp rx=0 tx=0).stop 2024-09-12T00:06:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 -- 172.21.15.60:0/2711984061 shutdown_connections 2024-09-12T00:06:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2140a2cf0 0x7ff2140a51b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff22c10c170 0x7ff22c19ce60 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c103660 0x7ff22c198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 --2- 172.21.15.60:0/2711984061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff22c102d40 0x7ff22c198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:35.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 -- 172.21.15.60:0/2711984061 >> 172.21.15.60:0/2711984061 conn(0x7ff22c0fc7a0 msgr2=0x7ff22c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:35.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 -- 172.21.15.60:0/2711984061 shutdown_connections 2024-09-12T00:06:35.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:35.133+0000 7ff2323c6640 1 -- 172.21.15.60:0/2711984061 wait complete. 2024-09-12T00:06:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:34 smithi105 ceph-mon[34805]: pgmap v221: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:06:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:06:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:06:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:06:35.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:34 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:06:35.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:34 smithi192 ceph-mon[35487]: pgmap v221: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:06:35.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:06:35.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:06:35.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:06:35.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:34 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:06:35.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:34 smithi060 ceph-mon[30953]: pgmap v221: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:06:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:06:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:06:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:06:35.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:34 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:06:35.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:06:36.111 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.598+0000 7fa4f783a640 1 -- 172.21.15.60:0/1133876266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0102790 msgr2=0x7fa4f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.598+0000 7fa4f783a640 1 --2- 172.21.15.60:0/1133876266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0102790 0x7fa4f01067e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4009900 tx=0x7fa4e402a3f0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.598+0000 7fa4f783a640 1 -- 172.21.15.60:0/1133876266 shutdown_connections 2024-09-12T00:06:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.598+0000 7fa4f783a640 1 --2- 172.21.15.60:0/1133876266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4f0106f10 0x7fa4f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.598+0000 7fa4f783a640 1 --2- 172.21.15.60:0/1133876266 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0102790 0x7fa4f01067e0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.598+0000 7fa4f783a640 1 --2- 172.21.15.60:0/1133876266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f0101de0 0x7fa4f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.598+0000 7fa4f783a640 1 -- 172.21.15.60:0/1133876266 >> 172.21.15.60:0/1133876266 conn(0x7fa4f00fd8c0 msgr2=0x7fa4f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.598+0000 7fa4f783a640 1 -- 172.21.15.60:0/1133876266 shutdown_connections 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 -- 172.21.15.60:0/1133876266 wait complete. 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 Processor -- start 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 -- start start 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4f0101de0 0x7fa4f0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f0102790 0x7fa4f01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0106f10 0x7fa4f019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f0112050 con 0x7fa4f0106f10 2024-09-12T00:06:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f0111ed0 con 0x7fa4f0101de0 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.599+0000 7fa4f783a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01121d0 con 0x7fa4f0102790 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0106f10 0x7fa4f019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0106f10 0x7fa4f019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55678/0 (socket says 172.21.15.60:55678) 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 -- 172.21.15.60:0/3892394389 learned_addr learned my addr 172.21.15.60:0/3892394389 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f0102790 0x7fa4f01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4f0101de0 0x7fa4f0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 -- 172.21.15.60:0/3892394389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f0102790 msgr2=0x7fa4f01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f0102790 0x7fa4f01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 -- 172.21.15.60:0/3892394389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4f0101de0 msgr2=0x7fa4f0198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4f0101de0 0x7fa4f0198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 -- 172.21.15.60:0/3892394389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f019d440 con 0x7fa4f0106f10 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0106f10 0x7fa4f019cd60 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800c970 tx=0x7fa4e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4ee7fc640 1 -- 172.21.15.60:0/3892394389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8007bb0 con 0x7fa4f0106f10 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f783a640 1 -- 172.21.15.60:0/3892394389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f019d730 con 0x7fa4f0106f10 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4ee7fc640 1 -- 172.21.15.60:0/3892394389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4e8007d50 con 0x7fa4f0106f10 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4ee7fc640 1 -- 172.21.15.60:0/3892394389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800f450 con 0x7fa4f0106f10 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.600+0000 7fa4f783a640 1 -- 172.21.15.60:0/3892394389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f01a5010 con 0x7fa4f0106f10 2024-09-12T00:06:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.602+0000 7fa4ee7fc640 1 -- 172.21.15.60:0/3892394389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa4e8005020 con 0x7fa4f0106f10 2024-09-12T00:06:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f9c13740 1 Processor -- start 2024-09-12T00:06:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f9c13740 1 -- start start 2024-09-12T00:06:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4ee7fc640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4d80a2cf0 0x7fa4d80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193493090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a193493a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a1933f92f0 con 0x55a1934935d0 2024-09-12T00:06:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a1933a0cf0 con 0x55a193494b40 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4ee7fc640 1 -- 172.21.15.60:0/3892394389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7fa4e80cf100 con 0x7fa4f0106f10 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a1933f52b0 con 0x55a19349e370 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.603+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4d80a2cf0 0x7fa4d80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f4dd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a193493a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f55d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193493090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f4dd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a193493a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55686/0 (socket says 172.21.15.60:55686) 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f4dd5640 1 -- 172.21.15.60:0/2883504245 learned_addr learned my addr 172.21.15.60:0/2883504245 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4d80a2cf0 0x7fa4d80a51b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4000c00 tx=0x7fa4e40319e0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f55d6640 1 -- 172.21.15.60:0/2883504245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 msgr2=0x55a1934a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f55d6640 1 -- 172.21.15.60:0/2883504245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 msgr2=0x55a193493a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a193493a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f55d6640 1 -- 172.21.15.60:0/2883504245 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1933853a0 con 0x55a193494b40 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a193493a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193493090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0007e10 tx=0x7fa4e000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c28a271eee1b6ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.604+0000 7fa4d77fe640 1 -- 172.21.15.60:0/2883504245 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0014070 con 0x55a193494b40 2024-09-12T00:06:36.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4d77fe640 1 -- 172.21.15.60:0/2883504245 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4e0004d20 con 0x55a193494b40 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4d77fe640 1 -- 172.21.15.60:0/2883504245 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0005280 con 0x55a193494b40 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2883504245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 msgr2=0x55a193493090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193493090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0007e10 tx=0x7fa4e000e720 comp rx=0 tx=0).stop 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2883504245 shutdown_connections 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a193493a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/2883504245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193493090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2883504245 >> 172.21.15.60:0/2883504245 conn(0x55a19345c310 msgr2=0x55a19348fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2883504245 shutdown_connections 2024-09-12T00:06:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.605+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2883504245 wait complete. 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 1 -- start start 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 1 Processor -- start 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1934935d0 0x55a19349dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a19349afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a19349e370 0x55a19349b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55a1934a5480 con 0x55a19349e370 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a1933b4060 con 0x55a193494b40 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a1934a5600 con 0x55a1934935d0 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f9c13740 10 client.0 _ll_register_callbacks cb 0x55a1931078c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f5dd7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a19349e370 0x55a19349b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f5dd7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a19349e370 0x55a19349b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55692/0 (socket says 172.21.15.60:55692) 2024-09-12T00:06:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a19349afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.606+0000 7fa4f5dd7640 1 -- 172.21.15.60:0/1107020345 learned_addr learned my addr 172.21.15.60:0/1107020345 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1934935d0 0x55a19349dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f5dd7640 1 -- 172.21.15.60:0/1107020345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1934935d0 msgr2=0x55a19349dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1934935d0 0x55a19349dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f5dd7640 1 -- 172.21.15.60:0/1107020345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 msgr2=0x55a19349afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a19349afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f5dd7640 1 -- 172.21.15.60:0/1107020345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a19316a3c0 con 0x55a19349e370 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a19349e370 0x55a19349b530 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa4e809b5d0 tx=0x7fa4e809b2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66722a1a088ef67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/1107020345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e801d040 con 0x55a19349e370 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/1107020345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7fa4e80ccaf0 con 0x55a19349e370 2024-09-12T00:06:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f9c13740 1 -- 172.21.15.60:0/1107020345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4e0004d20 con 0x55a19349e370 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/1107020345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fa4e809f9f0 con 0x55a19349e370 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f9c13740 10 client.17112 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4f9c13740 1 -- 172.21.15.60:0/1107020345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55a1934b0eb0 con 0x55a19349e370 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.607+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/1107020345 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4e0004d20 con 0x55a19349e370 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.608+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/1107020345 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fa4e809aa90 con 0x55a19349e370 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.608+0000 7fa4f9c13740 10 client.17112 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.608+0000 7fa4f9c13740 10 client.17112 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.608+0000 7fa4f9c13740 20 client.17112 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.608+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55a1934b2370 0x55a1934b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.608+0000 7fa4f9c13740 4 client.17112 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.608+0000 7fa4f9c13740 1 -- 172.21.15.60:0/1107020345 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a193406860 con 0x55a1934b2370 2024-09-12T00:06:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.608+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55a1934b2370 0x55a1934b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55a1934b2370 0x55a1934b47e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d395b663459f0cc9 server_cookie=d9134b959f450a84 in_seq=0 out_seq=0 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4d4ff9640 10 client.17112 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/1107020345 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a193406860 con 0x55a1934b2370 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4d4ff9640 10 client.17112 handle_command_reply: tid=0 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 client.17112 shutdown 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 -- 172.21.15.60:0/1107020345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a19349e370 msgr2=0x55a19349b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a19349e370 0x55a19349b530 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa4e809b5d0 tx=0x7fa4e809b2b0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 -- 172.21.15.60:0/1107020345 shutdown_connections 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55a1934b2370 0x55a1934b47e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a19349e370 0x55a19349b530 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a19349afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/1107020345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a1934935d0 0x55a19349dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4d4ff9640 0 client.17112 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:06:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.609+0000 7fa4f9c13740 1 -- 172.21.15.60:0/1107020345 >> 172.21.15.60:0/1107020345 conn(0x55a19345c310 msgr2=0x55a193495960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.610+0000 7fa4f9c13740 1 -- 172.21.15.60:0/1107020345 shutdown_connections 2024-09-12T00:06:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.610+0000 7fa4f9c13740 1 -- 172.21.15.60:0/1107020345 wait complete. 2024-09-12T00:06:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.610+0000 7fa4f9c13740 20 client.17112 trim_cache size 0 max 16384 2024-09-12T00:06:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f9c13740 1 Processor -- start 2024-09-12T00:06:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f9c13740 1 -- start start 2024-09-12T00:06:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a19349cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193496120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a193496660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01ab6c0 con 0x55a1934935d0 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01ad200 con 0x55a193494b40 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01abd90 con 0x55a19349e370 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a19349cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a19349cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55708/0 (socket says 172.21.15.60:55708) 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 -- 172.21.15.60:0/2562733706 learned_addr learned my addr 172.21.15.60:0/2562733706 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193496120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 -- 172.21.15.60:0/2562733706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 msgr2=0x55a193496660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a193496660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a193496660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 -- 172.21.15.60:0/2562733706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 msgr2=0x55a193496120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193496120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 -- 172.21.15.60:0/2562733706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a19349e020 con 0x55a1934935d0 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a193496660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.623+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a19349cf20 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0004610 tx=0x7fa4e0004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88125916b8e69b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4d6ffd640 1 -- 172.21.15.60:0/2562733706 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0014040 con 0x55a1934935d0 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4d6ffd640 1 -- 172.21.15.60:0/2562733706 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4e0004c00 con 0x55a1934935d0 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4d6ffd640 1 -- 172.21.15.60:0/2562733706 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00052b0 con 0x55a1934935d0 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2562733706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 msgr2=0x55a19349cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a19349cf20 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0004610 tx=0x7fa4e0004710 comp rx=0 tx=0).stop 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2562733706 shutdown_connections 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a193496660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a193494b40 0x55a193496120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/2562733706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a1934935d0 0x55a19349cf20 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2562733706 >> 172.21.15.60:0/2562733706 conn(0x55a19345c310 msgr2=0x55a19349c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2562733706 shutdown_connections 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.624+0000 7fa4f9c13740 1 -- 172.21.15.60:0/2562733706 wait complete. 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 1 -- start start 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 1 Processor -- start 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1934935d0 0x55a1934aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a193494b40 0x55a1934a6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01acb30 con 0x55a193494b40 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01ac460 con 0x55a1934935d0 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01a96c0 con 0x55a19349e370 2024-09-12T00:06:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f9c13740 10 client.0 _ll_register_callbacks cb 0x7fa4e800c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f4dd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a193494b40 0x55a1934a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f4dd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a193494b40 0x55a1934a6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55714/0 (socket says 172.21.15.60:55714) 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f4dd5640 1 -- 172.21.15.60:0/84395280 learned_addr learned my addr 172.21.15.60:0/84395280 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.625+0000 7fa4f5dd7640 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1934935d0 0x55a1934aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f4dd5640 1 -- 172.21.15.60:0/84395280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 msgr2=0x55a1934a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f4dd5640 1 -- 172.21.15.60:0/84395280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1934935d0 msgr2=0x55a1934aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1934935d0 0x55a1934aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f4dd5640 1 -- 172.21.15.60:0/84395280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1934a70c0 con 0x55a193494b40 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1934935d0 0x55a1934aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:36.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f4dd5640 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a193494b40 0x55a1934a6350 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4005ec0 tx=0x7fa4e4044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef3b8d40a0b4e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/84395280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4059060 con 0x55a193494b40 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/84395280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7fa4e4054480 con 0x55a193494b40 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f9c13740 1 -- 172.21.15.60:0/84395280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4e0004c00 con 0x55a193494b40 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/84395280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fa4e4035040 con 0x55a193494b40 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f9c13740 10 client.17118 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.626+0000 7fa4f9c13740 1 -- 172.21.15.60:0/84395280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55a19351d000 con 0x55a193494b40 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/84395280 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa4e0004c00 con 0x55a193494b40 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/84395280 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fa4e404a6e0 con 0x55a193494b40 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4f9c13740 10 client.17118 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4f9c13740 10 client.17118 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:06:36.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4f9c13740 20 client.17118 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55a19351d780 0x55a19351fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4f9c13740 4 client.17118 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4f9c13740 1 -- 172.21.15.60:0/84395280 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a193400d70 con 0x55a19351d780 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.627+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55a19351d780 0x55a19351fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f55d6640 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55a19351d780 0x55a19351fba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c3d203d292ad2bb3 server_cookie=c275194da1cf50db in_seq=0 out_seq=0 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4d4ff9640 10 client.17118 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4d4ff9640 1 -- 172.21.15.60:0/84395280 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a193400d70 con 0x55a19351d780 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4d4ff9640 10 client.17118 handle_command_reply: tid=0 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 client.17118 shutdown 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 -- 172.21.15.60:0/84395280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a193494b40 msgr2=0x55a1934a6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a193494b40 0x55a1934a6350 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4005ec0 tx=0x7fa4e4044000 comp rx=0 tx=0).stop 2024-09-12T00:06:36.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 -- 172.21.15.60:0/84395280 shutdown_connections 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x55a19351d780 0x55a19351fba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a19349e370 0x55a1934a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55a193494b40 0x55a1934a6350 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 --2- 172.21.15.60:0/84395280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a1934935d0 0x55a1934aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4d4ff9640 0 client.17118 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 -- 172.21.15.60:0/84395280 >> 172.21.15.60:0/84395280 conn(0x55a19345c310 msgr2=0x55a19349c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 -- 172.21.15.60:0/84395280 shutdown_connections 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 1 -- 172.21.15.60:0/84395280 wait complete. 2024-09-12T00:06:36.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.628+0000 7fa4f9c13740 20 client.17118 trim_cache size 0 max 16384 2024-09-12T00:06:36.635 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:06:36.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 -- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4d80a2cf0 msgr2=0x7fa4d80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4d80a2cf0 0x7fa4d80a51b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4000c00 tx=0x7fa4e40319e0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 -- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0106f10 msgr2=0x7fa4f019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:36.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0106f10 0x7fa4f019cd60 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800c970 tx=0x7fa4e800ce30 comp rx=0 tx=0).stop 2024-09-12T00:06:36.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 -- 172.21.15.60:0/3892394389 shutdown_connections 2024-09-12T00:06:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa4d80a2cf0 0x7fa4d80a51b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4f0106f10 0x7fa4f019cd60 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f0102790 0x7fa4f01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 --2- 172.21.15.60:0/3892394389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4f0101de0 0x7fa4f0198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 -- 172.21.15.60:0/3892394389 >> 172.21.15.60:0/3892394389 conn(0x7fa4f00fd8c0 msgr2=0x7fa4f00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 -- 172.21.15.60:0/3892394389 shutdown_connections 2024-09-12T00:06:36.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:36.629+0000 7fa4f783a640 1 -- 172.21.15.60:0/3892394389 wait complete. 2024-09-12T00:06:37.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:36 smithi192 ceph-mon[35487]: pgmap v222: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:37.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:36 smithi060 ceph-mon[30953]: pgmap v222: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:37.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:06:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:36 smithi105 ceph-mon[34805]: pgmap v222: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:37.665 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:38.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 -- 172.21.15.60:0/2499735047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 msgr2=0x7f3a241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/2499735047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 0x7f3a241021c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009900 tx=0x7f3a2002a3f0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 -- 172.21.15.60:0/2499735047 shutdown_connections 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/2499735047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a24106f10 0x7f3a2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/2499735047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24102790 0x7f3a241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/2499735047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 0x7f3a241021c0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 -- 172.21.15.60:0/2499735047 >> 172.21.15.60:0/2499735047 conn(0x7f3a240fd8c0 msgr2=0x7f3a240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 -- 172.21.15.60:0/2499735047 shutdown_connections 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.132+0000 7f3a2bb67640 1 -- 172.21.15.60:0/2499735047 wait complete. 2024-09-12T00:06:38.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2bb67640 1 Processor -- start 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2bb67640 1 -- start start 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2bb67640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 0x7f3a241984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2bb67640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24102790 0x7f3a24198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2bb67640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a24106f10 0x7f3a2419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2bb67640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24112050 con 0x7f3a24101de0 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2bb67640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24111ed0 con 0x7f3a24102790 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2bb67640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241121d0 con 0x7f3a24106f10 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a29903640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 0x7f3a241984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a29903640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 0x7f3a241984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55724/0 (socket says 172.21.15.60:55724) 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a29903640 1 -- 172.21.15.60:0/26149953 learned_addr learned my addr 172.21.15.60:0/26149953 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.133+0000 7f3a2a104640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a24106f10 0x7f3a2419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a29102640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24102790 0x7f3a24198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a29903640 1 -- 172.21.15.60:0/26149953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a24106f10 msgr2=0x7f3a2419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a29903640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a24106f10 0x7f3a2419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a29903640 1 -- 172.21.15.60:0/26149953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24102790 msgr2=0x7f3a24198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a29903640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24102790 0x7f3a24198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a29903640 1 -- 172.21.15.60:0/26149953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2419d4a0 con 0x7f3a24101de0 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a29102640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24102790 0x7f3a24198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a29903640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 0x7f3a241984f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3a20006010 tx=0x7f3a200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a1affd640 1 -- 172.21.15.60:0/26149953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2003f030 con 0x7f3a24101de0 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a2bb67640 1 -- 172.21.15.60:0/26149953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2419d730 con 0x7f3a24101de0 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a1affd640 1 -- 172.21.15.60:0/26149953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a20003d00 con 0x7f3a24101de0 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a1affd640 1 -- 172.21.15.60:0/26149953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20035070 con 0x7f3a24101de0 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.134+0000 7f3a2bb67640 1 -- 172.21.15.60:0/26149953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241a5070 con 0x7f3a24101de0 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.136+0000 7f3a1affd640 1 -- 172.21.15.60:0/26149953 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3a20042030 con 0x7f3a24101de0 2024-09-12T00:06:38.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2df40740 1 Processor -- start 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2df40740 1 -- start start 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 0x55808f3b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2df40740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55808f3102f0 con 0x55808f3abb40 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2df40740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55808f2b7cf0 con 0x55808f3b5370 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2df40740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55808f30c2b0 con 0x55808f3aa5d0 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.137+0000 7f3a2a104640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55726/0 (socket says 172.21.15.60:55726) 2024-09-12T00:06:38.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 -- 172.21.15.60:0/3465622160 learned_addr learned my addr 172.21.15.60:0/3465622160 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a29903640 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a1affd640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a100a2cf0 0x7f3a100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a29102640 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 0x55808f3b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 -- 172.21.15.60:0/3465622160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 msgr2=0x55808f3aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 -- 172.21.15.60:0/3465622160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 msgr2=0x55808f3b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 0x55808f3b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 -- 172.21.15.60:0/3465622160 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808f29c3a0 con 0x55808f3abb40 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a29903640 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a1affd640 1 -- 172.21.15.60:0/26149953 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f3a200efaa0 con 0x7f3a24101de0 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a100a2cf0 0x7f3a100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a2a104640 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3aa090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c010440 tx=0x7f3a1c010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d199433c03d3b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a0ffff640 1 -- 172.21.15.60:0/3465622160 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c01d400 con 0x55808f3abb40 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a0ffff640 1 -- 172.21.15.60:0/3465622160 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a1c013520 con 0x55808f3abb40 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.138+0000 7f3a0ffff640 1 -- 172.21.15.60:0/3465622160 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0119d0 con 0x55808f3abb40 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 -- 172.21.15.60:0/3465622160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 msgr2=0x55808f3aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2a104640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a100a2cf0 0x7f3a100a51b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c021000 tx=0x7f3a1c01e000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3aa090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c010440 tx=0x7f3a1c010900 comp rx=0 tx=0).stop 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 -- 172.21.15.60:0/3465622160 shutdown_connections 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 0x55808f3b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3465622160 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3aa090 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 -- 172.21.15.60:0/3465622160 >> 172.21.15.60:0/3465622160 conn(0x55808f373310 msgr2=0x55808f3a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 -- 172.21.15.60:0/3465622160 shutdown_connections 2024-09-12T00:06:38.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.139+0000 7f3a2df40740 1 -- 172.21.15.60:0/3465622160 wait complete. 2024-09-12T00:06:38.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 1 -- start start 2024-09-12T00:06:38.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 1 Processor -- start 2024-09-12T00:06:38.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 0x55808f3b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55808f3b8070 con 0x55808f3abb40 2024-09-12T00:06:38.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55808f2cb060 con 0x55808f3b5370 2024-09-12T00:06:38.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55808f3b81f0 con 0x55808f3aa5d0 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2df40740 10 client.0 _ll_register_callbacks cb 0x55808f01e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a29102640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a29102640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55736/0 (socket says 172.21.15.60:55736) 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a29102640 1 -- 172.21.15.60:0/3272356511 learned_addr learned my addr 172.21.15.60:0/3272356511 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a2a104640 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 0x55808f3b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.140+0000 7f3a29903640 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a29102640 1 -- 172.21.15.60:0/3272356511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 msgr2=0x55808f3b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a29102640 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a29102640 1 -- 172.21.15.60:0/3272356511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 msgr2=0x55808f3b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a29102640 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 0x55808f3b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a29102640 1 -- 172.21.15.60:0/3272356511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808f0813c0 con 0x55808f3abb40 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a29102640 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3b2020 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400f780 tx=0x7f3a1400fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1669fe6cb813787 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:38.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/3272356511 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400bd10 con 0x55808f3abb40 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/3272356511 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f3a1401b480 con 0x55808f3abb40 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a2df40740 1 -- 172.21.15.60:0/3272356511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a1c013520 con 0x55808f3abb40 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/3272356511 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3a1400fe90 con 0x55808f3abb40 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a2df40740 10 client.17130 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a2df40740 1 -- 172.21.15.60:0/3272356511 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55808f3c3b70 con 0x55808f3abb40 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.141+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/3272356511 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a1c013520 con 0x55808f3abb40 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/3272356511 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f3a140108e0 con 0x55808f3abb40 2024-09-12T00:06:38.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a2df40740 10 client.17130 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a2df40740 10 client.17130 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a2df40740 20 client.17130 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55808f3c5080 0x55808f3c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a2df40740 4 client.17130 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a2df40740 1 -- 172.21.15.60:0/3272356511 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55808f31d860 con 0x55808f3c5080 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a29903640 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55808f3c5080 0x55808f3c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a0d7fa640 10 client.17130 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.142+0000 7f3a29903640 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55808f3c5080 0x55808f3c74a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c201ee0d116d103 server_cookie=c6feaed1d91719aa in_seq=0 out_seq=0 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/3272356511 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55808f31d860 con 0x55808f3c5080 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a0d7fa640 10 client.17130 handle_command_reply: tid=0 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 client.17130 shutdown 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 -- 172.21.15.60:0/3272356511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 msgr2=0x55808f3b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3b2020 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400f780 tx=0x7f3a1400fc40 comp rx=0 tx=0).stop 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 -- 172.21.15.60:0/3272356511 shutdown_connections 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55808f3c5080 0x55808f3c74a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3b5370 0x55808f3b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3abb40 0x55808f3b2020 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3272356511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3aa5d0 0x55808f3b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a0d7fa640 0 client.17130 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.143+0000 7f3a2df40740 1 -- 172.21.15.60:0/3272356511 >> 172.21.15.60:0/3272356511 conn(0x55808f373310 msgr2=0x55808f3ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.144+0000 7f3a2df40740 1 -- 172.21.15.60:0/3272356511 shutdown_connections 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.144+0000 7f3a2df40740 1 -- 172.21.15.60:0/3272356511 wait complete. 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.144+0000 7f3a2df40740 20 client.17130 trim_cache size 0 max 16384 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2df40740 1 Processor -- start 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2df40740 1 -- start start 2024-09-12T00:06:38.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3aa5d0 0x55808f3c1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3abb40 0x55808f3b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3b5370 0x55808f3ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2df40740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241ad840 con 0x55808f3b5370 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2df40740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241af380 con 0x55808f3aa5d0 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2df40740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241adf10 con 0x55808f3abb40 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2a104640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3b5370 0x55808f3ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2a104640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3b5370 0x55808f3ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55750/0 (socket says 172.21.15.60:55750) 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2a104640 1 -- 172.21.15.60:0/3739809792 learned_addr learned my addr 172.21.15.60:0/3739809792 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a29903640 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3aa5d0 0x55808f3c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2a104640 1 -- 172.21.15.60:0/3739809792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3abb40 msgr2=0x55808f3b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2a104640 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3abb40 0x55808f3b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2a104640 1 -- 172.21.15.60:0/3739809792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3aa5d0 msgr2=0x55808f3c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:38.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2a104640 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3aa5d0 0x55808f3c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a2a104640 1 -- 172.21.15.60:0/3739809792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808f3a7960 con 0x55808f3b5370 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.157+0000 7f3a29903640 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3aa5d0 0x55808f3c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2a104640 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3b5370 0x55808f3ccd70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c010e00 tx=0x7f3a1c013f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12593ca0f7d23e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a0f7fe640 1 -- 172.21.15.60:0/3739809792 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c013520 con 0x55808f3b5370 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a0f7fe640 1 -- 172.21.15.60:0/3739809792 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a1c011ce0 con 0x55808f3b5370 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a0f7fe640 1 -- 172.21.15.60:0/3739809792 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c027770 con 0x55808f3b5370 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 -- 172.21.15.60:0/3739809792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3b5370 msgr2=0x55808f3ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3b5370 0x55808f3ccd70 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c010e00 tx=0x7f3a1c013f50 comp rx=0 tx=0).stop 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 -- 172.21.15.60:0/3739809792 shutdown_connections 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3b5370 0x55808f3ccd70 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3abb40 0x55808f3b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 --2- 172.21.15.60:0/3739809792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3aa5d0 0x55808f3c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 -- 172.21.15.60:0/3739809792 >> 172.21.15.60:0/3739809792 conn(0x55808f373310 msgr2=0x55808f3b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:38.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 -- 172.21.15.60:0/3739809792 shutdown_connections 2024-09-12T00:06:38.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.158+0000 7f3a2df40740 1 -- 172.21.15.60:0/3739809792 wait complete. 2024-09-12T00:06:38.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 1 -- start start 2024-09-12T00:06:38.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 1 Processor -- start 2024-09-12T00:06:38.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3aa5d0 0x55808f3b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3abb40 0x55808f3b9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3b5370 0x55808f3b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241aecb0 con 0x55808f3aa5d0 2024-09-12T00:06:38.207 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:06:38.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241ae5e0 con 0x55808f3abb40 2024-09-12T00:06:38.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3a241ab840 con 0x55808f3b5370 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a2df40740 10 client.0 _ll_register_callbacks cb 0x7f3a1400d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a29903640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3aa5d0 0x55808f3b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a29903640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3aa5d0 0x55808f3b9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55762/0 (socket says 172.21.15.60:55762) 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a29903640 1 -- 172.21.15.60:0/1118069448 learned_addr learned my addr 172.21.15.60:0/1118069448 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.159+0000 7f3a29102640 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3abb40 0x55808f3b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a2a104640 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3b5370 0x55808f3b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a29903640 1 -- 172.21.15.60:0/1118069448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3b5370 msgr2=0x55808f3b9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a29903640 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3b5370 0x55808f3b9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a29903640 1 -- 172.21.15.60:0/1118069448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3abb40 msgr2=0x55808f3b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a29903640 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3abb40 0x55808f3b9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a29903640 1 -- 172.21.15.60:0/1118069448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808f42eea0 con 0x55808f3aa5d0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a2a104640 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3b5370 0x55808f3b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a29903640 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3aa5d0 0x55808f3b9350 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3a20003fd0 tx=0x7f3a2003b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dad3952387c2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/1118069448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20049040 con 0x55808f3aa5d0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/1118069448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f3a200c00d0 con 0x55808f3aa5d0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a2df40740 1 -- 172.21.15.60:0/1118069448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a1c011ce0 con 0x55808f3aa5d0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/1118069448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3a200bc740 con 0x55808f3aa5d0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a2df40740 10 client.17136 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a2df40740 1 -- 172.21.15.60:0/1118069448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55808f430140 con 0x55808f3aa5d0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/1118069448 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a1c011ce0 con 0x55808f3aa5d0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.160+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/1118069448 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f3a200da060 con 0x55808f3aa5d0 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a2df40740 10 client.17136 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a2df40740 10 client.17136 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a2df40740 20 client.17136 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a2df40740 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55808f430810 0x55808f432c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a2df40740 4 client.17136 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a2df40740 1 -- 172.21.15.60:0/1118069448 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55808f317d70 con 0x55808f430810 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a29102640 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55808f430810 0x55808f432c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a29102640 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55808f430810 0x55808f432c00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4be7541c50ea3a32 server_cookie=cd0c61c39b9eafd4 in_seq=0 out_seq=0 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a0d7fa640 10 client.17136 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a0d7fa640 1 -- 172.21.15.60:0/1118069448 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55808f317d70 con 0x55808f430810 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a0d7fa640 10 client.17136 handle_command_reply: tid=0 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.161+0000 7f3a2df40740 1 client.17136 shutdown 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 -- 172.21.15.60:0/1118069448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3aa5d0 msgr2=0x55808f3b9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3aa5d0 0x55808f3b9350 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3a20003fd0 tx=0x7f3a2003b800 comp rx=0 tx=0).stop 2024-09-12T00:06:38.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 -- 172.21.15.60:0/1118069448 shutdown_connections 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55808f430810 0x55808f432c00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55808f3b5370 0x55808f3b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a0d7fa640 0 client.17136 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55808f3abb40 0x55808f3b9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 --2- 172.21.15.60:0/1118069448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55808f3aa5d0 0x55808f3b9350 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 -- 172.21.15.60:0/1118069448 >> 172.21.15.60:0/1118069448 conn(0x55808f373310 msgr2=0x55808f3b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 -- 172.21.15.60:0/1118069448 shutdown_connections 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 1 -- 172.21.15.60:0/1118069448 wait complete. 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2df40740 20 client.17136 trim_cache size 0 max 16384 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2bb67640 1 -- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a100a2cf0 msgr2=0x7f3a100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a100a2cf0 0x7f3a100a51b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c021000 tx=0x7f3a1c01e000 comp rx=0 tx=0).stop 2024-09-12T00:06:38.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2bb67640 1 -- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 msgr2=0x7f3a241984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.162+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 0x7f3a241984f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f3a20006010 tx=0x7f3a200042f0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.163+0000 7f3a2bb67640 1 -- 172.21.15.60:0/26149953 shutdown_connections 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.163+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a100a2cf0 0x7f3a100a51b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.163+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a24106f10 0x7f3a2419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.163+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24102790 0x7f3a24198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.163+0000 7f3a2bb67640 1 --2- 172.21.15.60:0/26149953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a24101de0 0x7f3a241984f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.163+0000 7f3a2bb67640 1 -- 172.21.15.60:0/26149953 >> 172.21.15.60:0/26149953 conn(0x7f3a240fd8c0 msgr2=0x7f3a240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.163+0000 7f3a2bb67640 1 -- 172.21.15.60:0/26149953 shutdown_connections 2024-09-12T00:06:38.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:38.163+0000 7f3a2bb67640 1 -- 172.21.15.60:0/26149953 wait complete. 2024-09-12T00:06:38.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:06:39.207 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:39.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:38 smithi192 ceph-mon[35487]: pgmap v223: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:06:39.329 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:38 smithi060 ceph-mon[30953]: pgmap v223: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:06:39.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:38 smithi105 ceph-mon[34805]: pgmap v223: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:06:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 -- 172.21.15.60:0/3285594757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 msgr2=0x7feb6c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 --2- 172.21.15.60:0/3285594757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 0x7feb6c1021c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009900 tx=0x7feb5c02a410 comp rx=0 tx=0).stop 2024-09-12T00:06:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 -- 172.21.15.60:0/3285594757 shutdown_connections 2024-09-12T00:06:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 --2- 172.21.15.60:0/3285594757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb6c106f10 0x7feb6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 --2- 172.21.15.60:0/3285594757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb6c102790 0x7feb6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 --2- 172.21.15.60:0/3285594757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 0x7feb6c1021c0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 -- 172.21.15.60:0/3285594757 >> 172.21.15.60:0/3285594757 conn(0x7feb6c0fd8c0 msgr2=0x7feb6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 -- 172.21.15.60:0/3285594757 shutdown_connections 2024-09-12T00:06:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 -- 172.21.15.60:0/3285594757 wait complete. 2024-09-12T00:06:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.670+0000 7feb70be1640 1 Processor -- start 2024-09-12T00:06:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb70be1640 1 -- start start 2024-09-12T00:06:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb70be1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 0x7feb6c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb70be1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb6c102790 0x7feb6c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb70be1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb6c106f10 0x7feb6c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb70be1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c1120d0 con 0x7feb6c101de0 2024-09-12T00:06:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb70be1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c111f50 con 0x7feb6c102790 2024-09-12T00:06:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb70be1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c112250 con 0x7feb6c106f10 2024-09-12T00:06:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 0x7feb6c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 0x7feb6c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55782/0 (socket says 172.21.15.60:55782) 2024-09-12T00:06:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 -- 172.21.15.60:0/3647460039 learned_addr learned my addr 172.21.15.60:0/3647460039 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb69d9b640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb6c102790 0x7feb6c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb6c106f10 0x7feb6c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 -- 172.21.15.60:0/3647460039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb6c106f10 msgr2=0x7feb6c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb6c106f10 0x7feb6c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 -- 172.21.15.60:0/3647460039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb6c102790 msgr2=0x7feb6c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb6c102790 0x7feb6c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 -- 172.21.15.60:0/3647460039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c19d4e0 con 0x7feb6c101de0 2024-09-12T00:06:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb6c106f10 0x7feb6c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:39.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.671+0000 7feb6a59c640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 0x7feb6c198530 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7feb5c006010 tx=0x7feb5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:39.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.672+0000 7feb5b7fe640 1 -- 172.21.15.60:0/3647460039 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c03f030 con 0x7feb6c101de0 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.672+0000 7feb5b7fe640 1 -- 172.21.15.60:0/3647460039 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb5c003d00 con 0x7feb6c101de0 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.672+0000 7feb70be1640 1 -- 172.21.15.60:0/3647460039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6c19d770 con 0x7feb6c101de0 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.672+0000 7feb5b7fe640 1 -- 172.21.15.60:0/3647460039 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c035070 con 0x7feb6c101de0 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.672+0000 7feb70be1640 1 -- 172.21.15.60:0/3647460039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6c1a50b0 con 0x7feb6c101de0 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.674+0000 7feb5b7fe640 1 -- 172.21.15.60:0/3647460039 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7feb5c042030 con 0x7feb6c101de0 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.674+0000 7feb72fba740 1 Processor -- start 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb72fba740 1 -- start start 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb72fba740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a798090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb72fba740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a798a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb72fba740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a7a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb5b7fe640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feb540a2cf0 0x7feb540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb72fba740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55681a6fe2f0 con 0x55681a7985d0 2024-09-12T00:06:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb72fba740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55681a6a5cf0 con 0x55681a799b40 2024-09-12T00:06:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb72fba740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55681a6fa2b0 con 0x55681a7a3370 2024-09-12T00:06:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feb540a2cf0 0x7feb540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a798a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a798a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55794/0 (socket says 172.21.15.60:55794) 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6a59c640 1 -- 172.21.15.60:0/1979151386 learned_addr learned my addr 172.21.15.60:0/1979151386 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a798090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb5b7fe640 1 -- 172.21.15.60:0/3647460039 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7feb5c0efa40 con 0x7feb6c101de0 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb69d9b640 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a7a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6a59c640 1 -- 172.21.15.60:0/1979151386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 msgr2=0x55681a7a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6a59c640 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a7a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6a59c640 1 -- 172.21.15.60:0/1979151386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 msgr2=0x55681a798090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6a59c640 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a798090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb6a59c640 1 -- 172.21.15.60:0/1979151386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681a68a3a0 con 0x55681a7985d0 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.675+0000 7feb69d9b640 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a7a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:39.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.676+0000 7feb6a59c640 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a798a10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0b84a0 tx=0x7feb5c040fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e25eb1c7e639b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.676+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feb540a2cf0 0x7feb540a51b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb6400afd0 tx=0x7feb6400a3d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.676+0000 7feb58ff9640 1 -- 172.21.15.60:0/1979151386 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c049070 con 0x55681a7985d0 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.676+0000 7feb58ff9640 1 -- 172.21.15.60:0/1979151386 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb5c0bc740 con 0x55681a7985d0 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.676+0000 7feb58ff9640 1 -- 172.21.15.60:0/1979151386 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0c03f0 con 0x55681a7985d0 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 -- 172.21.15.60:0/1979151386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 msgr2=0x55681a798a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a798a10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0b84a0 tx=0x7feb5c040fb0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 -- 172.21.15.60:0/1979151386 shutdown_connections 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a7a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a798a10 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 --2- 172.21.15.60:0/1979151386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a798090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 -- 172.21.15.60:0/1979151386 >> 172.21.15.60:0/1979151386 conn(0x55681a761310 msgr2=0x55681a794c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 -- 172.21.15.60:0/1979151386 shutdown_connections 2024-09-12T00:06:39.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 -- 172.21.15.60:0/1979151386 wait complete. 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 -- start start 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.677+0000 7feb72fba740 1 Processor -- start 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb72fba740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb72fba740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7a0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb72fba740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7a3370 0x55681a7a0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb72fba740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55681a7a5e30 con 0x55681a7985d0 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb72fba740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55681a6b9060 con 0x55681a7a3370 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb72fba740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55681a7a5fb0 con 0x55681a799b40 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb72fba740 10 client.0 _ll_register_callbacks cb 0x55681a40c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55810/0 (socket says 172.21.15.60:55810) 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6a59c640 1 -- 172.21.15.60:0/307267003 learned_addr learned my addr 172.21.15.60:0/307267003 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:39.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb69d9b640 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7a3370 0x55681a7a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6a59c640 1 -- 172.21.15.60:0/307267003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 msgr2=0x55681a7a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6a59c640 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6a59c640 1 -- 172.21.15.60:0/307267003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7a3370 msgr2=0x55681a7a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6a59c640 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7a3370 0x55681a7a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6a59c640 1 -- 172.21.15.60:0/307267003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681a46f3c0 con 0x55681a7985d0 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.678+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7a3370 0x55681a7a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb6a59c640 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a2b30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7feb5c005ab0 tx=0x7feb5c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632aff63ab2071e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb51ffb640 1 -- 172.21.15.60:0/307267003 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c049040 con 0x55681a7985d0 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb51ffb640 1 -- 172.21.15.60:0/307267003 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7feb5c0ed430 con 0x55681a7985d0 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 1 -- 172.21.15.60:0/307267003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb5c0bc740 con 0x55681a7985d0 2024-09-12T00:06:39.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb51ffb640 1 -- 172.21.15.60:0/307267003 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7feb5c0bbe10 con 0x55681a7985d0 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 10 client.17148 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 1 -- 172.21.15.60:0/307267003 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55681a7a5e30 con 0x55681a7985d0 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb51ffb640 1 -- 172.21.15.60:0/307267003 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb5c0bc740 con 0x55681a7985d0 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb51ffb640 1 -- 172.21.15.60:0/307267003 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7feb5c0071c0 con 0x55681a7985d0 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 10 client.17148 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 10 client.17148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 20 client.17148 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55681a7bb200 0x55681a7bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 4 client.17148 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.679+0000 7feb72fba740 1 -- 172.21.15.60:0/307267003 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55681a70b860 con 0x55681a7bb200 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.680+0000 7feb69d9b640 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55681a7bb200 0x55681a7bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.680+0000 7feb51ffb640 10 client.17148 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.680+0000 7feb69d9b640 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55681a7bb200 0x55681a7bd5f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9f440179d6a4f68 server_cookie=bbca76aa63425a9a in_seq=0 out_seq=0 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb51ffb640 1 -- 172.21.15.60:0/307267003 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55681a70b860 con 0x55681a7bb200 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb51ffb640 10 client.17148 handle_command_reply: tid=0 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 client.17148 shutdown 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 -- 172.21.15.60:0/307267003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 msgr2=0x55681a7a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a2b30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7feb5c005ab0 tx=0x7feb5c005e80 comp rx=0 tx=0).stop 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 -- 172.21.15.60:0/307267003 shutdown_connections 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55681a7bb200 0x55681a7bd5f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7a3370 0x55681a7a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 --2- 172.21.15.60:0/307267003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a2b30 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb72fba740 1 -- 172.21.15.60:0/307267003 >> 172.21.15.60:0/307267003 conn(0x55681a761310 msgr2=0x55681a79a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:39.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.681+0000 7feb51ffb640 0 client.17148 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:39.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.682+0000 7feb72fba740 1 -- 172.21.15.60:0/307267003 shutdown_connections 2024-09-12T00:06:39.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.682+0000 7feb72fba740 1 -- 172.21.15.60:0/307267003 wait complete. 2024-09-12T00:06:39.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.682+0000 7feb72fba740 20 client.17148 trim_cache size 0 max 16384 2024-09-12T00:06:39.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb72fba740 1 Processor -- start 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb72fba740 1 -- start start 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb72fba740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb72fba740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a79b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb72fba740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a79b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb72fba740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c1ab6f0 con 0x55681a7985d0 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb72fba740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c1ad230 con 0x55681a799b40 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb72fba740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c1abdc0 con 0x55681a7a3370 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55824/0 (socket says 172.21.15.60:55824) 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6a59c640 1 -- 172.21.15.60:0/2626893770 learned_addr learned my addr 172.21.15.60:0/2626893770 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:39.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb69d9b640 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a79b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a79b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6a59c640 1 -- 172.21.15.60:0/2626893770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 msgr2=0x55681a79b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6a59c640 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a79b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6a59c640 1 -- 172.21.15.60:0/2626893770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 msgr2=0x55681a79b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6a59c640 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a79b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6a59c640 1 -- 172.21.15.60:0/2626893770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681a7a9100 con 0x55681a7985d0 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a79b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.695+0000 7feb69d9b640 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a79b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb6a59c640 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a28c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0bbfd0 tx=0x7feb5c03b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5893cd073ca57c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb53fff640 1 -- 172.21.15.60:0/2626893770 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0bbb80 con 0x55681a7985d0 2024-09-12T00:06:39.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb53fff640 1 -- 172.21.15.60:0/2626893770 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb5c0d6020 con 0x55681a7985d0 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb53fff640 1 -- 172.21.15.60:0/2626893770 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0bc2a0 con 0x55681a7985d0 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb72fba740 1 -- 172.21.15.60:0/2626893770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 msgr2=0x55681a7a28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb72fba740 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a28c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0bbfd0 tx=0x7feb5c03b800 comp rx=0 tx=0).stop 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb72fba740 1 -- 172.21.15.60:0/2626893770 shutdown_connections 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb72fba740 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a7a3370 0x55681a79b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb72fba740 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a799b40 0x55681a79b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb72fba740 1 --2- 172.21.15.60:0/2626893770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7985d0 0x55681a7a28c0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.696+0000 7feb72fba740 1 -- 172.21.15.60:0/2626893770 >> 172.21.15.60:0/2626893770 conn(0x55681a761310 msgr2=0x55681a7a89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 -- 172.21.15.60:0/2626893770 shutdown_connections 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 -- 172.21.15.60:0/2626893770 wait complete. 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 -- start start 2024-09-12T00:06:39.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 Processor -- start 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7985d0 0x55681a7b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7a3370 0x55681a7b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c1acb60 con 0x55681a7a3370 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c1ac490 con 0x55681a7985d0 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c1a96f0 con 0x55681a799b40 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb72fba740 10 client.0 _ll_register_callbacks cb 0x7feb64014600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb6ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7a3370 0x55681a7b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb6ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7a3370 0x55681a7b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55830/0 (socket says 172.21.15.60:55830) 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb6ad9d640 1 -- 172.21.15.60:0/1926125959 learned_addr learned my addr 172.21.15.60:0/1926125959 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:39.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.697+0000 7feb6a59c640 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7985d0 0x55681a7b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb69d9b640 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb6ad9d640 1 -- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 msgr2=0x55681a7b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb6ad9d640 1 -- 172.21.15.60:0/1926125959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7985d0 msgr2=0x55681a7b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7985d0 0x55681a7b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb6ad9d640 1 -- 172.21.15.60:0/1926125959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681a7b4170 con 0x55681a7a3370 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb69d9b640 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb6ad9d640 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7a3370 0x55681a7b3c30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7feb64012bc0 tx=0x7feb64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0c068bf6d64830 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:39.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb51ffb640 1 -- 172.21.15.60:0/1926125959 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6401fba0 con 0x55681a7a3370 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb51ffb640 1 -- 172.21.15.60:0/1926125959 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7feb6401fd40 con 0x55681a7a3370 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb72fba740 1 -- 172.21.15.60:0/1926125959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb5c0d6020 con 0x55681a7a3370 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb51ffb640 1 -- 172.21.15.60:0/1926125959 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7feb64021430 con 0x55681a7a3370 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb72fba740 10 client.17154 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.698+0000 7feb72fba740 1 -- 172.21.15.60:0/1926125959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55681a825a20 con 0x55681a7a3370 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb51ffb640 1 -- 172.21.15.60:0/1926125959 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb5c0d6020 con 0x55681a7a3370 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb51ffb640 1 -- 172.21.15.60:0/1926125959 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7feb64010040 con 0x55681a7a3370 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb72fba740 10 client.17154 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb72fba740 10 client.17154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb72fba740 20 client.17154 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb72fba740 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55681a8261a0 0x55681a8285c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:39.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb72fba740 4 client.17154 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb72fba740 1 -- 172.21.15.60:0/1926125959 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55681a705d70 con 0x55681a8261a0 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.699+0000 7feb6a59c640 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55681a8261a0 0x55681a8285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb6a59c640 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55681a8261a0 0x55681a8285c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb059967ed3b01f server_cookie=8afea9f5fe985d3a in_seq=0 out_seq=0 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb51ffb640 10 client.17154 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb51ffb640 1 -- 172.21.15.60:0/1926125959 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55681a705d70 con 0x55681a8261a0 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb51ffb640 10 client.17154 handle_command_reply: tid=0 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 client.17154 shutdown 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 -- 172.21.15.60:0/1926125959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7a3370 msgr2=0x55681a7b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7a3370 0x55681a7b3c30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7feb64012bc0 tx=0x7feb64004a40 comp rx=0 tx=0).stop 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 -- 172.21.15.60:0/1926125959 shutdown_connections 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55681a8261a0 0x55681a8285c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55681a7a3370 0x55681a7b3c30 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55681a799b40 0x55681a7b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb51ffb640 0 client.17154 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 --2- 172.21.15.60:0/1926125959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55681a7985d0 0x55681a7b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 -- 172.21.15.60:0/1926125959 >> 172.21.15.60:0/1926125959 conn(0x55681a761310 msgr2=0x55681a7a81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 -- 172.21.15.60:0/1926125959 shutdown_connections 2024-09-12T00:06:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 1 -- 172.21.15.60:0/1926125959 wait complete. 2024-09-12T00:06:39.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.700+0000 7feb72fba740 20 client.17154 trim_cache size 0 max 16384 2024-09-12T00:06:39.706 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:06:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 -- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feb540a2cf0 msgr2=0x7feb540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feb540a2cf0 0x7feb540a51b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb6400afd0 tx=0x7feb6400a3d0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 -- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 msgr2=0x7feb6c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 0x7feb6c198530 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7feb5c006010 tx=0x7feb5c0042f0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 -- 172.21.15.60:0/3647460039 shutdown_connections 2024-09-12T00:06:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7feb540a2cf0 0x7feb540a51b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb6c106f10 0x7feb6c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb6c102790 0x7feb6c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 --2- 172.21.15.60:0/3647460039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb6c101de0 0x7feb6c198530 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:39.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 -- 172.21.15.60:0/3647460039 >> 172.21.15.60:0/3647460039 conn(0x7feb6c0fd8c0 msgr2=0x7feb6c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:39.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 -- 172.21.15.60:0/3647460039 shutdown_connections 2024-09-12T00:06:39.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:39.701+0000 7feb70be1640 1 -- 172.21.15.60:0/3647460039 wait complete. 2024-09-12T00:06:41.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:40 smithi192 ceph-mon[35487]: pgmap v224: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:06:41.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:40 smithi060 ceph-mon[30953]: pgmap v224: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:06:41.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:40 smithi105 ceph-mon[34805]: pgmap v224: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T00:06:41.504 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:06:41.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:06:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 -- 172.21.15.60:0/152243078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38100a80 msgr2=0x7f3e38100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 --2- 172.21.15.60:0/152243078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38100a80 0x7f3e38100ee0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009930 tx=0x7f3e2802a420 comp rx=0 tx=0).stop 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 -- 172.21.15.60:0/152243078 shutdown_connections 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 --2- 172.21.15.60:0/152243078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e38101420 0x7f3e3810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 --2- 172.21.15.60:0/152243078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38100a80 0x7f3e38100ee0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 --2- 172.21.15.60:0/152243078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e38106a80 0x7f3e38106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 -- 172.21.15.60:0/152243078 >> 172.21.15.60:0/152243078 conn(0x7f3e380fc7a0 msgr2=0x7f3e380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 -- 172.21.15.60:0/152243078 shutdown_connections 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.282+0000 7f3e4030e640 1 -- 172.21.15.60:0/152243078 wait complete. 2024-09-12T00:06:42.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e4030e640 1 Processor -- start 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e4030e640 1 -- start start 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e4030e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e38100a80 0x7f3e3810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e4030e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e38101420 0x7f3e3810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e4030e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38106a80 0x7f3e3810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e4030e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3e381120c0 con 0x7f3e38106a80 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e4030e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e38111f40 con 0x7f3e38101420 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e4030e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e38112240 con 0x7f3e38100a80 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e3e8ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38106a80 0x7f3e3810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e3e8ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38106a80 0x7f3e3810ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49742/0 (socket says 172.21.15.60:49742) 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.283+0000 7f3e3e8ab640 1 -- 172.21.15.60:0/2681236969 learned_addr learned my addr 172.21.15.60:0/2681236969 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e38101420 0x7f3e3810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e38100a80 0x7f3e3810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3e8ab640 1 -- 172.21.15.60:0/2681236969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e38100a80 msgr2=0x7f3e3810e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3e8ab640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e38100a80 0x7f3e3810e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3e8ab640 1 -- 172.21.15.60:0/2681236969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e38101420 msgr2=0x7f3e3810e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3e8ab640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e38101420 0x7f3e3810e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3e8ab640 1 -- 172.21.15.60:0/2681236969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e381a69a0 con 0x7f3e38106a80 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e38100a80 0x7f3e3810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e3e8ab640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38106a80 0x7f3e3810ee60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000cce0 tx=0x7f3e3000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e2f7fe640 1 -- 172.21.15.60:0/2681236969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3000f450 con 0x7f3e38106a80 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e2f7fe640 1 -- 172.21.15.60:0/2681236969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3e3000faf0 con 0x7f3e38106a80 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e4030e640 1 -- 172.21.15.60:0/2681236969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e381a6c90 con 0x7f3e38106a80 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e2f7fe640 1 -- 172.21.15.60:0/2681236969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30018cc0 con 0x7f3e38106a80 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.284+0000 7f3e4030e640 1 -- 172.21.15.60:0/2681236969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e381a7150 con 0x7f3e38106a80 2024-09-12T00:06:42.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.286+0000 7f3e2f7fe640 1 -- 172.21.15.60:0/2681236969 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3e3000f5f0 con 0x7f3e38106a80 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e426e7740 1 Processor -- start 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e426e7740 1 -- start start 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e85b60 0x557167e85f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 0x557167e90800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e90d40 0x557167e93130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e426e7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557167deb280 con 0x557167e85b60 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e426e7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557167d92b10 con 0x557167e86480 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e426e7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557167de7240 con 0x557167e90d40 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e3d8a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e85b60 0x557167e85f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e2f7fe640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3e240a2cf0 0x7f3e240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e3d8a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e85b60 0x557167e85f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49756/0 (socket says 172.21.15.60:49756) 2024-09-12T00:06:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.287+0000 7f3e3d8a9640 1 -- 172.21.15.60:0/105532619 learned_addr learned my addr 172.21.15.60:0/105532619 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3e8ab640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3e240a2cf0 0x7f3e240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 0x557167e90800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e90d40 0x557167e93130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3d8a9640 1 -- 172.21.15.60:0/105532619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e90d40 msgr2=0x557167e93130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e2f7fe640 1 -- 172.21.15.60:0/2681236969 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f3e300cf950 con 0x7f3e38106a80 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e90d40 0x557167e93130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3d8a9640 1 -- 172.21.15.60:0/105532619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 msgr2=0x557167e90800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 0x557167e90800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3d8a9640 1 -- 172.21.15.60:0/105532619 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557167d9f1f0 con 0x557167e85b60 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e85b60 0x557167e85f40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e28005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cbd30185e61f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e3e8ab640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3e240a2cf0 0x7f3e240a51b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e30008fd0 tx=0x7f3e30066e50 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e2cdea640 1 -- 172.21.15.60:0/105532619 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28035040 con 0x557167e85b60 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e2cdea640 1 -- 172.21.15.60:0/105532619 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3e28005020 con 0x557167e85b60 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.288+0000 7f3e2cdea640 1 -- 172.21.15.60:0/105532619 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28004bd0 con 0x557167e85b60 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 -- 172.21.15.60:0/105532619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e85b60 msgr2=0x557167e85f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e85b60 0x557167e85f40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e28005fd0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 -- 172.21.15.60:0/105532619 shutdown_connections 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e90d40 0x557167e93130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 0x557167e90800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 --2- 172.21.15.60:0/105532619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e85b60 0x557167e85f40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 -- 172.21.15.60:0/105532619 >> 172.21.15.60:0/105532619 conn(0x557167e820f0 msgr2=0x557167e824d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 -- 172.21.15.60:0/105532619 shutdown_connections 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 -- 172.21.15.60:0/105532619 wait complete. 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.289+0000 7f3e426e7740 1 -- start start 2024-09-12T00:06:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e426e7740 1 Processor -- start 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e8dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e426e7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557167e93910 con 0x557167e86480 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e426e7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557167da5f10 con 0x557167e90d40 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e426e7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557167e93a90 con 0x557167e85b60 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e426e7740 10 client.0 _ll_register_callbacks cb 0x557167d6ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49770/0 (socket says 172.21.15.60:49770) 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 -- 172.21.15.60:0/151118518 learned_addr learned my addr 172.21.15.60:0/151118518 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e8dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 -- 172.21.15.60:0/151118518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 msgr2=0x557167e8dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e8dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 -- 172.21.15.60:0/151118518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 msgr2=0x557167e8e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 -- 172.21.15.60:0/151118518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557167b5c6a0 con 0x557167e86480 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8e0e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f3e340107c0 tx=0x7f3e34010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a214c30f7a2449 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.290+0000 7f3e21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e21ffb640 1 -- 172.21.15.60:0/151118518 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400ed40 con 0x557167e86480 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 1 -- 172.21.15.60:0/151118518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e28005020 con 0x557167e86480 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e21ffb640 1 -- 172.21.15.60:0/151118518 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f3e34005020 con 0x557167e86480 2024-09-12T00:06:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e21ffb640 1 -- 172.21.15.60:0/151118518 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3e34005220 con 0x557167e86480 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 10 client.17166 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 1 -- 172.21.15.60:0/151118518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x557167e9f530 con 0x557167e86480 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e21ffb640 1 -- 172.21.15.60:0/151118518 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3e28005020 con 0x557167e86480 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e21ffb640 1 -- 172.21.15.60:0/151118518 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f3e340114d0 con 0x557167e86480 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 10 client.17166 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 20 client.17166 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557167ea0a40 0x557167ea2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 4 client.17166 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.291+0000 7f3e426e7740 1 -- 172.21.15.60:0/151118518 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557167df87f0 con 0x557167ea0a40 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.292+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557167ea0a40 0x557167ea2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.292+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557167ea0a40 0x557167ea2e80 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffa8fc82e013df3f server_cookie=6672a9bf4a037f8a in_seq=0 out_seq=0 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.292+0000 7f3e21ffb640 10 client.17166 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e21ffb640 1 -- 172.21.15.60:0/151118518 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557167df87f0 con 0x557167ea0a40 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e21ffb640 10 client.17166 handle_command_reply: tid=0 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 client.17166 shutdown 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 -- 172.21.15.60:0/151118518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 msgr2=0x557167e8e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8e0e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f3e340107c0 tx=0x7f3e34010c80 comp rx=0 tx=0).stop 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 -- 172.21.15.60:0/151118518 shutdown_connections 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557167ea0a40 0x557167ea2e80 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8e0e0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e21ffb640 0 client.17166 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 --2- 172.21.15.60:0/151118518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e8dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 -- 172.21.15.60:0/151118518 >> 172.21.15.60:0/151118518 conn(0x557167e820f0 msgr2=0x557167e87e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 -- 172.21.15.60:0/151118518 shutdown_connections 2024-09-12T00:06:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 1 -- 172.21.15.60:0/151118518 wait complete. 2024-09-12T00:06:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.293+0000 7f3e426e7740 20 client.17166 trim_cache size 0 max 16384 2024-09-12T00:06:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e426e7740 1 Processor -- start 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e426e7740 1 -- start start 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e885c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 0x557167ea8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e90d40 0x557167ea8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e426e7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3e381af980 con 0x557167e90d40 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e426e7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e381b14c0 con 0x557167e86480 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e426e7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e381b0050 con 0x557167e85b60 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e3d8a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e90d40 0x557167ea8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e3d8a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e90d40 0x557167ea8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49784/0 (socket says 172.21.15.60:49784) 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.311+0000 7f3e3d8a9640 1 -- 172.21.15.60:0/343764346 learned_addr learned my addr 172.21.15.60:0/343764346 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 0x557167ea8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e885c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e3d8a9640 1 -- 172.21.15.60:0/343764346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 msgr2=0x557167e885c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e885c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e3d8a9640 1 -- 172.21.15.60:0/343764346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 msgr2=0x557167ea8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 0x557167ea8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e3d8a9640 1 -- 172.21.15.60:0/343764346 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557167ea3500 con 0x557167e90d40 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e90d40 0x557167ea8c90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e28040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8934dde0b6d45cad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e23fff640 1 -- 172.21.15.60:0/343764346 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28059070 con 0x557167e90d40 2024-09-12T00:06:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e23fff640 1 -- 172.21.15.60:0/343764346 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3e28003cf0 con 0x557167e90d40 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.312+0000 7f3e23fff640 1 -- 172.21.15.60:0/343764346 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28035040 con 0x557167e90d40 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 -- 172.21.15.60:0/343764346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e90d40 msgr2=0x557167ea8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e90d40 0x557167ea8c90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3e28000c00 tx=0x7f3e28040040 comp rx=0 tx=0).stop 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 -- 172.21.15.60:0/343764346 shutdown_connections 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e90d40 0x557167ea8c90 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e86480 0x557167ea8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 --2- 172.21.15.60:0/343764346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e885c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 -- 172.21.15.60:0/343764346 >> 172.21.15.60:0/343764346 conn(0x557167e820f0 msgr2=0x557167e8fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 -- 172.21.15.60:0/343764346 shutdown_connections 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 -- 172.21.15.60:0/343764346 wait complete. 2024-09-12T00:06:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 -- start start 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.313+0000 7f3e426e7740 1 Processor -- start 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e8ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e426e7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e426e7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3e381b0df0 con 0x557167e86480 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e426e7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e381b0720 con 0x557167e90d40 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e426e7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e381ad980 con 0x557167e85b60 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e426e7740 10 client.0 _ll_register_callbacks cb 0x7f3e3400c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49800/0 (socket says 172.21.15.60:49800) 2024-09-12T00:06:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 -- 172.21.15.60:0/1852079363 learned_addr learned my addr 172.21.15.60:0/1852079363 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e8ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 -- 172.21.15.60:0/1852079363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 msgr2=0x557167e8ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e8ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 -- 172.21.15.60:0/1852079363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 msgr2=0x557167e8b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 -- 172.21.15.60:0/1852079363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557167f0a8a0 con 0x557167e86480 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e3e0aa640 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8b2a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3e34011ab0 tx=0x7f3e340116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f425f34a7e7b3f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.314+0000 7f3e21ffb640 1 -- 172.21.15.60:0/1852079363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34033060 con 0x557167e86480 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e21ffb640 1 -- 172.21.15.60:0/1852079363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f3e3400ed40 con 0x557167e86480 2024-09-12T00:06:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 1 -- 172.21.15.60:0/1852079363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e28003cf0 con 0x557167e86480 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e21ffb640 1 -- 172.21.15.60:0/1852079363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3e34028070 con 0x557167e86480 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 10 client.17172 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 1 -- 172.21.15.60:0/1852079363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x557167f0bbe0 con 0x557167e86480 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e21ffb640 1 -- 172.21.15.60:0/1852079363 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3e28003cf0 con 0x557167e86480 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e21ffb640 1 -- 172.21.15.60:0/1852079363 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f3e34003900 con 0x557167e86480 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 10 client.17172 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 20 client.17172 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557167f0c360 0x557167f0e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 4 client.17172 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e426e7740 1 -- 172.21.15.60:0/1852079363 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557167df2d00 con 0x557167f0c360 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.315+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557167f0c360 0x557167f0e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.316+0000 7f3e3d8a9640 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557167f0c360 0x557167f0e780 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9340a9b4a78ace5 server_cookie=e981e30076b8a14d in_seq=0 out_seq=0 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.316+0000 7f3e21ffb640 10 client.17172 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e21ffb640 1 -- 172.21.15.60:0/1852079363 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557167df2d00 con 0x557167f0c360 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e21ffb640 10 client.17172 handle_command_reply: tid=0 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 client.17172 shutdown 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 -- 172.21.15.60:0/1852079363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 msgr2=0x557167e8b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8b2a0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3e34011ab0 tx=0x7f3e340116f0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 -- 172.21.15.60:0/1852079363 shutdown_connections 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x557167f0c360 0x557167f0e780 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e21ffb640 0 client.17172 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557167e90d40 0x557167e8b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557167e86480 0x557167e8b2a0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 --2- 172.21.15.60:0/1852079363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557167e85b60 0x557167e8ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 -- 172.21.15.60:0/1852079363 >> 172.21.15.60:0/1852079363 conn(0x557167e820f0 msgr2=0x557167e8c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 -- 172.21.15.60:0/1852079363 shutdown_connections 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 1 -- 172.21.15.60:0/1852079363 wait complete. 2024-09-12T00:06:42.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.317+0000 7f3e426e7740 20 client.17172 trim_cache size 0 max 16384 2024-09-12T00:06:42.328 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:06:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:06:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "545e9edd-1917-4996-89f0-d9106d1c85b6", 2024-09-12T00:06:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:06:42.328 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:06:42.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 -- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3e240a2cf0 msgr2=0x7f3e240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3e240a2cf0 0x7f3e240a51b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e30008fd0 tx=0x7f3e30066e50 comp rx=0 tx=0).stop 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 -- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38106a80 msgr2=0x7f3e3810ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38106a80 0x7f3e3810ee60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000cce0 tx=0x7f3e3000a620 comp rx=0 tx=0).stop 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 -- 172.21.15.60:0/2681236969 shutdown_connections 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3e240a2cf0 0x7f3e240a51b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e38106a80 0x7f3e3810ee60 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e38101420 0x7f3e3810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 --2- 172.21.15.60:0/2681236969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e38100a80 0x7f3e3810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 -- 172.21.15.60:0/2681236969 >> 172.21.15.60:0/2681236969 conn(0x7f3e380fc7a0 msgr2=0x7f3e380fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 -- 172.21.15.60:0/2681236969 shutdown_connections 2024-09-12T00:06:42.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:42.318+0000 7f3e4030e640 1 -- 172.21.15.60:0/2681236969 wait complete. 2024-09-12T00:06:43.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:06:43.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:42 smithi192 ceph-mon[35487]: pgmap v225: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:43.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:42 smithi060 ceph-mon[30953]: pgmap v225: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:43.379 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:06:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:42 smithi105 ceph-mon[34805]: pgmap v225: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 -- 172.21.15.60:0/3228829428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414102dd0 msgr2=0x7f54141031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 --2- 172.21.15.60:0/3228829428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414102dd0 0x7f54141031b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f5404009930 tx=0x7f540402a420 comp rx=0 tx=0).stop 2024-09-12T00:06:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 -- 172.21.15.60:0/3228829428 shutdown_connections 2024-09-12T00:06:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 --2- 172.21.15.60:0/3228829428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5414108300 0x7f541410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 --2- 172.21.15.60:0/3228829428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5414103780 0x7f5414107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 --2- 172.21.15.60:0/3228829428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414102dd0 0x7f54141031b0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 -- 172.21.15.60:0/3228829428 >> 172.21.15.60:0/3228829428 conn(0x7f54140fc7d0 msgr2=0x7f54140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 -- 172.21.15.60:0/3228829428 shutdown_connections 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 -- 172.21.15.60:0/3228829428 wait complete. 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 Processor -- start 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.843+0000 7f5419c19640 1 -- start start 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5419c19640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5414102dd0 0x7f5414198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5419c19640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5414103780 0x7f5414198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5419c19640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414108300 0x7f541419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5419c19640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54141121f0 con 0x7f5414108300 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5419c19640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5414112070 con 0x7f5414103780 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5419c19640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5414112370 con 0x7f5414102dd0 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414108300 0x7f541419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414108300 0x7f541419cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49810/0 (socket says 172.21.15.60:49810) 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 -- 172.21.15.60:0/1787507052 learned_addr learned my addr 172.21.15.60:0/1787507052 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f540affd640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5414103780 0x7f5414198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f54137fe640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5414102dd0 0x7f5414198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 -- 172.21.15.60:0/1787507052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5414102dd0 msgr2=0x7f5414198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5414102dd0 0x7f5414198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 -- 172.21.15.60:0/1787507052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5414103780 msgr2=0x7f5414198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5414103780 0x7f5414198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 -- 172.21.15.60:0/1787507052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541419d600 con 0x7f5414108300 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f540affd640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5414103780 0x7f5414198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.844+0000 7f5413fff640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414108300 0x7f541419cf20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f540c00eaa0 tx=0x7f540c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:43.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.845+0000 7f54117fa640 1 -- 172.21.15.60:0/1787507052 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c00cdb0 con 0x7f5414108300 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.845+0000 7f54117fa640 1 -- 172.21.15.60:0/1787507052 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f540c004b20 con 0x7f5414108300 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.845+0000 7f5419c19640 1 -- 172.21.15.60:0/1787507052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541419d8f0 con 0x7f5414108300 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.845+0000 7f54117fa640 1 -- 172.21.15.60:0/1787507052 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c011760 con 0x7f5414108300 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.845+0000 7f5419c19640 1 -- 172.21.15.60:0/1787507052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54141a51d0 con 0x7f5414108300 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f54117fa640 1 -- 172.21.15.60:0/1787507052 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f540c004cd0 con 0x7f5414108300 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f541bff2740 1 Processor -- start 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f541bff2740 1 -- start start 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f541bff2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 0x561dc7cfb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f541bff2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d06140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f541bff2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7d06680 0x561dc7d08a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f541bff2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561dc7c612e0 con 0x561dc7cfbdc0 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f541bff2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561dc7c08ce0 con 0x561dc7d06680 2024-09-12T00:06:43.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f541bff2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561dc7c5d2a0 con 0x561dc7cfb4a0 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f54137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d06140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f54137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d06140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49826/0 (socket says 172.21.15.60:49826) 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f54137fe640 1 -- 172.21.15.60:0/4056402639 learned_addr learned my addr 172.21.15.60:0/4056402639 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f540affd640 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 0x561dc7cfb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.848+0000 7f540affd640 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7d06680 0x561dc7d08a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f54137fe640 1 -- 172.21.15.60:0/4056402639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 msgr2=0x561dc7cfb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f54137fe640 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 0x561dc7cfb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f54137fe640 1 -- 172.21.15.60:0/4056402639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7d06680 msgr2=0x561dc7d08a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f54137fe640 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7d06680 0x561dc7d08a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f54137fe640 1 -- 172.21.15.60:0/4056402639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dc7bed440 con 0x561dc7cfbdc0 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f54117fa640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f54137fe640 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d06140 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5404009930 tx=0x7f5404032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c1b302149b90bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f540affd640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f54117fa640 1 -- 172.21.15.60:0/1787507052 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f540c0cf6e0 con 0x7f5414108300 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f5409ffb640 1 -- 172.21.15.60:0/4056402639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540403f070 con 0x561dc7cfbdc0 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f5409ffb640 1 -- 172.21.15.60:0/4056402639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5404032e20 con 0x561dc7cfbdc0 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.849+0000 7f5409ffb640 1 -- 172.21.15.60:0/4056402639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404035070 con 0x561dc7cfbdc0 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 -- 172.21.15.60:0/4056402639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 msgr2=0x561dc7d06140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f540affd640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x561dc7cf8db0 tx=0x7f53fc005d20 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d06140 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5404009930 tx=0x7f5404032d30 comp rx=0 tx=0).stop 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 -- 172.21.15.60:0/4056402639 shutdown_connections 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7d06680 0x561dc7d08a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d06140 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 --2- 172.21.15.60:0/4056402639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 0x561dc7cfb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 -- 172.21.15.60:0/4056402639 >> 172.21.15.60:0/4056402639 conn(0x561dc7cf7a30 msgr2=0x561dc7cf7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 -- 172.21.15.60:0/4056402639 shutdown_connections 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 -- 172.21.15.60:0/4056402639 wait complete. 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.850+0000 7f541bff2740 1 -- start start 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f541bff2740 1 Processor -- start 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f541bff2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d05f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f541bff2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d03220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f541bff2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7d06680 0x561dc7d03760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f541bff2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x561dc7d09250 con 0x561dc7cfbdc0 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f541bff2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561dc7c1c050 con 0x561dc7cfb4a0 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f541bff2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561dc7d093d0 con 0x561dc7d06680 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f541bff2740 10 client.0 _ll_register_callbacks cb 0x561dc7c5c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f540affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d03220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f540affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d03220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49840/0 (socket says 172.21.15.60:49840) 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f540affd640 1 -- 172.21.15.60:0/2039111918 learned_addr learned my addr 172.21.15.60:0/2039111918 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f5413fff640 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7d06680 0x561dc7d03760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f54137fe640 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d05f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f540affd640 1 -- 172.21.15.60:0/2039111918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7d06680 msgr2=0x561dc7d03760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f540affd640 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7d06680 0x561dc7d03760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f540affd640 1 -- 172.21.15.60:0/2039111918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 msgr2=0x561dc7d05f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f540affd640 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d05f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.851+0000 7f540affd640 1 -- 172.21.15.60:0/2039111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dc79d23c0 con 0x561dc7cfbdc0 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f540affd640 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d03220 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f54140697d0 tx=0x7f53fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e93cd93d8f365f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f53f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f53f2ffd640 1 -- 172.21.15.60:0/2039111918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc004220 con 0x561dc7cfbdc0 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f53f2ffd640 1 -- 172.21.15.60:0/2039111918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f53fc0043c0 con 0x561dc7cfbdc0 2024-09-12T00:06:43.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f541bff2740 1 -- 172.21.15.60:0/2039111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5404032e20 con 0x561dc7cfbdc0 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f53f2ffd640 1 -- 172.21.15.60:0/2039111918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f53fc0035f0 con 0x561dc7cfbdc0 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f541bff2740 10 client.17184 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f541bff2740 1 -- 172.21.15.60:0/2039111918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x561dc7d14c20 con 0x561dc7cfbdc0 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f53f2ffd640 1 -- 172.21.15.60:0/2039111918 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5404032e20 con 0x561dc7cfbdc0 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f53f2ffd640 1 -- 172.21.15.60:0/2039111918 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f53fc030020 con 0x561dc7cfbdc0 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f541bff2740 10 client.17184 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f541bff2740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f541bff2740 20 client.17184 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.852+0000 7f541bff2740 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561dc7d16080 0x561dc7d184e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.853+0000 7f541bff2740 4 client.17184 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.853+0000 7f541bff2740 1 -- 172.21.15.60:0/2039111918 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dc7c6e850 con 0x561dc7d16080 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.853+0000 7f54137fe640 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561dc7d16080 0x561dc7d184e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.853+0000 7f54137fe640 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561dc7d16080 0x561dc7d184e0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=860559b57a7623fb server_cookie=2d5bf55fab257dee in_seq=0 out_seq=0 2024-09-12T00:06:43.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.853+0000 7f53f2ffd640 10 client.17184 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f53f2ffd640 1 -- 172.21.15.60:0/2039111918 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561dc7c6e850 con 0x561dc7d16080 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f53f2ffd640 10 client.17184 handle_command_reply: tid=0 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 client.17184 shutdown 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 -- 172.21.15.60:0/2039111918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 msgr2=0x561dc7d03220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d03220 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f54140697d0 tx=0x7f53fc0046c0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 -- 172.21.15.60:0/2039111918 shutdown_connections 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561dc7d16080 0x561dc7d184e0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7d06680 0x561dc7d03760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d03220 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 --2- 172.21.15.60:0/2039111918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d05f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 -- 172.21.15.60:0/2039111918 >> 172.21.15.60:0/2039111918 conn(0x561dc7cf7a30 msgr2=0x561dc7cfd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f53f2ffd640 0 client.17184 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 -- 172.21.15.60:0/2039111918 shutdown_connections 2024-09-12T00:06:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 1 -- 172.21.15.60:0/2039111918 wait complete. 2024-09-12T00:06:43.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.854+0000 7f541bff2740 20 client.17184 trim_cache size 0 max 16384 2024-09-12T00:06:43.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.871+0000 7f541bff2740 1 Processor -- start 2024-09-12T00:06:43.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f541bff2740 1 -- start start 2024-09-12T00:06:43.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f541bff2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cf7a30 0x561dc7d124b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f541bff2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d01af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f541bff2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d05190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f541bff2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54141ad9b0 con 0x561dc7cfbdc0 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f541bff2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54141af4f0 con 0x561dc7cfb4a0 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f541bff2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54141ae080 con 0x561dc7cf7a30 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d05190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d05190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49856/0 (socket says 172.21.15.60:49856) 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 -- 172.21.15.60:0/1079937146 learned_addr learned my addr 172.21.15.60:0/1079937146 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f54137fe640 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cf7a30 0x561dc7d124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f540affd640 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d01af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 -- 172.21.15.60:0/1079937146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cf7a30 msgr2=0x561dc7d124b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:43.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cf7a30 0x561dc7d124b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 -- 172.21.15.60:0/1079937146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 msgr2=0x561dc7d01af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:43.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d01af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 -- 172.21.15.60:0/1079937146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dc7d021d0 con 0x561dc7cfbdc0 2024-09-12T00:06:43.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f540affd640 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d01af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:06:43.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.872+0000 7f5413fff640 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d05190 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f540c0cceb0 tx=0x7f540c09c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12312be0ebab265a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:43.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f54097fa640 1 -- 172.21.15.60:0/1079937146 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c01f030 con 0x561dc7cfbdc0 2024-09-12T00:06:43.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f54097fa640 1 -- 172.21.15.60:0/1079937146 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f540c0a4890 con 0x561dc7cfbdc0 2024-09-12T00:06:43.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f54097fa640 1 -- 172.21.15.60:0/1079937146 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c09aae0 con 0x561dc7cfbdc0 2024-09-12T00:06:43.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 -- 172.21.15.60:0/1079937146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 msgr2=0x561dc7d05190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d05190 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f540c0cceb0 tx=0x7f540c09c320 comp rx=0 tx=0).stop 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 -- 172.21.15.60:0/1079937146 shutdown_connections 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d05190 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cfb4a0 0x561dc7d01af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 --2- 172.21.15.60:0/1079937146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cf7a30 0x561dc7d124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 -- 172.21.15.60:0/1079937146 >> 172.21.15.60:0/1079937146 conn(0x561dc7d038c0 msgr2=0x561dc7d04a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 -- 172.21.15.60:0/1079937146 shutdown_connections 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.873+0000 7f541bff2740 1 -- 172.21.15.60:0/1079937146 wait complete. 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 1 -- start start 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 1 Processor -- start 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cf7a30 0x561dc7d784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 0x561dc7d78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d7cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54141aee20 con 0x561dc7cfbdc0 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54141ae750 con 0x561dc7cf7a30 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54141ab9b0 con 0x561dc7cfb4a0 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f541bff2740 10 client.0 _ll_register_callbacks cb 0x7f53fc00be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f5413fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d7cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f5413fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d7cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49858/0 (socket says 172.21.15.60:49858) 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f5413fff640 1 -- 172.21.15.60:0/265926755 learned_addr learned my addr 172.21.15.60:0/265926755 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f540affd640 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 0x561dc7d78a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.874+0000 7f54137fe640 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cf7a30 0x561dc7d784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f5413fff640 1 -- 172.21.15.60:0/265926755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 msgr2=0x561dc7d78a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f5413fff640 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 0x561dc7d78a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f5413fff640 1 -- 172.21.15.60:0/265926755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cf7a30 msgr2=0x561dc7d784d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f5413fff640 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cf7a30 0x561dc7d784d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f5413fff640 1 -- 172.21.15.60:0/265926755 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dc7d7d180 con 0x561dc7cfbdc0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f54137fe640 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cf7a30 0x561dc7d784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f5413fff640 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d7cae0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f540c0cd450 tx=0x7f540c005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15658e1c2713bfb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f53f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f53f2ffd640 1 -- 172.21.15.60:0/265926755 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c063030 con 0x561dc7cfbdc0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f53f2ffd640 1 -- 172.21.15.60:0/265926755 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8484+0+0 (secure 0 0 0) 0x7f540c09b1e0 con 0x561dc7cfbdc0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f541bff2740 1 -- 172.21.15.60:0/265926755 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f540c0a4890 con 0x561dc7cfbdc0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f53f2ffd640 1 -- 172.21.15.60:0/265926755 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f540c01f070 con 0x561dc7cfbdc0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f541bff2740 10 client.17190 fetch_fsmap learned FSMap version 52 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f541bff2740 1 -- 172.21.15.60:0/265926755 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x561dc7d85690 con 0x561dc7cfbdc0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.875+0000 7f53f2ffd640 1 -- 172.21.15.60:0/265926755 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f540c0a4890 con 0x561dc7cfbdc0 2024-09-12T00:06:43.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f53f2ffd640 1 -- 172.21.15.60:0/265926755 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f540c00f040 con 0x561dc7cfbdc0 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f541bff2740 10 client.17190 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f541bff2740 10 client.17190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f541bff2740 20 client.17190 populate_metadata read hostname 'smithi060' 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f541bff2740 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561dc7d06680 0x561dc7d87b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f541bff2740 4 client.17190 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f541bff2740 1 -- 172.21.15.60:0/265926755 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561dc7c68d60 con 0x561dc7d06680 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f54137fe640 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561dc7d06680 0x561dc7d87b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f54137fe640 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561dc7d06680 0x561dc7d87b70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b54adbc3b620bad server_cookie=f6bd8f1053049b80 in_seq=0 out_seq=0 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f53f2ffd640 10 client.17190 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f53f2ffd640 1 -- 172.21.15.60:0/265926755 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561dc7c68d60 con 0x561dc7d06680 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.876+0000 7f53f2ffd640 10 client.17190 handle_command_reply: tid=0 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 client.17190 shutdown 2024-09-12T00:06:43.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 -- 172.21.15.60:0/265926755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 msgr2=0x561dc7d7cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d7cae0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f540c0cd450 tx=0x7f540c005e10 comp rx=0 tx=0).stop 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 -- 172.21.15.60:0/265926755 shutdown_connections 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x561dc7d06680 0x561dc7d87b70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x561dc7cfbdc0 0x561dc7d7cae0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561dc7cfb4a0 0x561dc7d78a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 --2- 172.21.15.60:0/265926755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x561dc7cf7a30 0x561dc7d784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 -- 172.21.15.60:0/265926755 >> 172.21.15.60:0/265926755 conn(0x561dc7d038c0 msgr2=0x561dc7d04a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f53f2ffd640 0 client.17190 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 -- 172.21.15.60:0/265926755 shutdown_connections 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 1 -- 172.21.15.60:0/265926755 wait complete. 2024-09-12T00:06:43.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f541bff2740 20 client.17190 trim_cache size 0 max 16384 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "545e9edd-1917-4996-89f0-d9106d1c85b6": { 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "545e9edd-1917-4996-89f0-d9106d1c85b6", 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:06:43.882 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:06:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f5419c19640 1 -- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 msgr2=0x7f54000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f5419c19640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x561dc7cf8db0 tx=0x7f53fc005d20 comp rx=0 tx=0).stop 2024-09-12T00:06:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f5419c19640 1 -- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414108300 msgr2=0x7f541419cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:06:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.877+0000 7f5419c19640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414108300 0x7f541419cf20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f540c00eaa0 tx=0x7f540c00ef60 comp rx=0 tx=0).stop 2024-09-12T00:06:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.878+0000 7f5419c19640 1 -- 172.21.15.60:0/1787507052 shutdown_connections 2024-09-12T00:06:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.878+0000 7f5419c19640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.878+0000 7f5419c19640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5414108300 0x7f541419cf20 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.878+0000 7f5419c19640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5414103780 0x7f5414198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.878+0000 7f5419c19640 1 --2- 172.21.15.60:0/1787507052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5414102dd0 0x7f5414198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:06:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.878+0000 7f5419c19640 1 -- 172.21.15.60:0/1787507052 >> 172.21.15.60:0/1787507052 conn(0x7f54140fc7d0 msgr2=0x7f5414105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:06:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.878+0000 7f5419c19640 1 -- 172.21.15.60:0/1787507052 shutdown_connections 2024-09-12T00:06:43.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:06:43.878+0000 7f5419c19640 1 -- 172.21.15.60:0/1787507052 wait complete. 2024-09-12T00:06:44.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:43 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:06:44.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:43 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:06:44.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:43 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:06:44.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:43 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:06:44.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:43 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:06:44.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:43 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:06:44.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:43 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:06:44.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:43 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:06:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:43 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:06:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:43 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:06:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:43 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:06:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:43 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:06:44.702 INFO:tasks.cephfs.filesystem:scrub status for tag:545e9edd-1917-4996-89f0-d9106d1c85b6 - {'path': '/', 'tag': '545e9edd-1917-4996-89f0-d9106d1c85b6', 'options': 'recursive,force'} 2024-09-12T00:06:45.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:44 smithi192 ceph-mon[35487]: pgmap v226: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:45.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:44 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:06:45.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:44 smithi060 ceph-mon[30953]: pgmap v226: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:45.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:44 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:06:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:44 smithi105 ceph-mon[34805]: pgmap v226: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:44 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:06:47.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:46 smithi192 ceph-mon[35487]: pgmap v227: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:47.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:46 smithi060 ceph-mon[30953]: pgmap v227: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:47.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:46 smithi105 ceph-mon[34805]: pgmap v227: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:49.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:49 smithi192 ceph-mon[35487]: pgmap v228: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:49.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:49 smithi060 ceph-mon[30953]: pgmap v228: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:49 smithi105 ceph-mon[34805]: pgmap v228: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:51.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:51 smithi192 ceph-mon[35487]: pgmap v229: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:51.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:51 smithi060 ceph-mon[30953]: pgmap v229: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:51.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:51 smithi105 ceph-mon[34805]: pgmap v229: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:53.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:53 smithi192 ceph-mon[35487]: pgmap v230: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:53.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:53 smithi060 ceph-mon[30953]: pgmap v230: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:53.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:53 smithi105 ceph-mon[34805]: pgmap v230: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:06:55.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:55 smithi192 ceph-mon[35487]: pgmap v231: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:55.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:55 smithi060 ceph-mon[30953]: pgmap v231: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:55.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:55 smithi105 ceph-mon[34805]: pgmap v231: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:06:57.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:57 smithi192 ceph-mon[35487]: pgmap v232: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:57.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:57 smithi060 ceph-mon[30953]: pgmap v232: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:57.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:57 smithi105 ceph-mon[34805]: pgmap v232: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:06:59.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:06:59 smithi192 ceph-mon[35487]: pgmap v233: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:06:59.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:06:59 smithi060 ceph-mon[30953]: pgmap v233: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:06:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:06:59 smithi105 ceph-mon[34805]: pgmap v233: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:07:01.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:01 smithi192 ceph-mon[35487]: pgmap v234: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:01.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:01 smithi060 ceph-mon[30953]: pgmap v234: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:01 smithi105 ceph-mon[34805]: pgmap v234: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:03.281 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:03 smithi105 ceph-mon[34805]: pgmap v235: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:03.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:03 smithi192 ceph-mon[35487]: pgmap v235: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:03.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:03 smithi060 ceph-mon[30953]: pgmap v235: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:05.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:05 smithi192 ceph-mon[35487]: pgmap v236: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:07:05.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:05 smithi060 ceph-mon[30953]: pgmap v236: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:07:05.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:05 smithi105 ceph-mon[34805]: pgmap v236: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:07:07.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:07 smithi192 ceph-mon[35487]: pgmap v237: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:07:07.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:07 smithi060 ceph-mon[30953]: pgmap v237: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:07:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:07 smithi105 ceph-mon[34805]: pgmap v237: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:07:09.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:09 smithi060 ceph-mon[30953]: pgmap v238: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:07:09.478 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:09 smithi105 ceph-mon[34805]: pgmap v238: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:07:09.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:09 smithi192 ceph-mon[35487]: pgmap v238: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:07:10.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:10 smithi060 ceph-mon[30953]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T00:07:10.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:10 smithi105 ceph-mon[34805]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T00:07:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:10 smithi192 ceph-mon[35487]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T00:07:11.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:11 smithi060 ceph-mon[30953]: pgmap v240: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:07:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:11 smithi105 ceph-mon[34805]: pgmap v240: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:07:11.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:11 smithi192 ceph-mon[35487]: pgmap v240: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:07:13.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:13 smithi060 ceph-mon[30953]: pgmap v241: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:07:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:13 smithi105 ceph-mon[34805]: pgmap v241: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:07:13.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:13 smithi192 ceph-mon[35487]: pgmap v241: 97 pgs: 97 active+clean; 275 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:07:14.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:07:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:15.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:15 smithi060 ceph-mon[30953]: pgmap v242: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:15.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:15 smithi105 ceph-mon[34805]: pgmap v242: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:15.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:15 smithi192 ceph-mon[35487]: pgmap v242: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:15.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 -- 172.21.15.60:0/2900046037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881082a0 msgr2=0x7f248810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 --2- 172.21.15.60:0/2900046037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881082a0 0x7f248810ec40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2480009930 tx=0x7f248002a420 comp rx=0 tx=0).stop 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 -- 172.21.15.60:0/2900046037 shutdown_connections 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 --2- 172.21.15.60:0/2900046037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881082a0 0x7f248810ec40 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 --2- 172.21.15.60:0/2900046037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24881036e0 0x7f2488107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 --2- 172.21.15.60:0/2900046037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2488102d30 0x7f2488103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 -- 172.21.15.60:0/2900046037 >> 172.21.15.60:0/2900046037 conn(0x7f24880fc7d0 msgr2=0x7f24880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 -- 172.21.15.60:0/2900046037 shutdown_connections 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.790+0000 7f248fc3f640 1 -- 172.21.15.60:0/2900046037 wait complete. 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248fc3f640 1 Processor -- start 2024-09-12T00:07:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248fc3f640 1 -- start start 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248fc3f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2488102d30 0x7f2488198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248fc3f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881036e0 0x7f2488198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248fc3f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24881082a0 0x7f248819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248fc3f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f24881121c0 con 0x7f24881036e0 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248fc3f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2488112040 con 0x7f2488102d30 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248fc3f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2488112340 con 0x7f24881082a0 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248d1da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881036e0 0x7f2488198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248d1da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881036e0 0x7f2488198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49278/0 (socket says 172.21.15.60:49278) 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248d1da640 1 -- 172.21.15.60:0/3986064040 learned_addr learned my addr 172.21.15.60:0/3986064040 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.791+0000 7f248d9db640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2488102d30 0x7f2488198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248e1dc640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24881082a0 0x7f248819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248d1da640 1 -- 172.21.15.60:0/3986064040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24881082a0 msgr2=0x7f248819cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248d1da640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24881082a0 0x7f248819cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248d1da640 1 -- 172.21.15.60:0/3986064040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2488102d30 msgr2=0x7f2488198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248d1da640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2488102d30 0x7f2488198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248d1da640 1 -- 172.21.15.60:0/3986064040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248819d5c0 con 0x7f24881036e0 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248d1da640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881036e0 0x7f2488198b50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f247800c970 tx=0x7f247800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f247effd640 1 -- 172.21.15.60:0/3986064040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478007bb0 con 0x7f24881036e0 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248fc3f640 1 -- 172.21.15.60:0/3986064040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248819d8b0 con 0x7f24881036e0 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f247effd640 1 -- 172.21.15.60:0/3986064040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2478007d50 con 0x7f24881036e0 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f247effd640 1 -- 172.21.15.60:0/3986064040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247800f450 con 0x7f24881036e0 2024-09-12T00:07:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.792+0000 7f248fc3f640 1 -- 172.21.15.60:0/3986064040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24881a5190 con 0x7f24881036e0 2024-09-12T00:07:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.795+0000 7f247effd640 1 -- 172.21.15.60:0/3986064040 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2478005000 con 0x7f24881036e0 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f2492018740 1 Processor -- start 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f2492018740 1 -- start start 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f2492018740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee88b0 0x564b5bee8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f2492018740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee91d0 0x564b5bef3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f2492018740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bef3a90 0x564b5bef5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f2492018740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564b5be4a2e0 con 0x564b5bee91d0 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f2492018740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564b5bdf1ce0 con 0x564b5bee88b0 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f2492018740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564b5be462a0 con 0x564b5bef3a90 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f248d9db640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee91d0 0x564b5bef3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f247effd640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f24740a2cf0 0x7f24740a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f248d9db640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee91d0 0x564b5bef3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49280/0 (socket says 172.21.15.60:49280) 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f248d9db640 1 -- 172.21.15.60:0/3209969512 learned_addr learned my addr 172.21.15.60:0/3209969512 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f248d1da640 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bef3a90 0x564b5bef5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.796+0000 7f248e1dc640 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee88b0 0x564b5bee8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248e1dc640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f24740a2cf0 0x7f24740a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248d9db640 1 -- 172.21.15.60:0/3209969512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bef3a90 msgr2=0x564b5bef5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248d9db640 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bef3a90 0x564b5bef5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248d9db640 1 -- 172.21.15.60:0/3209969512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee88b0 msgr2=0x564b5bee8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248d9db640 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee88b0 0x564b5bee8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248d9db640 1 -- 172.21.15.60:0/3209969512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5bdd6440 con 0x564b5bee91d0 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f247effd640 1 -- 172.21.15.60:0/3986064040 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8528+0+0 (secure 0 0 0) 0x7f24780cf220 con 0x7f24881036e0 2024-09-12T00:07:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248d1da640 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bef3a90 0x564b5bef5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248d9db640 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee91d0 0x564b5bef3550 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f248400af40 tx=0x7f248400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46047b2a888bd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f248e1dc640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f24740a2cf0 0x7f24740a51b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2480005ec0 tx=0x7f2480009260 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f2473fff640 1 -- 172.21.15.60:0/3209969512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248401d070 con 0x564b5bee91d0 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f2473fff640 1 -- 172.21.15.60:0/3209969512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2484010e00 con 0x564b5bee91d0 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.797+0000 7f2473fff640 1 -- 172.21.15.60:0/3209969512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484016340 con 0x564b5bee91d0 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 -- 172.21.15.60:0/3209969512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee91d0 msgr2=0x564b5bef3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee91d0 0x564b5bef3550 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f248400af40 tx=0x7f248400f850 comp rx=0 tx=0).stop 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 -- 172.21.15.60:0/3209969512 shutdown_connections 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bef3a90 0x564b5bef5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee91d0 0x564b5bef3550 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 --2- 172.21.15.60:0/3209969512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee88b0 0x564b5bee8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 -- 172.21.15.60:0/3209969512 >> 172.21.15.60:0/3209969512 conn(0x564b5bee4e40 msgr2=0x564b5bee5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 -- 172.21.15.60:0/3209969512 shutdown_connections 2024-09-12T00:07:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.798+0000 7f2492018740 1 -- 172.21.15.60:0/3209969512 wait complete. 2024-09-12T00:07:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 1 -- start start 2024-09-12T00:07:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 1 Processor -- start 2024-09-12T00:07:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee88b0 0x564b5bef3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bef3a90 0x564b5bef0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564b5bef6660 con 0x564b5bef3a90 2024-09-12T00:07:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564b5be05050 con 0x564b5bee91d0 2024-09-12T00:07:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564b5bef67e0 con 0x564b5bee88b0 2024-09-12T00:07:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f2492018740 10 client.0 _ll_register_callbacks cb 0x564b5be45160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f248e1dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bef3a90 0x564b5bef0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f248e1dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bef3a90 0x564b5bef0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49294/0 (socket says 172.21.15.60:49294) 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f248e1dc640 1 -- 172.21.15.60:0/609304923 learned_addr learned my addr 172.21.15.60:0/609304923 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f248d9db640 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee88b0 0x564b5bef3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.799+0000 7f248d1da640 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f248e1dc640 1 -- 172.21.15.60:0/609304923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee88b0 msgr2=0x564b5bef3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f248e1dc640 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee88b0 0x564b5bef3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f248e1dc640 1 -- 172.21.15.60:0/609304923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 msgr2=0x564b5bef0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f248e1dc640 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f248e1dc640 1 -- 172.21.15.60:0/609304923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5bbbb3c0 con 0x564b5bef3a90 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f248e1dc640 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bef3a90 0x564b5bef0b60 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2480009930 tx=0x7f248002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34640c4457335257 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f24717fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f24717fa640 1 -- 172.21.15.60:0/609304923 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248004f030 con 0x564b5bef3a90 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f2492018740 1 -- 172.21.15.60:0/609304923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2484010e00 con 0x564b5bef3a90 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f24717fa640 1 -- 172.21.15.60:0/609304923 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8528+0+0 (secure 0 0 0) 0x7f2480005020 con 0x564b5bef3a90 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f24717fa640 1 -- 172.21.15.60:0/609304923 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2480059050 con 0x564b5bef3a90 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f2492018740 10 client.17202 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.800+0000 7f2492018740 1 -- 172.21.15.60:0/609304923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564b5bf02020 con 0x564b5bef3a90 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f24717fa640 1 -- 172.21.15.60:0/609304923 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2484010e00 con 0x564b5bef3a90 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f24717fa640 1 -- 172.21.15.60:0/609304923 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f248003a040 con 0x564b5bef3a90 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f2492018740 10 client.17202 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f2492018740 10 client.17202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f2492018740 20 client.17202 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f2492018740 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b5bf03430 0x564b5bf058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f2492018740 4 client.17202 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f2492018740 1 -- 172.21.15.60:0/609304923 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b5be57850 con 0x564b5bf03430 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.801+0000 7f248d9db640 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b5bf03430 0x564b5bf058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.802+0000 7f24717fa640 10 client.17202 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.802+0000 7f248d9db640 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b5bf03430 0x564b5bf058d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1d15580e54e1ef server_cookie=45fb4d295321973b in_seq=0 out_seq=0 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.802+0000 7f24717fa640 1 -- 172.21.15.60:0/609304923 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b5be57850 con 0x564b5bf03430 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.802+0000 7f24717fa640 10 client.17202 handle_command_reply: tid=0 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.802+0000 7f2492018740 1 client.17202 shutdown 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 -- 172.21.15.60:0/609304923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bef3a90 msgr2=0x564b5bef0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bef3a90 0x564b5bef0b60 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2480009930 tx=0x7f248002a420 comp rx=0 tx=0).stop 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 -- 172.21.15.60:0/609304923 shutdown_connections 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b5bf03430 0x564b5bf058d0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bef3a90 0x564b5bef0b60 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f24717fa640 0 client.17202 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 --2- 172.21.15.60:0/609304923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee88b0 0x564b5bef3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 -- 172.21.15.60:0/609304923 >> 172.21.15.60:0/609304923 conn(0x564b5bee4e40 msgr2=0x564b5beeab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 -- 172.21.15.60:0/609304923 shutdown_connections 2024-09-12T00:07:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 1 -- 172.21.15.60:0/609304923 wait complete. 2024-09-12T00:07:15.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.803+0000 7f2492018740 20 client.17202 trim_cache size 0 max 16384 2024-09-12T00:07:15.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.820+0000 7f2492018740 1 Processor -- start 2024-09-12T00:07:15.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.820+0000 7f2492018740 1 -- start start 2024-09-12T00:07:15.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.820+0000 7f2492018740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5beff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.820+0000 7f2492018740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5bf0b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.820+0000 7f2492018740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bf0b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.820+0000 7f2492018740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f24881ab860 con 0x564b5bee88b0 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.820+0000 7f2492018740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24881ad3a0 con 0x564b5bee91d0 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.820+0000 7f2492018740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24881abf30 con 0x564b5bee4e40 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5bf0b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5bf0b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49300/0 (socket says 172.21.15.60:49300) 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 -- 172.21.15.60:0/3989996735 learned_addr learned my addr 172.21.15.60:0/3989996735 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d9db640 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5beff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248e1dc640 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bf0b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 -- 172.21.15.60:0/3989996735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 msgr2=0x564b5beff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5beff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 -- 172.21.15.60:0/3989996735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 msgr2=0x564b5bf0b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bf0b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 -- 172.21.15.60:0/3989996735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5bee4c70 con 0x564b5bee88b0 2024-09-12T00:07:15.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d9db640 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5beff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:15.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248e1dc640 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bf0b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:15.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f248d1da640 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5bf0b1f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f24780980d0 tx=0x7f247806e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4f2f75c02d8729 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:15.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.821+0000 7f24737fe640 1 -- 172.21.15.60:0/3989996735 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247801d040 con 0x564b5bee88b0 2024-09-12T00:07:15.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f24737fe640 1 -- 172.21.15.60:0/3989996735 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f247809be00 con 0x564b5bee88b0 2024-09-12T00:07:15.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f24737fe640 1 -- 172.21.15.60:0/3989996735 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24780ccbb0 con 0x564b5bee88b0 2024-09-12T00:07:15.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f2492018740 1 -- 172.21.15.60:0/3989996735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 msgr2=0x564b5bf0b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f2492018740 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5bf0b1f0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f24780980d0 tx=0x7f247806e770 comp rx=0 tx=0).stop 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f2492018740 1 -- 172.21.15.60:0/3989996735 shutdown_connections 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f2492018740 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bf0b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f2492018740 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5bf0b1f0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f2492018740 1 --2- 172.21.15.60:0/3989996735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5beff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f2492018740 1 -- 172.21.15.60:0/3989996735 >> 172.21.15.60:0/3989996735 conn(0x564b5bef0cc0 msgr2=0x564b5beeef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.822+0000 7f2492018740 1 -- 172.21.15.60:0/3989996735 shutdown_connections 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 -- 172.21.15.60:0/3989996735 wait complete. 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 -- start start 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 Processor -- start 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5befba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5befbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f24881accd0 con 0x564b5bee88b0 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24881ac600 con 0x564b5bee91d0 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24881a9840 con 0x564b5bee4e40 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.823+0000 7f2492018740 10 client.0 _ll_register_callbacks cb 0x7f2480031760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5befbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5befbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49304/0 (socket says 172.21.15.60:49304) 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 -- 172.21.15.60:0/2566558782 learned_addr learned my addr 172.21.15.60:0/2566558782 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248e1dc640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d9db640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5befba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 -- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 msgr2=0x564b5befba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5befba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 -- 172.21.15.60:0/2566558782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 msgr2=0x564b5bef8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 -- 172.21.15.60:0/2566558782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5bef8fc0 con 0x564b5bee88b0 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d9db640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5befba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248e1dc640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f248d1da640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5befbf70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f2478005940 tx=0x7f2478004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f5aaec1b7bdaff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f24717fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f24717fa640 1 -- 172.21.15.60:0/2566558782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24780b9060 con 0x564b5bee88b0 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f24717fa640 1 -- 172.21.15.60:0/2566558782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8528+0+0 (secure 0 0 0) 0x7f24780ccbb0 con 0x564b5bee88b0 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.824+0000 7f2492018740 1 -- 172.21.15.60:0/2566558782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f247809be00 con 0x564b5bee88b0 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f24717fa640 1 -- 172.21.15.60:0/2566558782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f247801d040 con 0x564b5bee88b0 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f2492018740 10 client.17208 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f2492018740 1 -- 172.21.15.60:0/2566558782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564b5bf6eaa0 con 0x564b5bee88b0 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f24717fa640 1 -- 172.21.15.60:0/2566558782 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f247809fab0 con 0x564b5bee88b0 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f24717fa640 1 -- 172.21.15.60:0/2566558782 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f247809a5c0 con 0x564b5bee88b0 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f2492018740 10 client.17208 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f2492018740 10 client.17208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f2492018740 20 client.17208 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f2492018740 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b5bef3a90 0x564b5bf71240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f2492018740 4 client.17208 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f2492018740 1 -- 172.21.15.60:0/2566558782 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f247809be00 con 0x564b5bef3a90 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.825+0000 7f248d9db640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b5bef3a90 0x564b5bf71240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f24717fa640 10 client.17208 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f248d9db640 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b5bef3a90 0x564b5bf71240 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff7022df38464b42 server_cookie=287b331b3ec443a0 in_seq=0 out_seq=0 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f24717fa640 1 -- 172.21.15.60:0/2566558782 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f247809be00 con 0x564b5bef3a90 2024-09-12T00:07:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f24717fa640 10 client.17208 handle_command_reply: tid=0 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 client.17208 shutdown 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 -- 172.21.15.60:0/2566558782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 msgr2=0x564b5befbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5befbf70 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f2478005940 tx=0x7f2478004780 comp rx=0 tx=0).stop 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 -- 172.21.15.60:0/2566558782 shutdown_connections 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x564b5bef3a90 0x564b5bf71240 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564b5bee91d0 0x564b5bef8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b5bee88b0 0x564b5befbf70 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f24717fa640 0 client.17208 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 --2- 172.21.15.60:0/2566558782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b5bee4e40 0x564b5befba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 -- 172.21.15.60:0/2566558782 >> 172.21.15.60:0/2566558782 conn(0x564b5bef0cc0 msgr2=0x564b5bef26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 -- 172.21.15.60:0/2566558782 shutdown_connections 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 1 -- 172.21.15.60:0/2566558782 wait complete. 2024-09-12T00:07:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.826+0000 7f2492018740 20 client.17208 trim_cache size 0 max 16384 2024-09-12T00:07:15.832 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:07:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:07:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:07:15.832 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 -- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f24740a2cf0 msgr2=0x7f24740a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f24740a2cf0 0x7f24740a51b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2480005ec0 tx=0x7f2480009260 comp rx=0 tx=0).stop 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 -- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881036e0 msgr2=0x7f2488198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881036e0 0x7f2488198b50 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f247800c970 tx=0x7f247800ce30 comp rx=0 tx=0).stop 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 -- 172.21.15.60:0/3986064040 shutdown_connections 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f24740a2cf0 0x7f24740a51b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24881082a0 0x7f248819cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24881036e0 0x7f2488198b50 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 --2- 172.21.15.60:0/3986064040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2488102d30 0x7f2488198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 -- 172.21.15.60:0/3986064040 >> 172.21.15.60:0/3986064040 conn(0x7f24880fc7d0 msgr2=0x7f2488105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 -- 172.21.15.60:0/3986064040 shutdown_connections 2024-09-12T00:07:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:15.827+0000 7f248fc3f640 1 -- 172.21.15.60:0/3986064040 wait complete. 2024-09-12T00:07:16.656 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:07:16.657 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:07:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:17.332 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:17 smithi060 ceph-mon[30953]: pgmap v243: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 -- 172.21.15.60:0/2840112629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4106f00 msgr2=0x7fa9d410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 --2- 172.21.15.60:0/2840112629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4106f00 0x7fa9d410ea80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009ca0 tx=0x7fa9cc02a8c0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 -- 172.21.15.60:0/2840112629 shutdown_connections 2024-09-12T00:07:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 --2- 172.21.15.60:0/2840112629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4106f00 0x7fa9d410ea80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 --2- 172.21.15.60:0/2840112629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9d4102780 0x7fa9d41067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 --2- 172.21.15.60:0/2840112629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d4101dd0 0x7fa9d41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 -- 172.21.15.60:0/2840112629 >> 172.21.15.60:0/2840112629 conn(0x7fa9d40fd8b0 msgr2=0x7fa9d40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:17.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 -- 172.21.15.60:0/2840112629 shutdown_connections 2024-09-12T00:07:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.416+0000 7fa9da651640 1 -- 172.21.15.60:0/2840112629 wait complete. 2024-09-12T00:07:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9da651640 1 Processor -- start 2024-09-12T00:07:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9da651640 1 -- start start 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9da651640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4101dd0 0x7fa9d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9da651640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d4102780 0x7fa9d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9da651640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9d4106f00 0x7fa9d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9da651640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d4112080 con 0x7fa9d4101dd0 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9da651640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d4111f00 con 0x7fa9d4106f00 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9da651640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d4112200 con 0x7fa9d4102780 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9d3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4101dd0 0x7fa9d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9d3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4101dd0 0x7fa9d40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49326/0 (socket says 172.21.15.60:49326) 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9d3fff640 1 -- 172.21.15.60:0/1801549604 learned_addr learned my addr 172.21.15.60:0/1801549604 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9cbfff640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d4102780 0x7fa9d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.417+0000 7fa9d8bee640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9d4106f00 0x7fa9d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d3fff640 1 -- 172.21.15.60:0/1801549604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d4102780 msgr2=0x7fa9d4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d3fff640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d4102780 0x7fa9d4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d3fff640 1 -- 172.21.15.60:0/1801549604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9d4106f00 msgr2=0x7fa9d4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d3fff640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9d4106f00 0x7fa9d4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d3fff640 1 -- 172.21.15.60:0/1801549604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d41a68f0 con 0x7fa9d4101dd0 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d3fff640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4101dd0 0x7fa9d40744f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400c920 tx=0x7fa9c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d1ffb640 1 -- 172.21.15.60:0/1801549604 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4007c70 con 0x7fa9d4101dd0 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d1ffb640 1 -- 172.21.15.60:0/1801549604 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa9c4007e10 con 0x7fa9d4101dd0 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d41a6be0 con 0x7fa9d4101dd0 2024-09-12T00:07:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9d1ffb640 1 -- 172.21.15.60:0/1801549604 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4018940 con 0x7fa9d4101dd0 2024-09-12T00:07:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.418+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d41a7170 con 0x7fa9d4101dd0 2024-09-12T00:07:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.419+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d41021b0 con 0x7fa9d4101dd0 2024-09-12T00:07:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.421+0000 7fa9d1ffb640 1 -- 172.21.15.60:0/1801549604 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa9c4018b00 con 0x7fa9d4101dd0 2024-09-12T00:07:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.421+0000 7fa9d1ffb640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa9c00a2d70 0x7fa9c00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.421+0000 7fa9cbfff640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa9c00a2d70 0x7fa9c00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.421+0000 7fa9d1ffb640 1 -- 172.21.15.60:0/1801549604 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8528+0+0 (secure 0 0 0) 0x7fa9c40cf700 con 0x7fa9d4101dd0 2024-09-12T00:07:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.422+0000 7fa9cbfff640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa9c00a2d70 0x7fa9c00a5230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4075f80 tx=0x7fa9bc00b390 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.425+0000 7fa9d1ffb640 1 -- 172.21.15.60:0/1801549604 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa9c4014030 con 0x7fa9d4101dd0 2024-09-12T00:07:17.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:17 smithi105 ceph-mon[34805]: pgmap v243: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:17.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:17 smithi192 ceph-mon[35487]: pgmap v243: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:17.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.639+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9d4075a20 con 0x7fa9d4101dd0 2024-09-12T00:07:17.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.640+0000 7fa9d1ffb640 1 -- 172.21.15.60:0/1801549604 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7fa9c409c430 con 0x7fa9d4101dd0 2024-09-12T00:07:17.640 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:07:17.641 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:07:17.642 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa9c00a2d70 msgr2=0x7fa9c00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa9c00a2d70 0x7fa9c00a5230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4075f80 tx=0x7fa9bc00b390 comp rx=0 tx=0).stop 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4101dd0 msgr2=0x7fa9d40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4101dd0 0x7fa9d40744f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400c920 tx=0x7fa9c400cde0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 shutdown_connections 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa9c00a2d70 0x7fa9c00a5230 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9d4106f00 0x7fa9d4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9d4102780 0x7fa9d4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 --2- 172.21.15.60:0/1801549604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d4101dd0 0x7fa9d40744f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 >> 172.21.15.60:0/1801549604 conn(0x7fa9d40fd8b0 msgr2=0x7fa9d40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 shutdown_connections 2024-09-12T00:07:17.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:17.642+0000 7fa9da651640 1 -- 172.21.15.60:0/1801549604 wait complete. 2024-09-12T00:07:18.266 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:18 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1801549604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:07:18.266 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:18 smithi060 ceph-mon[30953]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T00:07:18.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:07:18.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:18 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1801549604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:07:18.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:18 smithi105 ceph-mon[34805]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T00:07:18.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:18 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1801549604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:07:18.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:18 smithi192 ceph-mon[35487]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T00:07:18.557 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:19.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.028+0000 7f6b180a4640 1 -- 172.21.15.60:0/3653965405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 msgr2=0x7f6b101009c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.028+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3653965405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 0x7f6b101009c0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009900 tx=0x7f6b0002a410 comp rx=0 tx=0).stop 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.028+0000 7f6b180a4640 1 -- 172.21.15.60:0/3653965405 shutdown_connections 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.028+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3653965405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b10104e80 0x7f6b10105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.028+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3653965405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 0x7f6b101009c0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.028+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3653965405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10069f00 0x7f6b10100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.028+0000 7f6b180a4640 1 -- 172.21.15.60:0/3653965405 >> 172.21.15.60:0/3653965405 conn(0x7f6b10077210 msgr2=0x7f6b100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.028+0000 7f6b180a4640 1 -- 172.21.15.60:0/3653965405 shutdown_connections 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 -- 172.21.15.60:0/3653965405 wait complete. 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 Processor -- start 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 -- start start 2024-09-12T00:07:19.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10069f00 0x7f6b10102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 0x7f6b10102fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b10104e80 0x7f6b10103500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b10111020 con 0x7f6b1006a370 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b10110ea0 con 0x7f6b10104e80 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b180a4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101111a0 con 0x7f6b10069f00 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b1563f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 0x7f6b10102fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b1563f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 0x7f6b10102fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49342/0 (socket says 172.21.15.60:49342) 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.029+0000 7f6b1563f640 1 -- 172.21.15.60:0/3962736161 learned_addr learned my addr 172.21.15.60:0/3962736161 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b16641640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b10104e80 0x7f6b10103500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b15e40640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10069f00 0x7f6b10102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b1563f640 1 -- 172.21.15.60:0/3962736161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10069f00 msgr2=0x7f6b10102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b1563f640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10069f00 0x7f6b10102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b1563f640 1 -- 172.21.15.60:0/3962736161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b10104e80 msgr2=0x7f6b10103500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b1563f640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b10104e80 0x7f6b10103500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b1563f640 1 -- 172.21.15.60:0/3962736161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b101a69f0 con 0x7f6b1006a370 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b16641640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b10104e80 0x7f6b10103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b15e40640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10069f00 0x7f6b10102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b1563f640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 0x7f6b10102fc0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6b00004770 tx=0x7f6b00032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b06ffd640 1 -- 172.21.15.60:0/3962736161 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0003f030 con 0x7f6b1006a370 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b06ffd640 1 -- 172.21.15.60:0/3962736161 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b00003d00 con 0x7f6b1006a370 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b180a4640 1 -- 172.21.15.60:0/3962736161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b101a6c80 con 0x7f6b1006a370 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b06ffd640 1 -- 172.21.15.60:0/3962736161 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00035070 con 0x7f6b1006a370 2024-09-12T00:07:19.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.030+0000 7f6b180a4640 1 -- 172.21.15.60:0/3962736161 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b101a7160 con 0x7f6b1006a370 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.032+0000 7f6b06ffd640 1 -- 172.21.15.60:0/3962736161 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6b00042030 con 0x7f6b1006a370 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b1a47d740 1 Processor -- start 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b1a47d740 1 -- start start 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 0x564e7f7fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f7fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f809760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564e7f7622f0 con 0x564e7f7fc5d0 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564e7f709cf0 con 0x564e7f807370 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564e7f75e2b0 con 0x564e7f7fdb40 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b15e40640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f7fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b06ffd640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6afc0a2cf0 0x7f6afc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b15e40640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f7fca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49348/0 (socket says 172.21.15.60:49348) 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b15e40640 1 -- 172.21.15.60:0/2549340954 learned_addr learned my addr 172.21.15.60:0/2549340954 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.033+0000 7f6b16641640 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 0x564e7f7fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b16641640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6afc0a2cf0 0x7f6afc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b1563f640 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f809760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b15e40640 1 -- 172.21.15.60:0/2549340954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 msgr2=0x564e7f7fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b15e40640 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 0x564e7f7fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b15e40640 1 -- 172.21.15.60:0/2549340954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 msgr2=0x564e7f809760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b15e40640 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f809760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b15e40640 1 -- 172.21.15.60:0/2549340954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e7f6ee3a0 con 0x564e7f7fc5d0 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b06ffd640 1 -- 172.21.15.60:0/3962736161 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f6b000efa50 con 0x7f6b1006a370 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b15e40640 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f7fca10 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00cca0 tx=0x7f6b0c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86bb9f9af521ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6b16641640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6afc0a2cf0 0x7f6afc0a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b08005c40 tx=0x7f6b08009280 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6afbfff640 1 -- 172.21.15.60:0/2549340954 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c005220 con 0x564e7f7fc5d0 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6afbfff640 1 -- 172.21.15.60:0/2549340954 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b0c004ca0 con 0x564e7f7fc5d0 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.034+0000 7f6afbfff640 1 -- 172.21.15.60:0/2549340954 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0109f0 con 0x564e7f7fc5d0 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2549340954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 msgr2=0x564e7f7fca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f7fca10 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00cca0 tx=0x7f6b0c00e720 comp rx=0 tx=0).stop 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2549340954 shutdown_connections 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f809760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f7fca10 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2549340954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 0x564e7f7fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2549340954 >> 172.21.15.60:0/2549340954 conn(0x564e7f7c5310 msgr2=0x564e7f7f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2549340954 shutdown_connections 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2549340954 wait complete. 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 -- start start 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.035+0000 7f6b1a47d740 1 Processor -- start 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f806d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f804020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f804610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564e7f80a070 con 0x564e7f7fdb40 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564e7f71d060 con 0x564e7f807370 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564e7f80a1f0 con 0x564e7f7fc5d0 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1a47d740 10 client.0 _ll_register_callbacks cb 0x564e7f4708c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1563f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f804020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1563f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f804020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49358/0 (socket says 172.21.15.60:49358) 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1563f640 1 -- 172.21.15.60:0/3431858293 learned_addr learned my addr 172.21.15.60:0/3431858293 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b15e40640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f806d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b16641640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f804610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1563f640 1 -- 172.21.15.60:0/3431858293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 msgr2=0x564e7f806d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1563f640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f806d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1563f640 1 -- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 msgr2=0x564e7f804610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1563f640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f804610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b1563f640 1 -- 172.21.15.60:0/3431858293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e7f4d33c0 con 0x564e7f7fdb40 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b16641640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f804610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.036+0000 7f6b15e40640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f806d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:19.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1563f640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f804020 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6b000ed270 tx=0x7f6b00049bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796e690999abfe0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6af97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6af97fa640 1 -- 172.21.15.60:0/3431858293 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00049040 con 0x564e7f7fdb40 2024-09-12T00:07:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6af97fa640 1 -- 172.21.15.60:0/3431858293 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f6b000ed440 con 0x564e7f7fdb40 2024-09-12T00:07:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 1 -- 172.21.15.60:0/3431858293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b0c004ca0 con 0x564e7f7fdb40 2024-09-12T00:07:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6af97fa640 1 -- 172.21.15.60:0/3431858293 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6b000bbad0 con 0x564e7f7fdb40 2024-09-12T00:07:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 10 client.17226 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 1 -- 172.21.15.60:0/3431858293 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564e7f815b40 con 0x564e7f7fdb40 2024-09-12T00:07:19.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6af97fa640 1 -- 172.21.15.60:0/3431858293 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b0c004ca0 con 0x564e7f7fdb40 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6af97fa640 1 -- 172.21.15.60:0/3431858293 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f6b000b8600 con 0x564e7f7fdb40 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 10 client.17226 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 10 client.17226 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 20 client.17226 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564e7f816fa0 0x564e7f819390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 4 client.17226 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.037+0000 7f6b1a47d740 1 -- 172.21.15.60:0/3431858293 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e7f76f860 con 0x564e7f816fa0 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.038+0000 7f6b15e40640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564e7f816fa0 0x564e7f819390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.038+0000 7f6b15e40640 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564e7f816fa0 0x564e7f819390 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cd1856e4bd836e6a server_cookie=67f4dc38597cd54 in_seq=0 out_seq=0 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.038+0000 7f6af97fa640 10 client.17226 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:07:19.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6af97fa640 1 -- 172.21.15.60:0/3431858293 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e7f76f860 con 0x564e7f816fa0 2024-09-12T00:07:19.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6af97fa640 10 client.17226 handle_command_reply: tid=0 2024-09-12T00:07:19.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 client.17226 shutdown 2024-09-12T00:07:19.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 -- 172.21.15.60:0/3431858293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 msgr2=0x564e7f804020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f804020 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6b000ed270 tx=0x7f6b00049bd0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 -- 172.21.15.60:0/3431858293 shutdown_connections 2024-09-12T00:07:19.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564e7f816fa0 0x564e7f819390 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f804610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f804020 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/3431858293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f806d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6af97fa640 0 client.17226 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:07:19.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 -- 172.21.15.60:0/3431858293 >> 172.21.15.60:0/3431858293 conn(0x564e7f7c5310 msgr2=0x564e7f7fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:19.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 -- 172.21.15.60:0/3431858293 shutdown_connections 2024-09-12T00:07:19.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 1 -- 172.21.15.60:0/3431858293 wait complete. 2024-09-12T00:07:19.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.039+0000 7f6b1a47d740 20 client.17226 trim_cache size 0 max 16384 2024-09-12T00:07:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.052+0000 7f6b1a47d740 1 Processor -- start 2024-09-12T00:07:19.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.052+0000 7f6b1a47d740 1 -- start start 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f7f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f813340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f81eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101afa10 con 0x564e7f7fdb40 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101b1550 con 0x564e7f807370 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101b00e0 con 0x564e7f7fc5d0 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f813340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f813340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49360/0 (socket says 172.21.15.60:49360) 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 -- 172.21.15.60:0/1452407216 learned_addr learned my addr 172.21.15.60:0/1452407216 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:19.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b16641640 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f81eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b15e40640 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f7f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 -- 172.21.15.60:0/1452407216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 msgr2=0x564e7f7f8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f7f8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 -- 172.21.15.60:0/1452407216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 msgr2=0x564e7f81eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f81eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 -- 172.21.15.60:0/1452407216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e7f819700 con 0x564e7f7fdb40 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b16641640 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f81eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6b1563f640 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f813340 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c4cf0 tx=0x7f6b0002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f691d7bfe7ab45e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.053+0000 7f6afb7fe640 1 -- 172.21.15.60:0/1452407216 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00049050 con 0x564e7f7fdb40 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6afb7fe640 1 -- 172.21.15.60:0/1452407216 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b000b5070 con 0x564e7f7fdb40 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6afb7fe640 1 -- 172.21.15.60:0/1452407216 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b000bb8f0 con 0x564e7f7fdb40 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 -- 172.21.15.60:0/1452407216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 msgr2=0x564e7f813340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f813340 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6b000c4cf0 tx=0x7f6b0002a410 comp rx=0 tx=0).stop 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 -- 172.21.15.60:0/1452407216 shutdown_connections 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f81eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fdb40 0x564e7f813340 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/1452407216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fc5d0 0x564e7f7f8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 -- 172.21.15.60:0/1452407216 >> 172.21.15.60:0/1452407216 conn(0x564e7f7c5310 msgr2=0x564e7f7f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 -- 172.21.15.60:0/1452407216 shutdown_connections 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.054+0000 7f6b1a47d740 1 -- 172.21.15.60:0/1452407216 wait complete. 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 1 -- start start 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 1 Processor -- start 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f80f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 0x564e7f80f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f80c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101b0e80 con 0x564e7f7fc5d0 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101b07b0 con 0x564e7f807370 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b101ada10 con 0x564e7f7fdb40 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1a47d740 10 client.0 _ll_register_callbacks cb 0x7f6b00032e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b15e40640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f80f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b15e40640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f80f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49372/0 (socket says 172.21.15.60:49372) 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b15e40640 1 -- 172.21.15.60:0/2870002547 learned_addr learned my addr 172.21.15.60:0/2870002547 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b1563f640 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 0x564e7f80f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.055+0000 7f6b16641640 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f80c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b15e40640 1 -- 172.21.15.60:0/2870002547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 msgr2=0x564e7f80f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b15e40640 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 0x564e7f80f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b15e40640 1 -- 172.21.15.60:0/2870002547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 msgr2=0x564e7f80c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b15e40640 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f80c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b15e40640 1 -- 172.21.15.60:0/2870002547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e7f80ca40 con 0x564e7f7fc5d0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b15e40640 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f80f4b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x564e7f7f9ac0 tx=0x7f6b0c00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614a1fee8dc5f27b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6af97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6af97fa640 1 -- 172.21.15.60:0/2870002547 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c005450 con 0x564e7f7fc5d0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2870002547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b000b5070 con 0x564e7f7fc5d0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6af97fa640 1 -- 172.21.15.60:0/2870002547 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f6b0c0055f0 con 0x564e7f7fc5d0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6af97fa640 1 -- 172.21.15.60:0/2870002547 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6b0c004020 con 0x564e7f7fc5d0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b1a47d740 10 client.17232 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2870002547 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564e7f882520 con 0x564e7f7fc5d0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.056+0000 7f6af97fa640 1 -- 172.21.15.60:0/2870002547 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b000b5070 con 0x564e7f7fc5d0 2024-09-12T00:07:19.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6af97fa640 1 -- 172.21.15.60:0/2870002547 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f6b0c037020 con 0x564e7f7fc5d0 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6b1a47d740 10 client.17232 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6b1a47d740 10 client.17232 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6b1a47d740 20 client.17232 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564e7f882970 0x564e7f884d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6b1a47d740 4 client.17232 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2870002547 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e7f769d70 con 0x564e7f882970 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6b1563f640 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564e7f882970 0x564e7f884d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6af97fa640 10 client.17232 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.057+0000 7f6b1563f640 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564e7f882970 0x564e7f884d90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ec98b99b0b23bca1 server_cookie=c336c0de7288b2e6 in_seq=0 out_seq=0 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6af97fa640 1 -- 172.21.15.60:0/2870002547 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e7f769d70 con 0x564e7f882970 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6af97fa640 10 client.17232 handle_command_reply: tid=0 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 client.17232 shutdown 2024-09-12T00:07:19.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2870002547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 msgr2=0x564e7f80f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f80f4b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x564e7f7f9ac0 tx=0x7f6b0c00ef50 comp rx=0 tx=0).stop 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2870002547 shutdown_connections 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x564e7f882970 0x564e7f884d90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564e7f807370 0x564e7f80c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564e7f7fdb40 0x564e7f80f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 --2- 172.21.15.60:0/2870002547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564e7f7fc5d0 0x564e7f80f4b0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6af97fa640 0 client.17232 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2870002547 >> 172.21.15.60:0/2870002547 conn(0x564e7f7c5310 msgr2=0x564e7f805880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2870002547 shutdown_connections 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 1 -- 172.21.15.60:0/2870002547 wait complete. 2024-09-12T00:07:19.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.058+0000 7f6b1a47d740 20 client.17232 trim_cache size 0 max 16384 2024-09-12T00:07:19.072 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:19.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 -- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6afc0a2cf0 msgr2=0x7f6afc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6afc0a2cf0 0x7f6afc0a51b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b08005c40 tx=0x7f6b08009280 comp rx=0 tx=0).stop 2024-09-12T00:07:19.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 -- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 msgr2=0x7f6b10102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:19.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 0x7f6b10102fc0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6b00004770 tx=0x7f6b00032c90 comp rx=0 tx=0).stop 2024-09-12T00:07:19.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 -- 172.21.15.60:0/3962736161 shutdown_connections 2024-09-12T00:07:19.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6afc0a2cf0 0x7f6afc0a51b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b10104e80 0x7f6b10103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b1006a370 0x7f6b10102fc0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 --2- 172.21.15.60:0/3962736161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10069f00 0x7f6b10102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:19.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 -- 172.21.15.60:0/3962736161 >> 172.21.15.60:0/3962736161 conn(0x7f6b10077210 msgr2=0x7f6b100fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:19.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 -- 172.21.15.60:0/3962736161 shutdown_connections 2024-09-12T00:07:19.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:19.059+0000 7f6b180a4640 1 -- 172.21.15.60:0/3962736161 wait complete. 2024-09-12T00:07:19.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:19 smithi060 ceph-mon[30953]: pgmap v244: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:19 smithi105 ceph-mon[34805]: pgmap v244: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:19.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:19 smithi192 ceph-mon[35487]: pgmap v244: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:19.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:07:20.042 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.491+0000 7f906239c640 1 -- 172.21.15.60:0/3281805794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 msgr2=0x7f905c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.491+0000 7f906239c640 1 --2- 172.21.15.60:0/3281805794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 0x7f905c10ea90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9054009ca0 tx=0x7f905402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 -- 172.21.15.60:0/3281805794 shutdown_connections 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 --2- 172.21.15.60:0/3281805794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 0x7f905c10ea90 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 --2- 172.21.15.60:0/3281805794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c102790 0x7f905c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 --2- 172.21.15.60:0/3281805794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c101de0 0x7f905c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 -- 172.21.15.60:0/3281805794 >> 172.21.15.60:0/3281805794 conn(0x7f905c0fd8c0 msgr2=0x7f905c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 -- 172.21.15.60:0/3281805794 shutdown_connections 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 -- 172.21.15.60:0/3281805794 wait complete. 2024-09-12T00:07:20.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 Processor -- start 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.492+0000 7f906239c640 1 -- start start 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f906239c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c101de0 0x7f905c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f906239c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c102790 0x7f905c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f906239c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 0x7f905c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f906239c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1120e0 con 0x7f905c106f10 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f906239c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f905c111f60 con 0x7f905c101de0 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f906239c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f905c112260 con 0x7f905c102790 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f9060939640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 0x7f905c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f9060939640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 0x7f905c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49382/0 (socket says 172.21.15.60:49382) 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f9060939640 1 -- 172.21.15.60:0/97148509 learned_addr learned my addr 172.21.15.60:0/97148509 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f905bfff640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c101de0 0x7f905c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f905b7fe640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c102790 0x7f905c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f9060939640 1 -- 172.21.15.60:0/97148509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c102790 msgr2=0x7f905c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f9060939640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c102790 0x7f905c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f9060939640 1 -- 172.21.15.60:0/97148509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c101de0 msgr2=0x7f905c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f9060939640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c101de0 0x7f905c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f9060939640 1 -- 172.21.15.60:0/97148509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c19d430 con 0x7f905c106f10 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.493+0000 7f905b7fe640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c102790 0x7f905c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.494+0000 7f9060939640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 0x7f905c19cd50 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9054003f10 tx=0x7f9054003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.494+0000 7f90597fa640 1 -- 172.21.15.60:0/97148509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054031710 con 0x7f905c106f10 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.494+0000 7f90597fa640 1 -- 172.21.15.60:0/97148509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90540318b0 con 0x7f905c106f10 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.494+0000 7f90597fa640 1 -- 172.21.15.60:0/97148509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905402fc50 con 0x7f905c106f10 2024-09-12T00:07:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.494+0000 7f906239c640 1 -- 172.21.15.60:0/97148509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c19d6c0 con 0x7f905c106f10 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.494+0000 7f906239c640 1 -- 172.21.15.60:0/97148509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c1a5000 con 0x7f905c106f10 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.496+0000 7f90597fa640 1 -- 172.21.15.60:0/97148509 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9054004040 con 0x7f905c106f10 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.496+0000 7f9064775740 1 Processor -- start 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f9064775740 1 -- start start 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f9064775740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54fb40 0x55951a54e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f9064775740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f9064775740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a55d780 0x55951a55fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f9064775740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55951a4b42f0 con 0x55951a55d780 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f9064775740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55951a45bcf0 con 0x55951a54e5d0 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f9064775740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55951a4b02b0 con 0x55951a54fb40 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a55d780 0x55951a55fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a55d780 0x55951a55fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49392/0 (socket says 172.21.15.60:49392) 2024-09-12T00:07:20.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 -- 172.21.15.60:0/2651360209 learned_addr learned my addr 172.21.15.60:0/2651360209 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f90597fa640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f90440a2cf0 0x7f90440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905bfff640 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f9060939640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f90440a2cf0 0x7f90440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54fb40 0x55951a54e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 -- 172.21.15.60:0/2651360209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54fb40 msgr2=0x55951a54e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54fb40 0x55951a54e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 -- 172.21.15.60:0/2651360209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 msgr2=0x55951a54ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905b7fe640 1 -- 172.21.15.60:0/2651360209 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55951a4403a0 con 0x55951a55d780 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f90597fa640 1 -- 172.21.15.60:0/97148509 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f90540f0870 con 0x7f905c106f10 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.497+0000 7f905bfff640 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:20.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.498+0000 7f905b7fe640 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a55d780 0x55951a55fb70 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9050013540 tx=0x7f905000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6abff8ab18ac4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.498+0000 7f90427fc640 1 -- 172.21.15.60:0/2651360209 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050019030 con 0x55951a55d780 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.498+0000 7f90427fc640 1 -- 172.21.15.60:0/2651360209 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90500035f0 con 0x55951a55d780 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.498+0000 7f90427fc640 1 -- 172.21.15.60:0/2651360209 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050011720 con 0x55951a55d780 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.498+0000 7f9064775740 1 -- 172.21.15.60:0/2651360209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a55d780 msgr2=0x55951a55fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.498+0000 7f9064775740 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a55d780 0x55951a55fb70 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9050013540 tx=0x7f905000b6b0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.498+0000 7f9060939640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f90440a2cf0 0x7f90440a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f905404b6b0 tx=0x7f905408ee20 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 -- 172.21.15.60:0/2651360209 shutdown_connections 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a55d780 0x55951a55fb70 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 --2- 172.21.15.60:0/2651360209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54fb40 0x55951a54e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 -- 172.21.15.60:0/2651360209 >> 172.21.15.60:0/2651360209 conn(0x55951a517310 msgr2=0x55951a54ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 -- 172.21.15.60:0/2651360209 shutdown_connections 2024-09-12T00:07:20.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 -- 172.21.15.60:0/2651360209 wait complete. 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 -- start start 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.499+0000 7f9064775740 1 Processor -- start 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f9064775740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a55d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f9064775740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a55a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f9064775740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a55aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f9064775740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55951a560480 con 0x55951a54fb40 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f9064775740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55951a46f060 con 0x55951a54e5d0 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f9064775740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55951a560600 con 0x55951a55d780 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f9064775740 10 client.0 _ll_register_callbacks cb 0x55951a1c28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a55a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a55a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49406/0 (socket says 172.21.15.60:49406) 2024-09-12T00:07:20.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 -- 172.21.15.60:0/1524111398 learned_addr learned my addr 172.21.15.60:0/1524111398 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905b7fe640 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a55d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 -- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 msgr2=0x55951a55aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905b7fe640 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a55aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a55aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 -- 172.21.15.60:0/1524111398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 msgr2=0x55951a55d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a55d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 -- 172.21.15.60:0/1524111398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55951a2253c0 con 0x55951a54fb40 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905b7fe640 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a55aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f905bfff640 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a55a430 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f904c00ba10 tx=0x7f904c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bd21b99cee5414 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f903b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f903b7fe640 1 -- 172.21.15.60:0/1524111398 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c003e80 con 0x55951a54fb40 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f903b7fe640 1 -- 172.21.15.60:0/1524111398 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f904c011440 con 0x55951a54fb40 2024-09-12T00:07:20.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.500+0000 7f9064775740 1 -- 172.21.15.60:0/1524111398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90500035f0 con 0x55951a54fb40 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f903b7fe640 1 -- 172.21.15.60:0/1524111398 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f904c011640 con 0x55951a54fb40 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f9064775740 10 client.17244 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f9064775740 1 -- 172.21.15.60:0/1524111398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55951a56bf80 con 0x55951a54fb40 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f903b7fe640 1 -- 172.21.15.60:0/1524111398 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90500035f0 con 0x55951a54fb40 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f903b7fe640 1 -- 172.21.15.60:0/1524111398 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f904c022070 con 0x55951a54fb40 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f9064775740 10 client.17244 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f9064775740 10 client.17244 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f9064775740 20 client.17244 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f9064775740 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55951a56d4e0 0x55951a56f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f9064775740 4 client.17244 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f9064775740 1 -- 172.21.15.60:0/1524111398 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55951a4c1860 con 0x55951a56d4e0 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.501+0000 7f905b7fe640 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55951a56d4e0 0x55951a56f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.502+0000 7f905b7fe640 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55951a56d4e0 0x55951a56f920 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=106790febd22778b server_cookie=eb8a99fe02e1412a in_seq=0 out_seq=0 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.502+0000 7f903b7fe640 10 client.17244 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f903b7fe640 1 -- 172.21.15.60:0/1524111398 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55951a4c1860 con 0x55951a56d4e0 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f903b7fe640 10 client.17244 handle_command_reply: tid=0 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 client.17244 shutdown 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 -- 172.21.15.60:0/1524111398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 msgr2=0x55951a55a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a55a430 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f904c00ba10 tx=0x7f904c00bed0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 -- 172.21.15.60:0/1524111398 shutdown_connections 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55951a56d4e0 0x55951a56f920 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a55aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a55a430 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 --2- 172.21.15.60:0/1524111398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a55d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f903b7fe640 0 client.17244 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:07:20.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 -- 172.21.15.60:0/1524111398 >> 172.21.15.60:0/1524111398 conn(0x55951a517310 msgr2=0x55951a550960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 -- 172.21.15.60:0/1524111398 shutdown_connections 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 1 -- 172.21.15.60:0/1524111398 wait complete. 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.503+0000 7f9064775740 20 client.17244 trim_cache size 0 max 16384 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f9064775740 1 Processor -- start 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f9064775740 1 -- start start 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f9064775740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f9064775740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a54f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f9064775740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a569720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f9064775740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ab660 con 0x55951a54fb40 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f9064775740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ad1a0 con 0x55951a54e5d0 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f9064775740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1abd30 con 0x55951a55d780 2024-09-12T00:07:20.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a54f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a54f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49422/0 (socket says 172.21.15.60:49422) 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905bfff640 1 -- 172.21.15.60:0/791214603 learned_addr learned my addr 172.21.15.60:0/791214603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905b7fe640 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a569720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905b7fe640 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905bfff640 1 -- 172.21.15.60:0/791214603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 msgr2=0x55951a569720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905bfff640 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a569720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905bfff640 1 -- 172.21.15.60:0/791214603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 msgr2=0x55951a54ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905bfff640 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.516+0000 7f905bfff640 1 -- 172.21.15.60:0/791214603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55951a54b960 con 0x55951a54fb40 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.517+0000 7f905bfff640 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a54f300 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f904c01bc30 tx=0x7f904c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ad7400e883d65a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.517+0000 7f9041ffb640 1 -- 172.21.15.60:0/791214603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c028070 con 0x55951a54fb40 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.517+0000 7f9041ffb640 1 -- 172.21.15.60:0/791214603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f904c00b400 con 0x55951a54fb40 2024-09-12T00:07:20.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.517+0000 7f9041ffb640 1 -- 172.21.15.60:0/791214603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c02d460 con 0x55951a54fb40 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 -- 172.21.15.60:0/791214603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 msgr2=0x55951a54f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a54f300 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f904c01bc30 tx=0x7f904c00b6f0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 -- 172.21.15.60:0/791214603 shutdown_connections 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a55d780 0x55951a569720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a54f300 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 --2- 172.21.15.60:0/791214603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a54e5d0 0x55951a54ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 -- 172.21.15.60:0/791214603 >> 172.21.15.60:0/791214603 conn(0x55951a517310 msgr2=0x55951a54a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 -- 172.21.15.60:0/791214603 shutdown_connections 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 -- 172.21.15.60:0/791214603 wait complete. 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 -- start start 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.518+0000 7f9064775740 1 Processor -- start 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f9064775740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54e5d0 0x55951a565c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f9064775740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a566180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f9064775740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a55d780 0x55951a5570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f9064775740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1acad0 con 0x55951a54fb40 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f9064775740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ac400 con 0x55951a55d780 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f9064775740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1a9680 con 0x55951a54e5d0 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f9064775740 10 client.0 _ll_register_callbacks cb 0x7f904c0042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a566180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a566180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49432/0 (socket says 172.21.15.60:49432) 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 -- 172.21.15.60:0/3251332462 learned_addr learned my addr 172.21.15.60:0/3251332462 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905b7fe640 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a55d780 0x55951a5570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905b7fe640 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54e5d0 0x55951a565c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 -- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54e5d0 msgr2=0x55951a565c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54e5d0 0x55951a565c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 -- 172.21.15.60:0/3251332462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a55d780 msgr2=0x55951a5570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a55d780 0x55951a5570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 -- 172.21.15.60:0/3251332462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55951a557900 con 0x55951a54fb40 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905b7fe640 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54e5d0 0x55951a565c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f905bfff640 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a566180 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f904c01be70 tx=0x7f904c011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9a1e5aa018dd91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.519+0000 7f903b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f903b7fe640 1 -- 172.21.15.60:0/3251332462 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c028040 con 0x55951a54fb40 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f903b7fe640 1 -- 172.21.15.60:0/3251332462 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f904c01b630 con 0x55951a54fb40 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 1 -- 172.21.15.60:0/3251332462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f904c00b400 con 0x55951a54fb40 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f903b7fe640 1 -- 172.21.15.60:0/3251332462 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f904c03d050 con 0x55951a54fb40 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 10 client.17250 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 1 -- 172.21.15.60:0/3251332462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55951a5d7eb0 con 0x55951a54fb40 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f903b7fe640 1 -- 172.21.15.60:0/3251332462 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f904c00b400 con 0x55951a54fb40 2024-09-12T00:07:20.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f903b7fe640 1 -- 172.21.15.60:0/3251332462 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f904c022070 con 0x55951a54fb40 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 10 client.17250 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 10 client.17250 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 20 client.17250 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55951a5d8490 0x55951a5da8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 4 client.17250 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.520+0000 7f9064775740 1 -- 172.21.15.60:0/3251332462 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55951a4bbd70 con 0x55951a5d8490 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.521+0000 7f905b7fe640 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55951a5d8490 0x55951a5da8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.521+0000 7f905b7fe640 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55951a5d8490 0x55951a5da8b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4fe3731bfba7f2a3 server_cookie=95e012f9fc7dcf8b in_seq=0 out_seq=0 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.521+0000 7f903b7fe640 10 client.17250 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.521+0000 7f903b7fe640 1 -- 172.21.15.60:0/3251332462 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55951a4bbd70 con 0x55951a5d8490 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.521+0000 7f903b7fe640 10 client.17250 handle_command_reply: tid=0 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.521+0000 7f9064775740 1 client.17250 shutdown 2024-09-12T00:07:20.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.521+0000 7f9064775740 1 -- 172.21.15.60:0/3251332462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 msgr2=0x55951a566180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.521+0000 7f9064775740 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a566180 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f904c01be70 tx=0x7f904c011de0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 1 -- 172.21.15.60:0/3251332462 shutdown_connections 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55951a5d8490 0x55951a5da8b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55951a55d780 0x55951a5570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55951a54fb40 0x55951a566180 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 1 --2- 172.21.15.60:0/3251332462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55951a54e5d0 0x55951a565c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 1 -- 172.21.15.60:0/3251332462 >> 172.21.15.60:0/3251332462 conn(0x55951a517310 msgr2=0x55951a5588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f903b7fe640 0 client.17250 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 1 -- 172.21.15.60:0/3251332462 shutdown_connections 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 1 -- 172.21.15.60:0/3251332462 wait complete. 2024-09-12T00:07:20.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f9064775740 20 client.17250 trim_cache size 0 max 16384 2024-09-12T00:07:20.540 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:20.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 -- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f90440a2cf0 msgr2=0x7f90440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f90440a2cf0 0x7f90440a51b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f905404b6b0 tx=0x7f905408ee20 comp rx=0 tx=0).stop 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 -- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 msgr2=0x7f905c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 0x7f905c19cd50 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9054003f10 tx=0x7f9054003f40 comp rx=0 tx=0).stop 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 -- 172.21.15.60:0/97148509 shutdown_connections 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f90440a2cf0 0x7f90440a51b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f905c106f10 0x7f905c19cd50 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f905c102790 0x7f905c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 --2- 172.21.15.60:0/97148509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c101de0 0x7f905c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.522+0000 7f906239c640 1 -- 172.21.15.60:0/97148509 >> 172.21.15.60:0/97148509 conn(0x7f905c0fd8c0 msgr2=0x7f905c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.523+0000 7f906239c640 1 -- 172.21.15.60:0/97148509 shutdown_connections 2024-09-12T00:07:20.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:20.523+0000 7f906239c640 1 -- 172.21.15.60:0/97148509 wait complete. 2024-09-12T00:07:21.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:21 smithi060 ceph-mon[30953]: pgmap v246: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:21 smithi105 ceph-mon[34805]: pgmap v246: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:21.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:07:21.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:21 smithi192 ceph-mon[35487]: pgmap v246: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:21.793 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:22.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 -- 172.21.15.60:0/9077513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634108290 msgr2=0x7f063410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 --2- 172.21.15.60:0/9077513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634108290 0x7f063410ec30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f062c009cd0 tx=0x7f062c02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 -- 172.21.15.60:0/9077513 shutdown_connections 2024-09-12T00:07:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 --2- 172.21.15.60:0/9077513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634108290 0x7f063410ec30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 --2- 172.21.15.60:0/9077513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0634103740 0x7f0634107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 --2- 172.21.15.60:0/9077513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0634102d90 0x7f0634103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 -- 172.21.15.60:0/9077513 >> 172.21.15.60:0/9077513 conn(0x7f06340fc7d0 msgr2=0x7f06340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 -- 172.21.15.60:0/9077513 shutdown_connections 2024-09-12T00:07:22.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 -- 172.21.15.60:0/9077513 wait complete. 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.252+0000 7f0639534640 1 Processor -- start 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f0639534640 1 -- start start 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f0639534640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0634102d90 0x7f06341985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f0639534640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634103740 0x7f0634198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f0639534640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0634108290 0x7f063419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f0639534640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06341121b0 con 0x7f0634103740 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f0639534640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0634112030 con 0x7f0634102d90 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f0639534640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0634112330 con 0x7f0634108290 2024-09-12T00:07:22.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f06327fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634103740 0x7f0634198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f06327fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634103740 0x7f0634198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60838/0 (socket says 172.21.15.60:60838) 2024-09-12T00:07:22.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f06327fc640 1 -- 172.21.15.60:0/2962430686 learned_addr learned my addr 172.21.15.60:0/2962430686 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:22.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f06337fe640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0634108290 0x7f063419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.253+0000 7f0632ffd640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0634102d90 0x7f06341985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f06327fc640 1 -- 172.21.15.60:0/2962430686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0634108290 msgr2=0x7f063419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f06327fc640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0634108290 0x7f063419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f06327fc640 1 -- 172.21.15.60:0/2962430686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0634102d90 msgr2=0x7f06341985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f06327fc640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0634102d90 0x7f06341985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f06327fc640 1 -- 172.21.15.60:0/2962430686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063419d5a0 con 0x7f0634103740 2024-09-12T00:07:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f06327fc640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634103740 0x7f0634198b30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f062800e9c0 tx=0x7f062800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f061bfff640 1 -- 172.21.15.60:0/2962430686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062800cd80 con 0x7f0634103740 2024-09-12T00:07:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f061bfff640 1 -- 172.21.15.60:0/2962430686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0628005520 con 0x7f0634103740 2024-09-12T00:07:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f0639534640 1 -- 172.21.15.60:0/2962430686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063419d890 con 0x7f0634103740 2024-09-12T00:07:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f061bfff640 1 -- 172.21.15.60:0/2962430686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628010690 con 0x7f0634103740 2024-09-12T00:07:22.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.254+0000 7f0639534640 1 -- 172.21.15.60:0/2962430686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06341a5170 con 0x7f0634103740 2024-09-12T00:07:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.256+0000 7f061bfff640 1 -- 172.21.15.60:0/2962430686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f06280046c0 con 0x7f0634103740 2024-09-12T00:07:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.256+0000 7f063b90d740 1 Processor -- start 2024-09-12T00:07:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f063b90d740 1 -- start start 2024-09-12T00:07:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f063b90d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef240090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f063b90d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef2405d0 0x556aef240a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f063b90d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef24b370 0x556aef24d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f061bfff640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f061c0a2d70 0x7f061c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f063b90d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556aef1a62f0 con 0x556aef2405d0 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f063b90d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556aef14dcf0 con 0x556aef24b370 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f063b90d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556aef1a22b0 con 0x556aef241b40 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f0632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef2405d0 0x556aef240a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f0632ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef2405d0 0x556aef240a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60852/0 (socket says 172.21.15.60:60852) 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f0632ffd640 1 -- 172.21.15.60:0/2599829908 learned_addr learned my addr 172.21.15.60:0/2599829908 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f06337fe640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f061c0a2d70 0x7f061c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f06327fc640 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef24b370 0x556aef24d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f06337fe640 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef240090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f061bfff640 1 -- 172.21.15.60:0/2962430686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f06280cf6e0 con 0x7f0634103740 2024-09-12T00:07:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f0632ffd640 1 -- 172.21.15.60:0/2599829908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 msgr2=0x556aef240090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f0632ffd640 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef240090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f0632ffd640 1 -- 172.21.15.60:0/2599829908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef24b370 msgr2=0x556aef24d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f0632ffd640 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef24b370 0x556aef24d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.257+0000 7f0632ffd640 1 -- 172.21.15.60:0/2599829908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aef1323a0 con 0x556aef2405d0 2024-09-12T00:07:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.258+0000 7f06337fe640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f061c0a2d70 0x7f061c0a5230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f062c006010 tx=0x7f062c031640 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.258+0000 7f0632ffd640 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef2405d0 0x556aef240a10 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f062400bd10 tx=0x7f06240107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a5bc450943748a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.258+0000 7f06197fa640 1 -- 172.21.15.60:0/2599829908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624004030 con 0x556aef2405d0 2024-09-12T00:07:22.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.258+0000 7f06197fa640 1 -- 172.21.15.60:0/2599829908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06240041d0 con 0x556aef2405d0 2024-09-12T00:07:22.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.258+0000 7f06197fa640 1 -- 172.21.15.60:0/2599829908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624011730 con 0x556aef2405d0 2024-09-12T00:07:22.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.258+0000 7f063b90d740 1 -- 172.21.15.60:0/2599829908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef2405d0 msgr2=0x556aef240a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.258+0000 7f063b90d740 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef2405d0 0x556aef240a10 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f062400bd10 tx=0x7f06240107a0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 -- 172.21.15.60:0/2599829908 shutdown_connections 2024-09-12T00:07:22.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef24b370 0x556aef24d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef2405d0 0x556aef240a10 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 --2- 172.21.15.60:0/2599829908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef240090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 -- 172.21.15.60:0/2599829908 >> 172.21.15.60:0/2599829908 conn(0x556aef209310 msgr2=0x556aef23cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 -- 172.21.15.60:0/2599829908 shutdown_connections 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 -- 172.21.15.60:0/2599829908 wait complete. 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 -- start start 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 Processor -- start 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 0x556aef24ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef241b40 0x556aef247ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef24b370 0x556aef2485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556aef24e070 con 0x556aef241b40 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556aef161060 con 0x556aef2405d0 2024-09-12T00:07:22.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556aef24e1f0 con 0x556aef24b370 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.259+0000 7f063b90d740 10 client.0 _ll_register_callbacks cb 0x556aeeeb48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef241b40 0x556aef247ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef241b40 0x556aef247ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60866/0 (socket says 172.21.15.60:60866) 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 -- 172.21.15.60:0/42536563 learned_addr learned my addr 172.21.15.60:0/42536563 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06337fe640 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef24b370 0x556aef2485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f0632ffd640 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 0x556aef24ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 -- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef24b370 msgr2=0x556aef2485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef24b370 0x556aef2485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 -- 172.21.15.60:0/42536563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 msgr2=0x556aef24ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 0x556aef24ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 -- 172.21.15.60:0/42536563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aeef173c0 con 0x556aef241b40 2024-09-12T00:07:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06337fe640 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef24b370 0x556aef2485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f06327fc640 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef241b40 0x556aef247ff0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f062809b920 tx=0x7f062809a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9978fc5747f791 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f0616ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f0616ff5640 1 -- 172.21.15.60:0/42536563 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06280a41f0 con 0x556aef241b40 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f0616ff5640 1 -- 172.21.15.60:0/42536563 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f06280668c0 con 0x556aef241b40 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f063b90d740 1 -- 172.21.15.60:0/42536563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06240041d0 con 0x556aef241b40 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f0616ff5640 1 -- 172.21.15.60:0/42536563 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f06280a3590 con 0x556aef241b40 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f063b90d740 10 client.17262 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.260+0000 7f063b90d740 1 -- 172.21.15.60:0/42536563 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x556aef259ae0 con 0x556aef241b40 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f0616ff5640 1 -- 172.21.15.60:0/42536563 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06240041d0 con 0x556aef241b40 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f0616ff5640 1 -- 172.21.15.60:0/42536563 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f06280a3780 con 0x556aef241b40 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f063b90d740 10 client.17262 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f063b90d740 10 client.17262 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f063b90d740 20 client.17262 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f063b90d740 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x556aef25af90 0x556aef25d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f063b90d740 4 client.17262 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f063b90d740 1 -- 172.21.15.60:0/42536563 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aef1b3860 con 0x556aef25af90 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.261+0000 7f0632ffd640 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x556aef25af90 0x556aef25d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f0632ffd640 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x556aef25af90 0x556aef25d380 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93c04203975d429c server_cookie=1f2e41edaf1c3a6f in_seq=0 out_seq=0 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f0616ff5640 10 client.17262 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f0616ff5640 1 -- 172.21.15.60:0/42536563 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556aef1b3860 con 0x556aef25af90 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f0616ff5640 10 client.17262 handle_command_reply: tid=0 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 client.17262 shutdown 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 -- 172.21.15.60:0/42536563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef241b40 msgr2=0x556aef247ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef241b40 0x556aef247ff0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f062809b920 tx=0x7f062809a130 comp rx=0 tx=0).stop 2024-09-12T00:07:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 -- 172.21.15.60:0/42536563 shutdown_connections 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x556aef25af90 0x556aef25d380 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef24b370 0x556aef2485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef241b40 0x556aef247ff0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f0616ff5640 0 client.17262 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 --2- 172.21.15.60:0/42536563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 0x556aef24ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.262+0000 7f063b90d740 1 -- 172.21.15.60:0/42536563 >> 172.21.15.60:0/42536563 conn(0x556aef209310 msgr2=0x556aef242960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.263+0000 7f063b90d740 1 -- 172.21.15.60:0/42536563 shutdown_connections 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.263+0000 7f063b90d740 1 -- 172.21.15.60:0/42536563 wait complete. 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.263+0000 7f063b90d740 20 client.17262 trim_cache size 0 max 16384 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.275+0000 7f063b90d740 1 Processor -- start 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.275+0000 7f063b90d740 1 -- start start 2024-09-12T00:07:22.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f063b90d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 0x556aef23ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f063b90d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef257310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f063b90d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef262c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f063b90d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06341ad980 con 0x556aef24b370 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f063b90d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06341af4c0 con 0x556aef2405d0 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f063b90d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06341ae050 con 0x556aef241b40 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef262c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef262c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60880/0 (socket says 172.21.15.60:60880) 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 -- 172.21.15.60:0/3415006742 learned_addr learned my addr 172.21.15.60:0/3415006742 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f0632ffd640 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 0x556aef23ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06327fc640 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef257310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 -- 172.21.15.60:0/3415006742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 msgr2=0x556aef257310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef257310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 -- 172.21.15.60:0/3415006742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 msgr2=0x556aef23ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 0x556aef23ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 -- 172.21.15.60:0/3415006742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aef243120 con 0x556aef24b370 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06327fc640 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef257310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f06337fe640 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef262c50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f062c035000 tx=0x7f062c03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8736eaa631856a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f0618ff9640 1 -- 172.21.15.60:0/3415006742 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c057070 con 0x556aef24b370 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f0618ff9640 1 -- 172.21.15.60:0/3415006742 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f062c031d90 con 0x556aef24b370 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.276+0000 7f0618ff9640 1 -- 172.21.15.60:0/3415006742 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c0309d0 con 0x556aef24b370 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 -- 172.21.15.60:0/3415006742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 msgr2=0x556aef262c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef262c50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f062c035000 tx=0x7f062c03c000 comp rx=0 tx=0).stop 2024-09-12T00:07:22.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 -- 172.21.15.60:0/3415006742 shutdown_connections 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef262c50 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef241b40 0x556aef257310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 --2- 172.21.15.60:0/3415006742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef2405d0 0x556aef23ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 -- 172.21.15.60:0/3415006742 >> 172.21.15.60:0/3415006742 conn(0x556aef209310 msgr2=0x556aef23c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 -- 172.21.15.60:0/3415006742 shutdown_connections 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 -- 172.21.15.60:0/3415006742 wait complete. 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 -- start start 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.277+0000 7f063b90d740 1 Processor -- start 2024-09-12T00:07:22.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f063b90d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef2405d0 0x556aef253480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f063b90d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef241b40 0x556aef2539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f063b90d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef250450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f063b90d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06341aedf0 con 0x556aef24b370 2024-09-12T00:07:22.303 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:22.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f063b90d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06341ae720 con 0x556aef241b40 2024-09-12T00:07:22.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f063b90d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06341ab980 con 0x556aef2405d0 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef250450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f063b90d740 10 client.0 _ll_register_callbacks cb 0x7f062800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef250450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60886/0 (socket says 172.21.15.60:60886) 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 -- 172.21.15.60:0/543401154 learned_addr learned my addr 172.21.15.60:0/543401154 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06327fc640 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef241b40 0x556aef2539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f0632ffd640 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef2405d0 0x556aef253480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 -- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef2405d0 msgr2=0x556aef253480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef2405d0 0x556aef253480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 -- 172.21.15.60:0/543401154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef241b40 msgr2=0x556aef2539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef241b40 0x556aef2539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 -- 172.21.15.60:0/543401154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aef250990 con 0x556aef24b370 2024-09-12T00:07:22.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f0632ffd640 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef2405d0 0x556aef253480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f06337fe640 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef250450 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f062c055040 tx=0x7f062c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300135f27ef56423 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.278+0000 7f0616ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f0616ff5640 1 -- 172.21.15.60:0/543401154 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c057030 con 0x556aef24b370 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f0616ff5640 1 -- 172.21.15.60:0/543401154 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f062c02e040 con 0x556aef24b370 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 1 -- 172.21.15.60:0/543401154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f062c031d90 con 0x556aef24b370 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f0616ff5640 1 -- 172.21.15.60:0/543401154 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f062c030b20 con 0x556aef24b370 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 10 client.17268 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 1 -- 172.21.15.60:0/543401154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x556aef2ca630 con 0x556aef24b370 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f0616ff5640 1 -- 172.21.15.60:0/543401154 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f062c031d90 con 0x556aef24b370 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f0616ff5640 1 -- 172.21.15.60:0/543401154 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f062c045030 con 0x556aef24b370 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 10 client.17268 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:22.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 10 client.17268 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 20 client.17268 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x556aef2caca0 0x556aef2cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 4 client.17268 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f063b90d740 1 -- 172.21.15.60:0/543401154 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556aef1add70 con 0x556aef2caca0 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.279+0000 7f0632ffd640 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x556aef2caca0 0x556aef2cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f0616ff5640 10 client.17268 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f0632ffd640 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x556aef2caca0 0x556aef2cd090 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acf9e1d2deccfe9d server_cookie=ab8f10d5ccfadb61 in_seq=0 out_seq=0 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f0616ff5640 1 -- 172.21.15.60:0/543401154 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556aef1add70 con 0x556aef2caca0 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f0616ff5640 10 client.17268 handle_command_reply: tid=0 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 client.17268 shutdown 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 -- 172.21.15.60:0/543401154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 msgr2=0x556aef250450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef250450 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f062c055040 tx=0x7f062c005ef0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 -- 172.21.15.60:0/543401154 shutdown_connections 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x556aef2caca0 0x556aef2cd090 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556aef24b370 0x556aef250450 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556aef241b40 0x556aef2539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f0616ff5640 0 client.17268 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 --2- 172.21.15.60:0/543401154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556aef2405d0 0x556aef253480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 -- 172.21.15.60:0/543401154 >> 172.21.15.60:0/543401154 conn(0x556aef209310 msgr2=0x556aef249850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 -- 172.21.15.60:0/543401154 shutdown_connections 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 1 -- 172.21.15.60:0/543401154 wait complete. 2024-09-12T00:07:22.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.280+0000 7f063b90d740 20 client.17268 trim_cache size 0 max 16384 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 -- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f061c0a2d70 msgr2=0x7f061c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f061c0a2d70 0x7f061c0a5230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f062c006010 tx=0x7f062c031640 comp rx=0 tx=0).stop 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 -- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634103740 msgr2=0x7f0634198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634103740 0x7f0634198b30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f062800e9c0 tx=0x7f062800ee80 comp rx=0 tx=0).stop 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 -- 172.21.15.60:0/2962430686 shutdown_connections 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f061c0a2d70 0x7f061c0a5230 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0634108290 0x7f063419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0634103740 0x7f0634198b30 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 --2- 172.21.15.60:0/2962430686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0634102d90 0x7f06341985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 -- 172.21.15.60:0/2962430686 >> 172.21.15.60:0/2962430686 conn(0x7f06340fc7d0 msgr2=0x7f0634106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:22.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 -- 172.21.15.60:0/2962430686 shutdown_connections 2024-09-12T00:07:22.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:22.281+0000 7f0639534640 1 -- 172.21.15.60:0/2962430686 wait complete. 2024-09-12T00:07:23.056 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:07:23.316 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:23.336 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:23 smithi192 ceph-mon[35487]: pgmap v247: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:23.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:23 smithi060 ceph-mon[30953]: pgmap v247: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:23 smithi105 ceph-mon[34805]: pgmap v247: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:07:23.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 -- 172.21.15.60:0/1540422191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab410c180 msgr2=0x7f0ab410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 --2- 172.21.15.60:0/1540422191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab410c180 0x7f0ab410e600 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009ca0 tx=0x7f0aac02a950 comp rx=0 tx=0).stop 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 -- 172.21.15.60:0/1540422191 shutdown_connections 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 --2- 172.21.15.60:0/1540422191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab410c180 0x7f0ab410e600 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 --2- 172.21.15.60:0/1540422191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ab41036c0 0x7f0ab410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 --2- 172.21.15.60:0/1540422191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ab4102da0 0x7f0ab4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 -- 172.21.15.60:0/1540422191 >> 172.21.15.60:0/1540422191 conn(0x7f0ab40fc7a0 msgr2=0x7f0ab40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 -- 172.21.15.60:0/1540422191 shutdown_connections 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.880+0000 7f0abc799640 1 -- 172.21.15.60:0/1540422191 wait complete. 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abc799640 1 Processor -- start 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abc799640 1 -- start start 2024-09-12T00:07:23.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abc799640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ab4102da0 0x7f0ab4100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abc799640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab41036c0 0x7f0ab4100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abc799640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ab410c180 0x7f0ab4101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abc799640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab4112080 con 0x7f0ab41036c0 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abc799640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab4111f00 con 0x7f0ab4102da0 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abc799640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab4112200 con 0x7f0ab410c180 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0ab9d34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab41036c0 0x7f0ab4100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0ab9d34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab41036c0 0x7f0ab4100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60898/0 (socket says 172.21.15.60:60898) 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0ab9d34640 1 -- 172.21.15.60:0/3463577979 learned_addr learned my addr 172.21.15.60:0/3463577979 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abad36640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ab410c180 0x7f0ab4101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0aba535640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ab4102da0 0x7f0ab4100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0ab9d34640 1 -- 172.21.15.60:0/3463577979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ab410c180 msgr2=0x7f0ab4101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0ab9d34640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ab410c180 0x7f0ab4101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0ab9d34640 1 -- 172.21.15.60:0/3463577979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ab4102da0 msgr2=0x7f0ab4100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0ab9d34640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ab4102da0 0x7f0ab4100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0ab9d34640 1 -- 172.21.15.60:0/3463577979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab41a6960 con 0x7f0ab41036c0 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.881+0000 7f0abad36640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ab410c180 0x7f0ab4101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.882+0000 7f0ab9d34640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab41036c0 0x7f0ab4100f40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400d770 tx=0x7f0aa400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.882+0000 7f0aab7fe640 1 -- 172.21.15.60:0/3463577979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4017070 con 0x7f0ab41036c0 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.882+0000 7f0aab7fe640 1 -- 172.21.15.60:0/3463577979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0aa4005520 con 0x7f0ab41036c0 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.882+0000 7f0abc799640 1 -- 172.21.15.60:0/3463577979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab41a6c50 con 0x7f0ab41036c0 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.882+0000 7f0aab7fe640 1 -- 172.21.15.60:0/3463577979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4010460 con 0x7f0ab41036c0 2024-09-12T00:07:23.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.882+0000 7f0abc799640 1 -- 172.21.15.60:0/3463577979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab41a7140 con 0x7f0ab41036c0 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.884+0000 7f0aab7fe640 1 -- 172.21.15.60:0/3463577979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0aa4004ea0 con 0x7f0ab41036c0 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.884+0000 7f0abeb72740 1 Processor -- start 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abeb72740 1 -- start start 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b2b40 0x55adca2b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0aab7fe640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0aa00a2cf0 0x7f0aa00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 0x55adca2be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abeb72740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55adca2172f0 con 0x55adca2b15d0 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abeb72740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55adca1becf0 con 0x55adca2b2b40 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abeb72740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55adca2132b0 con 0x55adca2bc370 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0ab9d34640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0aa00a2cf0 0x7f0aa00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b2b40 0x55adca2b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b2b40 0x55adca2b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:41972/0 (socket says 172.21.15.60:41972) 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 -- 172.21.15.60:0/1977511217 learned_addr learned my addr 172.21.15.60:0/1977511217 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0aab7fe640 1 -- 172.21.15.60:0/3463577979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f0aa40cef90 con 0x7f0ab41036c0 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0aba535640 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 0x55adca2be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 -- 172.21.15.60:0/1977511217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 msgr2=0x55adca2be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 0x55adca2be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 -- 172.21.15.60:0/1977511217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 msgr2=0x55adca2b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.885+0000 7f0abad36640 1 -- 172.21.15.60:0/1977511217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adca1a33a0 con 0x55adca2b2b40 2024-09-12T00:07:23.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.886+0000 7f0ab9d34640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0aa00a2cf0 0x7f0aa00a51b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0aa409b170 tx=0x7f0aa4090900 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.886+0000 7f0abad36640 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b2b40 0x55adca2b1090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55adca2b2070 tx=0x7f0aac004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef83012945a1d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.886+0000 7f0aa8ff9640 1 -- 172.21.15.60:0/1977511217 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac03d070 con 0x55adca2b2b40 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.886+0000 7f0aa8ff9640 1 -- 172.21.15.60:0/1977511217 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0aac02fc50 con 0x55adca2b2b40 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.886+0000 7f0aa8ff9640 1 -- 172.21.15.60:0/1977511217 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac034040 con 0x55adca2b2b40 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 -- 172.21.15.60:0/1977511217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b2b40 msgr2=0x55adca2b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b2b40 0x55adca2b1090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55adca2b2070 tx=0x7f0aac004a40 comp rx=0 tx=0).stop 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 -- 172.21.15.60:0/1977511217 shutdown_connections 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 0x55adca2be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 --2- 172.21.15.60:0/1977511217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b2b40 0x55adca2b1090 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 -- 172.21.15.60:0/1977511217 >> 172.21.15.60:0/1977511217 conn(0x55adca27a310 msgr2=0x55adca2adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 -- 172.21.15.60:0/1977511217 shutdown_connections 2024-09-12T00:07:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 -- 172.21.15.60:0/1977511217 wait complete. 2024-09-12T00:07:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 -- start start 2024-09-12T00:07:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.887+0000 7f0abeb72740 1 Processor -- start 2024-09-12T00:07:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b15d0 0x55adca2bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 0x55adca2b9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abeb72740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55adca2bf010 con 0x55adca2b2b40 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abeb72740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55adca1d2060 con 0x55adca2b15d0 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abeb72740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55adca2bf190 con 0x55adca2bc370 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abeb72740 10 client.0 _ll_register_callbacks cb 0x55adc9f258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2b9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60914/0 (socket says 172.21.15.60:60914) 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 -- 172.21.15.60:0/3671174937 learned_addr learned my addr 172.21.15.60:0/3671174937 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abad36640 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b15d0 0x55adca2bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abad36640 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 0x55adca2b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 -- 172.21.15.60:0/3671174937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 msgr2=0x55adca2b9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:23.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 0x55adca2b9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 -- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b15d0 msgr2=0x55adca2bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b15d0 0x55adca2bbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 -- 172.21.15.60:0/3671174937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adc9f883c0 con 0x55adca2b2b40 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0abad36640 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b15d0 0x55adca2bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0aba535640 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2b9030 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000be60 tx=0x7f0ab0012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848389e31d975816 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0a9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.888+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3671174937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0004230 con 0x55adca2b2b40 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3671174937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f0ab00043d0 con 0x55adca2b2b40 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 1 -- 172.21.15.60:0/3671174937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aac02fc50 con 0x55adca2b2b40 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3671174937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f0ab00106a0 con 0x55adca2b2b40 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 10 client.17280 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:23.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 1 -- 172.21.15.60:0/3671174937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55adca2cab70 con 0x55adca2b2b40 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3671174937 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0aac02fc50 con 0x55adca2b2b40 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3671174937 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f0ab0022070 con 0x55adca2b2b40 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 10 client.17280 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 10 client.17280 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 20 client.17280 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55adca2cc030 0x55adca2ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 4 client.17280 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abeb72740 1 -- 172.21.15.60:0/3671174937 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55adca224860 con 0x55adca2cc030 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.889+0000 7f0abad36640 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55adca2cc030 0x55adca2ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.890+0000 7f0abad36640 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55adca2cc030 0x55adca2ce490 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47af63c8f8c4033b server_cookie=e0ceb3f2c1d8d454 in_seq=0 out_seq=0 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.890+0000 7f0a9dffb640 10 client.17280 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:07:23.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.890+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3671174937 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55adca224860 con 0x55adca2cc030 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.890+0000 7f0a9dffb640 10 client.17280 handle_command_reply: tid=0 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.890+0000 7f0abeb72740 1 client.17280 shutdown 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 -- 172.21.15.60:0/3671174937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 msgr2=0x55adca2b9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2b9030 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000be60 tx=0x7f0ab0012820 comp rx=0 tx=0).stop 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 -- 172.21.15.60:0/3671174937 shutdown_connections 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55adca2cc030 0x55adca2ce490 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2bc370 0x55adca2b9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0a9dffb640 0 client.17280 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2b9030 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3671174937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2b15d0 0x55adca2bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 -- 172.21.15.60:0/3671174937 >> 172.21.15.60:0/3671174937 conn(0x55adca27a310 msgr2=0x55adca2b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:23.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 -- 172.21.15.60:0/3671174937 shutdown_connections 2024-09-12T00:07:23.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 1 -- 172.21.15.60:0/3671174937 wait complete. 2024-09-12T00:07:23.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.891+0000 7f0abeb72740 20 client.17280 trim_cache size 0 max 16384 2024-09-12T00:07:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0abeb72740 1 Processor -- start 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0abeb72740 1 -- start start 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b15d0 0x55adca2b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2bc370 0x55adca2ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0abeb72740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41afa80 con 0x55adca2b2b40 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0abeb72740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b15c0 con 0x55adca2bc370 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0abeb72740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b0150 con 0x55adca2b15d0 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0aba535640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0aba535640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60928/0 (socket says 172.21.15.60:60928) 2024-09-12T00:07:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.904+0000 7f0aba535640 1 -- 172.21.15.60:0/1802597451 learned_addr learned my addr 172.21.15.60:0/1802597451 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0aba535640 1 -- 172.21.15.60:0/1802597451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b15d0 msgr2=0x55adca2b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0aba535640 1 --2- 172.21.15.60:0/1802597451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b15d0 0x55adca2b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0aba535640 1 -- 172.21.15.60:0/1802597451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2bc370 msgr2=0x55adca2ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0aba535640 1 --2- 172.21.15.60:0/1802597451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2bc370 0x55adca2ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0aba535640 1 -- 172.21.15.60:0/1802597451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55adca2ae960 con 0x55adca2b2b40 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0aba535640 1 --2- 172.21.15.60:0/1802597451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2c82e0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0001eb0 tx=0x7f0ab00057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be81eb818d146a2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0a9ffff640 1 -- 172.21.15.60:0/1802597451 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0028040 con 0x55adca2b2b40 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0a9ffff640 1 -- 172.21.15.60:0/1802597451 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ab0005040 con 0x55adca2b2b40 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.905+0000 7f0a9ffff640 1 -- 172.21.15.60:0/1802597451 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0003a10 con 0x55adca2b2b40 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- 172.21.15.60:0/1802597451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 msgr2=0x55adca2c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 --2- 172.21.15.60:0/1802597451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2c82e0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0001eb0 tx=0x7f0ab00057d0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- 172.21.15.60:0/1802597451 shutdown_connections 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 --2- 172.21.15.60:0/1802597451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2bc370 0x55adca2ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 --2- 172.21.15.60:0/1802597451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b2b40 0x55adca2c82e0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 --2- 172.21.15.60:0/1802597451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b15d0 0x55adca2b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- 172.21.15.60:0/1802597451 >> 172.21.15.60:0/1802597451 conn(0x55adca27a310 msgr2=0x55adca2a8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- 172.21.15.60:0/1802597451 shutdown_connections 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- 172.21.15.60:0/1802597451 wait complete. 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- start start 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 Processor -- start 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b2b40 0x55adca2c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2bc370 0x55adca2bfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b0ef0 con 0x55adca2b15d0 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41b0820 con 0x55adca2bc370 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab41ada80 con 0x55adca2b2b40 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abeb72740 10 client.0 _ll_register_callbacks cb 0x7f0ab000b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.906+0000 7f0abad36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abad36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60930/0 (socket says 172.21.15.60:60930) 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abad36640 1 -- 172.21.15.60:0/3042384729 learned_addr learned my addr 172.21.15.60:0/3042384729 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abad36640 1 -- 172.21.15.60:0/3042384729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b2b40 msgr2=0x55adca2c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0aba535640 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b2b40 0x55adca2c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abad36640 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b2b40 0x55adca2c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abad36640 1 -- 172.21.15.60:0/3042384729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2bc370 msgr2=0x55adca2bfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abad36640 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2bc370 0x55adca2bfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abad36640 1 -- 172.21.15.60:0/3042384729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55adca2c02e0 con 0x55adca2b15d0 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0aba535640 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b2b40 0x55adca2c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abad36640 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2c4720 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0aac003ea0 tx=0x7f0aac009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5d19f40d32c0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0a9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3042384729 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac04f070 con 0x55adca2b15d0 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3042384729 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f0aac02f500 con 0x55adca2b15d0 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abeb72740 1 -- 172.21.15.60:0/3042384729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab0005040 con 0x55adca2b15d0 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3042384729 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f0aac034040 con 0x55adca2b15d0 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abeb72740 10 client.17286 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:23.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.907+0000 7f0abeb72740 1 -- 172.21.15.60:0/3042384729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55adca3368b0 con 0x55adca2b15d0 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3042384729 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0ab0005040 con 0x55adca2b15d0 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3042384729 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f0aac05a070 con 0x55adca2b15d0 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0abeb72740 10 client.17286 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0abeb72740 10 client.17286 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0abeb72740 20 client.17286 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55adca336b90 0x55adca338f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0abeb72740 4 client.17286 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0abeb72740 1 -- 172.21.15.60:0/3042384729 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55adca21ed70 con 0x55adca336b90 2024-09-12T00:07:23.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0aba535640 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55adca336b90 0x55adca338f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0a9dffb640 10 client.17286 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.908+0000 7f0aba535640 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55adca336b90 0x55adca338f80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b31b7c365684902a server_cookie=46cb4b4e7e669d in_seq=0 out_seq=0 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0a9dffb640 1 -- 172.21.15.60:0/3042384729 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55adca21ed70 con 0x55adca336b90 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0a9dffb640 10 client.17286 handle_command_reply: tid=0 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 client.17286 shutdown 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 -- 172.21.15.60:0/3042384729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 msgr2=0x55adca2c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2c4720 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0aac003ea0 tx=0x7f0aac009970 comp rx=0 tx=0).stop 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 -- 172.21.15.60:0/3042384729 shutdown_connections 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55adca336b90 0x55adca338f80 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55adca2bc370 0x55adca2bfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55adca2b2b40 0x55adca2c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 --2- 172.21.15.60:0/3042384729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55adca2b15d0 0x55adca2c4720 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 -- 172.21.15.60:0/3042384729 >> 172.21.15.60:0/3042384729 conn(0x55adca27a310 msgr2=0x55adca2ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:23.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0a9dffb640 0 client.17286 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:07:23.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 -- 172.21.15.60:0/3042384729 shutdown_connections 2024-09-12T00:07:23.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 1 -- 172.21.15.60:0/3042384729 wait complete. 2024-09-12T00:07:23.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.909+0000 7f0abeb72740 20 client.17286 trim_cache size 0 max 16384 2024-09-12T00:07:23.923 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 -- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0aa00a2cf0 msgr2=0x7f0aa00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0aa00a2cf0 0x7f0aa00a51b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0aa409b170 tx=0x7f0aa4090900 comp rx=0 tx=0).stop 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 -- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab41036c0 msgr2=0x7f0ab4100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab41036c0 0x7f0ab4100f40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400d770 tx=0x7f0aa400dc30 comp rx=0 tx=0).stop 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 -- 172.21.15.60:0/3463577979 shutdown_connections 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0aa00a2cf0 0x7f0aa00a51b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ab410c180 0x7f0ab4101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ab41036c0 0x7f0ab4100f40 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 --2- 172.21.15.60:0/3463577979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ab4102da0 0x7f0ab4100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:23.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 -- 172.21.15.60:0/3463577979 >> 172.21.15.60:0/3463577979 conn(0x7f0ab40fc7a0 msgr2=0x7f0ab40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 -- 172.21.15.60:0/3463577979 shutdown_connections 2024-09-12T00:07:23.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:23.910+0000 7f0abc799640 1 -- 172.21.15.60:0/3463577979 wait complete. 2024-09-12T00:07:24.581 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:07:24.837 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:25.226 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:25 smithi060 ceph-mon[30953]: pgmap v248: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 -- 172.21.15.60:0/2418794109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 msgr2=0x7f679810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 --2- 172.21.15.60:0/2418794109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 0x7f679810bb50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f6780009900 tx=0x7f678002a480 comp rx=0 tx=0).stop 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 -- 172.21.15.60:0/2418794109 shutdown_connections 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 --2- 172.21.15.60:0/2418794109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f679810c170 0x7f679810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 --2- 172.21.15.60:0/2418794109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 0x7f679810bb50 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 --2- 172.21.15.60:0/2418794109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6798102d40 0x7f6798103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 -- 172.21.15.60:0/2418794109 >> 172.21.15.60:0/2418794109 conn(0x7f67980fc7a0 msgr2=0x7f67980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 -- 172.21.15.60:0/2418794109 shutdown_connections 2024-09-12T00:07:25.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 -- 172.21.15.60:0/2418794109 wait complete. 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.433+0000 7f679ce67640 1 Processor -- start 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f679ce67640 1 -- start start 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f679ce67640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6798102d40 0x7f67981009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f679ce67640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 0x7f6798100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f679ce67640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679810c170 0x7f6798101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f679ce67640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6798112140 con 0x7f6798103660 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f679ce67640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6798111fc0 con 0x7f6798102d40 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f679ce67640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67981122c0 con 0x7f679810c170 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 0x7f6798100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 0x7f6798100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60938/0 (socket says 172.21.15.60:60938) 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 -- 172.21.15.60:0/2414106408 learned_addr learned my addr 172.21.15.60:0/2414106408 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f679659c640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6798102d40 0x7f67981009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f6796d9d640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679810c170 0x7f6798101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 -- 172.21.15.60:0/2414106408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679810c170 msgr2=0x7f6798101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679810c170 0x7f6798101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 -- 172.21.15.60:0/2414106408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6798102d40 msgr2=0x7f67981009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6798102d40 0x7f67981009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 -- 172.21.15.60:0/2414106408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67981a6a30 con 0x7f6798103660 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.434+0000 7f678ffff640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 0x7f6798100ee0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f678002aa70 tx=0x7f6780032a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.435+0000 7f678f7fe640 1 -- 172.21.15.60:0/2414106408 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678003f030 con 0x7f6798103660 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.435+0000 7f678f7fe640 1 -- 172.21.15.60:0/2414106408 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6780032e40 con 0x7f6798103660 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.435+0000 7f679ce67640 1 -- 172.21.15.60:0/2414106408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67981a6cc0 con 0x7f6798103660 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.435+0000 7f678f7fe640 1 -- 172.21.15.60:0/2414106408 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780035070 con 0x7f6798103660 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.435+0000 7f679ce67640 1 -- 172.21.15.60:0/2414106408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67981a71a0 con 0x7f6798103660 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f679f240740 1 Processor -- start 2024-09-12T00:07:25.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f679f240740 1 -- start start 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f678f7fe640 1 -- 172.21.15.60:0/2414106408 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6780042030 con 0x7f6798103660 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f679f240740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 0x5580b9b7e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f679f240740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b7ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f679f240740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b89370 0x5580b9b8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f679f240740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5580b9ae42f0 con 0x5580b9b89370 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f679f240740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5580b9a8bcf0 con 0x5580b9b7e5d0 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f679f240740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5580b9ae02b0 con 0x5580b9b7fb40 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b89370 0x5580b9b8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b89370 0x5580b9b8b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60952/0 (socket says 172.21.15.60:60952) 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f678ffff640 1 -- 172.21.15.60:0/1694553657 learned_addr learned my addr 172.21.15.60:0/1694553657 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.438+0000 7f6796d9d640 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 0x5580b9b7e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f679659c640 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b7ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678ffff640 1 -- 172.21.15.60:0/1694553657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 msgr2=0x5580b9b7e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678ffff640 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 0x5580b9b7e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678ffff640 1 -- 172.21.15.60:0/1694553657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 msgr2=0x5580b9b7ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678ffff640 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b7ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678ffff640 1 -- 172.21.15.60:0/1694553657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b9a703a0 con 0x5580b9b89370 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678f7fe640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67840a2cf0 0x7f67840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f6796d9d640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67840a2cf0 0x7f67840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678ffff640 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b89370 0x5580b9b8b760 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f67800eceb0 tx=0x7f67800f5cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f910524f58e1fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678f7fe640 1 -- 172.21.15.60:0/2414106408 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f67800ef7d0 con 0x7f6798103660 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678cff9640 1 -- 172.21.15.60:0/1694553657 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780049020 con 0x5580b9b89370 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678cff9640 1 -- 172.21.15.60:0/1694553657 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67800bc410 con 0x5580b9b89370 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.439+0000 7f678cff9640 1 -- 172.21.15.60:0/1694553657 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67800bbae0 con 0x5580b9b89370 2024-09-12T00:07:25.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 -- 172.21.15.60:0/1694553657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b89370 msgr2=0x5580b9b8b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b89370 0x5580b9b8b760 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f67800eceb0 tx=0x7f67800f5cd0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f6796d9d640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67840a2cf0 0x7f67840a51b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f679000b4d0 tx=0x7f679000e040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 -- 172.21.15.60:0/1694553657 shutdown_connections 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b89370 0x5580b9b8b760 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b7ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 --2- 172.21.15.60:0/1694553657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 0x5580b9b7e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 -- 172.21.15.60:0/1694553657 >> 172.21.15.60:0/1694553657 conn(0x5580b9b47310 msgr2=0x5580b9b7ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 -- 172.21.15.60:0/1694553657 shutdown_connections 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.440+0000 7f679f240740 1 -- 172.21.15.60:0/1694553657 wait complete. 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 1 -- start start 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 1 Processor -- start 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b88d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b86030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b86640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5580b9b8be30 con 0x5580b9b7fb40 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5580b9a9f060 con 0x5580b9b7e5d0 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5580b9b8bfb0 con 0x5580b9b89370 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679f240740 10 client.0 _ll_register_callbacks cb 0x5580b97f28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b86030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b86030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60962/0 (socket says 172.21.15.60:60962) 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f678ffff640 1 -- 172.21.15.60:0/3051668957 learned_addr learned my addr 172.21.15.60:0/3051668957 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f6796d9d640 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b86640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f679659c640 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b88d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.441+0000 7f678ffff640 1 -- 172.21.15.60:0/3051668957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 msgr2=0x5580b9b86640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f678ffff640 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b86640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f678ffff640 1 -- 172.21.15.60:0/3051668957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 msgr2=0x5580b9b88d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f678ffff640 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b88d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f678ffff640 1 -- 172.21.15.60:0/3051668957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b98553c0 con 0x5580b9b7fb40 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f678ffff640 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b86030 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f67800f51b0 tx=0x7f6780049fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a59fe510b284947 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f677dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f677dffb640 1 -- 172.21.15.60:0/3051668957 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780049050 con 0x5580b9b7fb40 2024-09-12T00:07:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f677dffb640 1 -- 172.21.15.60:0/3051668957 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f67800b8380 con 0x5580b9b7fb40 2024-09-12T00:07:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 1 -- 172.21.15.60:0/3051668957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67800bc410 con 0x5580b9b7fb40 2024-09-12T00:07:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f677dffb640 1 -- 172.21.15.60:0/3051668957 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f67800bb670 con 0x5580b9b7fb40 2024-09-12T00:07:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 10 client.17298 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 1 -- 172.21.15.60:0/3051668957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5580b9b8be30 con 0x5580b9b7fb40 2024-09-12T00:07:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f677dffb640 1 -- 172.21.15.60:0/3051668957 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67800bc410 con 0x5580b9b7fb40 2024-09-12T00:07:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f677dffb640 1 -- 172.21.15.60:0/3051668957 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f67800ed1c0 con 0x5580b9b7fb40 2024-09-12T00:07:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 10 client.17298 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 20 client.17298 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5580b9b98a00 0x5580b9b9adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 4 client.17298 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.442+0000 7f679f240740 1 -- 172.21.15.60:0/3051668957 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580b9af1860 con 0x5580b9b98a00 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.443+0000 7f679659c640 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5580b9b98a00 0x5580b9b9adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.443+0000 7f679659c640 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5580b9b98a00 0x5580b9b9adf0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75154948bca94a72 server_cookie=3e5f9fdcf6731029 in_seq=0 out_seq=0 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.443+0000 7f677dffb640 10 client.17298 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f677dffb640 1 -- 172.21.15.60:0/3051668957 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5580b9af1860 con 0x5580b9b98a00 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f677dffb640 10 client.17298 handle_command_reply: tid=0 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 client.17298 shutdown 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 -- 172.21.15.60:0/3051668957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 msgr2=0x5580b9b86030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b86030 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f67800f51b0 tx=0x7f6780049fa0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 -- 172.21.15.60:0/3051668957 shutdown_connections 2024-09-12T00:07:25.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5580b9b98a00 0x5580b9b9adf0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b86640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b86030 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f677dffb640 0 client.17298 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:25.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 --2- 172.21.15.60:0/3051668957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b88d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 -- 172.21.15.60:0/3051668957 >> 172.21.15.60:0/3051668957 conn(0x5580b9b47310 msgr2=0x5580b9b80960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:25.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 -- 172.21.15.60:0/3051668957 shutdown_connections 2024-09-12T00:07:25.477 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:25.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 1 -- 172.21.15.60:0/3051668957 wait complete. 2024-09-12T00:07:25.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.444+0000 7f679f240740 20 client.17298 trim_cache size 0 max 16384 2024-09-12T00:07:25.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.457+0000 7f679f240740 1 Processor -- start 2024-09-12T00:07:25.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.457+0000 7f679f240740 1 -- start start 2024-09-12T00:07:25.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f679f240740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b79bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f679f240740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b81120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f679f240740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b81660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f679f240740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67981afb00 con 0x5580b9b7fb40 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f679f240740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b1640 con 0x5580b9b7e5d0 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f679f240740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b01d0 con 0x5580b9b89370 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b81120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b81120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60978/0 (socket says 172.21.15.60:60978) 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 -- 172.21.15.60:0/471909607 learned_addr learned my addr 172.21.15.60:0/471909607 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f679659c640 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b79bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f6796d9d640 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b81660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 -- 172.21.15.60:0/471909607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 msgr2=0x5580b9b81660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b81660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 -- 172.21.15.60:0/471909607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 msgr2=0x5580b9b79bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:25.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b79bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 -- 172.21.15.60:0/471909607 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b9b869b0 con 0x5580b9b7fb40 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f6796d9d640 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b81660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f678ffff640 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b81120 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f67800bba10 tx=0x7f67800ba220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f3c306e143ffad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f677ffff640 1 -- 172.21.15.60:0/471909607 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780049070 con 0x5580b9b7fb40 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f677ffff640 1 -- 172.21.15.60:0/471909607 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67800bc410 con 0x5580b9b7fb40 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.458+0000 7f677ffff640 1 -- 172.21.15.60:0/471909607 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67800bb850 con 0x5580b9b7fb40 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 -- 172.21.15.60:0/471909607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 msgr2=0x5580b9b81120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b81120 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f67800bba10 tx=0x7f67800ba220 comp rx=0 tx=0).stop 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 -- 172.21.15.60:0/471909607 shutdown_connections 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b89370 0x5580b9b81660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7fb40 0x5580b9b81120 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 --2- 172.21.15.60:0/471909607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b7e5d0 0x5580b9b79bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 -- 172.21.15.60:0/471909607 >> 172.21.15.60:0/471909607 conn(0x5580b9b47310 msgr2=0x5580b9b794e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 -- 172.21.15.60:0/471909607 shutdown_connections 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 -- 172.21.15.60:0/471909607 wait complete. 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.459+0000 7f679f240740 1 -- start start 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679f240740 1 Processor -- start 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679f240740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7e5d0 0x5580b9bfb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679f240740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 0x5580b9bfbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679f240740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b89370 0x5580b9b90e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679f240740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b0f70 con 0x5580b9b7e5d0 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679f240740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67981b08a0 con 0x5580b9b89370 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679f240740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67981adb00 con 0x5580b9b7fb40 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679f240740 10 client.0 _ll_register_callbacks cb 0x7f678800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7e5d0 0x5580b9bfb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7e5d0 0x5580b9bfb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60984/0 (socket says 172.21.15.60:60984) 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 -- 172.21.15.60:0/237371193 learned_addr learned my addr 172.21.15.60:0/237371193 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f678ffff640 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 0x5580b9bfbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f6796d9d640 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b89370 0x5580b9b90e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 -- 172.21.15.60:0/237371193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 msgr2=0x5580b9bfbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 0x5580b9bfbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 -- 172.21.15.60:0/237371193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b89370 msgr2=0x5580b9b90e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b89370 0x5580b9b90e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 -- 172.21.15.60:0/237371193 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b9b91500 con 0x5580b9b7e5d0 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f6796d9d640 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b89370 0x5580b9b90e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f679659c640 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7e5d0 0x5580b9bfb680 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x5580b9b9b450 tx=0x7f678800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c737b21f164aeb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.460+0000 7f677dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f677dffb640 1 -- 172.21.15.60:0/237371193 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788005020 con 0x5580b9b7e5d0 2024-09-12T00:07:25.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f677dffb640 1 -- 172.21.15.60:0/237371193 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f67880051c0 con 0x5580b9b7e5d0 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 1 -- 172.21.15.60:0/237371193 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67800bc410 con 0x5580b9b7e5d0 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f677dffb640 1 -- 172.21.15.60:0/237371193 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f67880053c0 con 0x5580b9b7e5d0 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 10 client.17304 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 1 -- 172.21.15.60:0/237371193 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5580b9c02e80 con 0x5580b9b7e5d0 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f677dffb640 1 -- 172.21.15.60:0/237371193 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67800bc410 con 0x5580b9b7e5d0 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f677dffb640 1 -- 172.21.15.60:0/237371193 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f67880268a0 con 0x5580b9b7e5d0 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 10 client.17304 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 20 client.17304 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5580b9c035b0 0x5580b9c059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 4 client.17304 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f679f240740 1 -- 172.21.15.60:0/237371193 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5580b9aebd70 con 0x5580b9c035b0 2024-09-12T00:07:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.461+0000 7f678ffff640 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5580b9c035b0 0x5580b9c059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f678ffff640 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5580b9c035b0 0x5580b9c059d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d72ad5e71df41bd server_cookie=d54ae3fefa54cffc in_seq=0 out_seq=0 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f677dffb640 10 client.17304 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f677dffb640 1 -- 172.21.15.60:0/237371193 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5580b9aebd70 con 0x5580b9c035b0 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f677dffb640 10 client.17304 handle_command_reply: tid=0 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 client.17304 shutdown 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 -- 172.21.15.60:0/237371193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7e5d0 msgr2=0x5580b9bfb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7e5d0 0x5580b9bfb680 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x5580b9b9b450 tx=0x7f678800bf90 comp rx=0 tx=0).stop 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 -- 172.21.15.60:0/237371193 shutdown_connections 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5580b9c035b0 0x5580b9c059d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5580b9b89370 0x5580b9b90e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5580b9b7fb40 0x5580b9bfbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f677dffb640 0 client.17304 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 --2- 172.21.15.60:0/237371193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5580b9b7e5d0 0x5580b9bfb680 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 -- 172.21.15.60:0/237371193 >> 172.21.15.60:0/237371193 conn(0x5580b9b47310 msgr2=0x5580b9b880b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 -- 172.21.15.60:0/237371193 shutdown_connections 2024-09-12T00:07:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 1 -- 172.21.15.60:0/237371193 wait complete. 2024-09-12T00:07:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.462+0000 7f679f240740 20 client.17304 trim_cache size 0 max 16384 2024-09-12T00:07:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 -- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67840a2cf0 msgr2=0x7f67840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67840a2cf0 0x7f67840a51b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f679000b4d0 tx=0x7f679000e040 comp rx=0 tx=0).stop 2024-09-12T00:07:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 -- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 msgr2=0x7f6798100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 0x7f6798100ee0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f678002aa70 tx=0x7f6780032a40 comp rx=0 tx=0).stop 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 -- 172.21.15.60:0/2414106408 shutdown_connections 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67840a2cf0 0x7f67840a51b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679810c170 0x7f6798101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6798103660 0x7f6798100ee0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 --2- 172.21.15.60:0/2414106408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6798102d40 0x7f67981009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 -- 172.21.15.60:0/2414106408 >> 172.21.15.60:0/2414106408 conn(0x7f67980fc7a0 msgr2=0x7f67980fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 -- 172.21.15.60:0/2414106408 shutdown_connections 2024-09-12T00:07:25.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:25.463+0000 7f679ce67640 1 -- 172.21.15.60:0/2414106408 wait complete. 2024-09-12T00:07:25.486 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:25 smithi105 ceph-mon[34805]: pgmap v248: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:07:25.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:25 smithi192 ceph-mon[35487]: pgmap v248: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:07:27.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:27 smithi060 ceph-mon[30953]: pgmap v249: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:07:27.462 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:07:27.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:07:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:27 smithi105 ceph-mon[34805]: pgmap v249: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:07:27.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:27 smithi192 ceph-mon[35487]: pgmap v249: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:07:27.734 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.222+0000 7fae1b880640 1 -- 172.21.15.60:0/589422292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14101de0 msgr2=0x7fae141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.222+0000 7fae1b880640 1 --2- 172.21.15.60:0/589422292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14101de0 0x7fae141021c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fae10009900 tx=0x7fae1002a410 comp rx=0 tx=0).stop 2024-09-12T00:07:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.223+0000 7fae1b880640 1 -- 172.21.15.60:0/589422292 shutdown_connections 2024-09-12T00:07:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.223+0000 7fae1b880640 1 --2- 172.21.15.60:0/589422292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae14106f10 0x7fae1410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.223+0000 7fae1b880640 1 --2- 172.21.15.60:0/589422292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae14102790 0x7fae141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.223+0000 7fae1b880640 1 --2- 172.21.15.60:0/589422292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14101de0 0x7fae141021c0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.223+0000 7fae1b880640 1 -- 172.21.15.60:0/589422292 >> 172.21.15.60:0/589422292 conn(0x7fae140fd8c0 msgr2=0x7fae140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.223+0000 7fae1b880640 1 -- 172.21.15.60:0/589422292 shutdown_connections 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.223+0000 7fae1b880640 1 -- 172.21.15.60:0/589422292 wait complete. 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.223+0000 7fae1b880640 1 Processor -- start 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae1b880640 1 -- start start 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae1b880640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae14101de0 0x7fae14198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae1b880640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14102790 0x7fae14198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae1b880640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae14106f10 0x7fae1419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae1b880640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fae14112090 con 0x7fae14102790 2024-09-12T00:07:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae1b880640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fae14111f10 con 0x7fae14106f10 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae1b880640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae14112210 con 0x7fae14101de0 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae18e1b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14102790 0x7fae14198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae18e1b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14102790 0x7fae14198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32774/0 (socket says 172.21.15.60:32774) 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae18e1b640 1 -- 172.21.15.60:0/601681322 learned_addr learned my addr 172.21.15.60:0/601681322 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae1961c640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae14101de0 0x7fae14198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae19e1d640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae14106f10 0x7fae1419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae18e1b640 1 -- 172.21.15.60:0/601681322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae14101de0 msgr2=0x7fae14198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae18e1b640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae14101de0 0x7fae14198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae18e1b640 1 -- 172.21.15.60:0/601681322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae14106f10 msgr2=0x7fae1419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae18e1b640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae14106f10 0x7fae1419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.224+0000 7fae18e1b640 1 -- 172.21.15.60:0/601681322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1419d4c0 con 0x7fae14102790 2024-09-12T00:07:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.225+0000 7fae18e1b640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14102790 0x7fae14198a50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c970 tx=0x7fae0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.225+0000 7fae0a7fc640 1 -- 172.21.15.60:0/601681322 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04007bb0 con 0x7fae14102790 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.225+0000 7fae0a7fc640 1 -- 172.21.15.60:0/601681322 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae04007d50 con 0x7fae14102790 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.225+0000 7fae0a7fc640 1 -- 172.21.15.60:0/601681322 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400f4b0 con 0x7fae14102790 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.225+0000 7fae1b880640 1 -- 172.21.15.60:0/601681322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1419d7b0 con 0x7fae14102790 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.225+0000 7fae1b880640 1 -- 172.21.15.60:0/601681322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae141a5090 con 0x7fae14102790 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae0a7fc640 1 -- 172.21.15.60:0/601681322 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fae040046c0 con 0x7fae14102790 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae1dc59740 1 Processor -- start 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae1dc59740 1 -- start start 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a09be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0aac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae1dc59740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562b8a001280 con 0x562b8a09ba60 2024-09-12T00:07:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae1dc59740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562b89fa8b10 con 0x562b8a0ab150 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.228+0000 7fae1dc59740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562b89ffd240 con 0x562b8a09c380 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a09be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a09be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32784/0 (socket says 172.21.15.60:32784) 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 -- 172.21.15.60:0/4106771276 learned_addr learned my addr 172.21.15.60:0/4106771276 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae1961c640 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae18e1b640 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 -- 172.21.15.60:0/4106771276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 msgr2=0x562b8a0aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 -- 172.21.15.60:0/4106771276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 msgr2=0x562b8a0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 -- 172.21.15.60:0/4106771276 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b89fb51f0 con 0x562b8a09ba60 2024-09-12T00:07:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae18e1b640 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae0a7fc640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fae000a2d70 0x7fae000a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae19e1d640 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a09be40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009f20 tx=0x7fae0c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a54dda90a1a130 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae1961c640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fae000a2d70 0x7fae000a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fae0a7fc640 1 -- 172.21.15.60:0/601681322 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fae040cf120 con 0x7fae14102790 2024-09-12T00:07:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.229+0000 7fadff7fe640 1 -- 172.21.15.60:0/4106771276 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c015070 con 0x562b8a09ba60 2024-09-12T00:07:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fadff7fe640 1 -- 172.21.15.60:0/4106771276 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae0c01ab60 con 0x562b8a09ba60 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fadff7fe640 1 -- 172.21.15.60:0/4106771276 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c011cc0 con 0x562b8a09ba60 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 -- 172.21.15.60:0/4106771276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 msgr2=0x562b8a09be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1961c640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fae000a2d70 0x7fae000a5230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae10009230 tx=0x7fae100058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a09be40 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009f20 tx=0x7fae0c00f730 comp rx=0 tx=0).stop 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 -- 172.21.15.60:0/4106771276 shutdown_connections 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 --2- 172.21.15.60:0/4106771276 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a09be40 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 -- 172.21.15.60:0/4106771276 >> 172.21.15.60:0/4106771276 conn(0x562b8a0980f0 msgr2=0x562b8a0984d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 -- 172.21.15.60:0/4106771276 shutdown_connections 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.230+0000 7fae1dc59740 1 -- 172.21.15.60:0/4106771276 wait complete. 2024-09-12T00:07:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 1 -- start start 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 1 Processor -- start 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 0x562b8a0a8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a0ab150 0x562b8a0a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562b8a0add80 con 0x562b8a0ab150 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562b89fbbf10 con 0x562b8a09ba60 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562b8a0adf00 con 0x562b8a09c380 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae1dc59740 10 client.0 _ll_register_callbacks cb 0x562b89f84a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae19e1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a0ab150 0x562b8a0a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae19e1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a0ab150 0x562b8a0a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32790/0 (socket says 172.21.15.60:32790) 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae19e1d640 1 -- 172.21.15.60:0/495603077 learned_addr learned my addr 172.21.15.60:0/495603077 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.231+0000 7fae18e1b640 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae1961c640 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 0x562b8a0a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae19e1d640 1 -- 172.21.15.60:0/495603077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 msgr2=0x562b8a0a8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae19e1d640 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae19e1d640 1 -- 172.21.15.60:0/495603077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 msgr2=0x562b8a0a8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae19e1d640 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 0x562b8a0a8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae19e1d640 1 -- 172.21.15.60:0/495603077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b89d726a0 con 0x562b8a0ab150 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae19e1d640 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a0ab150 0x562b8a0a8ad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fae0c011670 tx=0x7fae0c0116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850afbcc140880fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fadfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fadfcff9640 1 -- 172.21.15.60:0/495603077 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c028060 con 0x562b8a0ab150 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fadfcff9640 1 -- 172.21.15.60:0/495603077 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fae0c011c50 con 0x562b8a0ab150 2024-09-12T00:07:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae1dc59740 1 -- 172.21.15.60:0/495603077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae0c01ab60 con 0x562b8a0ab150 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fadfcff9640 1 -- 172.21.15.60:0/495603077 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fae0c015070 con 0x562b8a0ab150 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae1dc59740 10 client.17316 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fae1dc59740 1 -- 172.21.15.60:0/495603077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x562b8a0b9960 con 0x562b8a0ab150 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.232+0000 7fadfcff9640 1 -- 172.21.15.60:0/495603077 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae0c01ab60 con 0x562b8a0ab150 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fadfcff9640 1 -- 172.21.15.60:0/495603077 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fae0c005120 con 0x562b8a0ab150 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fae1dc59740 10 client.17316 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fae1dc59740 10 client.17316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fae1dc59740 20 client.17316 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fae1dc59740 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562b8a0bad00 0x562b8a0bd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fae1dc59740 4 client.17316 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fae1dc59740 1 -- 172.21.15.60:0/495603077 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b8a00e7f0 con 0x562b8a0bad00 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fae1961c640 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562b8a0bad00 0x562b8a0bd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fae1961c640 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562b8a0bad00 0x562b8a0bd0f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98172551cecc2741 server_cookie=3f6d479e413d93ad in_seq=0 out_seq=0 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.233+0000 7fadfcff9640 10 client.17316 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fadfcff9640 1 -- 172.21.15.60:0/495603077 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b8a00e7f0 con 0x562b8a0bad00 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fadfcff9640 10 client.17316 handle_command_reply: tid=0 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 client.17316 shutdown 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 -- 172.21.15.60:0/495603077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a0ab150 msgr2=0x562b8a0a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a0ab150 0x562b8a0a8ad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fae0c011670 tx=0x7fae0c0116a0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 -- 172.21.15.60:0/495603077 shutdown_connections 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562b8a0bad00 0x562b8a0bd0f0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a0ab150 0x562b8a0a8ad0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 --2- 172.21.15.60:0/495603077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 0x562b8a0a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fadfcff9640 0 client.17316 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.234+0000 7fae1dc59740 1 -- 172.21.15.60:0/495603077 >> 172.21.15.60:0/495603077 conn(0x562b8a0980f0 msgr2=0x562b8a09de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.235+0000 7fae1dc59740 1 -- 172.21.15.60:0/495603077 shutdown_connections 2024-09-12T00:07:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.235+0000 7fae1dc59740 1 -- 172.21.15.60:0/495603077 wait complete. 2024-09-12T00:07:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.235+0000 7fae1dc59740 20 client.17316 trim_cache size 0 max 16384 2024-09-12T00:07:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1dc59740 1 Processor -- start 2024-09-12T00:07:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1dc59740 1 -- start start 2024-09-12T00:07:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a0aa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0c2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1dc59740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fae141ab670 con 0x562b8a09ba60 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1dc59740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fae141ad1b0 con 0x562b8a0ab150 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1dc59740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae141abd40 con 0x562b8a09c380 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1961c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a0aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1961c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a0aa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32806/0 (socket says 172.21.15.60:32806) 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.252+0000 7fae1961c640 1 -- 172.21.15.60:0/833648014 learned_addr learned my addr 172.21.15.60:0/833648014 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae18e1b640 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae19e1d640 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae1961c640 1 -- 172.21.15.60:0/833648014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 msgr2=0x562b8a0a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae1961c640 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae1961c640 1 -- 172.21.15.60:0/833648014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 msgr2=0x562b8a0c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae1961c640 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae1961c640 1 -- 172.21.15.60:0/833648014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b8a097f20 con 0x562b8a09ba60 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae18e1b640 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae19e1d640 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fae1961c640 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a0aa270 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fae10004150 tx=0x7fae1003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd023eabc8bbf761 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fadfeffd640 1 -- 172.21.15.60:0/833648014 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10035040 con 0x562b8a09ba60 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fadfeffd640 1 -- 172.21.15.60:0/833648014 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae10003cf0 con 0x562b8a09ba60 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.253+0000 7fadfeffd640 1 -- 172.21.15.60:0/833648014 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1003dcb0 con 0x562b8a09ba60 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 -- 172.21.15.60:0/833648014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 msgr2=0x562b8a0aa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a0aa270 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fae10004150 tx=0x7fae1003f000 comp rx=0 tx=0).stop 2024-09-12T00:07:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 -- 172.21.15.60:0/833648014 shutdown_connections 2024-09-12T00:07:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a0ab150 0x562b8a0c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a09c380 0x562b8a0a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 --2- 172.21.15.60:0/833648014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09ba60 0x562b8a0aa270 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 -- 172.21.15.60:0/833648014 >> 172.21.15.60:0/833648014 conn(0x562b8a0980f0 msgr2=0x562b8a0a7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:28.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 -- 172.21.15.60:0/833648014 shutdown_connections 2024-09-12T00:07:28.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 -- 172.21.15.60:0/833648014 wait complete. 2024-09-12T00:07:28.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 -- start start 2024-09-12T00:07:28.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.254+0000 7fae1dc59740 1 Processor -- start 2024-09-12T00:07:28.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 0x562b8a0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09c380 0x562b8a0aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae1dc59740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a0ab150 0x562b8a0af190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae1dc59740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fae141acae0 con 0x562b8a09c380 2024-09-12T00:07:28.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae1dc59740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fae141ac410 con 0x562b8a09ba60 2024-09-12T00:07:28.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae1dc59740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae141a9670 con 0x562b8a0ab150 2024-09-12T00:07:28.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae1dc59740 10 client.0 _ll_register_callbacks cb 0x7fae0c009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:28.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09c380 0x562b8a0aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09c380 0x562b8a0aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32814/0 (socket says 172.21.15.60:32814) 2024-09-12T00:07:28.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 -- 172.21.15.60:0/2037754987 learned_addr learned my addr 172.21.15.60:0/2037754987 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:28.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae1961c640 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 0x562b8a0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae19e1d640 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a0ab150 0x562b8a0af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 -- 172.21.15.60:0/2037754987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a0ab150 msgr2=0x562b8a0af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:28.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a0ab150 0x562b8a0af190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 -- 172.21.15.60:0/2037754987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 msgr2=0x562b8a0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:28.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 0x562b8a0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 -- 172.21.15.60:0/2037754987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b8a0af990 con 0x562b8a09c380 2024-09-12T00:07:28.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fae18e1b640 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09c380 0x562b8a0aec50 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fae04098050 tx=0x7fae0409b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5c0ba8e2942dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.255+0000 7fadfcff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fadfcff9640 1 -- 172.21.15.60:0/2037754987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0401d040 con 0x562b8a09c380 2024-09-12T00:07:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fadfcff9640 1 -- 172.21.15.60:0/2037754987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fae04084dc0 con 0x562b8a09c380 2024-09-12T00:07:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 1 -- 172.21.15.60:0/2037754987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae10003cf0 con 0x562b8a09c380 2024-09-12T00:07:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fadfcff9640 1 -- 172.21.15.60:0/2037754987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fae040ccd40 con 0x562b8a09c380 2024-09-12T00:07:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 10 client.17322 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 1 -- 172.21.15.60:0/2037754987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x562b8a125730 con 0x562b8a09c380 2024-09-12T00:07:28.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fadfcff9640 1 -- 172.21.15.60:0/2037754987 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae10003cf0 con 0x562b8a09c380 2024-09-12T00:07:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fadfcff9640 1 -- 172.21.15.60:0/2037754987 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fae040afcc0 con 0x562b8a09c380 2024-09-12T00:07:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 10 client.17322 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 10 client.17322 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 20 client.17322 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562b8a125e60 0x562b8a128280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 4 client.17322 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:07:28.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.256+0000 7fae1dc59740 1 -- 172.21.15.60:0/2037754987 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562b8a008d00 con 0x562b8a125e60 2024-09-12T00:07:28.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.257+0000 7fae1961c640 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562b8a125e60 0x562b8a128280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:28.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.257+0000 7fadfcff9640 10 client.17322 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:28.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.257+0000 7fae1961c640 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562b8a125e60 0x562b8a128280 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cb32bf01b473486 server_cookie=62b259cb4b828329 in_seq=0 out_seq=0 2024-09-12T00:07:28.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fadfcff9640 1 -- 172.21.15.60:0/2037754987 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562b8a008d00 con 0x562b8a125e60 2024-09-12T00:07:28.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fadfcff9640 10 client.17322 handle_command_reply: tid=0 2024-09-12T00:07:28.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 client.17322 shutdown 2024-09-12T00:07:28.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 -- 172.21.15.60:0/2037754987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09c380 msgr2=0x562b8a0aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09c380 0x562b8a0aec50 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fae04098050 tx=0x7fae0409b450 comp rx=0 tx=0).stop 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 -- 172.21.15.60:0/2037754987 shutdown_connections 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x562b8a125e60 0x562b8a128280 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562b8a0ab150 0x562b8a0af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562b8a09c380 0x562b8a0aec50 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 --2- 172.21.15.60:0/2037754987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562b8a09ba60 0x562b8a0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fadfcff9640 0 client.17322 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.258+0000 7fae1dc59740 1 -- 172.21.15.60:0/2037754987 >> 172.21.15.60:0/2037754987 conn(0x562b8a0980f0 msgr2=0x562b8a0a67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:28.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1dc59740 1 -- 172.21.15.60:0/2037754987 shutdown_connections 2024-09-12T00:07:28.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1dc59740 1 -- 172.21.15.60:0/2037754987 wait complete. 2024-09-12T00:07:28.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1dc59740 20 client.17322 trim_cache size 0 max 16384 2024-09-12T00:07:28.269 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:07:28.269 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:07:28.269 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "a145ae41-389d-4a3f-b989-2ad2760e27c5", 2024-09-12T00:07:28.270 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:07:28.270 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:07:28.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 -- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fae000a2d70 msgr2=0x7fae000a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fae000a2d70 0x7fae000a5230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae10009230 tx=0x7fae100058d0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 -- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14102790 msgr2=0x7fae14198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:28.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14102790 0x7fae14198a50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c970 tx=0x7fae0400ce30 comp rx=0 tx=0).stop 2024-09-12T00:07:28.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 -- 172.21.15.60:0/601681322 shutdown_connections 2024-09-12T00:07:28.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fae000a2d70 0x7fae000a5230 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae14106f10 0x7fae1419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae14102790 0x7fae14198a50 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 --2- 172.21.15.60:0/601681322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae14101de0 0x7fae14198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:28.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 -- 172.21.15.60:0/601681322 >> 172.21.15.60:0/601681322 conn(0x7fae140fd8c0 msgr2=0x7fae140febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:28.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 -- 172.21.15.60:0/601681322 shutdown_connections 2024-09-12T00:07:28.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:28.259+0000 7fae1b880640 1 -- 172.21.15.60:0/601681322 wait complete. 2024-09-12T00:07:29.148 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:29 smithi060 ceph-mon[30953]: pgmap v250: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T00:07:29.149 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:29 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:07:29.149 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:29 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:29.149 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:29 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:07:29.149 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:29 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:29.149 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:29 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:07:29.150 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:07:29.408 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:29 smithi105 ceph-mon[34805]: pgmap v250: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T00:07:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:29 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:07:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:29 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:29 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:07:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:29 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:29 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:07:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:29 smithi192 ceph-mon[35487]: pgmap v250: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T00:07:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:29 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:07:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:29 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:29 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:07:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:29 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:29 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:07:29.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 -- 172.21.15.60:0/1599441925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 msgr2=0x7f74341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 --2- 172.21.15.60:0/1599441925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 0x7f74341067e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7428009900 tx=0x7f742802a410 comp rx=0 tx=0).stop 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 -- 172.21.15.60:0/1599441925 shutdown_connections 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 --2- 172.21.15.60:0/1599441925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7434106f10 0x7f743410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 --2- 172.21.15.60:0/1599441925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 0x7f74341067e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 --2- 172.21.15.60:0/1599441925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7434101de0 0x7f74341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 -- 172.21.15.60:0/1599441925 >> 172.21.15.60:0/1599441925 conn(0x7f74340fd8c0 msgr2=0x7f74340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 -- 172.21.15.60:0/1599441925 shutdown_connections 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 -- 172.21.15.60:0/1599441925 wait complete. 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 Processor -- start 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.865+0000 7f743ab06640 1 -- start start 2024-09-12T00:07:29.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f743ab06640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7434101de0 0x7f7434198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f743ab06640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 0x7f74341989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f743ab06640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7434106f10 0x7f743419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f743ab06640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7434112090 con 0x7f7434102790 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f743ab06640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7434111f10 con 0x7f7434106f10 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f743ab06640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7434112210 con 0x7f7434101de0 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 0x7f74341989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 0x7f74341989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32836/0 (socket says 172.21.15.60:32836) 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 -- 172.21.15.60:0/3255189968 learned_addr learned my addr 172.21.15.60:0/3255189968 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f74390a3640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7434106f10 0x7f743419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f74388a2640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7434101de0 0x7f7434198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 -- 172.21.15.60:0/3255189968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7434101de0 msgr2=0x7f7434198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7434101de0 0x7f7434198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 -- 172.21.15.60:0/3255189968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7434106f10 msgr2=0x7f743419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7434106f10 0x7f743419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 -- 172.21.15.60:0/3255189968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743419d410 con 0x7f7434102790 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f74388a2640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7434101de0 0x7f7434198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7433fff640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 0x7f74341989a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7428006010 tx=0x7f74280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7431ffb640 1 -- 172.21.15.60:0/3255189968 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742803f030 con 0x7f7434102790 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f743ab06640 1 -- 172.21.15.60:0/3255189968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743419d6a0 con 0x7f7434102790 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7431ffb640 1 -- 172.21.15.60:0/3255189968 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7428003d00 con 0x7f7434102790 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.866+0000 7f7431ffb640 1 -- 172.21.15.60:0/3255189968 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428035070 con 0x7f7434102790 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.867+0000 7f743ab06640 1 -- 172.21.15.60:0/3255189968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74341a4fe0 con 0x7f7434102790 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.869+0000 7f7431ffb640 1 -- 172.21.15.60:0/3255189968 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7428042030 con 0x7f7434102790 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.869+0000 7f743cedf740 1 Processor -- start 2024-09-12T00:07:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.869+0000 7f743cedf740 1 -- start start 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f743cedf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c905760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f743cedf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c914550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f743cedf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c916e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f743cedf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556c6c86b2e0 con 0x556c6c914a90 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f743cedf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556c6c812ce0 con 0x556c6c905380 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f743cedf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556c6c8672a0 con 0x556c6c905ca0 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7431ffb640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f741c0a2cf0 0x7f741c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7433fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c916e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f74390a3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c905760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f74388a2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c914550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f74390a3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c905760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:42152/0 (socket says 172.21.15.60:42152) 2024-09-12T00:07:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f74388a2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c914550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:39078/0 (socket says 172.21.15.60:39078) 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f74390a3640 1 -- 172.21.15.60:0/215904101 learned_addr learned my addr 172.21.15.60:0/215904101 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f74390a3640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f741c0a2cf0 0x7f741c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7431ffb640 1 -- 172.21.15.60:0/3255189968 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f74280efaa0 con 0x7f7434102790 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7433fff640 1 -- 172.21.15.60:0/215904101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 msgr2=0x556c6c914550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7433fff640 1 --2- 172.21.15.60:0/215904101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c914550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7433fff640 1 -- 172.21.15.60:0/215904101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 msgr2=0x556c6c905760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7433fff640 1 --2- 172.21.15.60:0/215904101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c905760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7433fff640 1 -- 172.21.15.60:0/215904101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c6c7f7440 con 0x556c6c914a90 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f74390a3640 1 --2- 172.21.15.60:0/215904101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c905760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.870+0000 7f7433fff640 1 --2- 172.21.15.60:0/215904101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c916e80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f74280ed1b0 tx=0x7f7428047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239dad66fb507c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f74390a3640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f741c0a2cf0 0x7f741c0a51b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f742c005c40 tx=0x7f742c0096a0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f741affd640 1 -- 172.21.15.60:0/215904101 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74280bb9a0 con 0x556c6c914a90 2024-09-12T00:07:29.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f741affd640 1 -- 172.21.15.60:0/215904101 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74280bc740 con 0x556c6c914a90 2024-09-12T00:07:29.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f741affd640 1 -- 172.21.15.60:0/215904101 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74280ed430 con 0x556c6c914a90 2024-09-12T00:07:29.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f743cedf740 1 -- 172.21.15.60:0/215904101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 msgr2=0x556c6c916e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f743cedf740 1 --2- 172.21.15.60:0/215904101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c916e80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f74280ed1b0 tx=0x7f7428047000 comp rx=0 tx=0).stop 2024-09-12T00:07:29.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f743cedf740 1 -- 172.21.15.60:0/215904101 shutdown_connections 2024-09-12T00:07:29.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f743cedf740 1 --2- 172.21.15.60:0/215904101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c916e80 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f743cedf740 1 --2- 172.21.15.60:0/215904101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c914550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f743cedf740 1 --2- 172.21.15.60:0/215904101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c905760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f743cedf740 1 -- 172.21.15.60:0/215904101 >> 172.21.15.60:0/215904101 conn(0x556c6c901a30 msgr2=0x556c6c901e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:29.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.871+0000 7f743cedf740 1 -- 172.21.15.60:0/215904101 shutdown_connections 2024-09-12T00:07:29.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 -- 172.21.15.60:0/215904101 wait complete. 2024-09-12T00:07:29.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 -- start start 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 Processor -- start 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905380 0x556c6c9144a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905ca0 0x556c6c911750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c914a90 0x556c6c911d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556c6c917420 con 0x556c6c905ca0 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556c6c826050 con 0x556c6c914a90 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556c6c9175a0 con 0x556c6c905380 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f743cedf740 10 client.0 _ll_register_callbacks cb 0x556c6c866160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:29.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f7433fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905ca0 0x556c6c911750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f7433fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905ca0 0x556c6c911750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32856/0 (socket says 172.21.15.60:32856) 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.872+0000 7f7433fff640 1 -- 172.21.15.60:0/513516037 learned_addr learned my addr 172.21.15.60:0/513516037 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f74390a3640 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c914a90 0x556c6c911d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f74388a2640 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905380 0x556c6c9144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7433fff640 1 -- 172.21.15.60:0/513516037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905380 msgr2=0x556c6c9144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7433fff640 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905380 0x556c6c9144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7433fff640 1 -- 172.21.15.60:0/513516037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c914a90 msgr2=0x556c6c911d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7433fff640 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c914a90 0x556c6c911d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7433fff640 1 -- 172.21.15.60:0/513516037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c6c5dc3c0 con 0x556c6c905ca0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f74390a3640 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c914a90 0x556c6c911d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7433fff640 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905ca0 0x556c6c911750 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7428005940 tx=0x7f74280bbf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0d02afce26ac94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7413fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7413fff640 1 -- 172.21.15.60:0/513516037 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428049040 con 0x556c6c905ca0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7413fff640 1 -- 172.21.15.60:0/513516037 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f74280830d0 con 0x556c6c905ca0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f743cedf740 1 -- 172.21.15.60:0/513516037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74280bc740 con 0x556c6c905ca0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7413fff640 1 -- 172.21.15.60:0/513516037 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f74280bb9a0 con 0x556c6c905ca0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f743cedf740 10 client.17334 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f743cedf740 1 -- 172.21.15.60:0/513516037 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x556c6c917420 con 0x556c6c905ca0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.873+0000 7f7413fff640 1 -- 172.21.15.60:0/513516037 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74280d6020 con 0x556c6c905ca0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.874+0000 7f7413fff640 1 -- 172.21.15.60:0/513516037 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f74280bc2a0 con 0x556c6c905ca0 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.874+0000 7f743cedf740 10 client.17334 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:29.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.874+0000 7f743cedf740 10 client.17334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.874+0000 7f743cedf740 20 client.17334 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.874+0000 7f743cedf740 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556c6c924070 0x556c6c926460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.874+0000 7f743cedf740 4 client.17334 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.874+0000 7f743cedf740 1 -- 172.21.15.60:0/513516037 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c6c878850 con 0x556c6c924070 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.874+0000 7f74388a2640 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556c6c924070 0x556c6c926460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f74388a2640 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556c6c924070 0x556c6c926460 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b41dd4bbd47e784a server_cookie=9fe14cee8183cbd in_seq=0 out_seq=0 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f7413fff640 10 client.17334 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f7413fff640 1 -- 172.21.15.60:0/513516037 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c6c878850 con 0x556c6c924070 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f7413fff640 10 client.17334 handle_command_reply: tid=0 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f743cedf740 1 client.17334 shutdown 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f743cedf740 1 -- 172.21.15.60:0/513516037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905ca0 msgr2=0x556c6c911750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f743cedf740 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905ca0 0x556c6c911750 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7428005940 tx=0x7f74280bbf40 comp rx=0 tx=0).stop 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f743cedf740 1 -- 172.21.15.60:0/513516037 shutdown_connections 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f743cedf740 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556c6c924070 0x556c6c926460 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f743cedf740 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c914a90 0x556c6c911d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.875+0000 7f743cedf740 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905ca0 0x556c6c911750 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.876+0000 7f743cedf740 1 --2- 172.21.15.60:0/513516037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905380 0x556c6c9144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.876+0000 7f7413fff640 0 client.17334 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.876+0000 7f743cedf740 1 -- 172.21.15.60:0/513516037 >> 172.21.15.60:0/513516037 conn(0x556c6c901a30 msgr2=0x556c6c907790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.876+0000 7f743cedf740 1 -- 172.21.15.60:0/513516037 shutdown_connections 2024-09-12T00:07:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.876+0000 7f743cedf740 1 -- 172.21.15.60:0/513516037 wait complete. 2024-09-12T00:07:29.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.876+0000 7f743cedf740 20 client.17334 trim_cache size 0 max 16384 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f743cedf740 1 Processor -- start 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f743cedf740 1 -- start start 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f743cedf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905380 0x556c6c920680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f743cedf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905ca0 0x556c6c900930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f743cedf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c914a90 0x556c6c900e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f743cedf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f74341ab5e0 con 0x556c6c905380 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f743cedf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74341ad120 con 0x556c6c905ca0 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f743cedf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f74341abcb0 con 0x556c6c914a90 2024-09-12T00:07:29.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f74388a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905380 0x556c6c920680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f74388a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905380 0x556c6c920680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32864/0 (socket says 172.21.15.60:32864) 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f74388a2640 1 -- 172.21.15.60:0/1588096402 learned_addr learned my addr 172.21.15.60:0/1588096402 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f7433fff640 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905ca0 0x556c6c900930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f74390a3640 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c914a90 0x556c6c900e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f74388a2640 1 -- 172.21.15.60:0/1588096402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c914a90 msgr2=0x556c6c900e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f74388a2640 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c914a90 0x556c6c900e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f74388a2640 1 -- 172.21.15.60:0/1588096402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905ca0 msgr2=0x556c6c900930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.893+0000 7f74388a2640 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905ca0 0x556c6c900930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.894+0000 7f74388a2640 1 -- 172.21.15.60:0/1588096402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c6c912090 con 0x556c6c905380 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.894+0000 7f7433fff640 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905ca0 0x556c6c900930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.894+0000 7f74390a3640 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c914a90 0x556c6c900e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.894+0000 7f74388a2640 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905380 0x556c6c920680 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f742400bd50 tx=0x7f742400b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8269e1c86126ed20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:29.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.894+0000 7f741a7fc640 1 -- 172.21.15.60:0/1588096402 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424005020 con 0x556c6c905380 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.894+0000 7f741a7fc640 1 -- 172.21.15.60:0/1588096402 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7424004730 con 0x556c6c905380 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.894+0000 7f741a7fc640 1 -- 172.21.15.60:0/1588096402 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742401a590 con 0x556c6c905380 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 -- 172.21.15.60:0/1588096402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905380 msgr2=0x556c6c920680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905380 0x556c6c920680 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f742400bd50 tx=0x7f742400b470 comp rx=0 tx=0).stop 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 -- 172.21.15.60:0/1588096402 shutdown_connections 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c914a90 0x556c6c900e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905ca0 0x556c6c900930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 --2- 172.21.15.60:0/1588096402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c905380 0x556c6c920680 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 -- 172.21.15.60:0/1588096402 >> 172.21.15.60:0/1588096402 conn(0x556c6c901a30 msgr2=0x556c6c900220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 -- 172.21.15.60:0/1588096402 shutdown_connections 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 -- 172.21.15.60:0/1588096402 wait complete. 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 -- start start 2024-09-12T00:07:29.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 Processor -- start 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c9184d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c918a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.895+0000 7f743cedf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c918f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f743cedf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f74341aca50 con 0x556c6c914a90 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f743cedf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74341ac380 con 0x556c6c905380 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f743cedf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f74341a95e0 con 0x556c6c905ca0 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f743cedf740 10 client.0 _ll_register_callbacks cb 0x7f742c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c918f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c918f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32874/0 (socket says 172.21.15.60:32874) 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 -- 172.21.15.60:0/2000399285 learned_addr learned my addr 172.21.15.60:0/2000399285 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74388a2640 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c9184d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f7433fff640 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c918a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 -- 172.21.15.60:0/2000399285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 msgr2=0x556c6c918a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c918a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 -- 172.21.15.60:0/2000399285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 msgr2=0x556c6c9184d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c9184d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 -- 172.21.15.60:0/2000399285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c6c98dc90 con 0x556c6c914a90 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74388a2640 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c9184d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f74390a3640 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c918f50 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f742c0125a0 tx=0x7f742c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0b43959ed80c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f7413fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f7413fff640 1 -- 172.21.15.60:0/2000399285 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c025070 con 0x556c6c914a90 2024-09-12T00:07:29.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.896+0000 7f7413fff640 1 -- 172.21.15.60:0/2000399285 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f742c0043c0 con 0x556c6c914a90 2024-09-12T00:07:29.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 1 -- 172.21.15.60:0/2000399285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7424004730 con 0x556c6c914a90 2024-09-12T00:07:29.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f7413fff640 1 -- 172.21.15.60:0/2000399285 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f742c031050 con 0x556c6c914a90 2024-09-12T00:07:29.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 10 client.17340 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:29.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 1 -- 172.21.15.60:0/2000399285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x556c6c98eed0 con 0x556c6c914a90 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f7413fff640 1 -- 172.21.15.60:0/2000399285 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7424004730 con 0x556c6c914a90 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f7413fff640 1 -- 172.21.15.60:0/2000399285 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f742c00f3f0 con 0x556c6c914a90 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 10 client.17340 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 10 client.17340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 20 client.17340 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556c6c98f620 0x556c6c991a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 4 client.17340 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f743cedf740 1 -- 172.21.15.60:0/2000399285 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c6c872d60 con 0x556c6c98f620 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.897+0000 7f74388a2640 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556c6c98f620 0x556c6c991a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f74388a2640 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556c6c98f620 0x556c6c991a40 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a782c54856c5a51 server_cookie=663c743bfcf5fe75 in_seq=0 out_seq=0 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f7413fff640 10 client.17340 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f7413fff640 1 -- 172.21.15.60:0/2000399285 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556c6c872d60 con 0x556c6c98f620 2024-09-12T00:07:29.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f7413fff640 10 client.17340 handle_command_reply: tid=0 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 client.17340 shutdown 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 -- 172.21.15.60:0/2000399285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 msgr2=0x556c6c918f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c918f50 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f742c0125a0 tx=0x7f742c004ab0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 -- 172.21.15.60:0/2000399285 shutdown_connections 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x556c6c98f620 0x556c6c991a40 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f7413fff640 0 client.17340 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556c6c914a90 0x556c6c918f50 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556c6c905ca0 0x556c6c918a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 --2- 172.21.15.60:0/2000399285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556c6c905380 0x556c6c9184d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 -- 172.21.15.60:0/2000399285 >> 172.21.15.60:0/2000399285 conn(0x556c6c901a30 msgr2=0x556c6c900a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 -- 172.21.15.60:0/2000399285 shutdown_connections 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.898+0000 7f743cedf740 1 -- 172.21.15.60:0/2000399285 wait complete. 2024-09-12T00:07:29.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743cedf740 20 client.17340 trim_cache size 0 max 16384 2024-09-12T00:07:29.915 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:07:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:07:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:07:29.915 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 -- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f741c0a2cf0 msgr2=0x7f741c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f741c0a2cf0 0x7f741c0a51b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f742c005c40 tx=0x7f742c0096a0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 -- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 msgr2=0x7f74341989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 0x7f74341989a0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7428006010 tx=0x7f74280042f0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 -- 172.21.15.60:0/3255189968 shutdown_connections 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f741c0a2cf0 0x7f741c0a51b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7434106f10 0x7f743419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7434102790 0x7f74341989a0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 --2- 172.21.15.60:0/3255189968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7434101de0 0x7f7434198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:29.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 -- 172.21.15.60:0/3255189968 >> 172.21.15.60:0/3255189968 conn(0x7f74340fd8c0 msgr2=0x7f74340fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:29.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 -- 172.21.15.60:0/3255189968 shutdown_connections 2024-09-12T00:07:29.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:29.899+0000 7f743ab06640 1 -- 172.21.15.60:0/3255189968 wait complete. 2024-09-12T00:07:30.649 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:07:30.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:07:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:31.316 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:31 smithi060 ceph-mon[30953]: pgmap v251: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 -- 172.21.15.60:0/2047774946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c102ef0 msgr2=0x7f0f0c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 --2- 172.21.15.60:0/2047774946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c102ef0 0x7f0f0c10da40 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009900 tx=0x7f0f0402a480 comp rx=0 tx=0).stop 2024-09-12T00:07:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 -- 172.21.15.60:0/2047774946 shutdown_connections 2024-09-12T00:07:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 --2- 172.21.15.60:0/2047774946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c102ef0 0x7f0f0c10da40 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 --2- 172.21.15.60:0/2047774946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f0c102570 0x7f0f0c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 --2- 172.21.15.60:0/2047774946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f0c100e20 0x7f0f0c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 -- 172.21.15.60:0/2047774946 >> 172.21.15.60:0/2047774946 conn(0x7f0f0c0fc7d0 msgr2=0x7f0f0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 -- 172.21.15.60:0/2047774946 shutdown_connections 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.399+0000 7f0f13e65640 1 -- 172.21.15.60:0/2047774946 wait complete. 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f13e65640 1 Processor -- start 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f13e65640 1 -- start start 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f13e65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c100e20 0x7f0f0c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f13e65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f0c102570 0x7f0f0c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f13e65640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f0c102ef0 0x7f0f0c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f13e65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c1121c0 con 0x7f0f0c100e20 2024-09-12T00:07:31.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f13e65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c112040 con 0x7f0f0c102570 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f13e65640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c112340 con 0x7f0f0c102ef0 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f11c01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c100e20 0x7f0f0c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f11c01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c100e20 0x7f0f0c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:32894/0 (socket says 172.21.15.60:32894) 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.400+0000 7f0f11c01640 1 -- 172.21.15.60:0/3266681126 learned_addr learned my addr 172.21.15.60:0/3266681126 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f12402640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f0c102ef0 0x7f0f0c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f11400640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f0c102570 0x7f0f0c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f11c01640 1 -- 172.21.15.60:0/3266681126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f0c102ef0 msgr2=0x7f0f0c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f11c01640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f0c102ef0 0x7f0f0c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f11c01640 1 -- 172.21.15.60:0/3266681126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f0c102570 msgr2=0x7f0f0c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f11c01640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f0c102570 0x7f0f0c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f11c01640 1 -- 172.21.15.60:0/3266681126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c19d530 con 0x7f0f0c100e20 2024-09-12T00:07:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f12402640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f0c102ef0 0x7f0f0c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f11c01640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c100e20 0x7f0f0c198580 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00d950 tx=0x7f0efc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f0affd640 1 -- 172.21.15.60:0/3266681126 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc017030 con 0x7f0f0c100e20 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f0affd640 1 -- 172.21.15.60:0/3266681126 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0efc004020 con 0x7f0f0c100e20 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0c19d820 con 0x7f0f0c100e20 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f0affd640 1 -- 172.21.15.60:0/3266681126 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc004a00 con 0x7f0f0c100e20 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.401+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0c1a5100 con 0x7f0f0c100e20 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.402+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0c101200 con 0x7f0f0c100e20 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.403+0000 7f0f0affd640 1 -- 172.21.15.60:0/3266681126 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0efc0041d0 con 0x7f0f0c100e20 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.404+0000 7f0f0affd640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0ef40a2cf0 0x7f0ef40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.404+0000 7f0f0affd640 1 -- 172.21.15.60:0/3266681126 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f0efc0cef20 con 0x7f0f0c100e20 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.404+0000 7f0f11400640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0ef40a2cf0 0x7f0ef40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.405+0000 7f0f11400640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0ef40a2cf0 0x7f0ef40a51b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f000092f0 tx=0x7f0f00009280 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.408+0000 7f0f0affd640 1 -- 172.21.15.60:0/3266681126 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0efc09bb60 con 0x7f0f0c100e20 2024-09-12T00:07:31.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:31 smithi105 ceph-mon[34805]: pgmap v251: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:31.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:31 smithi192 ceph-mon[35487]: pgmap v251: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:31.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.619+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f0c1a52d0 con 0x7f0f0c100e20 2024-09-12T00:07:31.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.620+0000 7f0f0affd640 1 -- 172.21.15.60:0/3266681126 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7f0efc09b460 con 0x7f0f0c100e20 2024-09-12T00:07:31.621 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:07:31.622 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:07:31.624 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:07:31.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0ef40a2cf0 msgr2=0x7f0ef40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:31.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0ef40a2cf0 0x7f0ef40a51b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f000092f0 tx=0x7f0f00009280 comp rx=0 tx=0).stop 2024-09-12T00:07:31.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c100e20 msgr2=0x7f0f0c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c100e20 0x7f0f0c198580 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00d950 tx=0x7f0efc00de10 comp rx=0 tx=0).stop 2024-09-12T00:07:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 shutdown_connections 2024-09-12T00:07:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0ef40a2cf0 0x7f0ef40a51b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f0c102ef0 0x7f0f0c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f0c102570 0x7f0f0c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.622+0000 7f0f13e65640 1 --2- 172.21.15.60:0/3266681126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f0c100e20 0x7f0f0c198580 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.623+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 >> 172.21.15.60:0/3266681126 conn(0x7f0f0c0fc7d0 msgr2=0x7f0f0c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.623+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 shutdown_connections 2024-09-12T00:07:31.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:31.623+0000 7f0f13e65640 1 -- 172.21.15.60:0/3266681126 wait complete. 2024-09-12T00:07:32.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:32 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3266681126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:07:32.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:07:32.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:32 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3266681126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:07:32.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:32 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3266681126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:07:32.626 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:33.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 -- 172.21.15.60:0/2632625514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4100e20 msgr2=0x7f33b4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/2632625514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4100e20 0x7f33b4101200 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009900 tx=0x7f33b002a480 comp rx=0 tx=0).stop 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 -- 172.21.15.60:0/2632625514 shutdown_connections 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/2632625514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33b4102ef0 0x7f33b410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/2632625514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b4102570 0x7f33b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/2632625514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4100e20 0x7f33b4101200 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 -- 172.21.15.60:0/2632625514 >> 172.21.15.60:0/2632625514 conn(0x7f33b40fc7d0 msgr2=0x7f33b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 -- 172.21.15.60:0/2632625514 shutdown_connections 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.088+0000 7f33bc5d1640 1 -- 172.21.15.60:0/2632625514 wait complete. 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bc5d1640 1 Processor -- start 2024-09-12T00:07:33.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bc5d1640 1 -- start start 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bc5d1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33b4100e20 0x7f33b4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bc5d1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b4102570 0x7f33b4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bc5d1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4102ef0 0x7f33b419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bc5d1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41110f0 con 0x7f33b4102ef0 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bc5d1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4110f70 con 0x7f33b4100e20 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bc5d1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4111270 con 0x7f33b4102570 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bab6e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4102ef0 0x7f33b419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bab6e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4102ef0 0x7f33b419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35734/0 (socket says 172.21.15.60:35734) 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33ba36d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33b4100e20 0x7f33b4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bab6e640 1 -- 172.21.15.60:0/3082922600 learned_addr learned my addr 172.21.15.60:0/3082922600 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:33.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b4102570 0x7f33b4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bab6e640 1 -- 172.21.15.60:0/3082922600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b4102570 msgr2=0x7f33b4198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bab6e640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b4102570 0x7f33b4198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bab6e640 1 -- 172.21.15.60:0/3082922600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33b4100e20 msgr2=0x7f33b4198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bab6e640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33b4100e20 0x7f33b4198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.089+0000 7f33bab6e640 1 -- 172.21.15.60:0/3082922600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b419d610 con 0x7f33b4102ef0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.090+0000 7f33bab6e640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4102ef0 0x7f33b419cf30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00eb10 tx=0x7f33ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.090+0000 7f33ab7fe640 1 -- 172.21.15.60:0/3082922600 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac004b20 con 0x7f33b4102ef0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.090+0000 7f33ab7fe640 1 -- 172.21.15.60:0/3082922600 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33ac004cc0 con 0x7f33b4102ef0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.090+0000 7f33bc5d1640 1 -- 172.21.15.60:0/3082922600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b419d900 con 0x7f33b4102ef0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.090+0000 7f33ab7fe640 1 -- 172.21.15.60:0/3082922600 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0107f0 con 0x7f33b4102ef0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.090+0000 7f33bc5d1640 1 -- 172.21.15.60:0/3082922600 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b41a51e0 con 0x7f33b4102ef0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.092+0000 7f33ab7fe640 1 -- 172.21.15.60:0/3082922600 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f33ac005020 con 0x7f33b4102ef0 2024-09-12T00:07:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33be9aa740 1 Processor -- start 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33be9aa740 1 -- start start 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 0x563a1e3c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33be9aa740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563a1e31a2f0 con 0x563a1e3b45d0 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33be9aa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563a1e2c1cf0 con 0x563a1e3bf370 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33be9aa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563a1e3162b0 con 0x563a1e3b5b40 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.093+0000 7f33ba36d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ba36d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35744/0 (socket says 172.21.15.60:35744) 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ba36d640 1 -- 172.21.15.60:0/3522753357 learned_addr learned my addr 172.21.15.60:0/3522753357 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ab7fe640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f33a00a2d70 0x7f33a00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 0x563a1e3c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ba36d640 1 -- 172.21.15.60:0/3522753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 msgr2=0x563a1e3b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ba36d640 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ba36d640 1 -- 172.21.15.60:0/3522753357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 msgr2=0x563a1e3c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ba36d640 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 0x563a1e3c1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ba36d640 1 -- 172.21.15.60:0/3522753357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1e2a63a0 con 0x563a1e3b45d0 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ab7fe640 1 -- 172.21.15.60:0/3082922600 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f33ac0cf9f0 con 0x7f33b4102ef0 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33bab6e640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f33a00a2d70 0x7f33a00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33ba36d640 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3b4a10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009900 tx=0x7f33b0031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90f6fdfa4b965e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.094+0000 7f33a8ff9640 1 -- 172.21.15.60:0/3522753357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0035040 con 0x563a1e3b45d0 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33a8ff9640 1 -- 172.21.15.60:0/3522753357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33b0004400 con 0x563a1e3b45d0 2024-09-12T00:07:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33a8ff9640 1 -- 172.21.15.60:0/3522753357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0031840 con 0x563a1e3b45d0 2024-09-12T00:07:33.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33be9aa740 1 -- 172.21.15.60:0/3522753357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 msgr2=0x563a1e3b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33bab6e640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f33a00a2d70 0x7f33a00a5230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33ac098330 tx=0x7f33ac00efd0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33be9aa740 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3b4a10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009900 tx=0x7f33b0031540 comp rx=0 tx=0).stop 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33be9aa740 1 -- 172.21.15.60:0/3522753357 shutdown_connections 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33be9aa740 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 0x563a1e3c1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33be9aa740 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3b4a10 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33be9aa740 1 --2- 172.21.15.60:0/3522753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33be9aa740 1 -- 172.21.15.60:0/3522753357 >> 172.21.15.60:0/3522753357 conn(0x563a1e37d310 msgr2=0x563a1e3b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.095+0000 7f33be9aa740 1 -- 172.21.15.60:0/3522753357 shutdown_connections 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 -- 172.21.15.60:0/3522753357 wait complete. 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 -- start start 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 Processor -- start 2024-09-12T00:07:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3bed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3bc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3bf370 0x563a1e3bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563a1e3c2010 con 0x563a1e3bf370 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563a1e2d5060 con 0x563a1e3b45d0 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563a1e3c2190 con 0x563a1e3b5b40 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33be9aa740 10 client.0 _ll_register_callbacks cb 0x563a1e0288c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33b9b6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3bf370 0x563a1e3bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33b9b6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3bf370 0x563a1e3bc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35752/0 (socket says 172.21.15.60:35752) 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.096+0000 7f33b9b6c640 1 -- 172.21.15.60:0/515255976 learned_addr learned my addr 172.21.15.60:0/515255976 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33ba36d640 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33b9b6c640 1 -- 172.21.15.60:0/515255976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 msgr2=0x563a1e3bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3bc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33b9b6c640 1 -- 172.21.15.60:0/515255976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 msgr2=0x563a1e3bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3bed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33b9b6c640 1 -- 172.21.15.60:0/515255976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1e08b3c0 con 0x563a1e3bf370 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33ba36d640 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3bf370 0x563a1e3bc5d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f33a4013db0 tx=0x7f33a400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef0cc776a3e0b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f339dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f339dffb640 1 -- 172.21.15.60:0/515255976 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a401c040 con 0x563a1e3bf370 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f339dffb640 1 -- 172.21.15.60:0/515255976 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f33a4013220 con 0x563a1e3bf370 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33be9aa740 1 -- 172.21.15.60:0/515255976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33b0004400 con 0x563a1e3bf370 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f339dffb640 1 -- 172.21.15.60:0/515255976 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f33a4005020 con 0x563a1e3bf370 2024-09-12T00:07:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33be9aa740 10 client.17358 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.097+0000 7f33be9aa740 1 -- 172.21.15.60:0/515255976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563a1e3cdaf0 con 0x563a1e3bf370 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f339dffb640 1 -- 172.21.15.60:0/515255976 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33b0004400 con 0x563a1e3bf370 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f339dffb640 1 -- 172.21.15.60:0/515255976 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f33a4012450 con 0x563a1e3bf370 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f33be9aa740 10 client.17358 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f33be9aa740 10 client.17358 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f33be9aa740 20 client.17358 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f33be9aa740 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x563a1e3cef00 0x563a1e3d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f33be9aa740 4 client.17358 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f33be9aa740 1 -- 172.21.15.60:0/515255976 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a1e327860 con 0x563a1e3cef00 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.098+0000 7f33ba36d640 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x563a1e3cef00 0x563a1e3d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.099+0000 7f33ba36d640 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x563a1e3cef00 0x563a1e3d1330 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5df9c235f8952c9a server_cookie=25242192b9a0553e in_seq=0 out_seq=0 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.099+0000 7f339dffb640 10 client.17358 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:07:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.099+0000 7f339dffb640 1 -- 172.21.15.60:0/515255976 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a1e327860 con 0x563a1e3cef00 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.099+0000 7f339dffb640 10 client.17358 handle_command_reply: tid=0 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.099+0000 7f33be9aa740 1 client.17358 shutdown 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.099+0000 7f33be9aa740 1 -- 172.21.15.60:0/515255976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3bf370 msgr2=0x563a1e3bc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.099+0000 7f33be9aa740 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3bf370 0x563a1e3bc5d0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f33a4013db0 tx=0x7f33a400c7e0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 1 -- 172.21.15.60:0/515255976 shutdown_connections 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3bf370 0x563a1e3bc5d0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x563a1e3cef00 0x563a1e3d1330 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 1 --2- 172.21.15.60:0/515255976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 1 -- 172.21.15.60:0/515255976 >> 172.21.15.60:0/515255976 conn(0x563a1e37d310 msgr2=0x563a1e3b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f339dffb640 0 client.17358 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:07:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 1 -- 172.21.15.60:0/515255976 shutdown_connections 2024-09-12T00:07:33.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 1 -- 172.21.15.60:0/515255976 wait complete. 2024-09-12T00:07:33.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.100+0000 7f33be9aa740 20 client.17358 trim_cache size 0 max 16384 2024-09-12T00:07:33.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33be9aa740 1 Processor -- start 2024-09-12T00:07:33.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33be9aa740 1 -- start start 2024-09-12T00:07:33.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 0x563a1e3c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33be9aa740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41ad8c0 con 0x563a1e3b45d0 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33be9aa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41af400 con 0x563a1e3bf370 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33be9aa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41adf90 con 0x563a1e3b5b40 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3abc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35758/0 (socket says 172.21.15.60:35758) 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 -- 172.21.15.60:0/386379127 learned_addr learned my addr 172.21.15.60:0/386379127 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33ba36d640 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 0x563a1e3c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 -- 172.21.15.60:0/386379127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 msgr2=0x563a1e3cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 -- 172.21.15.60:0/386379127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 msgr2=0x563a1e3c13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 0x563a1e3c13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.113+0000 7f33b9b6c640 1 -- 172.21.15.60:0/386379127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1e3c1ba0 con 0x563a1e3b45d0 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3abc60 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f33a40058c0 tx=0x7f33a400c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e71c4536498e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f339ffff640 1 -- 172.21.15.60:0/386379127 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4034070 con 0x563a1e3b45d0 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f339ffff640 1 -- 172.21.15.60:0/386379127 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33a4004640 con 0x563a1e3b45d0 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f339ffff640 1 -- 172.21.15.60:0/386379127 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4012cf0 con 0x563a1e3b45d0 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 -- 172.21.15.60:0/386379127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 msgr2=0x563a1e3abc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3abc60 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f33a40058c0 tx=0x7f33a400c3b0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 -- 172.21.15.60:0/386379127 shutdown_connections 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3bf370 0x563a1e3c13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3b5b40 0x563a1e3cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 --2- 172.21.15.60:0/386379127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b45d0 0x563a1e3abc60 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 -- 172.21.15.60:0/386379127 >> 172.21.15.60:0/386379127 conn(0x563a1e37d310 msgr2=0x563a1e3b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 -- 172.21.15.60:0/386379127 shutdown_connections 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.114+0000 7f33be9aa740 1 -- 172.21.15.60:0/386379127 wait complete. 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 1 -- start start 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 1 Processor -- start 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b5b40 0x563a1e3c0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3bf370 0x563a1e3c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41aed30 con 0x563a1e3b5b40 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41ae660 con 0x563a1e3b45d0 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41ab8c0 con 0x563a1e3bf370 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33be9aa740 10 client.0 _ll_register_callbacks cb 0x7f33a400cd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33ba36d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b5b40 0x563a1e3c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33ba36d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b5b40 0x563a1e3c0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35762/0 (socket says 172.21.15.60:35762) 2024-09-12T00:07:33.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33ba36d640 1 -- 172.21.15.60:0/2555972499 learned_addr learned my addr 172.21.15.60:0/2555972499 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.115+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3bf370 0x563a1e3c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33ba36d640 1 -- 172.21.15.60:0/2555972499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3bf370 msgr2=0x563a1e3c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33ba36d640 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3bf370 0x563a1e3c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33ba36d640 1 -- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 msgr2=0x563a1e3c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33ba36d640 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33ba36d640 1 -- 172.21.15.60:0/2555972499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a1e3c0db0 con 0x563a1e3b5b40 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33ba36d640 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b5b40 0x563a1e3c0040 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009900 tx=0x7f33b0004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dee88c6d71e6e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f339dffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:33.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f339dffb640 1 -- 172.21.15.60:0/2555972499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0035070 con 0x563a1e3b5b40 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33be9aa740 1 -- 172.21.15.60:0/2555972499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33a4004640 con 0x563a1e3b5b40 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f339dffb640 1 -- 172.21.15.60:0/2555972499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f33b00046c0 con 0x563a1e3b5b40 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f339dffb640 1 -- 172.21.15.60:0/2555972499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f33b00048c0 con 0x563a1e3b5b40 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33be9aa740 10 client.17364 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f33be9aa740 1 -- 172.21.15.60:0/2555972499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563a1e43dc30 con 0x563a1e3b5b40 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.116+0000 7f339dffb640 1 -- 172.21.15.60:0/2555972499 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33a4004640 con 0x563a1e3b5b40 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f339dffb640 1 -- 172.21.15.60:0/2555972499 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f33b0060070 con 0x563a1e3b5b40 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f33be9aa740 10 client.17364 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f33be9aa740 10 client.17364 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f33be9aa740 20 client.17364 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f33be9aa740 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x563a1e43dfc0 0x563a1e4403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f33be9aa740 4 client.17364 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:33.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f33be9aa740 1 -- 172.21.15.60:0/2555972499 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563a1e321d70 con 0x563a1e43dfc0 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x563a1e43dfc0 0x563a1e4403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f339dffb640 10 client.17364 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.117+0000 7f33b9b6c640 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x563a1e43dfc0 0x563a1e4403b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aaebbdcb0a467a31 server_cookie=1f5e9c50fb57043e in_seq=0 out_seq=0 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f339dffb640 1 -- 172.21.15.60:0/2555972499 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563a1e321d70 con 0x563a1e43dfc0 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f339dffb640 10 client.17364 handle_command_reply: tid=0 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 client.17364 shutdown 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 -- 172.21.15.60:0/2555972499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b5b40 msgr2=0x563a1e3c0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b5b40 0x563a1e3c0040 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009900 tx=0x7f33b0004c00 comp rx=0 tx=0).stop 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 -- 172.21.15.60:0/2555972499 shutdown_connections 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a1e3bf370 0x563a1e3c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563a1e3b5b40 0x563a1e3c0040 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x563a1e43dfc0 0x563a1e4403b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 --2- 172.21.15.60:0/2555972499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563a1e3b45d0 0x563a1e3c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f339dffb640 0 client.17364 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:07:33.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 -- 172.21.15.60:0/2555972499 >> 172.21.15.60:0/2555972499 conn(0x563a1e37d310 msgr2=0x563a1e3ba850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 -- 172.21.15.60:0/2555972499 shutdown_connections 2024-09-12T00:07:33.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 1 -- 172.21.15.60:0/2555972499 wait complete. 2024-09-12T00:07:33.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33be9aa740 20 client.17364 trim_cache size 0 max 16384 2024-09-12T00:07:33.128 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:33.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 -- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f33a00a2d70 msgr2=0x7f33a00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f33a00a2d70 0x7f33a00a5230 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f33ac098330 tx=0x7f33ac00efd0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 -- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4102ef0 msgr2=0x7f33b419cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:33.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4102ef0 0x7f33b419cf30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00eb10 tx=0x7f33ac00c2d0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 -- 172.21.15.60:0/3082922600 shutdown_connections 2024-09-12T00:07:33.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f33a00a2d70 0x7f33a00a5230 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33b4102ef0 0x7f33b419cf30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b4102570 0x7f33b4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 --2- 172.21.15.60:0/3082922600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33b4100e20 0x7f33b4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:33.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.118+0000 7f33bc5d1640 1 -- 172.21.15.60:0/3082922600 >> 172.21.15.60:0/3082922600 conn(0x7f33b40fc7d0 msgr2=0x7f33b406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:33.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.119+0000 7f33bc5d1640 1 -- 172.21.15.60:0/3082922600 shutdown_connections 2024-09-12T00:07:33.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:33.119+0000 7f33bc5d1640 1 -- 172.21.15.60:0/3082922600 wait complete. 2024-09-12T00:07:33.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:33 smithi060 ceph-mon[30953]: pgmap v252: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:33.380 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:33 smithi105 ceph-mon[34805]: pgmap v252: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:33.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:33 smithi192 ceph-mon[35487]: pgmap v252: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:33.923 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:07:34.183 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:34.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 -- 172.21.15.60:0/1744846154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878106f10 msgr2=0x7f687810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 --2- 172.21.15.60:0/1744846154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878106f10 0x7f687810ea90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f6870009ca0 tx=0x7f687002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 -- 172.21.15.60:0/1744846154 shutdown_connections 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 --2- 172.21.15.60:0/1744846154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878106f10 0x7f687810ea90 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 --2- 172.21.15.60:0/1744846154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6878102790 0x7f68781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 --2- 172.21.15.60:0/1744846154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6878101de0 0x7f68781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 -- 172.21.15.60:0/1744846154 >> 172.21.15.60:0/1744846154 conn(0x7f68780fd8c0 msgr2=0x7f68780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 -- 172.21.15.60:0/1744846154 shutdown_connections 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.655+0000 7f687d533640 1 -- 172.21.15.60:0/1744846154 wait complete. 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.656+0000 7f687d533640 1 Processor -- start 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.656+0000 7f687d533640 1 -- start start 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.656+0000 7f687d533640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878101de0 0x7f6878198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.656+0000 7f687d533640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6878102790 0x7f6878198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f687d533640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6878106f10 0x7f687819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f687d533640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6878112090 con 0x7f6878101de0 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f687d533640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6878111f10 con 0x7f6878106f10 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f687d533640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6878112210 con 0x7f6878102790 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878101de0 0x7f6878198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878101de0 0x7f6878198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35782/0 (socket says 172.21.15.60:35782) 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 -- 172.21.15.60:0/3427186247 learned_addr learned my addr 172.21.15.60:0/3427186247 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f68777fe640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6878106f10 0x7f687819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f68767fc640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6878102790 0x7f6878198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 -- 172.21.15.60:0/3427186247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6878102790 msgr2=0x7f6878198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6878102790 0x7f6878198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 -- 172.21.15.60:0/3427186247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6878106f10 msgr2=0x7f687819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6878106f10 0x7f687819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 -- 172.21.15.60:0/3427186247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687819d400 con 0x7f6878101de0 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f68767fc640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6878102790 0x7f6878198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f68777fe640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6878106f10 0x7f687819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f6876ffd640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878101de0 0x7f6878198450 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f686800c920 tx=0x7f686800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f685ffff640 1 -- 172.21.15.60:0/3427186247 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868007c70 con 0x7f6878101de0 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f687d533640 1 -- 172.21.15.60:0/3427186247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687819d6f0 con 0x7f6878101de0 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f685ffff640 1 -- 172.21.15.60:0/3427186247 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6868007e10 con 0x7f6878101de0 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.657+0000 7f685ffff640 1 -- 172.21.15.60:0/3427186247 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868018940 con 0x7f6878101de0 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.658+0000 7f687d533640 1 -- 172.21.15.60:0/3427186247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68781a4fd0 con 0x7f6878101de0 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f685ffff640 1 -- 172.21.15.60:0/3427186247 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6868018b20 con 0x7f6878101de0 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f687f90c740 1 Processor -- start 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f687f90c740 1 -- start start 2024-09-12T00:07:34.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f687f90c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b1c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f687f90c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 0x558b50b1ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f687f90c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b2b780 0x558b50b2db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f687f90c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558b50a822f0 con 0x558b50b1db40 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f687f90c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558b50a29cf0 con 0x558b50b2b780 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f687f90c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558b50a7e2b0 con 0x558b50b1c5d0 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f685ffff640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68600a2cf0 0x7f68600a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f68777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b1c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f68777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b1c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35798/0 (socket says 172.21.15.60:35798) 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f68777fe640 1 -- 172.21.15.60:0/3911772541 learned_addr learned my addr 172.21.15.60:0/3911772541 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f6876ffd640 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 0x558b50b1ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.661+0000 7f68767fc640 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b2b780 0x558b50b2db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f685ffff640 1 -- 172.21.15.60:0/3427186247 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f68680cf680 con 0x7f6878101de0 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f68777fe640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68600a2cf0 0x7f68600a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f68777fe640 1 -- 172.21.15.60:0/3911772541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 msgr2=0x558b50b1ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f68777fe640 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 0x558b50b1ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f68777fe640 1 -- 172.21.15.60:0/3911772541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b2b780 msgr2=0x558b50b2db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f68777fe640 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b2b780 0x558b50b2db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f68777fe640 1 -- 172.21.15.60:0/3911772541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b50a0e3a0 con 0x558b50b1db40 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f68777fe640 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b1c090 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f6870003aa0 tx=0x7f6870031f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a227b3a6b06ad526 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f685d7fa640 1 -- 172.21.15.60:0/3911772541 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870004b40 con 0x558b50b1db40 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f685d7fa640 1 -- 172.21.15.60:0/3911772541 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f687004e070 con 0x558b50b1db40 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f685d7fa640 1 -- 172.21.15.60:0/3911772541 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687002fd80 con 0x558b50b1db40 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.662+0000 7f68777fe640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68600a2cf0 0x7f68600a51b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f687004d000 tx=0x7f687004b000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:34.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 -- 172.21.15.60:0/3911772541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 msgr2=0x558b50b1c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b1c090 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f6870003aa0 tx=0x7f6870031f40 comp rx=0 tx=0).stop 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 -- 172.21.15.60:0/3911772541 shutdown_connections 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b2b780 0x558b50b2db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 0x558b50b1ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 --2- 172.21.15.60:0/3911772541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b1c090 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 -- 172.21.15.60:0/3911772541 >> 172.21.15.60:0/3911772541 conn(0x558b50ae5310 msgr2=0x558b50b18c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 -- 172.21.15.60:0/3911772541 shutdown_connections 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 -- 172.21.15.60:0/3911772541 wait complete. 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 -- start start 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.663+0000 7f687f90c740 1 Processor -- start 2024-09-12T00:07:34.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f687f90c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 0x558b50b2b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f687f90c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1db40 0x558b50b28420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f687f90c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b28a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f687f90c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558b50b2e300 con 0x558b50b2b780 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f687f90c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558b50a3d060 con 0x558b50b1c5d0 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f687f90c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558b50b2e480 con 0x558b50b1db40 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f687f90c740 10 client.0 _ll_register_callbacks cb 0x558b507908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b28a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b28a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35810/0 (socket says 172.21.15.60:35810) 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 -- 172.21.15.60:0/2520217107 learned_addr learned my addr 172.21.15.60:0/2520217107 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f6876ffd640 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 0x558b50b2b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68767fc640 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1db40 0x558b50b28420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 -- 172.21.15.60:0/2520217107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1db40 msgr2=0x558b50b28420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:34.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1db40 0x558b50b28420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 -- 172.21.15.60:0/2520217107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 msgr2=0x558b50b2b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 0x558b50b2b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 -- 172.21.15.60:0/2520217107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b507f33c0 con 0x558b50b2b780 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f68777fe640 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b28a10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6870006010 tx=0x7f6870031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54e960d1f82cdec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f685aff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.664+0000 7f685aff5640 1 -- 172.21.15.60:0/2520217107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687005a070 con 0x558b50b2b780 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f685aff5640 1 -- 172.21.15.60:0/2520217107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f6870004410 con 0x558b50b2b780 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 1 -- 172.21.15.60:0/2520217107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f687004e070 con 0x558b50b2b780 2024-09-12T00:07:34.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f685aff5640 1 -- 172.21.15.60:0/2520217107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6870004610 con 0x558b50b2b780 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 10 client.17376 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 1 -- 172.21.15.60:0/2520217107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558b50b2e300 con 0x558b50b2b780 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f685aff5640 1 -- 172.21.15.60:0/2520217107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f687004e070 con 0x558b50b2b780 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f685aff5640 1 -- 172.21.15.60:0/2520217107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f6870030ac0 con 0x558b50b2b780 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 10 client.17376 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 10 client.17376 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 20 client.17376 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558b50b3af70 0x558b50b3d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 4 client.17376 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f687f90c740 1 -- 172.21.15.60:0/2520217107 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b50a8f860 con 0x558b50b3af70 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.665+0000 7f6876ffd640 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558b50b3af70 0x558b50b3d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.666+0000 7f6876ffd640 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558b50b3af70 0x558b50b3d360 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=16303f4a1a5581cd server_cookie=ec2809d7c09fe32a in_seq=0 out_seq=0 2024-09-12T00:07:34.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.666+0000 7f685aff5640 10 client.17376 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:07:34.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f685aff5640 1 -- 172.21.15.60:0/2520217107 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b50a8f860 con 0x558b50b3af70 2024-09-12T00:07:34.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f685aff5640 10 client.17376 handle_command_reply: tid=0 2024-09-12T00:07:34.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 client.17376 shutdown 2024-09-12T00:07:34.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 -- 172.21.15.60:0/2520217107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 msgr2=0x558b50b28a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b28a10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f6870006010 tx=0x7f6870031b10 comp rx=0 tx=0).stop 2024-09-12T00:07:34.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 -- 172.21.15.60:0/2520217107 shutdown_connections 2024-09-12T00:07:34.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558b50b3af70 0x558b50b3d360 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b28a10 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1db40 0x558b50b28420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 --2- 172.21.15.60:0/2520217107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 0x558b50b2b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 -- 172.21.15.60:0/2520217107 >> 172.21.15.60:0/2520217107 conn(0x558b50ae5310 msgr2=0x558b50b1e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:34.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f685aff5640 0 client.17376 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:07:34.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 -- 172.21.15.60:0/2520217107 shutdown_connections 2024-09-12T00:07:34.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 1 -- 172.21.15.60:0/2520217107 wait complete. 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.667+0000 7f687f90c740 20 client.17376 trim_cache size 0 max 16384 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f687f90c740 1 Processor -- start 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f687f90c740 1 -- start start 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f687f90c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 0x558b50b375a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f687f90c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b2a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f687f90c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b2b780 0x558b50b42c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f687f90c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68781ab650 con 0x558b50b1db40 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f687f90c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68781ad190 con 0x558b50b1c5d0 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f687f90c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f68781abd20 con 0x558b50b2b780 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f68767fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b2a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f68767fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b2a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35826/0 (socket says 172.21.15.60:35826) 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 0x558b50b375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.680+0000 7f68767fc640 1 -- 172.21.15.60:0/3869958169 learned_addr learned my addr 172.21.15.60:0/3869958169 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f68777fe640 1 --2- 172.21.15.60:0/3869958169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b2b780 0x558b50b42c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f68767fc640 1 -- 172.21.15.60:0/3869958169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b2b780 msgr2=0x558b50b42c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f68767fc640 1 --2- 172.21.15.60:0/3869958169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b2b780 0x558b50b42c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f68767fc640 1 -- 172.21.15.60:0/3869958169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 msgr2=0x558b50b375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f68767fc640 1 --2- 172.21.15.60:0/3869958169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 0x558b50b375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f68767fc640 1 -- 172.21.15.60:0/3869958169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b50b3d6d0 con 0x558b50b1db40 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f68767fc640 1 --2- 172.21.15.60:0/3869958169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b2a390 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f68780fe0d0 tx=0x7f686c013460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee75c81b33aea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f685cff9640 1 -- 172.21.15.60:0/3869958169 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c01c640 con 0x558b50b1db40 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f685cff9640 1 -- 172.21.15.60:0/3869958169 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f686c011970 con 0x558b50b1db40 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.681+0000 7f685cff9640 1 -- 172.21.15.60:0/3869958169 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c01bbd0 con 0x558b50b1db40 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- 172.21.15.60:0/3869958169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 msgr2=0x558b50b2a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 --2- 172.21.15.60:0/3869958169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b2a390 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f68780fe0d0 tx=0x7f686c013460 comp rx=0 tx=0).stop 2024-09-12T00:07:34.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- 172.21.15.60:0/3869958169 shutdown_connections 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 --2- 172.21.15.60:0/3869958169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b2b780 0x558b50b42c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 --2- 172.21.15.60:0/3869958169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b1db40 0x558b50b2a390 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 --2- 172.21.15.60:0/3869958169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1c5d0 0x558b50b375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- 172.21.15.60:0/3869958169 >> 172.21.15.60:0/3869958169 conn(0x558b50ae5310 msgr2=0x558b50b29c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- 172.21.15.60:0/3869958169 shutdown_connections 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- 172.21.15.60:0/3869958169 wait complete. 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- start start 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 Processor -- start 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 0x558b50b25380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1db40 0x558b50b258c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b25e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68781acac0 con 0x558b50b2b780 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68781ac3f0 con 0x558b50b1db40 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f68781a9650 con 0x558b50b1c5d0 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.682+0000 7f687f90c740 10 client.0 _ll_register_callbacks cb 0x7f686c009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b25e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68767fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1db40 0x558b50b258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b25e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35842/0 (socket says 172.21.15.60:35842) 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 -- 172.21.15.60:0/3939485782 learned_addr learned my addr 172.21.15.60:0/3939485782 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f6876ffd640 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 0x558b50b25380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 -- 172.21.15.60:0/3939485782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 msgr2=0x558b50b25380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 0x558b50b25380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 -- 172.21.15.60:0/3939485782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1db40 msgr2=0x558b50b258c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:34.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1db40 0x558b50b258c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 -- 172.21.15.60:0/3939485782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b50ba4c20 con 0x558b50b2b780 2024-09-12T00:07:34.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f68777fe640 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b25e00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6870030e90 tx=0x7f687002f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99489dab77aebed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:34.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f685aff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:34.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f685aff5640 1 -- 172.21.15.60:0/3939485782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687005a040 con 0x558b50b2b780 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f685aff5640 1 -- 172.21.15.60:0/3939485782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f6870049820 con 0x558b50b2b780 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f687f90c740 1 -- 172.21.15.60:0/3939485782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f686c011970 con 0x558b50b2b780 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f685aff5640 1 -- 172.21.15.60:0/3939485782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6870070050 con 0x558b50b2b780 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f687f90c740 10 client.17382 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.683+0000 7f687f90c740 1 -- 172.21.15.60:0/3939485782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558b50ba5e00 con 0x558b50b2b780 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f685aff5640 1 -- 172.21.15.60:0/3939485782 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f686c011970 con 0x558b50b2b780 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f685aff5640 1 -- 172.21.15.60:0/3939485782 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f6870069060 con 0x558b50b2b780 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f687f90c740 10 client.17382 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f687f90c740 10 client.17382 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f687f90c740 20 client.17382 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f687f90c740 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558b50ba6460 0x558b50ba8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:34.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f687f90c740 4 client.17382 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f687f90c740 1 -- 172.21.15.60:0/3939485782 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b50a89d70 con 0x558b50ba6460 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f6876ffd640 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558b50ba6460 0x558b50ba8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f685aff5640 10 client.17382 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.684+0000 7f6876ffd640 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558b50ba6460 0x558b50ba8880 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=70567069b4843678 server_cookie=73fcbfdcdd3f4c1a in_seq=0 out_seq=0 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f685aff5640 1 -- 172.21.15.60:0/3939485782 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b50a89d70 con 0x558b50ba6460 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f685aff5640 10 client.17382 handle_command_reply: tid=0 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 client.17382 shutdown 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 -- 172.21.15.60:0/3939485782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 msgr2=0x558b50b25e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b25e00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6870030e90 tx=0x7f687002f960 comp rx=0 tx=0).stop 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 -- 172.21.15.60:0/3939485782 shutdown_connections 2024-09-12T00:07:34.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x558b50ba6460 0x558b50ba8880 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558b50b2b780 0x558b50b25e00 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558b50b1db40 0x558b50b258c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 --2- 172.21.15.60:0/3939485782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b50b1c5d0 0x558b50b25380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 -- 172.21.15.60:0/3939485782 >> 172.21.15.60:0/3939485782 conn(0x558b50ae5310 msgr2=0x558b50b17d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:34.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f685aff5640 0 client.17382 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:07:34.996 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:34.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 -- 172.21.15.60:0/3939485782 shutdown_connections 2024-09-12T00:07:34.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 1 -- 172.21.15.60:0/3939485782 wait complete. 2024-09-12T00:07:34.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.685+0000 7f687f90c740 20 client.17382 trim_cache size 0 max 16384 2024-09-12T00:07:34.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 -- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68600a2cf0 msgr2=0x7f68600a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68600a2cf0 0x7f68600a51b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f687004d000 tx=0x7f687004b000 comp rx=0 tx=0).stop 2024-09-12T00:07:34.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 -- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878101de0 msgr2=0x7f6878198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:34.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878101de0 0x7f6878198450 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f686800c920 tx=0x7f686800cde0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 -- 172.21.15.60:0/3427186247 shutdown_connections 2024-09-12T00:07:34.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68600a2cf0 0x7f68600a51b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6878106f10 0x7f687819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6878102790 0x7f6878198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 --2- 172.21.15.60:0/3427186247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6878101de0 0x7f6878198450 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:34.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 -- 172.21.15.60:0/3427186247 >> 172.21.15.60:0/3427186247 conn(0x7f68780fd8c0 msgr2=0x7f68780fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:34.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 -- 172.21.15.60:0/3427186247 shutdown_connections 2024-09-12T00:07:34.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:34.686+0000 7f687d533640 1 -- 172.21.15.60:0/3427186247 wait complete. 2024-09-12T00:07:35.260 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:35 smithi060 ceph-mon[30953]: pgmap v253: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:35.260 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:35 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:07:35.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:35 smithi105 ceph-mon[34805]: pgmap v253: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:35.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:35 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:07:35.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:35 smithi192 ceph-mon[35487]: pgmap v253: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:35.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:35 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:07:35.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:07:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:36.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:36 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:07:36.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:36 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:07:36.340 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:36 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:07:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 -- 172.21.15.60:0/1639411951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18100a80 msgr2=0x7fca18100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/1639411951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18100a80 0x7fca18100ee0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009930 tx=0x7fca0c02a420 comp rx=0 tx=0).stop 2024-09-12T00:07:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 -- 172.21.15.60:0/1639411951 shutdown_connections 2024-09-12T00:07:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/1639411951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca18101420 0x7fca1810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/1639411951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18100a80 0x7fca18100ee0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/1639411951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca18106a80 0x7fca18106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 -- 172.21.15.60:0/1639411951 >> 172.21.15.60:0/1639411951 conn(0x7fca180fc7a0 msgr2=0x7fca180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:36.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 -- 172.21.15.60:0/1639411951 shutdown_connections 2024-09-12T00:07:36.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.410+0000 7fca1d3fd640 1 -- 172.21.15.60:0/1639411951 wait complete. 2024-09-12T00:07:36.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca1d3fd640 1 Processor -- start 2024-09-12T00:07:36.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca1d3fd640 1 -- start start 2024-09-12T00:07:36.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca1d3fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca18100a80 0x7fca18197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca1d3fd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca18101420 0x7fca18197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca1d3fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18106a80 0x7fca1819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca1d3fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca18110fe0 con 0x7fca18106a80 2024-09-12T00:07:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca1d3fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca18110e60 con 0x7fca18100a80 2024-09-12T00:07:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca1d3fd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fca18111160 con 0x7fca18101420 2024-09-12T00:07:36.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca177fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18106a80 0x7fca1819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca177fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18106a80 0x7fca1819bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35850/0 (socket says 172.21.15.60:35850) 2024-09-12T00:07:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca177fe640 1 -- 172.21.15.60:0/2006893021 learned_addr learned my addr 172.21.15.60:0/2006893021 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca167fc640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca18101420 0x7fca18197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.411+0000 7fca16ffd640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca18100a80 0x7fca18197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fca177fe640 1 -- 172.21.15.60:0/2006893021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca18101420 msgr2=0x7fca18197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fca177fe640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca18101420 0x7fca18197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fca177fe640 1 -- 172.21.15.60:0/2006893021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca18100a80 msgr2=0x7fca18197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fca177fe640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca18100a80 0x7fca18197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fca177fe640 1 -- 172.21.15.60:0/2006893021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1819c3d0 con 0x7fca18106a80 2024-09-12T00:07:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fca177fe640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18106a80 0x7fca1819bcf0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fca1000b970 tx=0x7fca1000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fc9fffff640 1 -- 172.21.15.60:0/2006893021 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10019070 con 0x7fca18106a80 2024-09-12T00:07:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fc9fffff640 1 -- 172.21.15.60:0/2006893021 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca10014440 con 0x7fca18106a80 2024-09-12T00:07:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fca1d3fd640 1 -- 172.21.15.60:0/2006893021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1819c6c0 con 0x7fca18106a80 2024-09-12T00:07:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fc9fffff640 1 -- 172.21.15.60:0/2006893021 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca100075d0 con 0x7fca18106a80 2024-09-12T00:07:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.412+0000 7fca1d3fd640 1 -- 172.21.15.60:0/2006893021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca181a3fa0 con 0x7fca18106a80 2024-09-12T00:07:36.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.415+0000 7fc9fffff640 1 -- 172.21.15.60:0/2006893021 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fca1001c070 con 0x7fca18106a80 2024-09-12T00:07:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.415+0000 7fca1f7d6740 1 Processor -- start 2024-09-12T00:07:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.415+0000 7fca1f7d6740 1 -- start start 2024-09-12T00:07:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fc9fffff640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fca000a2cf0 0x7fca000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a387e0 0x5556c9a38c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a45970 0x5556c9a47d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5556c999c2f0 con 0x5556c9a39c30 2024-09-12T00:07:36.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5556c9943cf0 con 0x5556c9a387e0 2024-09-12T00:07:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5556c99982b0 con 0x5556c9a45970 2024-09-12T00:07:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fc9fffff640 1 -- 172.21.15.60:0/2006893021 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fca100ce800 con 0x7fca18106a80 2024-09-12T00:07:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca167fc640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fca000a2cf0 0x7fca000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35860/0 (socket says 172.21.15.60:35860) 2024-09-12T00:07:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 -- 172.21.15.60:0/195907459 learned_addr learned my addr 172.21.15.60:0/195907459 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca167fc640 1 --2- 172.21.15.60:0/195907459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a387e0 0x5556c9a38c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 -- 172.21.15.60:0/195907459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a45970 msgr2=0x5556c9a47d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 --2- 172.21.15.60:0/195907459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a45970 0x5556c9a47d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 -- 172.21.15.60:0/195907459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a387e0 msgr2=0x5556c9a38c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 --2- 172.21.15.60:0/195907459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a387e0 0x5556c9a38c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 -- 172.21.15.60:0/195907459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c99283a0 con 0x5556c9a39c30 2024-09-12T00:07:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.416+0000 7fca16ffd640 1 --2- 172.21.15.60:0/195907459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a382a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fca0800ad00 tx=0x7fca0800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a43f57e1e4677ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fca167fc640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fca000a2cf0 0x7fca000a51b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009900 tx=0x7fca0c0319d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:36.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fc9fd7fa640 1 -- 172.21.15.60:0/195907459 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0801d070 con 0x5556c9a39c30 2024-09-12T00:07:36.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fc9fd7fa640 1 -- 172.21.15.60:0/195907459 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca08018b40 con 0x5556c9a39c30 2024-09-12T00:07:36.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fc9fd7fa640 1 -- 172.21.15.60:0/195907459 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08010c20 con 0x5556c9a39c30 2024-09-12T00:07:36.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fca1f7d6740 1 -- 172.21.15.60:0/195907459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 msgr2=0x5556c9a382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/195907459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a382a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fca0800ad00 tx=0x7fca0800f790 comp rx=0 tx=0).stop 2024-09-12T00:07:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fca1f7d6740 1 -- 172.21.15.60:0/195907459 shutdown_connections 2024-09-12T00:07:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/195907459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a45970 0x5556c9a47d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/195907459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a387e0 0x5556c9a38c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.417+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/195907459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a382a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 -- 172.21.15.60:0/195907459 >> 172.21.15.60:0/195907459 conn(0x5556c99ff310 msgr2=0x5556c9a34e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 -- 172.21.15.60:0/195907459 shutdown_connections 2024-09-12T00:07:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 -- 172.21.15.60:0/195907459 wait complete. 2024-09-12T00:07:36.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 -- start start 2024-09-12T00:07:36.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 Processor -- start 2024-09-12T00:07:36.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a45350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 0x5556c9a42600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a42bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5556c9a48540 con 0x5556c9a387e0 2024-09-12T00:07:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5556c9957060 con 0x5556c9a45970 2024-09-12T00:07:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5556c9a486c0 con 0x5556c9a39c30 2024-09-12T00:07:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca1f7d6740 10 client.0 _ll_register_callbacks cb 0x5556c96aa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:36.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca16ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a45350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca16ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a45350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35870/0 (socket says 172.21.15.60:35870) 2024-09-12T00:07:36.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.418+0000 7fca16ffd640 1 -- 172.21.15.60:0/4128537194 learned_addr learned my addr 172.21.15.60:0/4128537194 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:36.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca177fe640 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a42bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca167fc640 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 0x5556c9a42600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca16ffd640 1 -- 172.21.15.60:0/4128537194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 msgr2=0x5556c9a42600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:36.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca16ffd640 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 0x5556c9a42600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca16ffd640 1 -- 172.21.15.60:0/4128537194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 msgr2=0x5556c9a42bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:36.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca16ffd640 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a42bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca16ffd640 1 -- 172.21.15.60:0/4128537194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c970d3c0 con 0x5556c9a387e0 2024-09-12T00:07:36.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca16ffd640 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a45350 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fca08010880 tx=0x7fca08019f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf3109ff5c8205a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:36.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fc9faff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:36.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fc9faff5640 1 -- 172.21.15.60:0/4128537194 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0801d040 con 0x5556c9a387e0 2024-09-12T00:07:36.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fc9faff5640 1 -- 172.21.15.60:0/4128537194 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fca08018640 con 0x5556c9a387e0 2024-09-12T00:07:36.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca1f7d6740 1 -- 172.21.15.60:0/4128537194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca08018b40 con 0x5556c9a387e0 2024-09-12T00:07:36.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fc9faff5640 1 -- 172.21.15.60:0/4128537194 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fca08031050 con 0x5556c9a387e0 2024-09-12T00:07:36.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca1f7d6740 10 client.17394 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:36.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fca1f7d6740 1 -- 172.21.15.60:0/4128537194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5556c9a53fc0 con 0x5556c9a387e0 2024-09-12T00:07:36.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.419+0000 7fc9faff5640 1 -- 172.21.15.60:0/4128537194 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca08018b40 con 0x5556c9a387e0 2024-09-12T00:07:36.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fc9faff5640 1 -- 172.21.15.60:0/4128537194 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fca08020030 con 0x5556c9a387e0 2024-09-12T00:07:36.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fca1f7d6740 10 client.17394 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:36.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fca1f7d6740 10 client.17394 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:07:36.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fca1f7d6740 20 client.17394 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:36.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5556c9a553c0 0x5556c9a577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fca1f7d6740 4 client.17394 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fca1f7d6740 1 -- 172.21.15.60:0/4128537194 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556c99a9860 con 0x5556c9a553c0 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fca167fc640 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5556c9a553c0 0x5556c9a577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fca167fc640 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5556c9a553c0 0x5556c9a577b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac8a9fe2cfe61ecb server_cookie=e8b3652f90a64f0f in_seq=0 out_seq=0 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.420+0000 7fc9faff5640 10 client.17394 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fc9faff5640 1 -- 172.21.15.60:0/4128537194 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556c99a9860 con 0x5556c9a553c0 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fc9faff5640 10 client.17394 handle_command_reply: tid=0 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 client.17394 shutdown 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 -- 172.21.15.60:0/4128537194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 msgr2=0x5556c9a45350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a45350 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fca08010880 tx=0x7fca08019f30 comp rx=0 tx=0).stop 2024-09-12T00:07:36.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 -- 172.21.15.60:0/4128537194 shutdown_connections 2024-09-12T00:07:36.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5556c9a553c0 0x5556c9a577b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a42bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 0x5556c9a42600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fc9faff5640 0 client.17394 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:07:36.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/4128537194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a45350 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 -- 172.21.15.60:0/4128537194 >> 172.21.15.60:0/4128537194 conn(0x5556c99ff310 msgr2=0x5556c9a3abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:36.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 -- 172.21.15.60:0/4128537194 shutdown_connections 2024-09-12T00:07:36.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.421+0000 7fca1f7d6740 1 -- 172.21.15.60:0/4128537194 wait complete. 2024-09-12T00:07:36.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.422+0000 7fca1f7d6740 20 client.17394 trim_cache size 0 max 16384 2024-09-12T00:07:36.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.434+0000 7fca1f7d6740 1 Processor -- start 2024-09-12T00:07:36.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.434+0000 7fca1f7d6740 1 -- start start 2024-09-12T00:07:36.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a387e0 0x5556c9a40150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca181ab6d0 con 0x5556c9a39c30 2024-09-12T00:07:36.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca181ad210 con 0x5556c9a45970 2024-09-12T00:07:36.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fca181abda0 con 0x5556c9a387e0 2024-09-12T00:07:36.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35872/0 (socket says 172.21.15.60:35872) 2024-09-12T00:07:36.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 -- 172.21.15.60:0/1286953751 learned_addr learned my addr 172.21.15.60:0/1286953751 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:36.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca16ffd640 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a387e0 0x5556c9a40150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca177fe640 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 -- 172.21.15.60:0/1286953751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a387e0 msgr2=0x5556c9a40150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:36.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a387e0 0x5556c9a40150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 -- 172.21.15.60:0/1286953751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 msgr2=0x5556c9a415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:36.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 -- 172.21.15.60:0/1286953751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c9a44f70 con 0x5556c9a39c30 2024-09-12T00:07:36.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fca167fc640 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a517a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fca0c02a940 tx=0x7fca0c047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a932db8fef494e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:36.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.435+0000 7fc9fcff9640 1 -- 172.21.15.60:0/1286953751 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c035040 con 0x5556c9a39c30 2024-09-12T00:07:36.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fc9fcff9640 1 -- 172.21.15.60:0/1286953751 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca0c003c40 con 0x5556c9a39c30 2024-09-12T00:07:36.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fc9fcff9640 1 -- 172.21.15.60:0/1286953751 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c04c600 con 0x5556c9a39c30 2024-09-12T00:07:36.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 -- 172.21.15.60:0/1286953751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 msgr2=0x5556c9a517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a517a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fca0c02a940 tx=0x7fca0c047000 comp rx=0 tx=0).stop 2024-09-12T00:07:36.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 -- 172.21.15.60:0/1286953751 shutdown_connections 2024-09-12T00:07:36.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a39c30 0x5556c9a517a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/1286953751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a387e0 0x5556c9a40150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 -- 172.21.15.60:0/1286953751 >> 172.21.15.60:0/1286953751 conn(0x5556c99ff310 msgr2=0x5556c9a40ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:36.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 -- 172.21.15.60:0/1286953751 shutdown_connections 2024-09-12T00:07:36.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.436+0000 7fca1f7d6740 1 -- 172.21.15.60:0/1286953751 wait complete. 2024-09-12T00:07:36.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 1 -- start start 2024-09-12T00:07:36.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 1 Processor -- start 2024-09-12T00:07:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a5c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 0x5556c9a5cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a5d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca181acb40 con 0x5556c9a387e0 2024-09-12T00:07:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca181ac470 con 0x5556c9a45970 2024-09-12T00:07:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fca181a96d0 con 0x5556c9a39c30 2024-09-12T00:07:36.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca1f7d6740 10 client.0 _ll_register_callbacks cb 0x7fca0801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca16ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a5c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca16ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a5c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35884/0 (socket says 172.21.15.60:35884) 2024-09-12T00:07:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca16ffd640 1 -- 172.21.15.60:0/206130644 learned_addr learned my addr 172.21.15.60:0/206130644 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca177fe640 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a5d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca167fc640 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 0x5556c9a5cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca16ffd640 1 -- 172.21.15.60:0/206130644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 msgr2=0x5556c9a5cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:36.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca16ffd640 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 0x5556c9a5cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca16ffd640 1 -- 172.21.15.60:0/206130644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 msgr2=0x5556c9a5d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:36.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca16ffd640 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a5d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.437+0000 7fca16ffd640 1 -- 172.21.15.60:0/206130644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c9abed50 con 0x5556c9a387e0 2024-09-12T00:07:36.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fca16ffd640 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a5c980 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fca0800a5c0 tx=0x7fca0800abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bbba50109d1bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:36.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fc9faff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:36.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fc9faff5640 1 -- 172.21.15.60:0/206130644 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0801d040 con 0x5556c9a387e0 2024-09-12T00:07:36.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fc9faff5640 1 -- 172.21.15.60:0/206130644 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fca08004d40 con 0x5556c9a387e0 2024-09-12T00:07:36.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fca1f7d6740 1 -- 172.21.15.60:0/206130644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca0c003c40 con 0x5556c9a387e0 2024-09-12T00:07:36.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fc9faff5640 1 -- 172.21.15.60:0/206130644 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fca0800a930 con 0x5556c9a387e0 2024-09-12T00:07:36.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fca1f7d6740 10 client.17400 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:36.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fca1f7d6740 1 -- 172.21.15.60:0/206130644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5556c9ac0010 con 0x5556c9a387e0 2024-09-12T00:07:36.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fc9faff5640 1 -- 172.21.15.60:0/206130644 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca0c003c40 con 0x5556c9a387e0 2024-09-12T00:07:36.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fc9faff5640 1 -- 172.21.15.60:0/206130644 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fca08020040 con 0x5556c9a387e0 2024-09-12T00:07:36.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fca1f7d6740 10 client.17400 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:36.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fca1f7d6740 10 client.17400 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:07:36.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.438+0000 7fca1f7d6740 20 client.17400 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:36.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5556c9ac0720 0x5556c9ac2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:36.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fca1f7d6740 4 client.17400 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:36.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fca1f7d6740 1 -- 172.21.15.60:0/206130644 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556c99a3d70 con 0x5556c9ac0720 2024-09-12T00:07:36.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fca167fc640 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5556c9ac0720 0x5556c9ac2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:36.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fc9faff5640 10 client.17400 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:07:36.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fca167fc640 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5556c9ac0720 0x5556c9ac2b10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f31d34be38728614 server_cookie=5790f7f5fecbef87 in_seq=0 out_seq=0 2024-09-12T00:07:36.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fc9faff5640 1 -- 172.21.15.60:0/206130644 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556c99a3d70 con 0x5556c9ac0720 2024-09-12T00:07:36.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fc9faff5640 10 client.17400 handle_command_reply: tid=0 2024-09-12T00:07:36.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.439+0000 7fca1f7d6740 1 client.17400 shutdown 2024-09-12T00:07:36.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 -- 172.21.15.60:0/206130644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 msgr2=0x5556c9a5c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a5c980 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fca0800a5c0 tx=0x7fca0800abf0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 -- 172.21.15.60:0/206130644 shutdown_connections 2024-09-12T00:07:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5556c9ac0720 0x5556c9ac2b10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5556c9a45970 0x5556c9a5d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5556c9a39c30 0x5556c9a5cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 --2- 172.21.15.60:0/206130644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5556c9a387e0 0x5556c9a5c980 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 -- 172.21.15.60:0/206130644 >> 172.21.15.60:0/206130644 conn(0x5556c99ff310 msgr2=0x5556c9a416f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:36.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fc9faff5640 0 client.17400 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:07:36.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 -- 172.21.15.60:0/206130644 shutdown_connections 2024-09-12T00:07:36.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 1 -- 172.21.15.60:0/206130644 wait complete. 2024-09-12T00:07:36.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.440+0000 7fca1f7d6740 20 client.17400 trim_cache size 0 max 16384 2024-09-12T00:07:36.465 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.441+0000 7fca1d3fd640 1 -- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fca000a2cf0 msgr2=0x7fca000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.441+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fca000a2cf0 0x7fca000a51b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009900 tx=0x7fca0c0319d0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.441+0000 7fca1d3fd640 1 -- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18106a80 msgr2=0x7fca1819bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.441+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18106a80 0x7fca1819bcf0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fca1000b970 tx=0x7fca1000bd70 comp rx=0 tx=0).stop 2024-09-12T00:07:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.442+0000 7fca1d3fd640 1 -- 172.21.15.60:0/2006893021 shutdown_connections 2024-09-12T00:07:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.442+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fca000a2cf0 0x7fca000a51b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.442+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca18106a80 0x7fca1819bcf0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.442+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca18101420 0x7fca18197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.442+0000 7fca1d3fd640 1 --2- 172.21.15.60:0/2006893021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca18100a80 0x7fca18197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:36.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.442+0000 7fca1d3fd640 1 -- 172.21.15.60:0/2006893021 >> 172.21.15.60:0/2006893021 conn(0x7fca180fc7a0 msgr2=0x7fca180fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:36.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.443+0000 7fca1d3fd640 1 -- 172.21.15.60:0/2006893021 shutdown_connections 2024-09-12T00:07:36.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:36.443+0000 7fca1d3fd640 1 -- 172.21.15.60:0/2006893021 wait complete. 2024-09-12T00:07:36.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:36 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:07:36.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:36 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:07:36.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:36 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:07:36.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:36 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:07:36.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:36 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:07:36.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:36 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:07:37.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:07:37.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:37 smithi105 ceph-mon[34805]: pgmap v254: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:37.430 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:37.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:37 smithi192 ceph-mon[35487]: pgmap v254: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:37.551 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:37 smithi060 ceph-mon[30953]: pgmap v254: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 -- 172.21.15.60:0/2519069553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70106a80 msgr2=0x7fcc70106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2519069553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70106a80 0x7fcc70106e60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009930 tx=0x7fcc6c02a420 comp rx=0 tx=0).stop 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 -- 172.21.15.60:0/2519069553 shutdown_connections 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2519069553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc70101420 0x7fcc7010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2519069553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc70100a80 0x7fcc70100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2519069553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70106a80 0x7fcc70106e60 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 -- 172.21.15.60:0/2519069553 >> 172.21.15.60:0/2519069553 conn(0x7fcc700fc7a0 msgr2=0x7fcc700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 -- 172.21.15.60:0/2519069553 shutdown_connections 2024-09-12T00:07:37.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.880+0000 7fcc7824f640 1 -- 172.21.15.60:0/2519069553 wait complete. 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc7824f640 1 Processor -- start 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc7824f640 1 -- start start 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc7824f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70100a80 0x7fcc70198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc7824f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc70101420 0x7fcc70198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc7824f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc70106a80 0x7fcc7019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc7824f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc701110b0 con 0x7fcc70100a80 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc7824f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70110f30 con 0x7fcc70106a80 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc7824f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcc70111230 con 0x7fcc70101420 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.881+0000 7fcc75feb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70100a80 0x7fcc70198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc75feb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70100a80 0x7fcc70198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35902/0 (socket says 172.21.15.60:35902) 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc75feb640 1 -- 172.21.15.60:0/2012248188 learned_addr learned my addr 172.21.15.60:0/2012248188 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc757ea640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc70101420 0x7fcc70198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc767ec640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc70106a80 0x7fcc7019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc75feb640 1 -- 172.21.15.60:0/2012248188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc70101420 msgr2=0x7fcc70198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc70101420 0x7fcc70198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc75feb640 1 -- 172.21.15.60:0/2012248188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc70106a80 msgr2=0x7fcc7019cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc70106a80 0x7fcc7019cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc75feb640 1 -- 172.21.15.60:0/2012248188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7019d5f0 con 0x7fcc70100a80 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc757ea640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc70101420 0x7fcc70198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70100a80 0x7fcc70198640 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c02a940 tx=0x7fcc6c032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc66ffd640 1 -- 172.21.15.60:0/2012248188 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c03f030 con 0x7fcc70100a80 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc66ffd640 1 -- 172.21.15.60:0/2012248188 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc6c003d00 con 0x7fcc70100a80 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc7824f640 1 -- 172.21.15.60:0/2012248188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7019d880 con 0x7fcc70100a80 2024-09-12T00:07:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc66ffd640 1 -- 172.21.15.60:0/2012248188 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c035070 con 0x7fcc70100a80 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.882+0000 7fcc7824f640 1 -- 172.21.15.60:0/2012248188 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc701a51c0 con 0x7fcc70100a80 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.884+0000 7fcc66ffd640 1 -- 172.21.15.60:0/2012248188 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcc6c042030 con 0x7fcc70100a80 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc7a628740 1 Processor -- start 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc7a628740 1 -- start start 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc66ffd640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcc5c0a2d70 0x7fcc5c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f4c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f4ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f57370 0x55d9b8f59760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc7a628740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8eb22f0 con 0x55d9b8f4db40 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc7a628740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8e59cf0 con 0x55d9b8f57370 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.885+0000 7fcc7a628740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8eae2b0 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc767ec640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcc5c0a2d70 0x7fcc5c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f4c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc66ffd640 1 -- 172.21.15.60:0/2012248188 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fcc6c0efeb0 con 0x7fcc70100a80 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f4c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35914/0 (socket says 172.21.15.60:35914) 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 -- 172.21.15.60:0/2559040495 learned_addr learned my addr 172.21.15.60:0/2559040495 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc757ea640 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f4ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc767ec640 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f57370 0x55d9b8f59760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 -- 172.21.15.60:0/2559040495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4c5d0 msgr2=0x55d9b8f4ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f4ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 -- 172.21.15.60:0/2559040495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f57370 msgr2=0x55d9b8f59760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f57370 0x55d9b8f59760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 -- 172.21.15.60:0/2559040495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b8e3e3a0 con 0x55d9b8f4db40 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc757ea640 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f4ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc767ec640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcc5c0a2d70 0x7fcc5c0a5230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc680070b0 tx=0x7fcc6800cb80 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f4c090 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0b87f0 tx=0x7fcc6c0bc220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e67704e5875214 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc5bfff640 1 -- 172.21.15.60:0/2559040495 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c049070 con 0x55d9b8f4db40 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc5bfff640 1 -- 172.21.15.60:0/2559040495 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc6c0bca90 con 0x55d9b8f4db40 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.886+0000 7fcc5bfff640 1 -- 172.21.15.60:0/2559040495 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0b8b60 con 0x55d9b8f4db40 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 -- 172.21.15.60:0/2559040495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 msgr2=0x55d9b8f4c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f4c090 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0b87f0 tx=0x7fcc6c0bc220 comp rx=0 tx=0).stop 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 -- 172.21.15.60:0/2559040495 shutdown_connections 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f57370 0x55d9b8f59760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f4ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2559040495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f4c090 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 -- 172.21.15.60:0/2559040495 >> 172.21.15.60:0/2559040495 conn(0x55d9b8f15310 msgr2=0x55d9b8f48c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 -- 172.21.15.60:0/2559040495 shutdown_connections 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.887+0000 7fcc7a628740 1 -- 172.21.15.60:0/2559040495 wait complete. 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 1 -- start start 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 1 Processor -- start 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f56da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f54050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 0x55d9b8f547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8eb22f0 con 0x55d9b8f4db40 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8e6d060 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d9b8f59e30 con 0x55d9b8f57370 2024-09-12T00:07:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc7a628740 10 client.0 _ll_register_callbacks cb 0x55d9b8bc08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc757ea640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f54050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc757ea640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f54050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35918/0 (socket says 172.21.15.60:35918) 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc757ea640 1 -- 172.21.15.60:0/3152068670 learned_addr learned my addr 172.21.15.60:0/3152068670 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.888+0000 7fcc767ec640 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 0x55d9b8f547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc75feb640 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f56da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc757ea640 1 -- 172.21.15.60:0/3152068670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 msgr2=0x55d9b8f547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc757ea640 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 0x55d9b8f547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc757ea640 1 -- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 msgr2=0x55d9b8f56da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc757ea640 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f56da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc757ea640 1 -- 172.21.15.60:0/3152068670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b8c233c0 con 0x55d9b8f4db40 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc75feb640 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f56da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc757ea640 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f54050 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000bf70 tx=0x7fcc6000f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89fe91192800db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:37.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc597fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc597fa640 1 -- 172.21.15.60:0/3152068670 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60018020 con 0x55d9b8f4db40 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc597fa640 1 -- 172.21.15.60:0/3152068670 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fcc60014660 con 0x55d9b8f4db40 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc7a628740 1 -- 172.21.15.60:0/3152068670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc6c0bca90 con 0x55d9b8f4db40 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc597fa640 1 -- 172.21.15.60:0/3152068670 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fcc60023050 con 0x55d9b8f4db40 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc7a628740 10 client.17412 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.889+0000 7fcc7a628740 1 -- 172.21.15.60:0/3152068670 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55d9b8f65840 con 0x55d9b8f4db40 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc597fa640 1 -- 172.21.15.60:0/3152068670 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc6c0bca90 con 0x55d9b8f4db40 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc597fa640 1 -- 172.21.15.60:0/3152068670 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fcc60013b80 con 0x55d9b8f4db40 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc7a628740 10 client.17412 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc7a628740 10 client.17412 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc7a628740 20 client.17412 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc7a628740 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55d9b8f67170 0x55d9b8f69630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc7a628740 4 client.17412 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc7a628740 1 -- 172.21.15.60:0/3152068670 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9b8ebf860 con 0x55d9b8f67170 2024-09-12T00:07:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.890+0000 7fcc75feb640 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55d9b8f67170 0x55d9b8f69630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.891+0000 7fcc75feb640 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55d9b8f67170 0x55d9b8f69630 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=28a014dc28f34890 server_cookie=3dfc3d4cfe48e223 in_seq=0 out_seq=0 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.891+0000 7fcc597fa640 10 client.17412 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.891+0000 7fcc597fa640 1 -- 172.21.15.60:0/3152068670 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9b8ebf860 con 0x55d9b8f67170 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.891+0000 7fcc597fa640 10 client.17412 handle_command_reply: tid=0 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.891+0000 7fcc7a628740 1 client.17412 shutdown 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 -- 172.21.15.60:0/3152068670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 msgr2=0x55d9b8f54050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f54050 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000bf70 tx=0x7fcc6000f5b0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 -- 172.21.15.60:0/3152068670 shutdown_connections 2024-09-12T00:07:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55d9b8f67170 0x55d9b8f69630 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 0x55d9b8f547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4db40 0x55d9b8f54050 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 --2- 172.21.15.60:0/3152068670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f56da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc597fa640 0 client.17412 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:07:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 -- 172.21.15.60:0/3152068670 >> 172.21.15.60:0/3152068670 conn(0x55d9b8f15310 msgr2=0x55d9b8f4e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 -- 172.21.15.60:0/3152068670 shutdown_connections 2024-09-12T00:07:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 1 -- 172.21.15.60:0/3152068670 wait complete. 2024-09-12T00:07:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.892+0000 7fcc7a628740 20 client.17412 trim_cache size 0 max 16384 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc7a628740 1 Processor -- start 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc7a628740 1 -- start start 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f48700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4db40 0x55d9b8f48c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f57370 0x55d9b8f6ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc7a628740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc701ad940 con 0x55d9b8f57370 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc7a628740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc701af480 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc7a628740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcc701ae010 con 0x55d9b8f4db40 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc767ec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f57370 0x55d9b8f6ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc767ec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f57370 0x55d9b8f6ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35920/0 (socket says 172.21.15.60:35920) 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc767ec640 1 -- 172.21.15.60:0/2268051173 learned_addr learned my addr 172.21.15.60:0/2268051173 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc757ea640 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4db40 0x55d9b8f48c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.905+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f48700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc767ec640 1 -- 172.21.15.60:0/2268051173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4db40 msgr2=0x55d9b8f48c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc767ec640 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4db40 0x55d9b8f48c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc767ec640 1 -- 172.21.15.60:0/2268051173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 msgr2=0x55d9b8f48700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc767ec640 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f48700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc767ec640 1 -- 172.21.15.60:0/2268051173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b8f54b50 con 0x55d9b8f57370 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc767ec640 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f57370 0x55d9b8f6ef40 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fcc68007a10 tx=0x7fcc68009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1719d65766271524 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc5b7fe640 1 -- 172.21.15.60:0/2268051173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6802b070 con 0x55d9b8f57370 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc5b7fe640 1 -- 172.21.15.60:0/2268051173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc68016040 con 0x55d9b8f57370 2024-09-12T00:07:37.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.906+0000 7fcc5b7fe640 1 -- 172.21.15.60:0/2268051173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68026b70 con 0x55d9b8f57370 2024-09-12T00:07:37.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 -- 172.21.15.60:0/2268051173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f57370 msgr2=0x55d9b8f6ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f57370 0x55d9b8f6ef40 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fcc68007a10 tx=0x7fcc68009470 comp rx=0 tx=0).stop 2024-09-12T00:07:37.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 -- 172.21.15.60:0/2268051173 shutdown_connections 2024-09-12T00:07:37.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f57370 0x55d9b8f6ef40 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f4db40 0x55d9b8f48c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2268051173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8f48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 -- 172.21.15.60:0/2268051173 >> 172.21.15.60:0/2268051173 conn(0x55d9b8f15310 msgr2=0x55d9b8f4f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:37.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 -- 172.21.15.60:0/2268051173 shutdown_connections 2024-09-12T00:07:37.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 -- 172.21.15.60:0/2268051173 wait complete. 2024-09-12T00:07:37.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 -- start start 2024-09-12T00:07:37.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.907+0000 7fcc7a628740 1 Processor -- start 2024-09-12T00:07:37.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8fca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4db40 0x55d9b8fca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc7a628740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 0x55d9b8f5a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc7a628740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc701aedb0 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc7a628740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc701ae6e0 con 0x55d9b8f4db40 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc7a628740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcc701ab940 con 0x55d9b8f57370 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc7a628740 10 client.0 _ll_register_callbacks cb 0x7fcc6000b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8fca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8fca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35924/0 (socket says 172.21.15.60:35924) 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 -- 172.21.15.60:0/2282070914 learned_addr learned my addr 172.21.15.60:0/2282070914 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc757ea640 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4db40 0x55d9b8fca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc767ec640 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 0x55d9b8f5a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 -- 172.21.15.60:0/2282070914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 msgr2=0x55d9b8f5a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 0x55d9b8f5a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 -- 172.21.15.60:0/2282070914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4db40 msgr2=0x55d9b8fca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4db40 0x55d9b8fca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 -- 172.21.15.60:0/2282070914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b8f5ae60 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc75feb640 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8fca270 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0bc090 tx=0x7fcc6c03b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed19c5bc39a621af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc597fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc597fa640 1 -- 172.21.15.60:0/2282070914 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c049040 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc597fa640 1 -- 172.21.15.60:0/2282070914 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7fcc6c0d52a0 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.908+0000 7fcc7a628740 1 -- 172.21.15.60:0/2282070914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc68016040 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc597fa640 1 -- 172.21.15.60:0/2282070914 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fcc6c0bc390 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc7a628740 10 client.17418 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc7a628740 1 -- 172.21.15.60:0/2282070914 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55d9b8fd1a10 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc597fa640 1 -- 172.21.15.60:0/2282070914 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc68016040 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc597fa640 1 -- 172.21.15.60:0/2282070914 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fcc6c0dc260 con 0x55d9b8f4c5d0 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc7a628740 10 client.17418 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc7a628740 10 client.17418 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:07:37.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc7a628740 20 client.17418 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55d9b8fd1f50 0x55d9b8fd4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc7a628740 4 client.17418 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc7a628740 1 -- 172.21.15.60:0/2282070914 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9b8eb9d70 con 0x55d9b8fd1f50 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.909+0000 7fcc757ea640 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55d9b8fd1f50 0x55d9b8fd4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc597fa640 10 client.17418 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc757ea640 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55d9b8fd1f50 0x55d9b8fd4340 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b75b247b24068778 server_cookie=c5987f66274960a8 in_seq=0 out_seq=0 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc597fa640 1 -- 172.21.15.60:0/2282070914 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9b8eb9d70 con 0x55d9b8fd1f50 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc597fa640 10 client.17418 handle_command_reply: tid=0 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 client.17418 shutdown 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 -- 172.21.15.60:0/2282070914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4c5d0 msgr2=0x55d9b8fca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8fca270 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0bc090 tx=0x7fcc6c03b920 comp rx=0 tx=0).stop 2024-09-12T00:07:37.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 -- 172.21.15.60:0/2282070914 shutdown_connections 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55d9b8fd1f50 0x55d9b8fd4340 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9b8f57370 0x55d9b8f5a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9b8f4db40 0x55d9b8fca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc597fa640 0 client.17418 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 --2- 172.21.15.60:0/2282070914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9b8f4c5d0 0x55d9b8fca270 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 -- 172.21.15.60:0/2282070914 >> 172.21.15.60:0/2282070914 conn(0x55d9b8f15310 msgr2=0x55d9b8f558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 -- 172.21.15.60:0/2282070914 shutdown_connections 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.910+0000 7fcc7a628740 1 -- 172.21.15.60:0/2282070914 wait complete. 2024-09-12T00:07:37.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7a628740 20 client.17418 trim_cache size 0 max 16384 2024-09-12T00:07:37.917 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:37.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 -- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcc5c0a2d70 msgr2=0x7fcc5c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcc5c0a2d70 0x7fcc5c0a5230 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc680070b0 tx=0x7fcc6800cb80 comp rx=0 tx=0).stop 2024-09-12T00:07:37.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 -- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70100a80 msgr2=0x7fcc70198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:37.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70100a80 0x7fcc70198640 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c02a940 tx=0x7fcc6c032bf0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 -- 172.21.15.60:0/2012248188 shutdown_connections 2024-09-12T00:07:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fcc5c0a2d70 0x7fcc5c0a5230 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc70106a80 0x7fcc7019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc70101420 0x7fcc70198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 --2- 172.21.15.60:0/2012248188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc70100a80 0x7fcc70198640 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 -- 172.21.15.60:0/2012248188 >> 172.21.15.60:0/2012248188 conn(0x7fcc700fc7a0 msgr2=0x7fcc7006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 -- 172.21.15.60:0/2012248188 shutdown_connections 2024-09-12T00:07:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:37.911+0000 7fcc7824f640 1 -- 172.21.15.60:0/2012248188 wait complete. 2024-09-12T00:07:38.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:07:39.009 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:39.434 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:39 smithi060 ceph-mon[30953]: pgmap v255: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:39.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:39 smithi105 ceph-mon[34805]: pgmap v255: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.516+0000 7f939e23a640 1 -- 172.21.15.60:0/686433014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398101420 msgr2=0x7f939810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.516+0000 7f939e23a640 1 --2- 172.21.15.60:0/686433014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398101420 0x7f939810d950 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f9390009930 tx=0x7f939002a420 comp rx=0 tx=0).stop 2024-09-12T00:07:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.516+0000 7f939e23a640 1 -- 172.21.15.60:0/686433014 shutdown_connections 2024-09-12T00:07:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.516+0000 7f939e23a640 1 --2- 172.21.15.60:0/686433014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398101420 0x7f939810d950 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.516+0000 7f939e23a640 1 --2- 172.21.15.60:0/686433014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9398100a80 0x7f9398100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.516+0000 7f939e23a640 1 --2- 172.21.15.60:0/686433014 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9398106a80 0x7f9398106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.516+0000 7f939e23a640 1 -- 172.21.15.60:0/686433014 >> 172.21.15.60:0/686433014 conn(0x7f93980fc7a0 msgr2=0x7f93980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.517+0000 7f939e23a640 1 -- 172.21.15.60:0/686433014 shutdown_connections 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.517+0000 7f939e23a640 1 -- 172.21.15.60:0/686433014 wait complete. 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.517+0000 7f939e23a640 1 Processor -- start 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.517+0000 7f939e23a640 1 -- start start 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.517+0000 7f939e23a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398100a80 0x7f9398197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f939e23a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9398101420 0x7f9398197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f939e23a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9398106a80 0x7f9398197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f939e23a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9398110fa0 con 0x7f9398100a80 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f939e23a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9398110e20 con 0x7f9398101420 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f939e23a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9398111120 con 0x7f9398106a80 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398100a80 0x7f9398197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398100a80 0x7f9398197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35946/0 (socket says 172.21.15.60:35946) 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 -- 172.21.15.60:0/4049957816 learned_addr learned my addr 172.21.15.60:0/4049957816 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f9396ffd640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9398101420 0x7f9398197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f9397fff640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9398106a80 0x7f9398197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 -- 172.21.15.60:0/4049957816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9398106a80 msgr2=0x7f9398197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9398106a80 0x7f9398197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 -- 172.21.15.60:0/4049957816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9398101420 msgr2=0x7f9398197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9398101420 0x7f9398197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 -- 172.21.15.60:0/4049957816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93981a69b0 con 0x7f9398100a80 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f9397fff640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9398106a80 0x7f9398197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f93977fe640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398100a80 0x7f9398197140 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f938800cce0 tx=0x7f938800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f9394ff9640 1 -- 172.21.15.60:0/4049957816 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388004b20 con 0x7f9398100a80 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f9394ff9640 1 -- 172.21.15.60:0/4049957816 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9388004cc0 con 0x7f9398100a80 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f939e23a640 1 -- 172.21.15.60:0/4049957816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93981a6ca0 con 0x7f9398100a80 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f9394ff9640 1 -- 172.21.15.60:0/4049957816 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938800f870 con 0x7f9398100a80 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.518+0000 7f939e23a640 1 -- 172.21.15.60:0/4049957816 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93981a71d0 con 0x7f9398100a80 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.521+0000 7f9394ff9640 1 -- 172.21.15.60:0/4049957816 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f938800fa10 con 0x7f9398100a80 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.521+0000 7f93a0613740 1 Processor -- start 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93a0613740 1 -- start start 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93a0613740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2682090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93a0613740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 0x5623c2682a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93a0613740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c268f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93a0613740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5623c25e82f0 con 0x5623c2683b40 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93a0613740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5623c258fcf0 con 0x5623c268d370 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93a0613740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5623c25e42b0 con 0x5623c26825d0 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9397fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2682090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9397fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2682090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35950/0 (socket says 172.21.15.60:35950) 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9397fff640 1 -- 172.21.15.60:0/3088915448 learned_addr learned my addr 172.21.15.60:0/3088915448 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93977fe640 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 0x5623c2682a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9396ffd640 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c268f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.539 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:39 smithi192 ceph-mon[35487]: pgmap v255: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9397fff640 1 -- 172.21.15.60:0/3088915448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 msgr2=0x5623c2682a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9397fff640 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 0x5623c2682a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9397fff640 1 -- 172.21.15.60:0/3088915448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 msgr2=0x5623c268f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9397fff640 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c268f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9397fff640 1 -- 172.21.15.60:0/3088915448 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c25743a0 con 0x5623c2683b40 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f9394ff9640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93800a2d70 0x7f93800a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.522+0000 7f93977fe640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93800a2d70 0x7f93800a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.523+0000 7f9397fff640 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2682090 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f9390009930 tx=0x7f9390032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f80912325a80c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.523+0000 7f9394ff9640 1 -- 172.21.15.60:0/4049957816 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f93880cf3e0 con 0x7f9398100a80 2024-09-12T00:07:39.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.523+0000 7f937dffb640 1 -- 172.21.15.60:0/3088915448 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939003f070 con 0x5623c2683b40 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.523+0000 7f937dffb640 1 -- 172.21.15.60:0/3088915448 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9390031840 con 0x5623c2683b40 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.523+0000 7f937dffb640 1 -- 172.21.15.60:0/3088915448 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390035070 con 0x5623c2683b40 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.523+0000 7f93a0613740 1 -- 172.21.15.60:0/3088915448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 msgr2=0x5623c2682090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.523+0000 7f93a0613740 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2682090 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f9390009930 tx=0x7f9390032d30 comp rx=0 tx=0).stop 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.523+0000 7f93977fe640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93800a2d70 0x7f93800a5230 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f93880ccc00 tx=0x7f93880059f0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 -- 172.21.15.60:0/3088915448 shutdown_connections 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c268f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 0x5623c2682a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 --2- 172.21.15.60:0/3088915448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2682090 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 -- 172.21.15.60:0/3088915448 >> 172.21.15.60:0/3088915448 conn(0x5623c264b310 msgr2=0x5623c267ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:39.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 -- 172.21.15.60:0/3088915448 shutdown_connections 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 -- 172.21.15.60:0/3088915448 wait complete. 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 -- start start 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 Processor -- start 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c26825d0 0x5623c268cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c2683b40 0x5623c2689fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c268a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5623c2690010 con 0x5623c26825d0 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5623c25a3060 con 0x5623c268d370 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5623c2690190 con 0x5623c2683b40 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.524+0000 7f93a0613740 10 client.0 _ll_register_callbacks cb 0x5623c22f68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:39.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c26825d0 0x5623c268cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c26825d0 0x5623c268cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35954/0 (socket says 172.21.15.60:35954) 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 -- 172.21.15.60:0/3949704524 learned_addr learned my addr 172.21.15.60:0/3949704524 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c268a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9396ffd640 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c2683b40 0x5623c2689fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 -- 172.21.15.60:0/3949704524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c2683b40 msgr2=0x5623c2689fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c2683b40 0x5623c2689fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 -- 172.21.15.60:0/3949704524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 msgr2=0x5623c268a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c268a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 -- 172.21.15.60:0/3949704524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c23593c0 con 0x5623c26825d0 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9397fff640 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c26825d0 0x5623c268cd20 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f939002a940 tx=0x7f9390005410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887bb94343932de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9376ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:39.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9376ffd640 1 -- 172.21.15.60:0/3949704524 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390050060 con 0x5623c26825d0 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9376ffd640 1 -- 172.21.15.60:0/3949704524 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f93900035f0 con 0x5623c26825d0 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f93a0613740 1 -- 172.21.15.60:0/3949704524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9390031840 con 0x5623c26825d0 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.525+0000 7f9376ffd640 1 -- 172.21.15.60:0/3949704524 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f939003f040 con 0x5623c26825d0 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f93a0613740 10 client.17430 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f93a0613740 1 -- 172.21.15.60:0/3949704524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5623c269ba90 con 0x5623c26825d0 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f9376ffd640 1 -- 172.21.15.60:0/3949704524 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9390031840 con 0x5623c26825d0 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f9376ffd640 1 -- 172.21.15.60:0/3949704524 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f9390004a70 con 0x5623c26825d0 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f93a0613740 10 client.17430 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f93a0613740 10 client.17430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:39.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f93a0613740 20 client.17430 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f93a0613740 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5623c269cde0 0x5623c269f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f93a0613740 4 client.17430 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f93a0613740 1 -- 172.21.15.60:0/3949704524 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623c25f5860 con 0x5623c269cde0 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.526+0000 7f9396ffd640 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5623c269cde0 0x5623c269f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.527+0000 7f9396ffd640 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5623c269cde0 0x5623c269f1d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46852b3e07a088db server_cookie=5d4612a3d1ccb5ae in_seq=0 out_seq=0 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.527+0000 7f9376ffd640 10 client.17430 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.527+0000 7f9376ffd640 1 -- 172.21.15.60:0/3949704524 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623c25f5860 con 0x5623c269cde0 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.527+0000 7f9376ffd640 10 client.17430 handle_command_reply: tid=0 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 client.17430 shutdown 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 -- 172.21.15.60:0/3949704524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c26825d0 msgr2=0x5623c268cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c26825d0 0x5623c268cd20 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f939002a940 tx=0x7f9390005410 comp rx=0 tx=0).stop 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 -- 172.21.15.60:0/3949704524 shutdown_connections 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5623c269cde0 0x5623c269f1d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c268a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c2683b40 0x5623c2689fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 --2- 172.21.15.60:0/3949704524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c26825d0 0x5623c268cd20 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f9376ffd640 0 client.17430 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 -- 172.21.15.60:0/3949704524 >> 172.21.15.60:0/3949704524 conn(0x5623c264b310 msgr2=0x5623c2684930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 -- 172.21.15.60:0/3949704524 shutdown_connections 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 1 -- 172.21.15.60:0/3949704524 wait complete. 2024-09-12T00:07:39.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.528+0000 7f93a0613740 20 client.17430 trim_cache size 0 max 16384 2024-09-12T00:07:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f93a0613740 1 Processor -- start 2024-09-12T00:07:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f93a0613740 1 -- start start 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f93a0613740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 0x5623c267dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f93a0613740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2687230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f93a0613740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c2687770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f93a0613740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93981afb00 con 0x5623c2683b40 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f93a0613740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f93981b1640 con 0x5623c268d370 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f93a0613740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93981b01d0 con 0x5623c26825d0 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f9396ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2687230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f9396ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2687230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35968/0 (socket says 172.21.15.60:35968) 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f9396ffd640 1 -- 172.21.15.60:0/1833362288 learned_addr learned my addr 172.21.15.60:0/1833362288 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.542+0000 7f9397fff640 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 0x5623c267dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f9397fff640 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c2687770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f9396ffd640 1 -- 172.21.15.60:0/1833362288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 msgr2=0x5623c267dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f9396ffd640 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 0x5623c267dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f9396ffd640 1 -- 172.21.15.60:0/1833362288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 msgr2=0x5623c2687770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f9396ffd640 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c2687770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f9396ffd640 1 -- 172.21.15.60:0/1833362288 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c2685120 con 0x5623c2683b40 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f9397fff640 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c2687770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f9396ffd640 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2687230 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f938c00b6e0 tx=0x7f938c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a52d6f80018142 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f937d7fa640 1 -- 172.21.15.60:0/1833362288 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c022020 con 0x5623c2683b40 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f937d7fa640 1 -- 172.21.15.60:0/1833362288 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f938c003ea0 con 0x5623c2683b40 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.543+0000 7f937d7fa640 1 -- 172.21.15.60:0/1833362288 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0119d0 con 0x5623c2683b40 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 -- 172.21.15.60:0/1833362288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 msgr2=0x5623c2687230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2687230 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f938c00b6e0 tx=0x7f938c00bf50 comp rx=0 tx=0).stop 2024-09-12T00:07:39.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 -- 172.21.15.60:0/1833362288 shutdown_connections 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c268d370 0x5623c2687770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c2687230 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 --2- 172.21.15.60:0/1833362288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c26825d0 0x5623c267dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 -- 172.21.15.60:0/1833362288 >> 172.21.15.60:0/1833362288 conn(0x5623c264b310 msgr2=0x5623c267d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 -- 172.21.15.60:0/1833362288 shutdown_connections 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 -- 172.21.15.60:0/1833362288 wait complete. 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.544+0000 7f93a0613740 1 -- start start 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f93a0613740 1 Processor -- start 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f93a0613740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c26825d0 0x5623c26a2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f93a0613740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c26a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f93a0613740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c268d370 0x5623c26a1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f93a0613740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93981b0f70 con 0x5623c2683b40 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f93a0613740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f93981b08a0 con 0x5623c26825d0 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f93a0613740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93981adb00 con 0x5623c268d370 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f93a0613740 10 client.0 _ll_register_callbacks cb 0x7f9390032c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9396ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c26a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9396ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c26a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35970/0 (socket says 172.21.15.60:35970) 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9396ffd640 1 -- 172.21.15.60:0/3749482380 learned_addr learned my addr 172.21.15.60:0/3749482380 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9397fff640 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c26825d0 0x5623c26a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9397fff640 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c268d370 0x5623c26a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9396ffd640 1 -- 172.21.15.60:0/3749482380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c268d370 msgr2=0x5623c26a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9396ffd640 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c268d370 0x5623c26a1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9396ffd640 1 -- 172.21.15.60:0/3749482380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c26825d0 msgr2=0x5623c26a2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9396ffd640 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c26825d0 0x5623c26a2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.545+0000 7f9396ffd640 1 -- 172.21.15.60:0/3749482380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c26a1540 con 0x5623c2683b40 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f9396ffd640 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c26a0ac0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f938c004590 tx=0x7f938c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925e19417622331d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f9376ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f9376ffd640 1 -- 172.21.15.60:0/3749482380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c005030 con 0x5623c2683b40 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f9376ffd640 1 -- 172.21.15.60:0/3749482380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f938c0051d0 con 0x5623c2683b40 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 1 -- 172.21.15.60:0/3749482380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f938c003ea0 con 0x5623c2683b40 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f9376ffd640 1 -- 172.21.15.60:0/3749482380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f938c038050 con 0x5623c2683b40 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 10 client.17436 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 1 -- 172.21.15.60:0/3749482380 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5623c27083e0 con 0x5623c2683b40 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f9376ffd640 1 -- 172.21.15.60:0/3749482380 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f938c003ea0 con 0x5623c2683b40 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f9376ffd640 1 -- 172.21.15.60:0/3749482380 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f938c004990 con 0x5623c2683b40 2024-09-12T00:07:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 10 client.17436 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 10 client.17436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 20 client.17436 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5623c2708a80 0x5623c270aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 4 client.17436 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.546+0000 7f93a0613740 1 -- 172.21.15.60:0/3749482380 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5623c25efd70 con 0x5623c2708a80 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.547+0000 7f9397fff640 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5623c2708a80 0x5623c270aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.547+0000 7f9376ffd640 10 client.17436 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.547+0000 7f9397fff640 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5623c2708a80 0x5623c270aea0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d2ed05f642979b1 server_cookie=c011bccf98c217fc in_seq=0 out_seq=0 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.547+0000 7f9376ffd640 1 -- 172.21.15.60:0/3749482380 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5623c25efd70 con 0x5623c2708a80 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.547+0000 7f9376ffd640 10 client.17436 handle_command_reply: tid=0 2024-09-12T00:07:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.547+0000 7f93a0613740 1 client.17436 shutdown 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 -- 172.21.15.60:0/3749482380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 msgr2=0x5623c26a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c26a0ac0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f938c004590 tx=0x7f938c011440 comp rx=0 tx=0).stop 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 -- 172.21.15.60:0/3749482380 shutdown_connections 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5623c2708a80 0x5623c270aea0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5623c268d370 0x5623c26a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5623c2683b40 0x5623c26a0ac0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f9376ffd640 0 client.17436 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 --2- 172.21.15.60:0/3749482380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5623c26825d0 0x5623c26a2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 -- 172.21.15.60:0/3749482380 >> 172.21.15.60:0/3749482380 conn(0x5623c264b310 msgr2=0x5623c2684930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 -- 172.21.15.60:0/3749482380 shutdown_connections 2024-09-12T00:07:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 1 -- 172.21.15.60:0/3749482380 wait complete. 2024-09-12T00:07:39.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f93a0613740 20 client.17436 trim_cache size 0 max 16384 2024-09-12T00:07:39.562 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:07:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f939e23a640 1 -- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93800a2d70 msgr2=0x7f93800a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f939e23a640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93800a2d70 0x7f93800a5230 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f93880ccc00 tx=0x7f93880059f0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.548+0000 7f939e23a640 1 -- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398100a80 msgr2=0x7f9398197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398100a80 0x7f9398197140 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f938800cce0 tx=0x7f938800a620 comp rx=0 tx=0).stop 2024-09-12T00:07:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 -- 172.21.15.60:0/4049957816 shutdown_connections 2024-09-12T00:07:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f93800a2d70 0x7f93800a5230 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9398106a80 0x7f9398197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9398101420 0x7f9398197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 --2- 172.21.15.60:0/4049957816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9398100a80 0x7f9398197140 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 -- 172.21.15.60:0/4049957816 >> 172.21.15.60:0/4049957816 conn(0x7f93980fc7a0 msgr2=0x7f93980fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 -- 172.21.15.60:0/4049957816 shutdown_connections 2024-09-12T00:07:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:39.549+0000 7f939e23a640 1 -- 172.21.15.60:0/4049957816 wait complete. 2024-09-12T00:07:41.269 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:07:41.270 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:07:41.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:41 smithi105 ceph-mon[34805]: pgmap v256: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:41.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:41 smithi192 ceph-mon[35487]: pgmap v256: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:41.541 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:41.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:41 smithi060 ceph-mon[30953]: pgmap v256: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:42.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.004+0000 7f68ca97f640 1 -- 172.21.15.60:0/3493421021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4106a80 msgr2=0x7f68c4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.004+0000 7f68ca97f640 1 --2- 172.21.15.60:0/3493421021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4106a80 0x7f68c4106e60 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009930 tx=0x7f68b402a420 comp rx=0 tx=0).stop 2024-09-12T00:07:42.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.004+0000 7f68ca97f640 1 -- 172.21.15.60:0/3493421021 shutdown_connections 2024-09-12T00:07:42.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.004+0000 7f68ca97f640 1 --2- 172.21.15.60:0/3493421021 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c4101420 0x7f68c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.004+0000 7f68ca97f640 1 --2- 172.21.15.60:0/3493421021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68c4100a80 0x7f68c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.004+0000 7f68ca97f640 1 --2- 172.21.15.60:0/3493421021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4106a80 0x7f68c4106e60 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.004+0000 7f68ca97f640 1 -- 172.21.15.60:0/3493421021 >> 172.21.15.60:0/3493421021 conn(0x7f68c40fc7a0 msgr2=0x7f68c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.005+0000 7f68ca97f640 1 -- 172.21.15.60:0/3493421021 shutdown_connections 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.005+0000 7f68ca97f640 1 -- 172.21.15.60:0/3493421021 wait complete. 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.005+0000 7f68ca97f640 1 Processor -- start 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.005+0000 7f68ca97f640 1 -- start start 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68ca97f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68c4100a80 0x7f68c40fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68ca97f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4101420 0x7f68c40fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68ca97f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c4106a80 0x7f68c40fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68ca97f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4110fe0 con 0x7f68c4101420 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68ca97f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4110e60 con 0x7f68c4106a80 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68ca97f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f68c4111160 con 0x7f68c4100a80 2024-09-12T00:07:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4101420 0x7f68c40fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4101420 0x7f68c40fd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50858/0 (socket says 172.21.15.60:50858) 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 -- 172.21.15.60:0/458770578 learned_addr learned my addr 172.21.15.60:0/458770578 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c4106a80 0x7f68c40fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c3fff640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68c4100a80 0x7f68c40fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 -- 172.21.15.60:0/458770578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68c4100a80 msgr2=0x7f68c40fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68c4100a80 0x7f68c40fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 -- 172.21.15.60:0/458770578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c4106a80 msgr2=0x7f68c40fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c4106a80 0x7f68c40fd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 -- 172.21.15.60:0/458770578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c41a6a90 con 0x7f68c4101420 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c3fff640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68c4100a80 0x7f68c40fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c4106a80 0x7f68c40fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c37fe640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4101420 0x7f68c40fd300 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f68b800b4a0 tx=0x7f68b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:42.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.006+0000 7f68c17fa640 1 -- 172.21.15.60:0/458770578 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8014070 con 0x7f68c4101420 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.007+0000 7f68ca97f640 1 -- 172.21.15.60:0/458770578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c41a6d80 con 0x7f68c4101420 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.007+0000 7f68c17fa640 1 -- 172.21.15.60:0/458770578 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68b8010b10 con 0x7f68c4101420 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.007+0000 7f68ca97f640 1 -- 172.21.15.60:0/458770578 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c41a7240 con 0x7f68c4101420 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.007+0000 7f68c17fa640 1 -- 172.21.15.60:0/458770578 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8017d60 con 0x7f68c4101420 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68c17fa640 1 -- 172.21.15.60:0/458770578 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f68b8017070 con 0x7f68c4101420 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68ccd58740 1 Processor -- start 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68ccd58740 1 -- start start 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada7b60 0x55851ada7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada8480 0x55851adb2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68ccd58740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55851ad0d280 con 0x55851ada8480 2024-09-12T00:07:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68ccd58740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55851acb4b10 con 0x55851adb2d40 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68ccd58740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55851ad09240 con 0x55851ada7b60 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada8480 0x55851adb2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.009+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada8480 0x55851adb2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50862/0 (socket says 172.21.15.60:50862) 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c3fff640 1 -- 172.21.15.60:0/246631639 learned_addr learned my addr 172.21.15.60:0/246631639 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c17fa640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68ac0a2cf0 0x7f68ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c37fe640 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68ac0a2cf0 0x7f68ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c17fa640 1 -- 172.21.15.60:0/458770578 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f68b80ce6a0 con 0x7f68c4101420 2024-09-12T00:07:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c3fff640 1 -- 172.21.15.60:0/246631639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada7b60 msgr2=0x55851ada7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c3fff640 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada7b60 0x55851ada7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c3fff640 1 -- 172.21.15.60:0/246631639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 msgr2=0x55851adb5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c3fff640 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c3fff640 1 -- 172.21.15.60:0/246631639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851acc11f0 con 0x55851ada8480 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c37fe640 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c3fff640 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada8480 0x55851adb2800 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009930 tx=0x7f68b4032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa39286994377dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68ac0a2cf0 0x7f68ac0a51b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009fd0 tx=0x7f68bc005bd0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68aa7fc640 1 -- 172.21.15.60:0/246631639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b403f070 con 0x55851ada8480 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68aa7fc640 1 -- 172.21.15.60:0/246631639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68b4031840 con 0x55851ada8480 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.010+0000 7f68aa7fc640 1 -- 172.21.15.60:0/246631639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4035070 con 0x55851ada8480 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 -- 172.21.15.60:0/246631639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada8480 msgr2=0x55851adb2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada8480 0x55851adb2800 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009930 tx=0x7f68b4032d30 comp rx=0 tx=0).stop 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 -- 172.21.15.60:0/246631639 shutdown_connections 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada8480 0x55851adb2800 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 --2- 172.21.15.60:0/246631639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada7b60 0x55851ada7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 -- 172.21.15.60:0/246631639 >> 172.21.15.60:0/246631639 conn(0x55851ada40f0 msgr2=0x55851ada44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 -- 172.21.15.60:0/246631639 shutdown_connections 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.011+0000 7f68ccd58740 1 -- 172.21.15.60:0/246631639 wait complete. 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 1 -- start start 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 1 Processor -- start 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adafbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada8480 0x55851adb0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55851adb5910 con 0x55851ada7b60 2024-09-12T00:07:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55851acc7f10 con 0x55851adb2d40 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55851adb5a90 con 0x55851ada8480 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68ccd58740 10 client.0 _ll_register_callbacks cb 0x55851ac90a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adafbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adafbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50866/0 (socket says 172.21.15.60:50866) 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68c3fff640 1 -- 172.21.15.60:0/487940357 learned_addr learned my addr 172.21.15.60:0/487940357 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68c37fe640 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada8480 0x55851adb0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.012+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68c3fff640 1 -- 172.21.15.60:0/487940357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada8480 msgr2=0x55851adb0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68c3fff640 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada8480 0x55851adb0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68c3fff640 1 -- 172.21.15.60:0/487940357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 msgr2=0x55851adb0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68c3fff640 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68c3fff640 1 -- 172.21.15.60:0/487940357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851aa7e6a0 con 0x55851ada7b60 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68c3fff640 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adafbd0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f68b402a460 tx=0x7f68b40050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67a03e72f486661 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68a37fe640 1 -- 172.21.15.60:0/487940357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b404a020 con 0x55851ada7b60 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68a37fe640 1 -- 172.21.15.60:0/487940357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f68b40046c0 con 0x55851ada7b60 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68ccd58740 1 -- 172.21.15.60:0/487940357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68b4031840 con 0x55851ada7b60 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68a37fe640 1 -- 172.21.15.60:0/487940357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f68b4055050 con 0x55851ada7b60 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68ccd58740 10 client.17448 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68ccd58740 1 -- 172.21.15.60:0/487940357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55851adc14f0 con 0x55851ada7b60 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.013+0000 7f68a37fe640 1 -- 172.21.15.60:0/487940357 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68b4031840 con 0x55851ada7b60 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.014+0000 7f68a37fe640 1 -- 172.21.15.60:0/487940357 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f68b40039f0 con 0x55851ada7b60 2024-09-12T00:07:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.014+0000 7f68ccd58740 10 client.17448 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.014+0000 7f68ccd58740 10 client.17448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.014+0000 7f68ccd58740 20 client.17448 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.014+0000 7f68ccd58740 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55851adc2840 0x55851adc4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.014+0000 7f68ccd58740 4 client.17448 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.014+0000 7f68ccd58740 1 -- 172.21.15.60:0/487940357 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55851ad1a7f0 con 0x55851adc2840 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.014+0000 7f68c37fe640 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55851adc2840 0x55851adc4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.015+0000 7f68a37fe640 10 client.17448 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.015+0000 7f68c37fe640 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55851adc2840 0x55851adc4c30 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3417779810fc12ab server_cookie=76f04076d27149a5 in_seq=0 out_seq=0 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.015+0000 7f68a37fe640 1 -- 172.21.15.60:0/487940357 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55851ad1a7f0 con 0x55851adc2840 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.015+0000 7f68a37fe640 10 client.17448 handle_command_reply: tid=0 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.015+0000 7f68ccd58740 1 client.17448 shutdown 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 -- 172.21.15.60:0/487940357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 msgr2=0x55851adafbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adafbd0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f68b402a460 tx=0x7f68b40050e0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 -- 172.21.15.60:0/487940357 shutdown_connections 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55851adc2840 0x55851adc4c30 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851adb2d40 0x55851adb0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851ada8480 0x55851adb0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68a37fe640 0 client.17448 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 --2- 172.21.15.60:0/487940357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adafbd0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 -- 172.21.15.60:0/487940357 >> 172.21.15.60:0/487940357 conn(0x55851ada40f0 msgr2=0x55851ada9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 -- 172.21.15.60:0/487940357 shutdown_connections 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 1 -- 172.21.15.60:0/487940357 wait complete. 2024-09-12T00:07:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.016+0000 7f68ccd58740 20 client.17448 trim_cache size 0 max 16384 2024-09-12T00:07:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.033+0000 7f68ccd58740 1 Processor -- start 2024-09-12T00:07:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.033+0000 7f68ccd58740 1 -- start start 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adaa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851ada3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68ccd58740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68c41afbc0 con 0x55851ada7b60 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68ccd58740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68c41b1700 con 0x55851ada8480 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68ccd58740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f68c41b0290 con 0x55851adb2d40 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adaa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adaa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50874/0 (socket says 172.21.15.60:50874) 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 -- 172.21.15.60:0/2473329701 learned_addr learned my addr 172.21.15.60:0/2473329701 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c37fe640 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851ada3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 -- 172.21.15.60:0/2473329701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 msgr2=0x55851ada3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851ada3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 -- 172.21.15.60:0/2473329701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 msgr2=0x55851adab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 -- 172.21.15.60:0/2473329701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55851adae120 con 0x55851ada7b60 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c37fe640 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851ada3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68c3fff640 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adaa5c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f68b402a940 tx=0x7f68b4032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b030c6ffe3f147eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.034+0000 7f68a9ffb640 1 -- 172.21.15.60:0/2473329701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b404a070 con 0x55851ada7b60 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68a9ffb640 1 -- 172.21.15.60:0/2473329701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68b4003af0 con 0x55851ada7b60 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68a9ffb640 1 -- 172.21.15.60:0/2473329701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b403f070 con 0x55851ada7b60 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 -- 172.21.15.60:0/2473329701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 msgr2=0x55851adaa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adaa5c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f68b402a940 tx=0x7f68b4032c10 comp rx=0 tx=0).stop 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 -- 172.21.15.60:0/2473329701 shutdown_connections 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851ada3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 --2- 172.21.15.60:0/2473329701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adaa5c0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 -- 172.21.15.60:0/2473329701 >> 172.21.15.60:0/2473329701 conn(0x55851ada40f0 msgr2=0x55851ada2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 -- 172.21.15.60:0/2473329701 shutdown_connections 2024-09-12T00:07:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.035+0000 7f68ccd58740 1 -- 172.21.15.60:0/2473329701 wait complete. 2024-09-12T00:07:42.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 1 -- start start 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 1 Processor -- start 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adb6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adb6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851adb74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68c41b1030 con 0x55851ada7b60 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68c41b0960 con 0x55851ada8480 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f68c41adbc0 con 0x55851adb2d40 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68ccd58740 10 client.0 _ll_register_callbacks cb 0x7f68b4032c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adb6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adb6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50884/0 (socket says 172.21.15.60:50884) 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.036+0000 7f68c3fff640 1 -- 172.21.15.60:0/4178363314 learned_addr learned my addr 172.21.15.60:0/4178363314 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c8f1c640 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851adb74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c37fe640 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adb6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c3fff640 1 -- 172.21.15.60:0/4178363314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 msgr2=0x55851adb74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c3fff640 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851adb74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c3fff640 1 -- 172.21.15.60:0/4178363314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 msgr2=0x55851adb6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c3fff640 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adb6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c3fff640 1 -- 172.21.15.60:0/4178363314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55851ae2c1a0 con 0x55851ada7b60 2024-09-12T00:07:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c37fe640 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adb6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68c3fff640 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adb6a60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f68b4005db0 tx=0x7f68b4031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b040fe13b4d02e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68a37fe640 1 -- 172.21.15.60:0/4178363314 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b403f070 con 0x55851ada7b60 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68a37fe640 1 -- 172.21.15.60:0/4178363314 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f68b40037f0 con 0x55851ada7b60 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68ccd58740 1 -- 172.21.15.60:0/4178363314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68b4003af0 con 0x55851ada7b60 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68a37fe640 1 -- 172.21.15.60:0/4178363314 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f68b404a040 con 0x55851ada7b60 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68ccd58740 10 client.17454 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.037+0000 7f68ccd58740 1 -- 172.21.15.60:0/4178363314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55851ae2d3d0 con 0x55851ada7b60 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68a37fe640 1 -- 172.21.15.60:0/4178363314 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68b4003af0 con 0x55851ada7b60 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68a37fe640 1 -- 172.21.15.60:0/4178363314 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f68b4069020 con 0x55851ada7b60 2024-09-12T00:07:42.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68ccd58740 10 client.17454 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68ccd58740 10 client.17454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68ccd58740 20 client.17454 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68ccd58740 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55851ae2d890 0x55851ae2fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68ccd58740 4 client.17454 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68ccd58740 1 -- 172.21.15.60:0/4178363314 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55851ad14d00 con 0x55851ae2d890 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68c37fe640 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55851ae2d890 0x55851ae2fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68c37fe640 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55851ae2d890 0x55851ae2fc80 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1fa8641a5221dc7 server_cookie=80b6ececd01fd16f in_seq=0 out_seq=0 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.038+0000 7f68a37fe640 10 client.17454 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68a37fe640 1 -- 172.21.15.60:0/4178363314 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55851ad14d00 con 0x55851ae2d890 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68a37fe640 10 client.17454 handle_command_reply: tid=0 2024-09-12T00:07:42.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 client.17454 shutdown 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 -- 172.21.15.60:0/4178363314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 msgr2=0x55851adb6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adb6a60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f68b4005db0 tx=0x7f68b4031870 comp rx=0 tx=0).stop 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 -- 172.21.15.60:0/4178363314 shutdown_connections 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55851ae2d890 0x55851ae2fc80 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55851adb2d40 0x55851adb74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55851ada8480 0x55851adb6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 --2- 172.21.15.60:0/4178363314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55851ada7b60 0x55851adb6a60 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 -- 172.21.15.60:0/4178363314 >> 172.21.15.60:0/4178363314 conn(0x55851ada40f0 msgr2=0x55851ada3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68a37fe640 0 client.17454 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 -- 172.21.15.60:0/4178363314 shutdown_connections 2024-09-12T00:07:42.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 1 -- 172.21.15.60:0/4178363314 wait complete. 2024-09-12T00:07:42.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.040+0000 7f68ccd58740 20 client.17454 trim_cache size 0 max 16384 2024-09-12T00:07:42.048 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:07:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:07:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "de56934b-b0ac-4374-8e9e-4bf249ef1f45", 2024-09-12T00:07:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:07:42.048 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:07:42.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 -- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68ac0a2cf0 msgr2=0x7f68ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68ac0a2cf0 0x7f68ac0a51b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009fd0 tx=0x7f68bc005bd0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 -- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4101420 msgr2=0x7f68c40fd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:42.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4101420 0x7f68c40fd300 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f68b800b4a0 tx=0x7f68b800b960 comp rx=0 tx=0).stop 2024-09-12T00:07:42.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 -- 172.21.15.60:0/458770578 shutdown_connections 2024-09-12T00:07:42.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f68ac0a2cf0 0x7f68ac0a51b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c4106a80 0x7f68c40fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68c4101420 0x7f68c40fd300 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 --2- 172.21.15.60:0/458770578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68c4100a80 0x7f68c40fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:42.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 -- 172.21.15.60:0/458770578 >> 172.21.15.60:0/458770578 conn(0x7f68c40fc7a0 msgr2=0x7f68c406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:42.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 -- 172.21.15.60:0/458770578 shutdown_connections 2024-09-12T00:07:42.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:42.041+0000 7f68ca97f640 1 -- 172.21.15.60:0/458770578 wait complete. 2024-09-12T00:07:42.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:42 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:07:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:42 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:07:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:42 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:07:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:42 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:07:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:42 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:07:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:42 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:07:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:07:42.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:07:43.185 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:07:43.306 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:43 smithi060 ceph-mon[30953]: pgmap v257: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:43 smithi105 ceph-mon[34805]: pgmap v257: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:43.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:43 smithi192 ceph-mon[35487]: pgmap v257: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:43.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 -- 172.21.15.60:0/2667843271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81036e0 msgr2=0x7f95a8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 --2- 172.21.15.60:0/2667843271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81036e0 0x7f95a8107b90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f9598009930 tx=0x7f959802a420 comp rx=0 tx=0).stop 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 -- 172.21.15.60:0/2667843271 shutdown_connections 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 --2- 172.21.15.60:0/2667843271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a81082a0 0x7f95a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 --2- 172.21.15.60:0/2667843271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81036e0 0x7f95a8107b90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 --2- 172.21.15.60:0/2667843271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95a8102d30 0x7f95a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 -- 172.21.15.60:0/2667843271 >> 172.21.15.60:0/2667843271 conn(0x7f95a80fc7d0 msgr2=0x7f95a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 -- 172.21.15.60:0/2667843271 shutdown_connections 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.674+0000 7f95af9d7640 1 -- 172.21.15.60:0/2667843271 wait complete. 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95af9d7640 1 Processor -- start 2024-09-12T00:07:43.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95af9d7640 1 -- start start 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95af9d7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95a8102d30 0x7f95a81986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95af9d7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a81036e0 0x7f95a8198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95af9d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81082a0 0x7f95a819cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95af9d7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95a81121c0 con 0x7f95a81082a0 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95af9d7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95a8112040 con 0x7f95a81036e0 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95af9d7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95a8112340 con 0x7f95a8102d30 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95adf74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81082a0 0x7f95a819cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95adf74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81082a0 0x7f95a819cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50912/0 (socket says 172.21.15.60:50912) 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.675+0000 7f95adf74640 1 -- 172.21.15.60:0/178220485 learned_addr learned my addr 172.21.15.60:0/178220485 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95ad773640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95a8102d30 0x7f95a81986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95acf72640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a81036e0 0x7f95a8198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95adf74640 1 -- 172.21.15.60:0/178220485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95a8102d30 msgr2=0x7f95a81986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95adf74640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95a8102d30 0x7f95a81986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95adf74640 1 -- 172.21.15.60:0/178220485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a81036e0 msgr2=0x7f95a8198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95adf74640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a81036e0 0x7f95a8198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95adf74640 1 -- 172.21.15.60:0/178220485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a819d650 con 0x7f95a81082a0 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95acf72640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a81036e0 0x7f95a8198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95adf74640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81082a0 0x7f95a819cf70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f95a000cad0 tx=0x7f95a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f959e7fc640 1 -- 172.21.15.60:0/178220485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a000ae20 con 0x7f95a81082a0 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95af9d7640 1 -- 172.21.15.60:0/178220485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a819d940 con 0x7f95a81082a0 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f959e7fc640 1 -- 172.21.15.60:0/178220485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95a0004b20 con 0x7f95a81082a0 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f959e7fc640 1 -- 172.21.15.60:0/178220485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a000f780 con 0x7f95a81082a0 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.676+0000 7f95af9d7640 1 -- 172.21.15.60:0/178220485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a81a5220 con 0x7f95a81082a0 2024-09-12T00:07:43.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f959e7fc640 1 -- 172.21.15.60:0/178220485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f95a0004cd0 con 0x7f95a81082a0 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f95b1db0740 1 Processor -- start 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f95b1db0740 1 -- start start 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a14a0 0x558f4d5a1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a1dc0 0x558f4d5ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5ac680 0x558f4d5aea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f95b1db0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558f4d5072e0 con 0x558f4d5a1dc0 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f95b1db0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558f4d4aece0 con 0x558f4d5a14a0 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.679+0000 7f95b1db0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558f4d5032a0 con 0x558f4d5ac680 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a1dc0 0x558f4d5ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f959e7fc640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95940a2cf0 0x7f95940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a1dc0 0x558f4d5ac140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50924/0 (socket says 172.21.15.60:50924) 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 -- 172.21.15.60:0/2731429802 learned_addr learned my addr 172.21.15.60:0/2731429802 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95acf72640 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5ac680 0x558f4d5aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95acf72640 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a14a0 0x558f4d5a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95adf74640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95940a2cf0 0x7f95940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f959e7fc640 1 -- 172.21.15.60:0/178220485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f95a00cf4d0 con 0x7f95a81082a0 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 -- 172.21.15.60:0/2731429802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5ac680 msgr2=0x558f4d5aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5ac680 0x558f4d5aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 -- 172.21.15.60:0/2731429802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a14a0 msgr2=0x558f4d5a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a14a0 0x558f4d5a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 -- 172.21.15.60:0/2731429802 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f4d493440 con 0x558f4d5a1dc0 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95acf72640 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5ac680 0x558f4d5aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:07:43.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95adf74640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95940a2cf0 0x7f95940a51b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f95a000caa0 tx=0x7f95a00058f0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.680+0000 7f95ad773640 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a1dc0 0x558f4d5ac140 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f95a400b760 tx=0x7f95a400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c343c1311d7543f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95937fe640 1 -- 172.21.15.60:0/2731429802 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4003dd0 con 0x558f4d5a1dc0 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95937fe640 1 -- 172.21.15.60:0/2731429802 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95a4015070 con 0x558f4d5a1dc0 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95937fe640 1 -- 172.21.15.60:0/2731429802 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4011440 con 0x558f4d5a1dc0 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 -- 172.21.15.60:0/2731429802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a1dc0 msgr2=0x558f4d5ac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a1dc0 0x558f4d5ac140 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f95a400b760 tx=0x7f95a400bc20 comp rx=0 tx=0).stop 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 -- 172.21.15.60:0/2731429802 shutdown_connections 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5ac680 0x558f4d5aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a1dc0 0x558f4d5ac140 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2731429802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a14a0 0x558f4d5a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 -- 172.21.15.60:0/2731429802 >> 172.21.15.60:0/2731429802 conn(0x558f4d59da30 msgr2=0x558f4d59de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:43.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 -- 172.21.15.60:0/2731429802 shutdown_connections 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.681+0000 7f95b1db0740 1 -- 172.21.15.60:0/2731429802 wait complete. 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 1 -- start start 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 1 Processor -- start 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 0x558f4d5abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 0x558f4d5a9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5a9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558f4d5af250 con 0x558f4d5ac680 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558f4d4c2050 con 0x558f4d5a1dc0 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558f4d5af3d0 con 0x558f4d5a14a0 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95b1db0740 10 client.0 _ll_register_callbacks cb 0x558f4d502160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95acf72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95acf72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5a9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50938/0 (socket says 172.21.15.60:50938) 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95acf72640 1 -- 172.21.15.60:0/2246763076 learned_addr learned my addr 172.21.15.60:0/2246763076 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95acf72640 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 0x558f4d5abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.682+0000 7f95ad773640 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 0x558f4d5a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95acf72640 1 -- 172.21.15.60:0/2246763076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 msgr2=0x558f4d5abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95acf72640 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 0x558f4d5abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95acf72640 1 -- 172.21.15.60:0/2246763076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 msgr2=0x558f4d5a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95acf72640 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 0x558f4d5a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95acf72640 1 -- 172.21.15.60:0/2246763076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f4d2783c0 con 0x558f4d5ac680 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95acf72640 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5a9780 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f95a80697d0 tx=0x7f9598009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e028838589fca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f9590ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:43.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f9590ff9640 1 -- 172.21.15.60:0/2246763076 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598035040 con 0x558f4d5ac680 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f9590ff9640 1 -- 172.21.15.60:0/2246763076 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f95980037f0 con 0x558f4d5ac680 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95b1db0740 1 -- 172.21.15.60:0/2246763076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95a4015070 con 0x558f4d5ac680 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f9590ff9640 1 -- 172.21.15.60:0/2246763076 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f95980039f0 con 0x558f4d5ac680 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95b1db0740 10 client.17466 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f95b1db0740 1 -- 172.21.15.60:0/2246763076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558f4d5babd0 con 0x558f4d5ac680 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.683+0000 7f9590ff9640 1 -- 172.21.15.60:0/2246763076 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95a4015070 con 0x558f4d5ac680 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f9590ff9640 1 -- 172.21.15.60:0/2246763076 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f9598052020 con 0x558f4d5ac680 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f95b1db0740 10 client.17466 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f95b1db0740 10 client.17466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f95b1db0740 20 client.17466 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558f4d5bbfe0 0x558f4d5be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f95b1db0740 4 client.17466 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f95b1db0740 1 -- 172.21.15.60:0/2246763076 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f4d514850 con 0x558f4d5bbfe0 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f95ad773640 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558f4d5bbfe0 0x558f4d5be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f95ad773640 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558f4d5bbfe0 0x558f4d5be3f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=597c355eed386cd9 server_cookie=7ec70e4b81dc8e9c in_seq=0 out_seq=0 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.684+0000 7f9590ff9640 10 client.17466 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f9590ff9640 1 -- 172.21.15.60:0/2246763076 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f4d514850 con 0x558f4d5bbfe0 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f9590ff9640 10 client.17466 handle_command_reply: tid=0 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 client.17466 shutdown 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 -- 172.21.15.60:0/2246763076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 msgr2=0x558f4d5a9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5a9780 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f95a80697d0 tx=0x7f9598009260 comp rx=0 tx=0).stop 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 -- 172.21.15.60:0/2246763076 shutdown_connections 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558f4d5bbfe0 0x558f4d5be3f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5a9780 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 0x558f4d5a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 --2- 172.21.15.60:0/2246763076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 0x558f4d5abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f9590ff9640 0 client.17466 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.685+0000 7f95b1db0740 1 -- 172.21.15.60:0/2246763076 >> 172.21.15.60:0/2246763076 conn(0x558f4d59da30 msgr2=0x558f4d59cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.686+0000 7f95b1db0740 1 -- 172.21.15.60:0/2246763076 shutdown_connections 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.686+0000 7f95b1db0740 1 -- 172.21.15.60:0/2246763076 wait complete. 2024-09-12T00:07:43.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.686+0000 7f95b1db0740 20 client.17466 trim_cache size 0 max 16384 2024-09-12T00:07:43.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95b1db0740 1 Processor -- start 2024-09-12T00:07:43.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95b1db0740 1 -- start start 2024-09-12T00:07:43.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a14a0 0x558f4d5b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a1dc0 0x558f4d5a4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5ac680 0x558f4d5c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95b1db0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95a81ad920 con 0x558f4d5a14a0 2024-09-12T00:07:43.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95b1db0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95a81af460 con 0x558f4d5ac680 2024-09-12T00:07:43.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95b1db0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95a81adff0 con 0x558f4d5a1dc0 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95acf72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a14a0 0x558f4d5b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95acf72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a14a0 0x558f4d5b84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50950/0 (socket says 172.21.15.60:50950) 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.703+0000 7f95acf72640 1 -- 172.21.15.60:0/3586443639 learned_addr learned my addr 172.21.15.60:0/3586443639 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f95acf72640 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5ac680 0x558f4d5c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f95ad773640 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a1dc0 0x558f4d5a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f95acf72640 1 -- 172.21.15.60:0/3586443639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a1dc0 msgr2=0x558f4d5a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f95acf72640 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a1dc0 0x558f4d5a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f95acf72640 1 -- 172.21.15.60:0/3586443639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5ac680 msgr2=0x558f4d5c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f95acf72640 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5ac680 0x558f4d5c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f95acf72640 1 -- 172.21.15.60:0/3586443639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f4d5a12d0 con 0x558f4d5a14a0 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f95acf72640 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a14a0 0x558f4d5b84b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9598004650 tx=0x7f959802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9cd8df28538bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:43.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f9592ffd640 1 -- 172.21.15.60:0/3586443639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598035070 con 0x558f4d5a14a0 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f9592ffd640 1 -- 172.21.15.60:0/3586443639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95980037f0 con 0x558f4d5a14a0 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.704+0000 7f9592ffd640 1 -- 172.21.15.60:0/3586443639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959804dc50 con 0x558f4d5a14a0 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 -- 172.21.15.60:0/3586443639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a14a0 msgr2=0x558f4d5b84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a14a0 0x558f4d5b84b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9598004650 tx=0x7f959802a420 comp rx=0 tx=0).stop 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 -- 172.21.15.60:0/3586443639 shutdown_connections 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5ac680 0x558f4d5c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a1dc0 0x558f4d5a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 --2- 172.21.15.60:0/3586443639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5a14a0 0x558f4d5b84b0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 -- 172.21.15.60:0/3586443639 >> 172.21.15.60:0/3586443639 conn(0x558f4d59da30 msgr2=0x558f4d5a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 -- 172.21.15.60:0/3586443639 shutdown_connections 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 -- 172.21.15.60:0/3586443639 wait complete. 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 -- start start 2024-09-12T00:07:43.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.705+0000 7f95b1db0740 1 Processor -- start 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 0x558f4d5b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 0x558f4d5b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95b1db0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95b1db0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95a81aed90 con 0x558f4d5ac680 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95b1db0740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95a81ae6c0 con 0x558f4d5a1dc0 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95b1db0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95a81ab920 con 0x558f4d5a14a0 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95b1db0740 10 client.0 _ll_register_callbacks cb 0x7f9598009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50966/0 (socket says 172.21.15.60:50966) 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 -- 172.21.15.60:0/721726001 learned_addr learned my addr 172.21.15.60:0/721726001 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95ad773640 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 0x558f4d5b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 0x558f4d5b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 -- 172.21.15.60:0/721726001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 msgr2=0x558f4d5b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 0x558f4d5b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 -- 172.21.15.60:0/721726001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 msgr2=0x558f4d5b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 0x558f4d5b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 -- 172.21.15.60:0/721726001 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f4d5b0dc0 con 0x558f4d5ac680 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95acf72640 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5b05e0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f959804d930 tx=0x7f9598032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa584d258d045044 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f9590ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f9590ff9640 1 -- 172.21.15.60:0/721726001 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598035040 con 0x558f4d5ac680 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f9590ff9640 1 -- 172.21.15.60:0/721726001 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8484+0+0 (secure 0 0 0) 0x7f9598003b90 con 0x558f4d5ac680 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.706+0000 7f95b1db0740 1 -- 172.21.15.60:0/721726001 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95980037f0 con 0x558f4d5ac680 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f9590ff9640 1 -- 172.21.15.60:0/721726001 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f9598003dd0 con 0x558f4d5ac680 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95b1db0740 10 client.17472 fetch_fsmap learned FSMap version 52 2024-09-12T00:07:43.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95b1db0740 1 -- 172.21.15.60:0/721726001 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558f4d5b0dc0 con 0x558f4d5ac680 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f9590ff9640 1 -- 172.21.15.60:0/721726001 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95980037f0 con 0x558f4d5ac680 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f9590ff9640 1 -- 172.21.15.60:0/721726001 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f9598067030 con 0x558f4d5ac680 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95b1db0740 10 client.17472 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95b1db0740 10 client.17472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95b1db0740 20 client.17472 populate_metadata read hostname 'smithi060' 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95b1db0740 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558f4d626fd0 0x558f4d6293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95b1db0740 4 client.17472 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95b1db0740 1 -- 172.21.15.60:0/721726001 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f4d50ed60 con 0x558f4d626fd0 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.707+0000 7f95ad773640 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558f4d626fd0 0x558f4d6293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95ad773640 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558f4d626fd0 0x558f4d6293f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a1afba85a9661d3 server_cookie=4de4be9f91ac0f1a in_seq=0 out_seq=0 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f9590ff9640 10 client.17472 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f9590ff9640 1 -- 172.21.15.60:0/721726001 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558f4d50ed60 con 0x558f4d626fd0 2024-09-12T00:07:43.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f9590ff9640 10 client.17472 handle_command_reply: tid=0 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 client.17472 shutdown 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 -- 172.21.15.60:0/721726001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 msgr2=0x558f4d5b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5b05e0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f959804d930 tx=0x7f9598032d50 comp rx=0 tx=0).stop 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 -- 172.21.15.60:0/721726001 shutdown_connections 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558f4d626fd0 0x558f4d6293f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558f4d5ac680 0x558f4d5b05e0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f9590ff9640 0 client.17472 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558f4d5a1dc0 0x558f4d5b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 --2- 172.21.15.60:0/721726001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558f4d5a14a0 0x558f4d5b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 -- 172.21.15.60:0/721726001 >> 172.21.15.60:0/721726001 conn(0x558f4d59da30 msgr2=0x558f4d5a4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 -- 172.21.15.60:0/721726001 shutdown_connections 2024-09-12T00:07:43.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 1 -- 172.21.15.60:0/721726001 wait complete. 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.708+0000 7f95b1db0740 20 client.17472 trim_cache size 0 max 16384 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout: "de56934b-b0ac-4374-8e9e-4bf249ef1f45": { 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "de56934b-b0ac-4374-8e9e-4bf249ef1f45", 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:07:43.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:07:43.722 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:07:43.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 -- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95940a2cf0 msgr2=0x7f95940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95940a2cf0 0x7f95940a51b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f95a000caa0 tx=0x7f95a00058f0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 -- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81082a0 msgr2=0x7f95a819cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81082a0 0x7f95a819cf70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f95a000cad0 tx=0x7f95a000cf90 comp rx=0 tx=0).stop 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 -- 172.21.15.60:0/178220485 shutdown_connections 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95940a2cf0 0x7f95940a51b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95a81082a0 0x7f95a819cf70 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a81036e0 0x7f95a8198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 --2- 172.21.15.60:0/178220485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95a8102d30 0x7f95a81986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 -- 172.21.15.60:0/178220485 >> 172.21.15.60:0/178220485 conn(0x7f95a80fc7d0 msgr2=0x7f95a8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 -- 172.21.15.60:0/178220485 shutdown_connections 2024-09-12T00:07:43.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:07:43.709+0000 7f95af9d7640 1 -- 172.21.15.60:0/178220485 wait complete. 2024-09-12T00:07:44.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:44 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:07:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:44 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:07:44.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:44 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:07:44.545 INFO:tasks.cephfs.filesystem:scrub status for tag:de56934b-b0ac-4374-8e9e-4bf249ef1f45 - {'path': '/', 'tag': 'de56934b-b0ac-4374-8e9e-4bf249ef1f45', 'options': 'recursive,force'} 2024-09-12T00:07:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:45 smithi105 ceph-mon[34805]: pgmap v258: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:07:45.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:45 smithi192 ceph-mon[35487]: pgmap v258: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:07:45.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:45 smithi060 ceph-mon[30953]: pgmap v258: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:07:47.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:47 smithi105 ceph-mon[34805]: pgmap v259: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:47.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:47 smithi192 ceph-mon[35487]: pgmap v259: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:47 smithi060 ceph-mon[30953]: pgmap v259: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:49.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:49 smithi105 ceph-mon[34805]: pgmap v260: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:49.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:49 smithi192 ceph-mon[35487]: pgmap v260: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:49.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:49 smithi060 ceph-mon[30953]: pgmap v260: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:51.390 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:51 smithi060 ceph-mon[30953]: pgmap v261: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:51.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:51 smithi105 ceph-mon[34805]: pgmap v261: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:51.536 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:51 smithi192 ceph-mon[35487]: pgmap v261: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:53.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:53 smithi105 ceph-mon[34805]: pgmap v262: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:53.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:53 smithi192 ceph-mon[35487]: pgmap v262: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:53 smithi060 ceph-mon[30953]: pgmap v262: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:07:55.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:55 smithi105 ceph-mon[34805]: pgmap v263: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:55.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:55 smithi192 ceph-mon[35487]: pgmap v263: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:55.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:55 smithi060 ceph-mon[30953]: pgmap v263: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:07:57.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:57 smithi105 ceph-mon[34805]: pgmap v264: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:57.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:57 smithi192 ceph-mon[35487]: pgmap v264: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:57.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:57 smithi060 ceph-mon[30953]: pgmap v264: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:07:59.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:07:59 smithi105 ceph-mon[34805]: pgmap v265: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:07:59.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:07:59 smithi192 ceph-mon[35487]: pgmap v265: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:07:59.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:07:59 smithi060 ceph-mon[30953]: pgmap v265: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:08:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:01 smithi105 ceph-mon[34805]: pgmap v266: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:01.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:01 smithi192 ceph-mon[35487]: pgmap v266: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:01.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:01 smithi060 ceph-mon[30953]: pgmap v266: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:03.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:03 smithi105 ceph-mon[34805]: pgmap v267: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:03.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:03 smithi192 ceph-mon[35487]: pgmap v267: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:03.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:03 smithi060 ceph-mon[30953]: pgmap v267: 97 pgs: 97 active+clean; 255 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:05.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:05 smithi105 ceph-mon[34805]: pgmap v268: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:08:05.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:05 smithi192 ceph-mon[35487]: pgmap v268: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:08:05.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:05 smithi060 ceph-mon[30953]: pgmap v268: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:08:07.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:07 smithi105 ceph-mon[34805]: pgmap v269: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:08:07.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:07 smithi192 ceph-mon[35487]: pgmap v269: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:08:07.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:07 smithi060 ceph-mon[30953]: pgmap v269: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:08:09.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:09 smithi105 ceph-mon[34805]: pgmap v270: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:08:09.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:09 smithi192 ceph-mon[35487]: pgmap v270: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:08:09.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:09 smithi060 ceph-mon[30953]: pgmap v270: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:08:10.483 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:10 smithi105 ceph-mon[34805]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T00:08:10.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:10 smithi192 ceph-mon[35487]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T00:08:10.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:10 smithi060 ceph-mon[30953]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T00:08:11.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:11 smithi105 ceph-mon[34805]: pgmap v272: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:08:11.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:11 smithi192 ceph-mon[35487]: pgmap v272: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:08:11.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:11 smithi060 ceph-mon[30953]: pgmap v272: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:08:13.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:13 smithi105 ceph-mon[34805]: pgmap v273: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:08:13.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:13 smithi192 ceph-mon[35487]: pgmap v273: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:08:13.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:13 smithi060 ceph-mon[30953]: pgmap v273: 97 pgs: 97 active+clean; 256 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:08:14.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:08:14.822 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:15.219 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:15 smithi060 ceph-mon[30953]: pgmap v274: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:15.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 -- 172.21.15.60:0/4199629913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c101ba0 msgr2=0x7f454c10d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 --2- 172.21.15.60:0/4199629913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c101ba0 0x7f454c10d970 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f4544009ca0 tx=0x7f454402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 -- 172.21.15.60:0/4199629913 shutdown_connections 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 --2- 172.21.15.60:0/4199629913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c101ba0 0x7f454c10d970 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 --2- 172.21.15.60:0/4199629913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c101200 0x7f454c101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 --2- 172.21.15.60:0/4199629913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f454c105ad0 0x7f454c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 -- 172.21.15.60:0/4199629913 >> 172.21.15.60:0/4199629913 conn(0x7f454c077210 msgr2=0x7f454c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 -- 172.21.15.60:0/4199629913 shutdown_connections 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 -- 172.21.15.60:0/4199629913 wait complete. 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 Processor -- start 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.306+0000 7f4551556640 1 -- start start 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f4551556640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f454c101200 0x7f454c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f4551556640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c101ba0 0x7f454c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f4551556640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c105ad0 0x7f454c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f4551556640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f454c111060 con 0x7f454c105ad0 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f4551556640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f454c110ee0 con 0x7f454c101200 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f4551556640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1111e0 con 0x7f454c101ba0 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c105ad0 0x7f454c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c105ad0 0x7f454c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47168/0 (socket says 172.21.15.60:47168) 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454b7fe640 1 -- 172.21.15.60:0/430797713 learned_addr learned my addr 172.21.15.60:0/430797713 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454affd640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f454c101200 0x7f454c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454a7fc640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c101ba0 0x7f454c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454b7fe640 1 -- 172.21.15.60:0/430797713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c101ba0 msgr2=0x7f454c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454b7fe640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c101ba0 0x7f454c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454b7fe640 1 -- 172.21.15.60:0/430797713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f454c101200 msgr2=0x7f454c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454b7fe640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f454c101200 0x7f454c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.307+0000 7f454b7fe640 1 -- 172.21.15.60:0/430797713 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c19d3c0 con 0x7f454c105ad0 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.308+0000 7f454b7fe640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c105ad0 0x7f454c19cce0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f4544005e30 tx=0x7f4544003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.308+0000 7f4543fff640 1 -- 172.21.15.60:0/430797713 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4544031650 con 0x7f454c105ad0 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.308+0000 7f4551556640 1 -- 172.21.15.60:0/430797713 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c19d650 con 0x7f454c105ad0 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.308+0000 7f4543fff640 1 -- 172.21.15.60:0/430797713 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45440317f0 con 0x7f454c105ad0 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.308+0000 7f4543fff640 1 -- 172.21.15.60:0/430797713 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454402fb70 con 0x7f454c105ad0 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.308+0000 7f4551556640 1 -- 172.21.15.60:0/430797713 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c1a4f90 con 0x7f454c105ad0 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.310+0000 7f4543fff640 1 -- 172.21.15.60:0/430797713 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f454402fd10 con 0x7f454c105ad0 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.310+0000 7f455392f740 1 Processor -- start 2024-09-12T00:08:15.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f455392f740 1 -- start start 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f455392f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f455392f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f455392f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 0x5591a18d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f455392f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5591a182e2e0 con 0x5591a18c84a0 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f455392f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5591a17d5ce0 con 0x5591a18c8dc0 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f455392f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5591a182a2a0 con 0x5591a18d3680 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f4543fff640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f45380a2cf0 0x7f45380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f454a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f454a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47176/0 (socket says 172.21.15.60:47176) 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f454a7fc640 1 -- 172.21.15.60:0/187436589 learned_addr learned my addr 172.21.15.60:0/187436589 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:15.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f454b7fe640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f45380a2cf0 0x7f45380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f454affd640 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f454a7fc640 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 0x5591a18d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.311+0000 7f4543fff640 1 -- 172.21.15.60:0/430797713 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8528+0+0 (secure 0 0 0) 0x7f45440f0760 con 0x7f454c105ad0 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f454a7fc640 1 -- 172.21.15.60:0/187436589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 msgr2=0x5591a18d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f454a7fc640 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 0x5591a18d5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f454a7fc640 1 -- 172.21.15.60:0/187436589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 msgr2=0x5591a18d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f454a7fc640 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f454a7fc640 1 -- 172.21.15.60:0/187436589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a17ba440 con 0x5591a18c84a0 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f454b7fe640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f45380a2cf0 0x7f45380a51b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f45440bcd20 tx=0x7f454402a8c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f454a7fc640 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18c8880 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f45340058a0 tx=0x7f453400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41569482313a06f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:15.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f45417fa640 1 -- 172.21.15.60:0/187436589 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45340120d0 con 0x5591a18c84a0 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f45417fa640 1 -- 172.21.15.60:0/187436589 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4534005020 con 0x5591a18c84a0 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f45417fa640 1 -- 172.21.15.60:0/187436589 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534004a00 con 0x5591a18c84a0 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.312+0000 7f454affd640 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 -- 172.21.15.60:0/187436589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 msgr2=0x5591a18c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18c8880 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f45340058a0 tx=0x7f453400b840 comp rx=0 tx=0).stop 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 -- 172.21.15.60:0/187436589 shutdown_connections 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 0x5591a18d5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 --2- 172.21.15.60:0/187436589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18c8880 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 -- 172.21.15.60:0/187436589 >> 172.21.15.60:0/187436589 conn(0x5591a18c4a30 msgr2=0x5591a18c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:15.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 -- 172.21.15.60:0/187436589 shutdown_connections 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.313+0000 7f455392f740 1 -- 172.21.15.60:0/187436589 wait complete. 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 1 -- start start 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 1 Processor -- start 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18d2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 0x5591a18d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5591a18d6250 con 0x5591a18c84a0 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5591a17e9050 con 0x5591a18c8dc0 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5591a18d63d0 con 0x5591a18d3680 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f455392f740 10 client.0 _ll_register_callbacks cb 0x5591a1829160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18d2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18d2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47188/0 (socket says 172.21.15.60:47188) 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 -- 172.21.15.60:0/4115835059 learned_addr learned my addr 172.21.15.60:0/4115835059 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454affd640 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 0x5591a18d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 -- 172.21.15.60:0/4115835059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 msgr2=0x5591a18d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 0x5591a18d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 -- 172.21.15.60:0/4115835059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 msgr2=0x5591a18d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.314+0000 7f454a7fc640 1 -- 172.21.15.60:0/4115835059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a159f3c0 con 0x5591a18c84a0 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f454a7fc640 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18d2fe0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4534005990 tx=0x7f453400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb23055383dc11c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f45327fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f45327fc640 1 -- 172.21.15.60:0/4115835059 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453402a060 con 0x5591a18c84a0 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f45327fc640 1 -- 172.21.15.60:0/4115835059 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8528+0+0 (secure 0 0 0) 0x7f453400e950 con 0x5591a18c84a0 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f455392f740 1 -- 172.21.15.60:0/4115835059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4534005020 con 0x5591a18c84a0 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f45327fc640 1 -- 172.21.15.60:0/4115835059 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f453400eb50 con 0x5591a18c84a0 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f455392f740 10 client.17484 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f455392f740 1 -- 172.21.15.60:0/4115835059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5591a18e1b90 con 0x5591a18c84a0 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f45327fc640 1 -- 172.21.15.60:0/4115835059 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4534005020 con 0x5591a18c84a0 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f45327fc640 1 -- 172.21.15.60:0/4115835059 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f45340104f0 con 0x5591a18c84a0 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.315+0000 7f455392f740 10 client.17484 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.316+0000 7f455392f740 10 client.17484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.316+0000 7f455392f740 20 client.17484 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.316+0000 7f455392f740 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5591a18e2ee0 0x5591a18e52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.316+0000 7f455392f740 4 client.17484 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.316+0000 7f455392f740 1 -- 172.21.15.60:0/4115835059 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591a183b850 con 0x5591a18e2ee0 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.316+0000 7f454affd640 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5591a18e2ee0 0x5591a18e52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.316+0000 7f454affd640 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5591a18e2ee0 0x5591a18e52d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15850121c807118e server_cookie=8747ee1269a09f28 in_seq=0 out_seq=0 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.316+0000 7f45327fc640 10 client.17484 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f45327fc640 1 -- 172.21.15.60:0/4115835059 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591a183b850 con 0x5591a18e2ee0 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f45327fc640 10 client.17484 handle_command_reply: tid=0 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 client.17484 shutdown 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 -- 172.21.15.60:0/4115835059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 msgr2=0x5591a18d2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18d2fe0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f4534005990 tx=0x7f453400b8b0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 -- 172.21.15.60:0/4115835059 shutdown_connections 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5591a18e2ee0 0x5591a18e52d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18d3680 0x5591a18d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c8dc0 0x5591a18d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 --2- 172.21.15.60:0/4115835059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c84a0 0x5591a18d2fe0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 -- 172.21.15.60:0/4115835059 >> 172.21.15.60:0/4115835059 conn(0x5591a18c4a30 msgr2=0x5591a18ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f45327fc640 0 client.17484 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 -- 172.21.15.60:0/4115835059 shutdown_connections 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.317+0000 7f455392f740 1 -- 172.21.15.60:0/4115835059 wait complete. 2024-09-12T00:08:15.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.318+0000 7f455392f740 20 client.17484 trim_cache size 0 max 16384 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f455392f740 1 Processor -- start 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f455392f740 1 -- start start 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f455392f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c84a0 0x5591a18c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f455392f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c8dc0 0x5591a18eaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f455392f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18d3680 0x5591a18eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f455392f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1ad8f0 con 0x5591a18d3680 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f455392f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1af430 con 0x5591a18c84a0 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f455392f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1adfc0 con 0x5591a18c8dc0 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f454a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18d3680 0x5591a18eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f454a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18d3680 0x5591a18eafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47192/0 (socket says 172.21.15.60:47192) 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.335+0000 7f454a7fc640 1 -- 172.21.15.60:0/3892241139 learned_addr learned my addr 172.21.15.60:0/3892241139 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c84a0 0x5591a18c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f454affd640 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c8dc0 0x5591a18eaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f454a7fc640 1 -- 172.21.15.60:0/3892241139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c8dc0 msgr2=0x5591a18eaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c8dc0 0x5591a18eaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f454a7fc640 1 -- 172.21.15.60:0/3892241139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c84a0 msgr2=0x5591a18c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c84a0 0x5591a18c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f454a7fc640 1 -- 172.21.15.60:0/3892241139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a18cf240 con 0x5591a18d3680 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18d3680 0x5591a18eafe0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f4534001eb0 tx=0x7f453401b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133f432b6fa90278 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f4540ff9640 1 -- 172.21.15.60:0/3892241139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453402a070 con 0x5591a18d3680 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f4540ff9640 1 -- 172.21.15.60:0/3892241139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f453400ecf0 con 0x5591a18d3680 2024-09-12T00:08:15.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.336+0000 7f4540ff9640 1 -- 172.21.15.60:0/3892241139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534010460 con 0x5591a18d3680 2024-09-12T00:08:15.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 -- 172.21.15.60:0/3892241139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18d3680 msgr2=0x5591a18eafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18d3680 0x5591a18eafe0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f4534001eb0 tx=0x7f453401b040 comp rx=0 tx=0).stop 2024-09-12T00:08:15.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 -- 172.21.15.60:0/3892241139 shutdown_connections 2024-09-12T00:08:15.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18d3680 0x5591a18eafe0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c8dc0 0x5591a18eaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 --2- 172.21.15.60:0/3892241139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18c84a0 0x5591a18c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 -- 172.21.15.60:0/3892241139 >> 172.21.15.60:0/3892241139 conn(0x5591a18c4a30 msgr2=0x5591a18c3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 -- 172.21.15.60:0/3892241139 shutdown_connections 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 -- 172.21.15.60:0/3892241139 wait complete. 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 -- start start 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 Processor -- start 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c84a0 0x5591a18d8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.337+0000 7f455392f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c8dc0 0x5591a18d8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f455392f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18d3680 0x5591a194ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f455392f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1aed60 con 0x5591a18c8dc0 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f455392f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1ae690 con 0x5591a18d3680 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f455392f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1ab8d0 con 0x5591a18c84a0 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f455392f740 10 client.0 _ll_register_callbacks cb 0x7f453400be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:15.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c8dc0 0x5591a18d8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c8dc0 0x5591a18d8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47208/0 (socket says 172.21.15.60:47208) 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 -- 172.21.15.60:0/3924728760 learned_addr learned my addr 172.21.15.60:0/3924728760 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c84a0 0x5591a18d8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18d3680 0x5591a194ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 -- 172.21.15.60:0/3924728760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c84a0 msgr2=0x5591a18d8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c84a0 0x5591a18d8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 -- 172.21.15.60:0/3924728760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18d3680 msgr2=0x5591a194ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18d3680 0x5591a194ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 -- 172.21.15.60:0/3924728760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a194bfb0 con 0x5591a18c8dc0 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18d3680 0x5591a194ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f454affd640 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c8dc0 0x5591a18d8fd0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x5591a18cfb20 tx=0x7f453c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4658330777d79ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f45327fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:15.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f45327fc640 1 -- 172.21.15.60:0/3924728760 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c023070 con 0x5591a18c8dc0 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f45327fc640 1 -- 172.21.15.60:0/3924728760 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8528+0+0 (secure 0 0 0) 0x7f453c004440 con 0x5591a18c8dc0 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f455392f740 1 -- 172.21.15.60:0/3924728760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f453400ecf0 con 0x5591a18c8dc0 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.338+0000 7f45327fc640 1 -- 172.21.15.60:0/3924728760 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f453c009c80 con 0x5591a18c8dc0 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f455392f740 10 client.17490 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f455392f740 1 -- 172.21.15.60:0/3924728760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5591a194d2c0 con 0x5591a18c8dc0 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f45327fc640 1 -- 172.21.15.60:0/3924728760 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f453c02c070 con 0x5591a18c8dc0 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f45327fc640 1 -- 172.21.15.60:0/3924728760 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f453c026020 con 0x5591a18c8dc0 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f455392f740 10 client.17490 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f455392f740 10 client.17490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f455392f740 20 client.17490 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f455392f740 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5591a194da70 0x5591a194fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:15.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f455392f740 4 client.17490 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f455392f740 1 -- 172.21.15.60:0/3924728760 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591a1835d60 con 0x5591a194da70 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.339+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5591a194da70 0x5591a194fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f45327fc640 10 client.17490 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f454a7fc640 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5591a194da70 0x5591a194fe90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4c09117a9ebad7a server_cookie=97e1aab6e199653c in_seq=0 out_seq=0 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f45327fc640 1 -- 172.21.15.60:0/3924728760 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5591a1835d60 con 0x5591a194da70 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f45327fc640 10 client.17490 handle_command_reply: tid=0 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 client.17490 shutdown 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 -- 172.21.15.60:0/3924728760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c8dc0 msgr2=0x5591a18d8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c8dc0 0x5591a18d8fd0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x5591a18cfb20 tx=0x7f453c012820 comp rx=0 tx=0).stop 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 -- 172.21.15.60:0/3924728760 shutdown_connections 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5591a194da70 0x5591a194fe90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5591a18d3680 0x5591a194ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5591a18c8dc0 0x5591a18d8fd0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 --2- 172.21.15.60:0/3924728760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591a18c84a0 0x5591a18d8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 -- 172.21.15.60:0/3924728760 >> 172.21.15.60:0/3924728760 conn(0x5591a18c4a30 msgr2=0x5591a18c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f45327fc640 0 client.17490 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 -- 172.21.15.60:0/3924728760 shutdown_connections 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 1 -- 172.21.15.60:0/3924728760 wait complete. 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.340+0000 7f455392f740 20 client.17490 trim_cache size 0 max 16384 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:08:15.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:08:15.346 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:08:15.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 -- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f45380a2cf0 msgr2=0x7f45380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f45380a2cf0 0x7f45380a51b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f45440bcd20 tx=0x7f454402a8c0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 -- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c105ad0 msgr2=0x7f454c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c105ad0 0x7f454c19cce0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f4544005e30 tx=0x7f4544003f10 comp rx=0 tx=0).stop 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 -- 172.21.15.60:0/430797713 shutdown_connections 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f45380a2cf0 0x7f45380a51b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f454c105ad0 0x7f454c19cce0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c101ba0 0x7f454c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 --2- 172.21.15.60:0/430797713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f454c101200 0x7f454c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 -- 172.21.15.60:0/430797713 >> 172.21.15.60:0/430797713 conn(0x7f454c077210 msgr2=0x7f454c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 -- 172.21.15.60:0/430797713 shutdown_connections 2024-09-12T00:08:15.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:15.341+0000 7f4551556640 1 -- 172.21.15.60:0/430797713 wait complete. 2024-09-12T00:08:15.480 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:15 smithi105 ceph-mon[34805]: pgmap v274: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:15.535 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:15 smithi192 ceph-mon[35487]: pgmap v274: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:16.232 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:08:16.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:08:16.496 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 -- 172.21.15.60:0/697501798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c4101280 msgr2=0x7f66c410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 --2- 172.21.15.60:0/697501798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c4101280 0x7f66c410df40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009900 tx=0x7f66ac02a3f0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 -- 172.21.15.60:0/697501798 shutdown_connections 2024-09-12T00:08:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 --2- 172.21.15.60:0/697501798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66c410e480 0x7f66c4110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 --2- 172.21.15.60:0/697501798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c4101280 0x7f66c410df40 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 --2- 172.21.15.60:0/697501798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66c41008d0 0x7f66c4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 -- 172.21.15.60:0/697501798 >> 172.21.15.60:0/697501798 conn(0x7f66c40fc7a0 msgr2=0x7f66c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 -- 172.21.15.60:0/697501798 shutdown_connections 2024-09-12T00:08:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 -- 172.21.15.60:0/697501798 wait complete. 2024-09-12T00:08:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 Processor -- start 2024-09-12T00:08:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.015+0000 7f66c9d83640 1 -- start start 2024-09-12T00:08:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c9d83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c41008d0 0x7f66c419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c9d83640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66c4101280 0x7f66c419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c9d83640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66c410e480 0x7f66c419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c9d83640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66c4114310 con 0x7f66c41008d0 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c9d83640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66c4114190 con 0x7f66c4101280 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c9d83640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66c4114490 con 0x7f66c410e480 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c41008d0 0x7f66c419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c41008d0 0x7f66c419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47240/0 (socket says 172.21.15.60:47240) 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 -- 172.21.15.60:0/2739701768 learned_addr learned my addr 172.21.15.60:0/2739701768 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66baffd640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66c4101280 0x7f66c419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:17.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 -- 172.21.15.60:0/2739701768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66c410e480 msgr2=0x7f66c419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c3fff640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66c410e480 0x7f66c419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66c410e480 0x7f66c419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 -- 172.21.15.60:0/2739701768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66c4101280 msgr2=0x7f66c419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66c4101280 0x7f66c419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 -- 172.21.15.60:0/2739701768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c419f660 con 0x7f66c41008d0 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66baffd640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66c4101280 0x7f66c419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c3fff640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66c410e480 0x7f66c419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.016+0000 7f66c37fe640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c41008d0 0x7f66c419a6b0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f66b400d950 tx=0x7f66b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.017+0000 7f66c17fa640 1 -- 172.21.15.60:0/2739701768 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4017030 con 0x7f66c41008d0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.017+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c419f950 con 0x7f66c41008d0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.017+0000 7f66c17fa640 1 -- 172.21.15.60:0/2739701768 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f66b4004020 con 0x7f66c41008d0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.017+0000 7f66c17fa640 1 -- 172.21.15.60:0/2739701768 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4004a00 con 0x7f66c41008d0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.017+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c41a7230 con 0x7f66c41008d0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.018+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c4100cb0 con 0x7f66c41008d0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.019+0000 7f66c17fa640 1 -- 172.21.15.60:0/2739701768 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f66b40041d0 con 0x7f66c41008d0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.020+0000 7f66c17fa640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f66b00a2cf0 0x7f66b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.020+0000 7f66c17fa640 1 -- 172.21.15.60:0/2739701768 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8528+0+0 (secure 0 0 0) 0x7f66b40cef20 con 0x7f66c41008d0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.020+0000 7f66baffd640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f66b00a2cf0 0x7f66b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.020+0000 7f66baffd640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f66b00a2cf0 0x7f66b00a51b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f66ac000c00 tx=0x7f66ac005a40 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:17.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.024+0000 7f66c17fa640 1 -- 172.21.15.60:0/2739701768 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66b409bb40 con 0x7f66c41008d0 2024-09-12T00:08:17.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.238+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66c41a7460 con 0x7f66c41008d0 2024-09-12T00:08:17.238 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:17 smithi060 ceph-mon[30953]: pgmap v275: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:17.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.239+0000 7f66c17fa640 1 -- 172.21.15.60:0/2739701768 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7f66b409b440 con 0x7f66c41008d0 2024-09-12T00:08:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:08:17.239 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:08:17.240 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:08:17.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f66b00a2cf0 msgr2=0x7f66b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:17.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f66b00a2cf0 0x7f66b00a51b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f66ac000c00 tx=0x7f66ac005a40 comp rx=0 tx=0).stop 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c41008d0 msgr2=0x7f66c419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c41008d0 0x7f66c419a6b0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f66b400d950 tx=0x7f66b400de10 comp rx=0 tx=0).stop 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 shutdown_connections 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f66b00a2cf0 0x7f66b00a51b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66c410e480 0x7f66c419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66c4101280 0x7f66c419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 --2- 172.21.15.60:0/2739701768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66c41008d0 0x7f66c419a6b0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 >> 172.21.15.60:0/2739701768 conn(0x7f66c40fc7a0 msgr2=0x7f66c4110670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 shutdown_connections 2024-09-12T00:08:17.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:17.241+0000 7f66c9d83640 1 -- 172.21.15.60:0/2739701768 wait complete. 2024-09-12T00:08:17.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:17 smithi105 ceph-mon[34805]: pgmap v275: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:17.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:17 smithi192 ceph-mon[35487]: pgmap v275: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:17.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:08:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:18.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:18 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2739701768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:08:18.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:18 smithi060 ceph-mon[30953]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T00:08:18.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:18 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2739701768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:08:18.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:18 smithi105 ceph-mon[34805]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T00:08:18.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:18 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2739701768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:08:18.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:18 smithi192 ceph-mon[35487]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T00:08:18.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 -- 172.21.15.60:0/1007626143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180102790 msgr2=0x7f31801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 --2- 172.21.15.60:0/1007626143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180102790 0x7f31801067e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f3170009900 tx=0x7f317002a410 comp rx=0 tx=0).stop 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 -- 172.21.15.60:0/1007626143 shutdown_connections 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 --2- 172.21.15.60:0/1007626143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3180106f10 0x7f318010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 --2- 172.21.15.60:0/1007626143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180102790 0x7f31801067e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 --2- 172.21.15.60:0/1007626143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3180101de0 0x7f31801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 -- 172.21.15.60:0/1007626143 >> 172.21.15.60:0/1007626143 conn(0x7f31800fd8c0 msgr2=0x7f31800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 -- 172.21.15.60:0/1007626143 shutdown_connections 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.702+0000 7f3187682640 1 -- 172.21.15.60:0/1007626143 wait complete. 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3187682640 1 Processor -- start 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3187682640 1 -- start start 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3187682640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3180101de0 0x7f3180198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3187682640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3180102790 0x7f3180198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3187682640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180106f10 0x7f318019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3187682640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31801120d0 con 0x7f3180106f10 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3187682640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3180111f50 con 0x7f3180102790 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3187682640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3180112250 con 0x7f3180101de0 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180106f10 0x7f318019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180106f10 0x7f318019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47260/0 (socket says 172.21.15.60:47260) 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 -- 172.21.15.60:0/1311649603 learned_addr learned my addr 172.21.15.60:0/1311649603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3184c1d640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3180102790 0x7f3180198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 -- 172.21.15.60:0/1311649603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3180101de0 msgr2=0x7f3180198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f318541e640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3180101de0 0x7f3180198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3180101de0 0x7f3180198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 -- 172.21.15.60:0/1311649603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3180102790 msgr2=0x7f3180198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3180102790 0x7f3180198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 -- 172.21.15.60:0/1311649603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318019d520 con 0x7f3180106f10 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3184c1d640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3180102790 0x7f3180198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.703+0000 7f3185c1f640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180106f10 0x7f318019ce40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f317800eaa0 tx=0x7f317800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.704+0000 7f31767fc640 1 -- 172.21.15.60:0/1311649603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317800cdb0 con 0x7f3180106f10 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.704+0000 7f31767fc640 1 -- 172.21.15.60:0/1311649603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3178004b20 con 0x7f3180106f10 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.704+0000 7f3187682640 1 -- 172.21.15.60:0/1311649603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318019d810 con 0x7f3180106f10 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.704+0000 7f31767fc640 1 -- 172.21.15.60:0/1311649603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178011760 con 0x7f3180106f10 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.704+0000 7f3187682640 1 -- 172.21.15.60:0/1311649603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31801a50f0 con 0x7f3180106f10 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.706+0000 7f31767fc640 1 -- 172.21.15.60:0/1311649603 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3178004cd0 con 0x7f3180106f10 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.706+0000 7f3189a5b740 1 Processor -- start 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3189a5b740 1 -- start start 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 0x560bef2d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d15d0 0x560bef2d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2dc370 0x560bef2de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3189a5b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560bef2372f0 con 0x560bef2d15d0 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3189a5b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560bef1decf0 con 0x560bef2d2b40 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3189a5b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560bef2332b0 con 0x560bef2dc370 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f318541e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d15d0 0x560bef2d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f31767fc640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f316c0a2d70 0x7f316c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3184c1d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 0x560bef2d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f318541e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d15d0 0x560bef2d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47276/0 (socket says 172.21.15.60:47276) 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f318541e640 1 -- 172.21.15.60:0/2286043868 learned_addr learned my addr 172.21.15.60:0/2286043868 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3185c1f640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f316c0a2d70 0x7f316c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f3184c1d640 1 --2- 172.21.15.60:0/2286043868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2dc370 0x560bef2de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f31767fc640 1 -- 172.21.15.60:0/1311649603 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f31780cf760 con 0x7f3180106f10 2024-09-12T00:08:18.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f318541e640 1 -- 172.21.15.60:0/2286043868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2dc370 msgr2=0x560bef2de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f318541e640 1 --2- 172.21.15.60:0/2286043868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2dc370 0x560bef2de760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f318541e640 1 -- 172.21.15.60:0/2286043868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 msgr2=0x560bef2d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f318541e640 1 --2- 172.21.15.60:0/2286043868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 0x560bef2d1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.707+0000 7f318541e640 1 -- 172.21.15.60:0/2286043868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bef1c33a0 con 0x560bef2d15d0 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.708+0000 7f318541e640 1 --2- 172.21.15.60:0/2286043868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d15d0 0x560bef2d1a10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f317c00a920 tx=0x7f317c00ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52970cc32b345ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.708+0000 7f3185c1f640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f316c0a2d70 0x7f316c0a5230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f317809b940 tx=0x7f317800cf50 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.708+0000 7f316b7fe640 1 -- 172.21.15.60:0/2286043868 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c015070 con 0x560bef2d15d0 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.708+0000 7f316b7fe640 1 -- 172.21.15.60:0/2286043868 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f317c00cb80 con 0x560bef2d15d0 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.708+0000 7f316b7fe640 1 -- 172.21.15.60:0/2286043868 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c018580 con 0x560bef2d15d0 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- 172.21.15.60:0/2286043868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d15d0 msgr2=0x560bef2d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2286043868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d15d0 0x560bef2d1a10 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f317c00a920 tx=0x7f317c00ade0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- 172.21.15.60:0/2286043868 shutdown_connections 2024-09-12T00:08:18.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2286043868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2dc370 0x560bef2de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2286043868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d15d0 0x560bef2d1a10 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2286043868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 0x560bef2d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- 172.21.15.60:0/2286043868 >> 172.21.15.60:0/2286043868 conn(0x560bef29a310 msgr2=0x560bef2cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- 172.21.15.60:0/2286043868 shutdown_connections 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- 172.21.15.60:0/2286043868 wait complete. 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- start start 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 Processor -- start 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d15d0 0x560bef2dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d2b40 0x560bef2d8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2d9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560bef2e3480 con 0x560bef2dc370 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560bef1f2060 con 0x560bef2d15d0 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.709+0000 7f3189a5b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560bef2e3600 con 0x560bef2d2b40 2024-09-12T00:08:18.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3189a5b740 10 client.0 _ll_register_callbacks cb 0x560beef458c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2d9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2d9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47284/0 (socket says 172.21.15.60:47284) 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 -- 172.21.15.60:0/2502471386 learned_addr learned my addr 172.21.15.60:0/2502471386 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d15d0 0x560bef2dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f318541e640 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d2b40 0x560bef2d8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 -- 172.21.15.60:0/2502471386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d2b40 msgr2=0x560bef2d8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d2b40 0x560bef2d8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 -- 172.21.15.60:0/2502471386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d15d0 msgr2=0x560bef2dbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d15d0 0x560bef2dbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 -- 172.21.15.60:0/2502471386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560beefa83c0 con 0x560bef2dc370 2024-09-12T00:08:18.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3184c1d640 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2d9490 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f3170009900 tx=0x7f317002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7371097c36893226 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3168ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3168ff9640 1 -- 172.21.15.60:0/2502471386 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170035040 con 0x560bef2dc370 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3189a5b740 1 -- 172.21.15.60:0/2502471386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f317c00cb80 con 0x560bef2dc370 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3168ff9640 1 -- 172.21.15.60:0/2502471386 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f3170003a00 con 0x560bef2dc370 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3168ff9640 1 -- 172.21.15.60:0/2502471386 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3170052050 con 0x560bef2dc370 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3189a5b740 10 client.17508 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.710+0000 7f3189a5b740 1 -- 172.21.15.60:0/2502471386 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x560bef2eee70 con 0x560bef2dc370 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f3168ff9640 1 -- 172.21.15.60:0/2502471386 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f317c00cb80 con 0x560bef2dc370 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f3168ff9640 1 -- 172.21.15.60:0/2502471386 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f3170049070 con 0x560bef2dc370 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f3189a5b740 10 client.17508 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f3189a5b740 10 client.17508 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:08:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f3189a5b740 20 client.17508 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x560bef2f0280 0x560bef2f2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f3189a5b740 4 client.17508 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f3189a5b740 1 -- 172.21.15.60:0/2502471386 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bef244860 con 0x560bef2f0280 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.711+0000 7f318541e640 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x560bef2f0280 0x560bef2f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.712+0000 7f318541e640 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x560bef2f0280 0x560bef2f2690 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4e0000270c1556e1 server_cookie=b219961a13377564 in_seq=0 out_seq=0 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.712+0000 7f3168ff9640 10 client.17508 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.712+0000 7f3168ff9640 1 -- 172.21.15.60:0/2502471386 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560bef244860 con 0x560bef2f0280 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.712+0000 7f3168ff9640 10 client.17508 handle_command_reply: tid=0 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.712+0000 7f3189a5b740 1 client.17508 shutdown 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.712+0000 7f3189a5b740 1 -- 172.21.15.60:0/2502471386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 msgr2=0x560bef2d9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.712+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2d9490 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f3170009900 tx=0x7f317002a410 comp rx=0 tx=0).stop 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 1 -- 172.21.15.60:0/2502471386 shutdown_connections 2024-09-12T00:08:18.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2d9490 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d2b40 0x560bef2d8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x560bef2f0280 0x560bef2f2690 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 1 --2- 172.21.15.60:0/2502471386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d15d0 0x560bef2dbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 1 -- 172.21.15.60:0/2502471386 >> 172.21.15.60:0/2502471386 conn(0x560bef29a310 msgr2=0x560bef2d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:18.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3168ff9640 0 client.17508 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:08:18.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 1 -- 172.21.15.60:0/2502471386 shutdown_connections 2024-09-12T00:08:18.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 1 -- 172.21.15.60:0/2502471386 wait complete. 2024-09-12T00:08:18.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.713+0000 7f3189a5b740 20 client.17508 trim_cache size 0 max 16384 2024-09-12T00:08:18.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3189a5b740 1 Processor -- start 2024-09-12T00:08:18.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3189a5b740 1 -- start start 2024-09-12T00:08:18.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 0x560bef2ec720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 0x560bef2f2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3189a5b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31801ab770 con 0x560bef2dc370 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3189a5b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31801ad2b0 con 0x560bef2d2b40 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3189a5b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f31801abe40 con 0x560bef2d15d0 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3184c1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3184c1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2dd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47286/0 (socket says 172.21.15.60:47286) 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3184c1d640 1 -- 172.21.15.60:0/1268567597 learned_addr learned my addr 172.21.15.60:0/1268567597 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f3184c1d640 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 0x560bef2ec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.726+0000 7f318541e640 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 0x560bef2f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f3184c1d640 1 -- 172.21.15.60:0/1268567597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 msgr2=0x560bef2ec720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f3184c1d640 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 0x560bef2ec720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f3184c1d640 1 -- 172.21.15.60:0/1268567597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 msgr2=0x560bef2f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f3184c1d640 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 0x560bef2f2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f3184c1d640 1 -- 172.21.15.60:0/1268567597 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bef2d9a90 con 0x560bef2dc370 2024-09-12T00:08:18.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f3184c1d640 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2dd760 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f31700057c0 tx=0x7f3170005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f0b21678b5b79b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f316affd640 1 -- 172.21.15.60:0/1268567597 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170035070 con 0x560bef2dc370 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f316affd640 1 -- 172.21.15.60:0/1268567597 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3170031ac0 con 0x560bef2dc370 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.727+0000 7f316affd640 1 -- 172.21.15.60:0/1268567597 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317003d620 con 0x560bef2dc370 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 -- 172.21.15.60:0/1268567597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 msgr2=0x560bef2dd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2dd760 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f31700057c0 tx=0x7f3170005fd0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 -- 172.21.15.60:0/1268567597 shutdown_connections 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2dc370 0x560bef2dd760 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2d2b40 0x560bef2f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 --2- 172.21.15.60:0/1268567597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 0x560bef2ec720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 -- 172.21.15.60:0/1268567597 >> 172.21.15.60:0/1268567597 conn(0x560bef29a310 msgr2=0x560bef2d7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 -- 172.21.15.60:0/1268567597 shutdown_connections 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 -- 172.21.15.60:0/1268567597 wait complete. 2024-09-12T00:08:18.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 -- start start 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.728+0000 7f3189a5b740 1 Processor -- start 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 0x560bef2e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d2b40 0x560bef2e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3189a5b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2dc370 0x560bef2d61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3189a5b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31801acbe0 con 0x560bef2d2b40 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3189a5b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31801ac510 con 0x560bef2dc370 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3189a5b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f31801a9770 con 0x560bef2d15d0 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3189a5b740 10 client.0 _ll_register_callbacks cb 0x7f3170009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d2b40 0x560bef2e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d2b40 0x560bef2e8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47296/0 (socket says 172.21.15.60:47296) 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 -- 172.21.15.60:0/170375889 learned_addr learned my addr 172.21.15.60:0/170375889 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3184c1d640 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2dc370 0x560bef2d61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3184c1d640 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 0x560bef2e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 -- 172.21.15.60:0/170375889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 msgr2=0x560bef2e8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 0x560bef2e8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 -- 172.21.15.60:0/170375889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2dc370 msgr2=0x560bef2d61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2dc370 0x560bef2d61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 -- 172.21.15.60:0/170375889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bef2d69b0 con 0x560bef2d2b40 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f318541e640 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d2b40 0x560bef2e8f80 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f317c00a920 tx=0x7f317c006a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beec2a3a09e3ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.729+0000 7f3168ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3168ff9640 1 -- 172.21.15.60:0/170375889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c015040 con 0x560bef2d2b40 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3168ff9640 1 -- 172.21.15.60:0/170375889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f317c00cac0 con 0x560bef2d2b40 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 1 -- 172.21.15.60:0/170375889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3170031ac0 con 0x560bef2d2b40 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3168ff9640 1 -- 172.21.15.60:0/170375889 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f317c00a530 con 0x560bef2d2b40 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 10 client.17514 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:18.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 1 -- 172.21.15.60:0/170375889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x560bef2f7db0 con 0x560bef2d2b40 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3168ff9640 1 -- 172.21.15.60:0/170375889 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3170031ac0 con 0x560bef2d2b40 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3168ff9640 1 -- 172.21.15.60:0/170375889 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f317c036070 con 0x560bef2d2b40 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 10 client.17514 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 10 client.17514 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 20 client.17514 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x560bef35af30 0x560bef35d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 4 client.17514 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.730+0000 7f3189a5b740 1 -- 172.21.15.60:0/170375889 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560bef23ed70 con 0x560bef35af30 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3184c1d640 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x560bef35af30 0x560bef35d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3184c1d640 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x560bef35af30 0x560bef35d320 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=623d2b12b2ba97dc server_cookie=fe912912ddfe6fc0 in_seq=0 out_seq=0 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3168ff9640 10 client.17514 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3168ff9640 1 -- 172.21.15.60:0/170375889 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560bef23ed70 con 0x560bef35af30 2024-09-12T00:08:18.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3168ff9640 10 client.17514 handle_command_reply: tid=0 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3189a5b740 1 client.17514 shutdown 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3189a5b740 1 -- 172.21.15.60:0/170375889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d2b40 msgr2=0x560bef2e8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3189a5b740 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d2b40 0x560bef2e8f80 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f317c00a920 tx=0x7f317c006a70 comp rx=0 tx=0).stop 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.731+0000 7f3189a5b740 1 -- 172.21.15.60:0/170375889 shutdown_connections 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3189a5b740 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x560bef35af30 0x560bef35d320 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3189a5b740 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560bef2dc370 0x560bef2d61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3189a5b740 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560bef2d2b40 0x560bef2e8f80 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3168ff9640 0 client.17514 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3189a5b740 1 --2- 172.21.15.60:0/170375889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560bef2d15d0 0x560bef2e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3189a5b740 1 -- 172.21.15.60:0/170375889 >> 172.21.15.60:0/170375889 conn(0x560bef29a310 msgr2=0x560bef2da7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3189a5b740 1 -- 172.21.15.60:0/170375889 shutdown_connections 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3189a5b740 1 -- 172.21.15.60:0/170375889 wait complete. 2024-09-12T00:08:18.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3189a5b740 20 client.17514 trim_cache size 0 max 16384 2024-09-12T00:08:18.739 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 -- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f316c0a2d70 msgr2=0x7f316c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f316c0a2d70 0x7f316c0a5230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f317809b940 tx=0x7f317800cf50 comp rx=0 tx=0).stop 2024-09-12T00:08:18.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 -- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180106f10 msgr2=0x7f318019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180106f10 0x7f318019ce40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f317800eaa0 tx=0x7f317800ef60 comp rx=0 tx=0).stop 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 -- 172.21.15.60:0/1311649603 shutdown_connections 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f316c0a2d70 0x7f316c0a5230 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180106f10 0x7f318019ce40 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3180102790 0x7f3180198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 --2- 172.21.15.60:0/1311649603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3180101de0 0x7f3180198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 -- 172.21.15.60:0/1311649603 >> 172.21.15.60:0/1311649603 conn(0x7f31800fd8c0 msgr2=0x7f31800fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 -- 172.21.15.60:0/1311649603 shutdown_connections 2024-09-12T00:08:18.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:18.732+0000 7f3187682640 1 -- 172.21.15.60:0/1311649603 wait complete. 2024-09-12T00:08:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:19 smithi105 ceph-mon[34805]: pgmap v276: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:19.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:19 smithi192 ceph-mon[35487]: pgmap v276: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:19.558 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:19 smithi060 ceph-mon[30953]: pgmap v276: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:19.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:08:19.849 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 -- 172.21.15.60:0/1854018610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420101de0 msgr2=0x7fe4201021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 --2- 172.21.15.60:0/1854018610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420101de0 0x7fe4201021c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009900 tx=0x7fe41c02a410 comp rx=0 tx=0).stop 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 -- 172.21.15.60:0/1854018610 shutdown_connections 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 --2- 172.21.15.60:0/1854018610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe420106f10 0x7fe42010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 --2- 172.21.15.60:0/1854018610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe420102790 0x7fe4201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 --2- 172.21.15.60:0/1854018610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420101de0 0x7fe4201021c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 -- 172.21.15.60:0/1854018610 >> 172.21.15.60:0/1854018610 conn(0x7fe4200fd8c0 msgr2=0x7fe4200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 -- 172.21.15.60:0/1854018610 shutdown_connections 2024-09-12T00:08:20.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 -- 172.21.15.60:0/1854018610 wait complete. 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 Processor -- start 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.366+0000 7fe426aba640 1 -- start start 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe426aba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe420101de0 0x7fe420198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe426aba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420102790 0x7fe420198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe426aba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe420106f10 0x7fe42019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe426aba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe420112150 con 0x7fe420102790 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe426aba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe420111fd0 con 0x7fe420106f10 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe426aba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201122d0 con 0x7fe420101de0 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420102790 0x7fe420198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420102790 0x7fe420198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47322/0 (socket says 172.21.15.60:47322) 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 -- 172.21.15.60:0/4075541048 learned_addr learned my addr 172.21.15.60:0/4075541048 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe424856640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe420101de0 0x7fe420198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe425057640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe420106f10 0x7fe42019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 -- 172.21.15.60:0/4075541048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe420101de0 msgr2=0x7fe420198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe420101de0 0x7fe420198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 -- 172.21.15.60:0/4075541048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe420106f10 msgr2=0x7fe42019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe420106f10 0x7fe42019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 -- 172.21.15.60:0/4075541048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42019d620 con 0x7fe420102790 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe425057640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe420106f10 0x7fe42019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.367+0000 7fe417fff640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420102790 0x7fe420198bb0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe41000b4a0 tx=0x7fe41000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.368+0000 7fe415ffb640 1 -- 172.21.15.60:0/4075541048 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410014070 con 0x7fe420102790 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.368+0000 7fe415ffb640 1 -- 172.21.15.60:0/4075541048 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe410010b10 con 0x7fe420102790 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.368+0000 7fe426aba640 1 -- 172.21.15.60:0/4075541048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42019d910 con 0x7fe420102790 2024-09-12T00:08:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.368+0000 7fe415ffb640 1 -- 172.21.15.60:0/4075541048 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410017d60 con 0x7fe420102790 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.368+0000 7fe426aba640 1 -- 172.21.15.60:0/4075541048 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4201a51f0 con 0x7fe420102790 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.370+0000 7fe415ffb640 1 -- 172.21.15.60:0/4075541048 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe410017070 con 0x7fe420102790 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe428e93740 1 Processor -- start 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe428e93740 1 -- start start 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe428e93740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a0c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe428e93740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0c5d0 0x55c653a0ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe428e93740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a19760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe428e93740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c6539722f0 con 0x55c653a0db40 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe428e93740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c653919cf0 con 0x55c653a0c5d0 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe428e93740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c65396e2b0 con 0x55c653a17370 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a0c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe415ffb640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4080a2cf0 0x7fe4080a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a0c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47326/0 (socket says 172.21.15.60:47326) 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 -- 172.21.15.60:0/1554745517 learned_addr learned my addr 172.21.15.60:0/1554745517 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe424856640 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0c5d0 0x55c653a0ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4080a2cf0 0x7fe4080a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe417fff640 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a19760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe415ffb640 1 -- 172.21.15.60:0/4075541048 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7fe4100ce7d0 con 0x7fe420102790 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 -- 172.21.15.60:0/1554745517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 msgr2=0x55c653a19760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a19760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 -- 172.21.15.60:0/1554745517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0c5d0 msgr2=0x55c653a0ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0c5d0 0x55c653a0ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe425057640 1 -- 172.21.15.60:0/1554745517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6538fe3a0 con 0x55c653a0db40 2024-09-12T00:08:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.371+0000 7fe424856640 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0c5d0 0x55c653a0ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.372+0000 7fe425057640 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a0c090 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe41800cbf0 tx=0x7fe418007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8136b5485c2196 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.372+0000 7fe406ffd640 1 -- 172.21.15.60:0/1554745517 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418015070 con 0x55c653a0db40 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.372+0000 7fe406ffd640 1 -- 172.21.15.60:0/1554745517 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe418016040 con 0x55c653a0db40 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.372+0000 7fe406ffd640 1 -- 172.21.15.60:0/1554745517 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41801e020 con 0x55c653a0db40 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.372+0000 7fe425057640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4080a2cf0 0x7fe4080a51b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe41801f000 tx=0x7fe41801b000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 -- 172.21.15.60:0/1554745517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 msgr2=0x55c653a0c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a0c090 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fe41800cbf0 tx=0x7fe418007680 comp rx=0 tx=0).stop 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 -- 172.21.15.60:0/1554745517 shutdown_connections 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a19760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0c5d0 0x55c653a0ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 --2- 172.21.15.60:0/1554745517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a0c090 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 -- 172.21.15.60:0/1554745517 >> 172.21.15.60:0/1554745517 conn(0x55c6539d5310 msgr2=0x55c653a08c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:20.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 -- 172.21.15.60:0/1554745517 shutdown_connections 2024-09-12T00:08:20.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.373+0000 7fe428e93740 1 -- 172.21.15.60:0/1554745517 wait complete. 2024-09-12T00:08:20.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 1 -- start start 2024-09-12T00:08:20.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 1 Processor -- start 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 0x55c653a16d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a14040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a17370 0x55c653a14650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c653a1a070 con 0x55c653a17370 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c65392d060 con 0x55c653a0db40 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c653a1a1f0 con 0x55c653a0c5d0 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.374+0000 7fe428e93740 10 client.0 _ll_register_callbacks cb 0x55c6536808c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a17370 0x55c653a14650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a17370 0x55c653a14650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47340/0 (socket says 172.21.15.60:47340) 2024-09-12T00:08:20.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 -- 172.21.15.60:0/3180851334 learned_addr learned my addr 172.21.15.60:0/3180851334 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe424856640 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 0x55c653a16d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe417fff640 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a14040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 -- 172.21.15.60:0/3180851334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 msgr2=0x55c653a16d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 0x55c653a16d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 -- 172.21.15.60:0/3180851334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 msgr2=0x55c653a14040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a14040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 -- 172.21.15.60:0/3180851334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6536e33c0 con 0x55c653a17370 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe425057640 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a17370 0x55c653a14650 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c390 tx=0x7fe418007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aee7ddeb35a9146 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe3fffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe3fffff640 1 -- 172.21.15.60:0/3180851334 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418015070 con 0x55c653a17370 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe3fffff640 1 -- 172.21.15.60:0/3180851334 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7fe41801aa10 con 0x55c653a17370 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.375+0000 7fe428e93740 1 -- 172.21.15.60:0/3180851334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe418016040 con 0x55c653a17370 2024-09-12T00:08:20.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe3fffff640 1 -- 172.21.15.60:0/3180851334 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fe41801e040 con 0x55c653a17370 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe428e93740 10 client.17526 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe428e93740 1 -- 172.21.15.60:0/3180851334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55c653a25b40 con 0x55c653a17370 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe3fffff640 1 -- 172.21.15.60:0/3180851334 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe418016040 con 0x55c653a17370 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe3fffff640 1 -- 172.21.15.60:0/3180851334 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fe418032030 con 0x55c653a17370 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe428e93740 10 client.17526 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe428e93740 10 client.17526 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe428e93740 20 client.17526 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe428e93740 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c653a27000 0x55c653a293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe428e93740 4 client.17526 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe428e93740 1 -- 172.21.15.60:0/3180851334 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c65397f860 con 0x55c653a27000 2024-09-12T00:08:20.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.376+0000 7fe424856640 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c653a27000 0x55c653a293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.377+0000 7fe3fffff640 10 client.17526 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.377+0000 7fe424856640 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c653a27000 0x55c653a293f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=37ec3af50c75267b server_cookie=b2914e50f916dac5 in_seq=0 out_seq=0 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe3fffff640 1 -- 172.21.15.60:0/3180851334 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c65397f860 con 0x55c653a27000 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe3fffff640 10 client.17526 handle_command_reply: tid=0 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 client.17526 shutdown 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 -- 172.21.15.60:0/3180851334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a17370 msgr2=0x55c653a14650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a17370 0x55c653a14650 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c390 tx=0x7fe418007c30 comp rx=0 tx=0).stop 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 -- 172.21.15.60:0/3180851334 shutdown_connections 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c653a27000 0x55c653a293f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a17370 0x55c653a14650 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a14040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 --2- 172.21.15.60:0/3180851334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 0x55c653a16d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 -- 172.21.15.60:0/3180851334 >> 172.21.15.60:0/3180851334 conn(0x55c6539d5310 msgr2=0x55c653a0e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:20.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe3fffff640 0 client.17526 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:08:20.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 -- 172.21.15.60:0/3180851334 shutdown_connections 2024-09-12T00:08:20.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 1 -- 172.21.15.60:0/3180851334 wait complete. 2024-09-12T00:08:20.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.378+0000 7fe428e93740 20 client.17526 trim_cache size 0 max 16384 2024-09-12T00:08:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.391+0000 7fe428e93740 1 Processor -- start 2024-09-12T00:08:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.391+0000 7fe428e93740 1 -- start start 2024-09-12T00:08:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.391+0000 7fe428e93740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0c5d0 0x55c653a15fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.391+0000 7fe428e93740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a1f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.391+0000 7fe428e93740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a1fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.391+0000 7fe428e93740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201adae0 con 0x55c653a0c5d0 2024-09-12T00:08:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.391+0000 7fe428e93740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201af620 con 0x55c653a0db40 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.391+0000 7fe428e93740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201ae1b0 con 0x55c653a17370 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0c5d0 0x55c653a15fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0c5d0 0x55c653a15fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47346/0 (socket says 172.21.15.60:47346) 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 -- 172.21.15.60:0/1255723018 learned_addr learned my addr 172.21.15.60:0/1255723018 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe425057640 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a1fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe417fff640 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a1f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 -- 172.21.15.60:0/1255723018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 msgr2=0x55c653a1fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a1fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 -- 172.21.15.60:0/1255723018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 msgr2=0x55c653a1f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a1f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 -- 172.21.15.60:0/1255723018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c653a29980 con 0x55c653a0c5d0 2024-09-12T00:08:20.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe425057640 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a1fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:20.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe417fff640 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a1f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe424856640 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0c5d0 0x55c653a15fb0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe41c005ab0 tx=0x7fe41c02ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c637bd07d288f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe4067fc640 1 -- 172.21.15.60:0/1255723018 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c04c070 con 0x55c653a0c5d0 2024-09-12T00:08:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe4067fc640 1 -- 172.21.15.60:0/1255723018 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe41c005520 con 0x55c653a0c5d0 2024-09-12T00:08:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.392+0000 7fe4067fc640 1 -- 172.21.15.60:0/1255723018 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c035040 con 0x55c653a0c5d0 2024-09-12T00:08:20.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 -- 172.21.15.60:0/1255723018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0c5d0 msgr2=0x55c653a15fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0c5d0 0x55c653a15fb0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe41c005ab0 tx=0x7fe41c02ab20 comp rx=0 tx=0).stop 2024-09-12T00:08:20.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 -- 172.21.15.60:0/1255723018 shutdown_connections 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a17370 0x55c653a1fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a0db40 0x55c653a1f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 --2- 172.21.15.60:0/1255723018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0c5d0 0x55c653a15fb0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 -- 172.21.15.60:0/1255723018 >> 172.21.15.60:0/1255723018 conn(0x55c6539d5310 msgr2=0x55c653a158a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 -- 172.21.15.60:0/1255723018 shutdown_connections 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 -- 172.21.15.60:0/1255723018 wait complete. 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 -- start start 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.393+0000 7fe428e93740 1 Processor -- start 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe428e93740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 0x55c653a89d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe428e93740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a8a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe428e93740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a17370 0x55c653a94bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe428e93740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201aef50 con 0x55c653a0db40 2024-09-12T00:08:20.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe428e93740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201ae880 con 0x55c653a17370 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe428e93740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201abae0 con 0x55c653a0c5d0 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe428e93740 10 client.0 _ll_register_callbacks cb 0x7fe41c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe417fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a8a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe417fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a8a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47352/0 (socket says 172.21.15.60:47352) 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe417fff640 1 -- 172.21.15.60:0/3697890406 learned_addr learned my addr 172.21.15.60:0/3697890406 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe424856640 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 0x55c653a89d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe425057640 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a17370 0x55c653a94bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe417fff640 1 -- 172.21.15.60:0/3697890406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 msgr2=0x55c653a89d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe417fff640 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 0x55c653a89d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe417fff640 1 -- 172.21.15.60:0/3697890406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a17370 msgr2=0x55c653a94bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe417fff640 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a17370 0x55c653a94bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe417fff640 1 -- 172.21.15.60:0/3697890406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c653a95200 con 0x55c653a0db40 2024-09-12T00:08:20.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.394+0000 7fe425057640 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a17370 0x55c653a94bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe417fff640 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a8a260 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe41009aac0 tx=0x7fe41001ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef74dcd084ca4d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe3fffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe3fffff640 1 -- 172.21.15.60:0/3697890406 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41001e040 con 0x55c653a0db40 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe3fffff640 1 -- 172.21.15.60:0/3697890406 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7fe410097430 con 0x55c653a0db40 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 1 -- 172.21.15.60:0/3697890406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe41c005520 con 0x55c653a0db40 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe3fffff640 1 -- 172.21.15.60:0/3697890406 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fe41009f170 con 0x55c653a0db40 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 10 client.17532 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 1 -- 172.21.15.60:0/3697890406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55c653a96490 con 0x55c653a0db40 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe3fffff640 1 -- 172.21.15.60:0/3697890406 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe41c005520 con 0x55c653a0db40 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe3fffff640 1 -- 172.21.15.60:0/3697890406 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fe4100cc160 con 0x55c653a0db40 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 10 client.17532 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:20.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 10 client.17532 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 20 client.17532 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c653a96c10 0x55c653a99030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 4 client.17532 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.395+0000 7fe428e93740 1 -- 172.21.15.60:0/3697890406 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c653979d70 con 0x55c653a96c10 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.396+0000 7fe424856640 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c653a96c10 0x55c653a99030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.396+0000 7fe424856640 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c653a96c10 0x55c653a99030 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eeb3705ed262df72 server_cookie=e37cb9a69511991c in_seq=0 out_seq=0 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.396+0000 7fe3fffff640 10 client.17532 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.396+0000 7fe3fffff640 1 -- 172.21.15.60:0/3697890406 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c653979d70 con 0x55c653a96c10 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.396+0000 7fe3fffff640 10 client.17532 handle_command_reply: tid=0 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.396+0000 7fe428e93740 1 client.17532 shutdown 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.396+0000 7fe428e93740 1 -- 172.21.15.60:0/3697890406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 msgr2=0x55c653a8a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.396+0000 7fe428e93740 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a8a260 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe41009aac0 tx=0x7fe41001ec80 comp rx=0 tx=0).stop 2024-09-12T00:08:20.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 1 -- 172.21.15.60:0/3697890406 shutdown_connections 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55c653a96c10 0x55c653a99030 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c653a17370 0x55c653a94bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c653a0db40 0x55c653a8a260 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 1 --2- 172.21.15.60:0/3697890406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c653a0c5d0 0x55c653a89d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe3fffff640 0 client.17532 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 1 -- 172.21.15.60:0/3697890406 >> 172.21.15.60:0/3697890406 conn(0x55c6539d5310 msgr2=0x55c653a160c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 1 -- 172.21.15.60:0/3697890406 shutdown_connections 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 1 -- 172.21.15.60:0/3697890406 wait complete. 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe428e93740 20 client.17532 trim_cache size 0 max 16384 2024-09-12T00:08:20.405 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 -- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4080a2cf0 msgr2=0x7fe4080a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4080a2cf0 0x7fe4080a51b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe41801f000 tx=0x7fe41801b000 comp rx=0 tx=0).stop 2024-09-12T00:08:20.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 -- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420102790 msgr2=0x7fe420198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420102790 0x7fe420198bb0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fe41000b4a0 tx=0x7fe41000b960 comp rx=0 tx=0).stop 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 -- 172.21.15.60:0/4075541048 shutdown_connections 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe4080a2cf0 0x7fe4080a51b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe420106f10 0x7fe42019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe420102790 0x7fe420198bb0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 --2- 172.21.15.60:0/4075541048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe420101de0 0x7fe420198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.397+0000 7fe426aba640 1 -- 172.21.15.60:0/4075541048 >> 172.21.15.60:0/4075541048 conn(0x7fe4200fd8c0 msgr2=0x7fe4200fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.398+0000 7fe426aba640 1 -- 172.21.15.60:0/4075541048 shutdown_connections 2024-09-12T00:08:20.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:20.398+0000 7fe426aba640 1 -- 172.21.15.60:0/4075541048 wait complete. 2024-09-12T00:08:21.175 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:08:21.433 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:21 smithi105 ceph-mon[34805]: pgmap v278: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:21.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:21 smithi192 ceph-mon[35487]: pgmap v278: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:21.554 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:21 smithi060 ceph-mon[30953]: pgmap v278: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:21.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 -- 172.21.15.60:0/890099134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 msgr2=0x7f6774106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 --2- 172.21.15.60:0/890099134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 0x7f6774106e60 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6764009930 tx=0x7f676402a420 comp rx=0 tx=0).stop 2024-09-12T00:08:21.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 -- 172.21.15.60:0/890099134 shutdown_connections 2024-09-12T00:08:21.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 --2- 172.21.15.60:0/890099134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6774101420 0x7f677410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 --2- 172.21.15.60:0/890099134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774100a80 0x7f6774100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 --2- 172.21.15.60:0/890099134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 0x7f6774106e60 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 -- 172.21.15.60:0/890099134 >> 172.21.15.60:0/890099134 conn(0x7f67740fc7a0 msgr2=0x7f67740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 -- 172.21.15.60:0/890099134 shutdown_connections 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.925+0000 7f6779a4d640 1 -- 172.21.15.60:0/890099134 wait complete. 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6779a4d640 1 Processor -- start 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6779a4d640 1 -- start start 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6779a4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6774100a80 0x7f6774199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6779a4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774101420 0x7f67741998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6779a4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 0x7f67741a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6779a4d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6774110fa0 con 0x7f6774106a80 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6779a4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6774110e20 con 0x7f6774100a80 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6779a4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6774111120 con 0x7f6774101420 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f67737fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 0x7f67741a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f67737fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 0x7f67741a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46700/0 (socket says 172.21.15.60:46700) 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f67737fe640 1 -- 172.21.15.60:0/902757923 learned_addr learned my addr 172.21.15.60:0/902757923 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f6772ffd640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6774100a80 0x7f6774199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.926+0000 7f676a7fc640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774101420 0x7f67741998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f67737fe640 1 -- 172.21.15.60:0/902757923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774101420 msgr2=0x7f67741998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f67737fe640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774101420 0x7f67741998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f67737fe640 1 -- 172.21.15.60:0/902757923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6774100a80 msgr2=0x7f6774199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f67737fe640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6774100a80 0x7f6774199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f67737fe640 1 -- 172.21.15.60:0/902757923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67741a4950 con 0x7f6774106a80 2024-09-12T00:08:21.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f67737fe640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 0x7f67741a4410 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f676c009fd0 tx=0x7f676c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f6778a4b640 1 -- 172.21.15.60:0/902757923 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c017070 con 0x7f6774106a80 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f6778a4b640 1 -- 172.21.15.60:0/902757923 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f676c004020 con 0x7f6774106a80 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f6779a4d640 1 -- 172.21.15.60:0/902757923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67741a4b20 con 0x7f6774106a80 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f6778a4b640 1 -- 172.21.15.60:0/902757923 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c0106c0 con 0x7f6774106a80 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.927+0000 7f6779a4d640 1 -- 172.21.15.60:0/902757923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67741a5060 con 0x7f6774106a80 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f6778a4b640 1 -- 172.21.15.60:0/902757923 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f676c0041d0 con 0x7f6774106a80 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f677be26740 1 Processor -- start 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f677be26740 1 -- start start 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f677be26740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f677be26740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 0x564212dbca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f677be26740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 0x564212dc9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f677be26740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564212d222f0 con 0x564212dbdb40 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f677be26740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564212cc9cf0 con 0x564212dc7370 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f677be26740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564212d1e2b0 con 0x564212dbc5d0 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f676a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f676a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46716/0 (socket says 172.21.15.60:46716) 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f676a7fc640 1 -- 172.21.15.60:0/4118668542 learned_addr learned my addr 172.21.15.60:0/4118668542 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f6778a4b640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67600a2d70 0x7f67600a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f676a7fc640 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 0x564212dc9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.930+0000 7f6772ffd640 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 0x564212dbca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f676a7fc640 1 -- 172.21.15.60:0/4118668542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 msgr2=0x564212dbca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f676a7fc640 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 0x564212dbca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f676a7fc640 1 -- 172.21.15.60:0/4118668542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 msgr2=0x564212dc9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:21.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f676a7fc640 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 0x564212dc9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f676a7fc640 1 -- 172.21.15.60:0/4118668542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564212cae3a0 con 0x564212dbdb40 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f6778a4b640 1 -- 172.21.15.60:0/902757923 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f676c0ceff0 con 0x7f6774106a80 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f67737fe640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67600a2d70 0x7f67600a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f676a7fc640 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbc090 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f675c00a500 tx=0x7f675c00a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97eb92777648df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f6769ffb640 1 -- 172.21.15.60:0/4118668542 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c019030 con 0x564212dbdb40 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f6769ffb640 1 -- 172.21.15.60:0/4118668542 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f675c005520 con 0x564212dbdb40 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.931+0000 7f6769ffb640 1 -- 172.21.15.60:0/4118668542 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c0116b0 con 0x564212dbdb40 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 -- 172.21.15.60:0/4118668542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 msgr2=0x564212dbc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f67737fe640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67600a2d70 0x7f67600a5230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f676c00b760 tx=0x7f676c086040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbc090 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f675c00a500 tx=0x7f675c00a780 comp rx=0 tx=0).stop 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 -- 172.21.15.60:0/4118668542 shutdown_connections 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 0x564212dc9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 0x564212dbca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 --2- 172.21.15.60:0/4118668542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbc090 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 -- 172.21.15.60:0/4118668542 >> 172.21.15.60:0/4118668542 conn(0x564212d85310 msgr2=0x564212db8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 -- 172.21.15.60:0/4118668542 shutdown_connections 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 -- 172.21.15.60:0/4118668542 wait complete. 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 -- start start 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.932+0000 7f677be26740 1 Processor -- start 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f677be26740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbc5d0 0x564212dc6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f677be26740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbdb40 0x564212dc3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f677be26740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dc7370 0x564212dc44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f677be26740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564212dca070 con 0x564212dbc5d0 2024-09-12T00:08:21.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f677be26740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564212cdd060 con 0x564212dbdb40 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f677be26740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564212dca1f0 con 0x564212dc7370 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f677be26740 10 client.0 _ll_register_callbacks cb 0x564212a308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbc5d0 0x564212dc6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbc5d0 0x564212dc6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46732/0 (socket says 172.21.15.60:46732) 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 -- 172.21.15.60:0/1438892335 learned_addr learned my addr 172.21.15.60:0/1438892335 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f6772ffd640 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbdb40 0x564212dc3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 -- 172.21.15.60:0/1438892335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dc7370 msgr2=0x564212dc44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dc7370 0x564212dc44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 -- 172.21.15.60:0/1438892335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbdb40 msgr2=0x564212dc3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbdb40 0x564212dc3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 -- 172.21.15.60:0/1438892335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564212a933c0 con 0x564212dbc5d0 2024-09-12T00:08:21.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f6772ffd640 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbdb40 0x564212dc3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f676a7fc640 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbc5d0 0x564212dc6ce0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f675c0057c0 tx=0x7f675c011300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdee441873c30c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f6752ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f6752ffd640 1 -- 172.21.15.60:0/1438892335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c019040 con 0x564212dbc5d0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f6752ffd640 1 -- 172.21.15.60:0/1438892335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f675c004ee0 con 0x564212dbc5d0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.933+0000 7f677be26740 1 -- 172.21.15.60:0/1438892335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f675c005520 con 0x564212dbc5d0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f6752ffd640 1 -- 172.21.15.60:0/1438892335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f675c0050e0 con 0x564212dbc5d0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f677be26740 10 client.17544 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f677be26740 1 -- 172.21.15.60:0/1438892335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564212dd5a80 con 0x564212dbc5d0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f6752ffd640 1 -- 172.21.15.60:0/1438892335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f675c005520 con 0x564212dbc5d0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f6752ffd640 1 -- 172.21.15.60:0/1438892335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f675c02e070 con 0x564212dbc5d0 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f677be26740 10 client.17544 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f677be26740 10 client.17544 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:08:21.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f677be26740 20 client.17544 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f677be26740 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564212dd6dd0 0x564212dd91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f677be26740 4 client.17544 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f677be26740 1 -- 172.21.15.60:0/1438892335 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564212d2f860 con 0x564212dd6dd0 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.934+0000 7f6772ffd640 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564212dd6dd0 0x564212dd91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.935+0000 7f6772ffd640 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564212dd6dd0 0x564212dd91c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f59c90929d408feb server_cookie=a4ef32af1416e9f5 in_seq=0 out_seq=0 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.935+0000 7f6752ffd640 10 client.17544 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.935+0000 7f6752ffd640 1 -- 172.21.15.60:0/1438892335 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564212d2f860 con 0x564212dd6dd0 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.935+0000 7f6752ffd640 10 client.17544 handle_command_reply: tid=0 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.935+0000 7f677be26740 1 client.17544 shutdown 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 -- 172.21.15.60:0/1438892335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbc5d0 msgr2=0x564212dc6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbc5d0 0x564212dc6ce0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f675c0057c0 tx=0x7f675c011300 comp rx=0 tx=0).stop 2024-09-12T00:08:21.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 -- 172.21.15.60:0/1438892335 shutdown_connections 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564212dd6dd0 0x564212dd91c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dc7370 0x564212dc44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbdb40 0x564212dc3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 --2- 172.21.15.60:0/1438892335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbc5d0 0x564212dc6ce0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f6752ffd640 0 client.17544 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 -- 172.21.15.60:0/1438892335 >> 172.21.15.60:0/1438892335 conn(0x564212d85310 msgr2=0x564212dbe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 -- 172.21.15.60:0/1438892335 shutdown_connections 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 1 -- 172.21.15.60:0/1438892335 wait complete. 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.936+0000 7f677be26740 20 client.17544 trim_cache size 0 max 16384 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f677be26740 1 Processor -- start 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f677be26740 1 -- start start 2024-09-12T00:08:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f677be26740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbc5d0 0x564212dbf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f677be26740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f677be26740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dc7370 0x564212dde930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f677be26740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67741ad930 con 0x564212dbdb40 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f677be26740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67741af470 con 0x564212dbc5d0 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f677be26740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67741ae000 con 0x564212dc7370 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46736/0 (socket says 172.21.15.60:46736) 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 -- 172.21.15.60:0/3941889776 learned_addr learned my addr 172.21.15.60:0/3941889776 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f676a7fc640 1 --2- 172.21.15.60:0/3941889776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbc5d0 0x564212dbf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 -- 172.21.15.60:0/3941889776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dc7370 msgr2=0x564212dde930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 --2- 172.21.15.60:0/3941889776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dc7370 0x564212dde930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 -- 172.21.15.60:0/3941889776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbc5d0 msgr2=0x564212dbf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 --2- 172.21.15.60:0/3941889776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbc5d0 0x564212dbf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 -- 172.21.15.60:0/3941889776 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564212db7310 con 0x564212dbdb40 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.949+0000 7f6772ffd640 1 --2- 172.21.15.60:0/3941889776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbf660 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6764009900 tx=0x7f67640058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1217d3e76c530bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f67697fa640 1 -- 172.21.15.60:0/3941889776 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764035040 con 0x564212dbdb40 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f67697fa640 1 -- 172.21.15.60:0/3941889776 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f676404a070 con 0x564212dbdb40 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f67697fa640 1 -- 172.21.15.60:0/3941889776 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764003e50 con 0x564212dbdb40 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 -- 172.21.15.60:0/3941889776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 msgr2=0x564212dbf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 --2- 172.21.15.60:0/3941889776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbf660 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6764009900 tx=0x7f67640058d0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 -- 172.21.15.60:0/3941889776 shutdown_connections 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 --2- 172.21.15.60:0/3941889776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dc7370 0x564212dde930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 --2- 172.21.15.60:0/3941889776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dbf660 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 --2- 172.21.15.60:0/3941889776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dbc5d0 0x564212dbf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 -- 172.21.15.60:0/3941889776 >> 172.21.15.60:0/3941889776 conn(0x564212d85310 msgr2=0x564212db7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 -- 172.21.15.60:0/3941889776 shutdown_connections 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.950+0000 7f677be26740 1 -- 172.21.15.60:0/3941889776 wait complete. 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 1 -- start start 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 1 Processor -- start 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 0x564212dcf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dcf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 0x564212dcc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67741aeda0 con 0x564212dbdb40 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67741ae6d0 con 0x564212dc7370 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67741ab930 con 0x564212dbc5d0 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f677be26740 10 client.0 _ll_register_callbacks cb 0x7f675c013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dcf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f6772ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dcf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46738/0 (socket says 172.21.15.60:46738) 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f6772ffd640 1 -- 172.21.15.60:0/1494077683 learned_addr learned my addr 172.21.15.60:0/1494077683 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.951+0000 7f676a7fc640 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 0x564212dcf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f676a7fc640 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 0x564212dcc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6772ffd640 1 -- 172.21.15.60:0/1494077683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 msgr2=0x564212dcf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6772ffd640 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 0x564212dcf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6772ffd640 1 -- 172.21.15.60:0/1494077683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 msgr2=0x564212dcc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6772ffd640 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 0x564212dcc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6772ffd640 1 -- 172.21.15.60:0/1494077683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564212db9960 con 0x564212dbdb40 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6772ffd640 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dcf9c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f676402a940 tx=0x7f676402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8774b72fe31977 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6752ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6752ffd640 1 -- 172.21.15.60:0/1494077683 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764054070 con 0x564212dbdb40 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6752ffd640 1 -- 172.21.15.60:0/1494077683 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f676403d450 con 0x564212dbdb40 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f677be26740 1 -- 172.21.15.60:0/1494077683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f676404a070 con 0x564212dbdb40 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f6752ffd640 1 -- 172.21.15.60:0/1494077683 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f6764035040 con 0x564212dbdb40 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f677be26740 10 client.17550 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.952+0000 7f677be26740 1 -- 172.21.15.60:0/1494077683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564212e41e50 con 0x564212dbdb40 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f6752ffd640 1 -- 172.21.15.60:0/1494077683 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f676404a070 con 0x564212dbdb40 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f6752ffd640 1 -- 172.21.15.60:0/1494077683 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f676404e7b0 con 0x564212dbdb40 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f677be26740 10 client.17550 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f677be26740 10 client.17550 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f677be26740 20 client.17550 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f677be26740 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564212e42510 0x564212e44930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f677be26740 4 client.17550 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f677be26740 1 -- 172.21.15.60:0/1494077683 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564212d29d70 con 0x564212e42510 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f676a7fc640 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564212e42510 0x564212e44930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f676a7fc640 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564212e42510 0x564212e44930 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f5c1c95337784 server_cookie=9f675070f20982b7 in_seq=0 out_seq=0 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.953+0000 7f6752ffd640 10 client.17550 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f6752ffd640 1 -- 172.21.15.60:0/1494077683 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564212d29d70 con 0x564212e42510 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f6752ffd640 10 client.17550 handle_command_reply: tid=0 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 client.17550 shutdown 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 -- 172.21.15.60:0/1494077683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 msgr2=0x564212dcf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dcf9c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f676402a940 tx=0x7f676402a420 comp rx=0 tx=0).stop 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 -- 172.21.15.60:0/1494077683 shutdown_connections 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x564212e42510 0x564212e44930 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564212dc7370 0x564212dcc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564212dbdb40 0x564212dcf9c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 --2- 172.21.15.60:0/1494077683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564212dbc5d0 0x564212dcf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 -- 172.21.15.60:0/1494077683 >> 172.21.15.60:0/1494077683 conn(0x564212d85310 msgr2=0x564212dc57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f6752ffd640 0 client.17550 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:08:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 -- 172.21.15.60:0/1494077683 shutdown_connections 2024-09-12T00:08:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 1 -- 172.21.15.60:0/1494077683 wait complete. 2024-09-12T00:08:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.954+0000 7f677be26740 20 client.17550 trim_cache size 0 max 16384 2024-09-12T00:08:21.970 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 -- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67600a2d70 msgr2=0x7f67600a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67600a2d70 0x7f67600a5230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f676c00b760 tx=0x7f676c086040 comp rx=0 tx=0).stop 2024-09-12T00:08:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 -- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 msgr2=0x7f67741a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 0x7f67741a4410 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f676c009fd0 tx=0x7f676c00b260 comp rx=0 tx=0).stop 2024-09-12T00:08:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 -- 172.21.15.60:0/902757923 shutdown_connections 2024-09-12T00:08:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67600a2d70 0x7f67600a5230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6774106a80 0x7f67741a4410 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774101420 0x7f67741998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 --2- 172.21.15.60:0/902757923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6774100a80 0x7f6774199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:21.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 -- 172.21.15.60:0/902757923 >> 172.21.15.60:0/902757923 conn(0x7f67740fc7a0 msgr2=0x7f67740fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:21.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 -- 172.21.15.60:0/902757923 shutdown_connections 2024-09-12T00:08:21.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:21.955+0000 7f6779a4d640 1 -- 172.21.15.60:0/902757923 wait complete. 2024-09-12T00:08:22.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:08:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:23.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:23 smithi060 ceph-mon[30953]: pgmap v279: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:23 smithi105 ceph-mon[34805]: pgmap v279: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.517+0000 7f541d3e6640 1 -- 172.21.15.60:0/2640712914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 msgr2=0x7f541810ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.517+0000 7f541d3e6640 1 --2- 172.21.15.60:0/2640712914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 0x7f541810ea20 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5410009ca0 tx=0x7f541002a8c0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.517+0000 7f541d3e6640 1 -- 172.21.15.60:0/2640712914 shutdown_connections 2024-09-12T00:08:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.517+0000 7f541d3e6640 1 --2- 172.21.15.60:0/2640712914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 0x7f541810ea20 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.517+0000 7f541d3e6640 1 --2- 172.21.15.60:0/2640712914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54180ffb60 0x7f54180fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.517+0000 7f541d3e6640 1 --2- 172.21.15.60:0/2640712914 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5418106b80 0x7f5418106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.517+0000 7f541d3e6640 1 -- 172.21.15.60:0/2640712914 >> 172.21.15.60:0/2640712914 conn(0x7f54180fba90 msgr2=0x7f54180fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 -- 172.21.15.60:0/2640712914 shutdown_connections 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 -- 172.21.15.60:0/2640712914 wait complete. 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 Processor -- start 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 -- start start 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54180ffb60 0x7f541819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 0x7f541819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5418106b80 0x7f541819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54181120c0 con 0x7f5418100500 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5418111f40 con 0x7f54180ffb60 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.518+0000 7f541d3e6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5418112240 con 0x7f5418106b80 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 0x7f541819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 0x7f541819ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46752/0 (socket says 172.21.15.60:46752) 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 -- 172.21.15.60:0/1399089566 learned_addr learned my addr 172.21.15.60:0/1399089566 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54180ffb60 0x7f541819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 -- 172.21.15.60:0/1399089566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5418106b80 msgr2=0x7f541819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5418106b80 0x7f541819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 -- 172.21.15.60:0/1399089566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54180ffb60 msgr2=0x7f541819a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54180ffb60 0x7f541819a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 -- 172.21.15.60:0/1399089566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541819f680 con 0x7f5418100500 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f54167fc640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 0x7f541819ac10 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f540c00e9f0 tx=0x7f540c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f53fffff640 1 -- 172.21.15.60:0/1399089566 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c00cd80 con 0x7f5418100500 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f541d3e6640 1 -- 172.21.15.60:0/1399089566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541819f970 con 0x7f5418100500 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.519+0000 7f541d3e6640 1 -- 172.21.15.60:0/1399089566 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54181a7250 con 0x7f5418100500 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.520+0000 7f53fffff640 1 -- 172.21.15.60:0/1399089566 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f540c005520 con 0x7f5418100500 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.520+0000 7f53fffff640 1 -- 172.21.15.60:0/1399089566 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c010690 con 0x7f5418100500 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.522+0000 7f541f7bf740 1 Processor -- start 2024-09-12T00:08:23.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.522+0000 7f541f7bf740 1 -- start start 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.522+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.522+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265d55d0 0x5561265d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.522+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265e0370 0x5561265e2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.522+0000 7f541f7bf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55612653b2f0 con 0x5561265e0370 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.522+0000 7f541f7bf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5561264e2cf0 con 0x5561265d55d0 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.522+0000 7f541f7bf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5561265372b0 con 0x5561265d6b40 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f53fffff640 1 -- 172.21.15.60:0/1399089566 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f540c010830 con 0x7f5418100500 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265d55d0 0x5561265d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265d55d0 0x5561265d5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:41614/0 (socket says 172.21.15.60:41614) 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 -- 172.21.15.60:0/1308555251 learned_addr learned my addr 172.21.15.60:0/1308555251 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f54177fe640 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f54167fc640 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265e0370 0x5561265e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 -- 172.21.15.60:0/1308555251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 msgr2=0x5561265d5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265d5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 -- 172.21.15.60:0/1308555251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265e0370 msgr2=0x5561265e2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265e0370 0x5561265e2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 -- 172.21.15.60:0/1308555251 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561264c73a0 con 0x5561265d55d0 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f54167fc640 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265e0370 0x5561265e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.523+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265d55d0 0x5561265d5a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f540800bd10 tx=0x7f54080107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45337f3d5b004c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f53fffff640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f53fd7fa640 1 -- 172.21.15.60:0/1308555251 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408004030 con 0x5561265d55d0 2024-09-12T00:08:23.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f53fd7fa640 1 -- 172.21.15.60:0/1308555251 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f54080041d0 con 0x5561265d55d0 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f53fd7fa640 1 -- 172.21.15.60:0/1308555251 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408011980 con 0x5561265d55d0 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f54177fe640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f53fffff640 1 -- 172.21.15.60:0/1399089566 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f540c0cf770 con 0x7f5418100500 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f541f7bf740 1 -- 172.21.15.60:0/1308555251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265d55d0 msgr2=0x5561265d5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f54177fe640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5410004af0 tx=0x7f5410005f70 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.524+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265d55d0 0x5561265d5a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f540800bd10 tx=0x7f54080107a0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 -- 172.21.15.60:0/1308555251 shutdown_connections 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265e0370 0x5561265e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265d55d0 0x5561265d5a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1308555251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265d5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 -- 172.21.15.60:0/1308555251 >> 172.21.15.60:0/1308555251 conn(0x55612659e310 msgr2=0x5561265d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 -- 172.21.15.60:0/1308555251 shutdown_connections 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 -- 172.21.15.60:0/1308555251 wait complete. 2024-09-12T00:08:23.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 -- start start 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.525+0000 7f541f7bf740 1 Processor -- start 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265dfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265dcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f541f7bf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5561265e3070 con 0x5561265d55d0 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f541f7bf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5561264f6060 con 0x5561265e0370 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f541f7bf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5561265e31f0 con 0x5561265d6b40 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f541f7bf740 10 client.0 _ll_register_callbacks cb 0x5561262498c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:23.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265dfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f54177fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265dfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46768/0 (socket says 172.21.15.60:46768) 2024-09-12T00:08:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 -- 172.21.15.60:0/1043256906 learned_addr learned my addr 172.21.15.60:0/1043256906 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f54167fc640 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265dcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 -- 172.21.15.60:0/1043256906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 msgr2=0x5561265dcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265dcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 -- 172.21.15.60:0/1043256906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 msgr2=0x5561265dd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:23.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265dd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 -- 172.21.15.60:0/1043256906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561262ac3c0 con 0x5561265d55d0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265dfca0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f54080115b0 tx=0x7f5408003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93807b8f62955c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.526+0000 7f53faff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f53faff5640 1 -- 172.21.15.60:0/1043256906 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408029060 con 0x5561265d55d0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f53faff5640 1 -- 172.21.15.60:0/1043256906 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f5408004380 con 0x5561265d55d0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 1 -- 172.21.15.60:0/1043256906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54080041d0 con 0x5561265d55d0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f53faff5640 1 -- 172.21.15.60:0/1043256906 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f54080035f0 con 0x5561265d55d0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 10 client.17559 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 1 -- 172.21.15.60:0/1043256906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5561265f7240 con 0x5561265d55d0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f53faff5640 1 -- 172.21.15.60:0/1043256906 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f54080041d0 con 0x5561265d55d0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f53faff5640 1 -- 172.21.15.60:0/1043256906 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f54080046e0 con 0x5561265d55d0 2024-09-12T00:08:23.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 10 client.17559 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 10 client.17559 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 20 client.17559 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5561265f8640 0x5561265faa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 4 client.17559 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.527+0000 7f541f7bf740 1 -- 172.21.15.60:0/1043256906 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556126548860 con 0x5561265f8640 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.528+0000 7f54167fc640 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5561265f8640 0x5561265faa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.528+0000 7f53faff5640 10 client.17559 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.528+0000 7f54167fc640 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5561265f8640 0x5561265faa30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3881fde3da7fcd2b server_cookie=beaad01885dfc2ff in_seq=0 out_seq=0 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f53faff5640 1 -- 172.21.15.60:0/1043256906 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556126548860 con 0x5561265f8640 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f53faff5640 10 client.17559 handle_command_reply: tid=0 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 client.17559 shutdown 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 -- 172.21.15.60:0/1043256906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 msgr2=0x5561265dfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265dfca0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f54080115b0 tx=0x7f5408003e70 comp rx=0 tx=0).stop 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 -- 172.21.15.60:0/1043256906 shutdown_connections 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x5561265f8640 0x5561265faa30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265dd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265dcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1043256906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265dfca0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 -- 172.21.15.60:0/1043256906 >> 172.21.15.60:0/1043256906 conn(0x55612659e310 msgr2=0x5561265d7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f53faff5640 0 client.17559 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 -- 172.21.15.60:0/1043256906 shutdown_connections 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.529+0000 7f541f7bf740 1 -- 172.21.15.60:0/1043256906 wait complete. 2024-09-12T00:08:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.530+0000 7f541f7bf740 20 client.17559 trim_cache size 0 max 16384 2024-09-12T00:08:23.540 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:23 smithi192 ceph-mon[35487]: pgmap v279: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f541f7bf740 1 Processor -- start 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f541f7bf740 1 -- start start 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d55d0 0x5561265f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d6b40 0x5561265d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f541f7bf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f540400e6e0 con 0x5561265d6b40 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f541f7bf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5404010220 con 0x5561265e0370 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f541f7bf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f540400edb0 con 0x5561265d55d0 2024-09-12T00:08:23.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54167fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d6b40 0x5561265d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54167fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d6b40 0x5561265d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46784/0 (socket says 172.21.15.60:46784) 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54167fc640 1 -- 172.21.15.60:0/1792543636 learned_addr learned my addr 172.21.15.60:0/1792543636 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d55d0 0x5561265f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54167fc640 1 -- 172.21.15.60:0/1792543636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d55d0 msgr2=0x5561265f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54167fc640 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d55d0 0x5561265f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54177fe640 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54167fc640 1 -- 172.21.15.60:0/1792543636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 msgr2=0x5561265d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54167fc640 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.543+0000 7f54167fc640 1 -- 172.21.15.60:0/1792543636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561265d2180 con 0x5561265d6b40 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.544+0000 7f5416ffd640 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d55d0 0x5561265f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:23.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.544+0000 7f54167fc640 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d6b40 0x5561265d1700 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c6a0 tx=0x7f540c0d1c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951c69c12456b948 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:23.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.544+0000 7f53fcff9640 1 -- 172.21.15.60:0/1792543636 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c0a4920 con 0x5561265d6b40 2024-09-12T00:08:23.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.544+0000 7f53fcff9640 1 -- 172.21.15.60:0/1792543636 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f540c099d50 con 0x5561265d6b40 2024-09-12T00:08:23.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.544+0000 7f53fcff9640 1 -- 172.21.15.60:0/1792543636 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c0a4490 con 0x5561265d6b40 2024-09-12T00:08:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 -- 172.21.15.60:0/1792543636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d6b40 msgr2=0x5561265d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d6b40 0x5561265d1700 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c6a0 tx=0x7f540c0d1c80 comp rx=0 tx=0).stop 2024-09-12T00:08:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 -- 172.21.15.60:0/1792543636 shutdown_connections 2024-09-12T00:08:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d6b40 0x5561265d1700 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 --2- 172.21.15.60:0/1792543636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d55d0 0x5561265f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 -- 172.21.15.60:0/1792543636 >> 172.21.15.60:0/1792543636 conn(0x55612659e310 msgr2=0x5561265db820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 -- 172.21.15.60:0/1792543636 shutdown_connections 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 -- 172.21.15.60:0/1792543636 wait complete. 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 -- start start 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 Processor -- start 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.545+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f541f7bf740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f541f7bf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f540400fb50 con 0x5561265d55d0 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f541f7bf740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f540400f480 con 0x5561265e0370 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f541f7bf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f540400c6e0 con 0x5561265d6b40 2024-09-12T00:08:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46786/0 (socket says 172.21.15.60:46786) 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 -- 172.21.15.60:0/107292273 learned_addr learned my addr 172.21.15.60:0/107292273 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f541f7bf740 10 client.0 _ll_register_callbacks cb 0x7f540c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f54177fe640 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f54167fc640 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 -- 172.21.15.60:0/107292273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 msgr2=0x5561265f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 -- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 msgr2=0x5561265d95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 -- 172.21.15.60:0/107292273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561265d9ae0 con 0x5561265d55d0 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f54177fe640 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f5416ffd640 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265f0d70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5408000c00 tx=0x7f5408005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1061bc083f79066a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f53faff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f53faff5640 1 -- 172.21.15.60:0/107292273 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408029070 con 0x5561265d55d0 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f53faff5640 1 -- 172.21.15.60:0/107292273 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f5408011a20 con 0x5561265d55d0 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.546+0000 7f541f7bf740 1 -- 172.21.15.60:0/107292273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f540c099d50 con 0x5561265d55d0 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f53faff5640 1 -- 172.21.15.60:0/107292273 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f540800bb60 con 0x5561265d55d0 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f541f7bf740 10 client.17565 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f541f7bf740 1 -- 172.21.15.60:0/107292273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x556126662780 con 0x5561265d55d0 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f53faff5640 1 -- 172.21.15.60:0/107292273 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f540c099d50 con 0x5561265d55d0 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f53faff5640 1 -- 172.21.15.60:0/107292273 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f54080046b0 con 0x5561265d55d0 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f541f7bf740 10 client.17565 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f541f7bf740 10 client.17565 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f541f7bf740 20 client.17565 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f541f7bf740 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x556126662ec0 0x5561266652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f541f7bf740 4 client.17565 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.547+0000 7f541f7bf740 1 -- 172.21.15.60:0/107292273 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556126542d70 con 0x556126662ec0 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f54167fc640 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x556126662ec0 0x5561266652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f54167fc640 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x556126662ec0 0x5561266652e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=784874db58bfdd93 server_cookie=576a9a5751ccc40f in_seq=0 out_seq=0 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f53faff5640 10 client.17565 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f53faff5640 1 -- 172.21.15.60:0/107292273 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556126542d70 con 0x556126662ec0 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f53faff5640 10 client.17565 handle_command_reply: tid=0 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 client.17565 shutdown 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 -- 172.21.15.60:0/107292273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 msgr2=0x5561265f0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265f0d70 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5408000c00 tx=0x7f5408005c50 comp rx=0 tx=0).stop 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 -- 172.21.15.60:0/107292273 shutdown_connections 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x556126662ec0 0x5561266652e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5561265e0370 0x5561265d95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5561265d6b40 0x5561265f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 --2- 172.21.15.60:0/107292273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5561265d55d0 0x5561265f0d70 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 -- 172.21.15.60:0/107292273 >> 172.21.15.60:0/107292273 conn(0x55612659e310 msgr2=0x5561265db680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f53faff5640 0 client.17565 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:08:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.548+0000 7f541f7bf740 1 -- 172.21.15.60:0/107292273 shutdown_connections 2024-09-12T00:08:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541f7bf740 1 -- 172.21.15.60:0/107292273 wait complete. 2024-09-12T00:08:23.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541f7bf740 20 client.17565 trim_cache size 0 max 16384 2024-09-12T00:08:23.555 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 -- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 msgr2=0x7f54000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5410004af0 tx=0x7f5410005f70 comp rx=0 tx=0).stop 2024-09-12T00:08:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 -- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 msgr2=0x7f541819ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 0x7f541819ac10 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f540c00e9f0 tx=0x7f540c00edf0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 -- 172.21.15.60:0/1399089566 shutdown_connections 2024-09-12T00:08:23.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f54000a2cf0 0x7f54000a51b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5418106b80 0x7f541819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5418100500 0x7f541819ac10 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 --2- 172.21.15.60:0/1399089566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54180ffb60 0x7f541819a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 -- 172.21.15.60:0/1399089566 >> 172.21.15.60:0/1399089566 conn(0x7f54180fba90 msgr2=0x7f541810d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 -- 172.21.15.60:0/1399089566 shutdown_connections 2024-09-12T00:08:23.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:23.549+0000 7f541d3e6640 1 -- 172.21.15.60:0/1399089566 wait complete. 2024-09-12T00:08:24.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:08:24.649 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:25.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 -- 172.21.15.60:0/2245245146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 msgr2=0x7f959810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 --2- 172.21.15.60:0/2245245146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 0x7f959810ea90 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9590009900 tx=0x7f959002a410 comp rx=0 tx=0).stop 2024-09-12T00:08:25.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 -- 172.21.15.60:0/2245245146 shutdown_connections 2024-09-12T00:08:25.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 --2- 172.21.15.60:0/2245245146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 0x7f959810ea90 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 --2- 172.21.15.60:0/2245245146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598102790 0x7f95981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 --2- 172.21.15.60:0/2245245146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9598101de0 0x7f95981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 -- 172.21.15.60:0/2245245146 >> 172.21.15.60:0/2245245146 conn(0x7f95980fd8c0 msgr2=0x7f95980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 -- 172.21.15.60:0/2245245146 shutdown_connections 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.142+0000 7f959f904640 1 -- 172.21.15.60:0/2245245146 wait complete. 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959f904640 1 Processor -- start 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959f904640 1 -- start start 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959f904640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9598101de0 0x7f95981984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959f904640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598102790 0x7f95981989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959f904640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 0x7f959819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959f904640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9598112090 con 0x7f9598106f10 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959f904640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9598111f10 con 0x7f9598102790 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959f904640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9598112210 con 0x7f9598101de0 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959dea1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 0x7f959819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959d6a0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9598101de0 0x7f95981984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959d6a0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9598101de0 0x7f95981984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.60:57190/0 (socket says 172.21.15.60:57190) 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959d6a0640 1 -- 172.21.15.60:0/3090129707 learned_addr learned my addr 172.21.15.60:0/3090129707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959dea1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 0x7f959819cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46804/0 (socket says 172.21.15.60:46804) 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.143+0000 7f959ce9f640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598102790 0x7f95981989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959dea1640 1 -- 172.21.15.60:0/3090129707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9598101de0 msgr2=0x7f95981984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959dea1640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9598101de0 0x7f95981984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959dea1640 1 -- 172.21.15.60:0/3090129707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598102790 msgr2=0x7f95981989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959dea1640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598102790 0x7f95981989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959dea1640 1 -- 172.21.15.60:0/3090129707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959819d460 con 0x7f9598106f10 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959ce9f640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598102790 0x7f95981989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959d6a0640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9598101de0 0x7f95981984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959dea1640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 0x7f959819cd80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f9590009230 tx=0x7f9590004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:25.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f95967fc640 1 -- 172.21.15.60:0/3090129707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959003f030 con 0x7f9598106f10 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f95967fc640 1 -- 172.21.15.60:0/3090129707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9590003af0 con 0x7f9598106f10 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959f904640 1 -- 172.21.15.60:0/3090129707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959819d6f0 con 0x7f9598106f10 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f95967fc640 1 -- 172.21.15.60:0/3090129707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590035070 con 0x7f9598106f10 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.144+0000 7f959f904640 1 -- 172.21.15.60:0/3090129707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95981a5030 con 0x7f9598106f10 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.146+0000 7f95967fc640 1 -- 172.21.15.60:0/3090129707 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9590042030 con 0x7f9598106f10 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95a1cdd740 1 Processor -- start 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95a1cdd740 1 -- start start 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56128e9082f0 con 0x56128e9a3b40 2024-09-12T00:08:25.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56128e8afcf0 con 0x56128e9a25d0 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56128e9042b0 con 0x56128e9ad370 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f959ce9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f959ce9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46814/0 (socket says 172.21.15.60:46814) 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f959ce9f640 1 -- 172.21.15.60:0/3961957099 learned_addr learned my addr 172.21.15.60:0/3961957099 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.147+0000 7f95967fc640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95800a2cf0 0x7f95800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959d6a0640 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959ce9f640 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959dea1640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95800a2cf0 0x7f95800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959ce9f640 1 -- 172.21.15.60:0/3961957099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 msgr2=0x56128e9af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959ce9f640 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959ce9f640 1 -- 172.21.15.60:0/3961957099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 msgr2=0x56128e9a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959ce9f640 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959ce9f640 1 -- 172.21.15.60:0/3961957099 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128e8943a0 con 0x56128e9a3b40 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f95967fc640 1 -- 172.21.15.60:0/3090129707 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f95900efc00 con 0x7f9598106f10 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959d6a0640 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959ce9f640 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a2090 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f958c005d90 tx=0x7f958c00c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66625e67eefb702 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f957f7fe640 1 -- 172.21.15.60:0/3961957099 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c018030 con 0x56128e9a3b40 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f959dea1640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95800a2cf0 0x7f95800a51b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f95900ed420 tx=0x7f95900b15d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f957f7fe640 1 -- 172.21.15.60:0/3961957099 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f958c005520 con 0x56128e9a3b40 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.148+0000 7f957f7fe640 1 -- 172.21.15.60:0/3961957099 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c010910 con 0x56128e9a3b40 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 -- 172.21.15.60:0/3961957099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 msgr2=0x56128e9a2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a2090 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f958c005d90 tx=0x7f958c00c600 comp rx=0 tx=0).stop 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 -- 172.21.15.60:0/3961957099 shutdown_connections 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/3961957099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a2090 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 -- 172.21.15.60:0/3961957099 >> 172.21.15.60:0/3961957099 conn(0x56128e96b310 msgr2=0x56128e99ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 -- 172.21.15.60:0/3961957099 shutdown_connections 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 -- 172.21.15.60:0/3961957099 wait complete. 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 -- start start 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.149+0000 7f95a1cdd740 1 Processor -- start 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56128e9b0070 con 0x56128e9a3b40 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56128e8c3060 con 0x56128e9a25d0 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56128e9b01f0 con 0x56128e9ad370 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f95a1cdd740 10 client.0 _ll_register_callbacks cb 0x56128e6168c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:25.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959d6a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959d6a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46830/0 (socket says 172.21.15.60:46830) 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959d6a0640 1 -- 172.21.15.60:0/2198071712 learned_addr learned my addr 172.21.15.60:0/2198071712 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959ce9f640 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959ce9f640 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959d6a0640 1 -- 172.21.15.60:0/2198071712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 msgr2=0x56128e9aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959d6a0640 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959d6a0640 1 -- 172.21.15.60:0/2198071712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 msgr2=0x56128e9acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959d6a0640 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.150+0000 7f959d6a0640 1 -- 172.21.15.60:0/2198071712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56128e6793c0 con 0x56128e9a3b40 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f959d6a0640 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a9fb0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9588013b40 tx=0x7f95880113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acecfc9541c400a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f957cff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:25.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f957cff9640 1 -- 172.21.15.60:0/2198071712 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588020060 con 0x56128e9a3b40 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f957cff9640 1 -- 172.21.15.60:0/2198071712 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f9588013250 con 0x56128e9a3b40 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 1 -- 172.21.15.60:0/2198071712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f958c005520 con 0x56128e9a3b40 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f957cff9640 1 -- 172.21.15.60:0/2198071712 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f9588012450 con 0x56128e9a3b40 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 10 client.17577 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 1 -- 172.21.15.60:0/2198071712 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56128e9bbb00 con 0x56128e9a3b40 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f957cff9640 1 -- 172.21.15.60:0/2198071712 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f958c005520 con 0x56128e9a3b40 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f957cff9640 1 -- 172.21.15.60:0/2198071712 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f958801a030 con 0x56128e9a3b40 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 10 client.17577 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 20 client.17577 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56128e9bd010 0x56128e9bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 4 client.17577 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:25.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.151+0000 7f95a1cdd740 1 -- 172.21.15.60:0/2198071712 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56128e915860 con 0x56128e9bd010 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.152+0000 7f959ce9f640 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56128e9bd010 0x56128e9bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.152+0000 7f959ce9f640 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56128e9bd010 0x56128e9bf430 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5942297aa883d53 server_cookie=4b13b7dbcac9cb8e in_seq=0 out_seq=0 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.152+0000 7f957cff9640 10 client.17577 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f957cff9640 1 -- 172.21.15.60:0/2198071712 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56128e915860 con 0x56128e9bd010 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f957cff9640 10 client.17577 handle_command_reply: tid=0 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 client.17577 shutdown 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 -- 172.21.15.60:0/2198071712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 msgr2=0x56128e9a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a9fb0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9588013b40 tx=0x7f95880113e0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 -- 172.21.15.60:0/2198071712 shutdown_connections 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56128e9bd010 0x56128e9bf430 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9a9fb0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f957cff9640 0 client.17577 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/2198071712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 -- 172.21.15.60:0/2198071712 >> 172.21.15.60:0/2198071712 conn(0x56128e96b310 msgr2=0x56128e9a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 -- 172.21.15.60:0/2198071712 shutdown_connections 2024-09-12T00:08:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 1 -- 172.21.15.60:0/2198071712 wait complete. 2024-09-12T00:08:25.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.153+0000 7f95a1cdd740 20 client.17577 trim_cache size 0 max 16384 2024-09-12T00:08:25.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.166+0000 7f95a1cdd740 1 Processor -- start 2024-09-12T00:08:25.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.166+0000 7f95a1cdd740 1 -- start start 2024-09-12T00:08:25.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.166+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a25d0 0x56128e9b9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.166+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a3b40 0x56128e9a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.166+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9a5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.166+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95981ad820 con 0x56128e9a25d0 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.166+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95981af360 con 0x56128e9a3b40 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.166+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95981adef0 con 0x56128e9ad370 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a25d0 0x56128e9b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a25d0 0x56128e9b9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46832/0 (socket says 172.21.15.60:46832) 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 -- 172.21.15.60:0/1084497064 learned_addr learned my addr 172.21.15.60:0/1084497064 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959d6a0640 1 --2- 172.21.15.60:0/1084497064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a3b40 0x56128e9a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 -- 172.21.15.60:0/1084497064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 msgr2=0x56128e9a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 --2- 172.21.15.60:0/1084497064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 -- 172.21.15.60:0/1084497064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a3b40 msgr2=0x56128e9a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 --2- 172.21.15.60:0/1084497064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a3b40 0x56128e9a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 -- 172.21.15.60:0/1084497064 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128e99f960 con 0x56128e9a25d0 2024-09-12T00:08:25.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f959ce9f640 1 --2- 172.21.15.60:0/1084497064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a25d0 0x56128e9b9310 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f958c004f00 tx=0x7f958c004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfaba4c4dd0b7a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f957effd640 1 -- 172.21.15.60:0/1084497064 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c018040 con 0x56128e9a25d0 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f957effd640 1 -- 172.21.15.60:0/1084497064 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f958c031070 con 0x56128e9a25d0 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.167+0000 7f957effd640 1 -- 172.21.15.60:0/1084497064 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c004750 con 0x56128e9a25d0 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1084497064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a25d0 msgr2=0x56128e9b9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1084497064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a25d0 0x56128e9b9310 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f958c004f00 tx=0x7f958c004e90 comp rx=0 tx=0).stop 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1084497064 shutdown_connections 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1084497064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1084497064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a3b40 0x56128e9a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1084497064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a25d0 0x56128e9b9310 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1084497064 >> 172.21.15.60:0/1084497064 conn(0x56128e96b310 msgr2=0x56128e9ac030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1084497064 shutdown_connections 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1084497064 wait complete. 2024-09-12T00:08:25.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.168+0000 7f95a1cdd740 1 -- start start 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f95a1cdd740 1 Processor -- start 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f95a1cdd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95981aec90 con 0x56128e9a3b40 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95981ae5c0 con 0x56128e9a25d0 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f95a1cdd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95981ab820 con 0x56128e9ad370 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f95a1cdd740 10 client.0 _ll_register_callbacks cb 0x7f9588009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959d6a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959d6a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46838/0 (socket says 172.21.15.60:46838) 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959d6a0640 1 -- 172.21.15.60:0/1519736061 learned_addr learned my addr 172.21.15.60:0/1519736061 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959ce9f640 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959ce9f640 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959d6a0640 1 -- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 msgr2=0x56128e9b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959d6a0640 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959d6a0640 1 -- 172.21.15.60:0/1519736061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 msgr2=0x56128e9b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959d6a0640 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959d6a0640 1 -- 172.21.15.60:0/1519736061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56128e9b1660 con 0x56128e9a3b40 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.169+0000 7f959ce9f640 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f959d6a0640 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9b0be0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f9588013b10 tx=0x7f9588013210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2328126c2b033e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f957cff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f957cff9640 1 -- 172.21.15.60:0/1519736061 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588033060 con 0x56128e9a3b40 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f957cff9640 1 -- 172.21.15.60:0/1519736061 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f9588004a00 con 0x56128e9a3b40 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1519736061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f958c031070 con 0x56128e9a3b40 2024-09-12T00:08:25.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f957cff9640 1 -- 172.21.15.60:0/1519736061 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f95880118e0 con 0x56128e9a3b40 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f95a1cdd740 10 client.17583 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1519736061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56128ea279d0 con 0x56128e9a3b40 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f957cff9640 1 -- 172.21.15.60:0/1519736061 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f958c031070 con 0x56128e9a3b40 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f957cff9640 1 -- 172.21.15.60:0/1519736061 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f958801a040 con 0x56128e9a3b40 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f95a1cdd740 10 client.17583 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.170+0000 7f95a1cdd740 10 client.17583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.171+0000 7f95a1cdd740 20 client.17583 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.171+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56128ea28180 0x56128ea2a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.171+0000 7f95a1cdd740 4 client.17583 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.171+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1519736061 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56128e90fd70 con 0x56128ea28180 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.171+0000 7f959ce9f640 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56128ea28180 0x56128ea2a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.171+0000 7f957cff9640 10 client.17583 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:25.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.171+0000 7f959ce9f640 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56128ea28180 0x56128ea2a5a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c03f82791222f7aa server_cookie=67d7d7d477d7d3b0 in_seq=0 out_seq=0 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f957cff9640 1 -- 172.21.15.60:0/1519736061 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56128e90fd70 con 0x56128ea28180 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f957cff9640 10 client.17583 handle_command_reply: tid=0 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 client.17583 shutdown 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1519736061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 msgr2=0x56128e9b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9b0be0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f9588013b10 tx=0x7f9588013210 comp rx=0 tx=0).stop 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1519736061 shutdown_connections 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x56128ea28180 0x56128ea2a5a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56128e9ad370 0x56128e9b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56128e9a3b40 0x56128e9b0be0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 --2- 172.21.15.60:0/1519736061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56128e9a25d0 0x56128e9b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1519736061 >> 172.21.15.60:0/1519736061 conn(0x56128e96b310 msgr2=0x56128e9a9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f957cff9640 0 client.17583 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:25.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1519736061 shutdown_connections 2024-09-12T00:08:25.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 1 -- 172.21.15.60:0/1519736061 wait complete. 2024-09-12T00:08:25.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.172+0000 7f95a1cdd740 20 client.17583 trim_cache size 0 max 16384 2024-09-12T00:08:25.178 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:25.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 -- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95800a2cf0 msgr2=0x7f95800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95800a2cf0 0x7f95800a51b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f95900ed420 tx=0x7f95900b15d0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 -- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 msgr2=0x7f959819cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 0x7f959819cd80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f9590009230 tx=0x7f9590004270 comp rx=0 tx=0).stop 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 -- 172.21.15.60:0/3090129707 shutdown_connections 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f95800a2cf0 0x7f95800a51b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9598106f10 0x7f959819cd80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598102790 0x7f95981989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 --2- 172.21.15.60:0/3090129707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9598101de0 0x7f95981984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 -- 172.21.15.60:0/3090129707 >> 172.21.15.60:0/3090129707 conn(0x7f95980fd8c0 msgr2=0x7f95980feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 -- 172.21.15.60:0/3090129707 shutdown_connections 2024-09-12T00:08:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:25.173+0000 7f959f904640 1 -- 172.21.15.60:0/3090129707 wait complete. 2024-09-12T00:08:25.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:25 smithi060 ceph-mon[30953]: pgmap v280: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:08:25.478 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:25 smithi105 ceph-mon[34805]: pgmap v280: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:08:25.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:25 smithi192 ceph-mon[35487]: pgmap v280: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:08:26.946 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:08:26.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:08:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:27.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:27 smithi060 ceph-mon[30953]: pgmap v281: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:08:27.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:27 smithi105 ceph-mon[34805]: pgmap v281: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:08:27.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:27 smithi192 ceph-mon[35487]: pgmap v281: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:08:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.732+0000 7f62e14a5640 1 -- 172.21.15.60:0/254763448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc102570 msgr2=0x7f62dc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.732+0000 7f62e14a5640 1 --2- 172.21.15.60:0/254763448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc102570 0x7f62dc1029b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009900 tx=0x7f62d002a480 comp rx=0 tx=0).stop 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.733+0000 7f62e14a5640 1 -- 172.21.15.60:0/254763448 shutdown_connections 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.733+0000 7f62e14a5640 1 --2- 172.21.15.60:0/254763448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc102ef0 0x7f62dc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.733+0000 7f62e14a5640 1 --2- 172.21.15.60:0/254763448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc102570 0x7f62dc1029b0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.733+0000 7f62e14a5640 1 --2- 172.21.15.60:0/254763448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62dc100e20 0x7f62dc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.733+0000 7f62e14a5640 1 -- 172.21.15.60:0/254763448 >> 172.21.15.60:0/254763448 conn(0x7f62dc0fc7d0 msgr2=0x7f62dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.733+0000 7f62e14a5640 1 -- 172.21.15.60:0/254763448 shutdown_connections 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.733+0000 7f62e14a5640 1 -- 172.21.15.60:0/254763448 wait complete. 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.733+0000 7f62e14a5640 1 Processor -- start 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62e14a5640 1 -- start start 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62e14a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc100e20 0x7f62dc1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62e14a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc102570 0x7f62dc197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62e14a5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62dc102ef0 0x7f62dc19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62e14a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc1110a0 con 0x7f62dc100e20 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62e14a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc110f20 con 0x7f62dc102570 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62e14a5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc111220 con 0x7f62dc102ef0 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc100e20 0x7f62dc1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc100e20 0x7f62dc1974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46856/0 (socket says 172.21.15.60:46856) 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62daffd640 1 -- 172.21.15.60:0/830407029 learned_addr learned my addr 172.21.15.60:0/830407029 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62da7fc640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc102570 0x7f62dc197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62db7fe640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62dc102ef0 0x7f62dc19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62daffd640 1 -- 172.21.15.60:0/830407029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62dc102ef0 msgr2=0x7f62dc19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62daffd640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62dc102ef0 0x7f62dc19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62daffd640 1 -- 172.21.15.60:0/830407029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc102570 msgr2=0x7f62dc197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62daffd640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc102570 0x7f62dc197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62daffd640 1 -- 172.21.15.60:0/830407029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62dc19c470 con 0x7f62dc100e20 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.734+0000 7f62da7fc640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc102570 0x7f62dc197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.735+0000 7f62daffd640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc100e20 0x7f62dc1974c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00af30 tx=0x7f62cc00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.735+0000 7f62c3fff640 1 -- 172.21.15.60:0/830407029 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc007bb0 con 0x7f62dc100e20 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.735+0000 7f62e14a5640 1 -- 172.21.15.60:0/830407029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62dc19c760 con 0x7f62dc100e20 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.735+0000 7f62c3fff640 1 -- 172.21.15.60:0/830407029 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62cc007d50 con 0x7f62dc100e20 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.735+0000 7f62c3fff640 1 -- 172.21.15.60:0/830407029 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00f550 con 0x7f62dc100e20 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.735+0000 7f62e14a5640 1 -- 172.21.15.60:0/830407029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62dc069f70 con 0x7f62dc100e20 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62c3fff640 1 -- 172.21.15.60:0/830407029 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f62cc005020 con 0x7f62dc100e20 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62e387e740 1 Processor -- start 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62e387e740 1 -- start start 2024-09-12T00:08:27.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62e387e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62e387e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60ccd6c0 0x558a60cc76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62e387e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cc7d60 0x558a60cc81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62e387e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558a60c23280 con 0x558a60ccd6c0 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62e387e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a60bcab10 con 0x558a60cccda0 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.738+0000 7f62e387e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a60c1f240 con 0x558a60cc7d60 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62db7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60ccd6c0 0x558a60cc76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62db7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:41718/0 (socket says 172.21.15.60:41718) 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62da7fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cc7d60 0x558a60cc81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62db7fe640 1 -- 172.21.15.60:0/2451819155 learned_addr learned my addr 172.21.15.60:0/2451819155 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62c3fff640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f62c40a2cf0 0x7f62c40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62db7fe640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f62c40a2cf0 0x7f62c40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62c3fff640 1 -- 172.21.15.60:0/830407029 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f62cc0d0f90 con 0x7f62dc100e20 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62da7fc640 1 -- 172.21.15.60:0/2451819155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 msgr2=0x558a60ccd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62da7fc640 1 --2- 172.21.15.60:0/2451819155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62da7fc640 1 -- 172.21.15.60:0/2451819155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60ccd6c0 msgr2=0x558a60cc76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62da7fc640 1 --2- 172.21.15.60:0/2451819155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60ccd6c0 0x558a60cc76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62da7fc640 1 -- 172.21.15.60:0/2451819155 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a60bd71f0 con 0x558a60cc7d60 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62da7fc640 1 --2- 172.21.15.60:0/2451819155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cc7d60 0x558a60cc81e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009230 tx=0x7f62d0032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de1c4dacaffaaab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.739+0000 7f62db7fe640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f62c40a2cf0 0x7f62c40a51b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005c40 tx=0x7f62d4004ab0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62c17fa640 1 -- 172.21.15.60:0/2451819155 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d003f070 con 0x558a60cc7d60 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62c17fa640 1 -- 172.21.15.60:0/2451819155 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62d00317e0 con 0x558a60cc7d60 2024-09-12T00:08:27.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62c17fa640 1 -- 172.21.15.60:0/2451819155 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0035070 con 0x558a60cc7d60 2024-09-12T00:08:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 -- 172.21.15.60:0/2451819155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cc7d60 msgr2=0x558a60cc81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 --2- 172.21.15.60:0/2451819155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cc7d60 0x558a60cc81e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009230 tx=0x7f62d0032d50 comp rx=0 tx=0).stop 2024-09-12T00:08:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 -- 172.21.15.60:0/2451819155 shutdown_connections 2024-09-12T00:08:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 --2- 172.21.15.60:0/2451819155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cc7d60 0x558a60cc81e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 --2- 172.21.15.60:0/2451819155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60ccd6c0 0x558a60cc76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 --2- 172.21.15.60:0/2451819155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 -- 172.21.15.60:0/2451819155 >> 172.21.15.60:0/2451819155 conn(0x558a60cb9ba0 msgr2=0x558a60cb9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 -- 172.21.15.60:0/2451819155 shutdown_connections 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.740+0000 7f62e387e740 1 -- 172.21.15.60:0/2451819155 wait complete. 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 1 -- start start 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 1 Processor -- start 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cd0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60cd1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60cd1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x558a60cd4080 con 0x558a60cc7d60 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a60bddf10 con 0x558a60cccda0 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a60cd4200 con 0x558a60ccd6c0 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62e387e740 10 client.0 _ll_register_callbacks cb 0x558a60ba6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:27.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cd0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cd0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46876/0 (socket says 172.21.15.60:46876) 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62da7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60cd1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62daffd640 1 -- 172.21.15.60:0/1670859641 learned_addr learned my addr 172.21.15.60:0/1670859641 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.741+0000 7f62db7fe640 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60cd1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62da7fc640 1 -- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 msgr2=0x558a60cd1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62da7fc640 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60cd1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62da7fc640 1 -- 172.21.15.60:0/1670859641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 msgr2=0x558a60cd0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62da7fc640 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cd0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62da7fc640 1 -- 172.21.15.60:0/1670859641 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a609946a0 con 0x558a60cccda0 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62daffd640 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cd0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62db7fe640 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60cd1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62da7fc640 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60cd1130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009900 tx=0x7f62d0031460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d138fbeb23657a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:27.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62beff5640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62beff5640 1 -- 172.21.15.60:0/1670859641 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d004a020 con 0x558a60cccda0 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62e387e740 1 -- 172.21.15.60:0/1670859641 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62d00317e0 con 0x558a60cccda0 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62beff5640 1 -- 172.21.15.60:0/1670859641 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f62d00035f0 con 0x558a60cccda0 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62beff5640 1 -- 172.21.15.60:0/1670859641 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f62d0055050 con 0x558a60cccda0 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62e387e740 10 client.26912 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.742+0000 7f62e387e740 1 -- 172.21.15.60:0/1670859641 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558a60cdfd80 con 0x558a60cccda0 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62beff5640 1 -- 172.21.15.60:0/1670859641 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62d00317e0 con 0x558a60cccda0 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62beff5640 1 -- 172.21.15.60:0/1670859641 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f62d003ba30 con 0x558a60cccda0 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62e387e740 10 client.26912 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62e387e740 10 client.26912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62e387e740 20 client.26912 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62e387e740 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a60ce10d0 0x558a60ce34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62e387e740 4 client.26912 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62e387e740 1 -- 172.21.15.60:0/1670859641 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a60c307f0 con 0x558a60ce10d0 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.743+0000 7f62daffd640 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a60ce10d0 0x558a60ce34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.744+0000 7f62daffd640 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a60ce10d0 0x558a60ce34c0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=542db118b6d6592c server_cookie=44224def3fcd2092 in_seq=0 out_seq=0 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.744+0000 7f62beff5640 10 client.26912 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.744+0000 7f62beff5640 1 -- 172.21.15.60:0/1670859641 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a60c307f0 con 0x558a60ce10d0 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.744+0000 7f62beff5640 10 client.26912 handle_command_reply: tid=0 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.744+0000 7f62e387e740 1 client.26912 shutdown 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 -- 172.21.15.60:0/1670859641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 msgr2=0x558a60cd1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60cd1130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009900 tx=0x7f62d0031460 comp rx=0 tx=0).stop 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 -- 172.21.15.60:0/1670859641 shutdown_connections 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a60ce10d0 0x558a60ce34c0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60cd1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60cd1130 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62beff5640 0 client.26912 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 --2- 172.21.15.60:0/1670859641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cd0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 -- 172.21.15.60:0/1670859641 >> 172.21.15.60:0/1670859641 conn(0x558a60cb9ba0 msgr2=0x558a60cb9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 -- 172.21.15.60:0/1670859641 shutdown_connections 2024-09-12T00:08:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 1 -- 172.21.15.60:0/1670859641 wait complete. 2024-09-12T00:08:27.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.745+0000 7f62e387e740 20 client.26912 trim_cache size 0 max 16384 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62e387e740 1 Processor -- start 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62e387e740 1 -- start start 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62e387e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cc76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62e387e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62e387e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60ccf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62e387e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc1ab660 con 0x558a60cc7d60 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62e387e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc1ad1a0 con 0x558a60cccda0 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62e387e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc1abd30 con 0x558a60ccd6c0 2024-09-12T00:08:27.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cc76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cc76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46880/0 (socket says 172.21.15.60:46880) 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.762+0000 7f62daffd640 1 -- 172.21.15.60:0/2391580783 learned_addr learned my addr 172.21.15.60:0/2391580783 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62da7fc640 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62daffd640 1 -- 172.21.15.60:0/2391580783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 msgr2=0x558a60ccf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62db7fe640 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60ccf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62daffd640 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60ccf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62daffd640 1 -- 172.21.15.60:0/2391580783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 msgr2=0x558a60ccf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62daffd640 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62daffd640 1 -- 172.21.15.60:0/2391580783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a60ce3830 con 0x558a60cc7d60 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62daffd640 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cc76f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f62cc088150 tx=0x7f62cc00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d993dbd50e3efa3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62c0ff9640 1 -- 172.21.15.60:0/2391580783 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc0cfe60 con 0x558a60cc7d60 2024-09-12T00:08:27.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62c0ff9640 1 -- 172.21.15.60:0/2391580783 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62cc09dce0 con 0x558a60cc7d60 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.763+0000 7f62c0ff9640 1 -- 172.21.15.60:0/2391580783 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc004790 con 0x558a60cc7d60 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- 172.21.15.60:0/2391580783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 msgr2=0x558a60cc76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cc76f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f62cc088150 tx=0x7f62cc00f040 comp rx=0 tx=0).stop 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- 172.21.15.60:0/2391580783 shutdown_connections 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60ccd6c0 0x558a60ccf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60cccda0 0x558a60ccf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 --2- 172.21.15.60:0/2391580783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60cc76f0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- 172.21.15.60:0/2391580783 >> 172.21.15.60:0/2391580783 conn(0x558a60cb9ba0 msgr2=0x558a60cb9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- 172.21.15.60:0/2391580783 shutdown_connections 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- 172.21.15.60:0/2391580783 wait complete. 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- start start 2024-09-12T00:08:27.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 Processor -- start 2024-09-12T00:08:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60ce8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cccda0 0x558a60ce8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60ccd6c0 0x558a60ce9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc1acad0 con 0x558a60cc7d60 2024-09-12T00:08:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc1ac400 con 0x558a60ccd6c0 2024-09-12T00:08:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f62dc1a9660 con 0x558a60cccda0 2024-09-12T00:08:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62e387e740 10 client.0 _ll_register_callbacks cb 0x7f62cc0996b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:27.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.764+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60ce8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60ce8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46884/0 (socket says 172.21.15.60:46884) 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62daffd640 1 -- 172.21.15.60:0/166584388 learned_addr learned my addr 172.21.15.60:0/166584388 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62da7fc640 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cccda0 0x558a60ce8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62db7fe640 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60ccd6c0 0x558a60ce9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62daffd640 1 -- 172.21.15.60:0/166584388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cccda0 msgr2=0x558a60ce8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62daffd640 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cccda0 0x558a60ce8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62daffd640 1 -- 172.21.15.60:0/166584388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60ccd6c0 msgr2=0x558a60ce9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62daffd640 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60ccd6c0 0x558a60ce9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62daffd640 1 -- 172.21.15.60:0/166584388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a60d4aae0 con 0x558a60cc7d60 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62db7fe640 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60ccd6c0 0x558a60ce9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62daffd640 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60ce8710 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0a5d20 tx=0x7f62cc0a1990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937b6535467804ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:27.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62beff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62beff5640 1 -- 172.21.15.60:0/166584388 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc09d5e0 con 0x558a60cc7d60 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62beff5640 1 -- 172.21.15.60:0/166584388 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f62cc099c50 con 0x558a60cc7d60 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62e387e740 1 -- 172.21.15.60:0/166584388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62cc09dce0 con 0x558a60cc7d60 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62beff5640 1 -- 172.21.15.60:0/166584388 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f62cc099330 con 0x558a60cc7d60 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62e387e740 10 client.17601 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.765+0000 7f62e387e740 1 -- 172.21.15.60:0/166584388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558a60d4be00 con 0x558a60cc7d60 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62beff5640 1 -- 172.21.15.60:0/166584388 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62cc09dce0 con 0x558a60cc7d60 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62beff5640 1 -- 172.21.15.60:0/166584388 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f62cc0a5dc0 con 0x558a60cc7d60 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62e387e740 10 client.17601 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62e387e740 10 client.17601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62e387e740 20 client.17601 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62e387e740 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a60d4c520 0x558a60d4e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:27.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62e387e740 4 client.17601 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62e387e740 1 -- 172.21.15.60:0/166584388 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558a60c2ad00 con 0x558a60d4c520 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.766+0000 7f62da7fc640 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a60d4c520 0x558a60d4e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.767+0000 7f62da7fc640 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a60d4c520 0x558a60d4e940 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=907edee030bb6c82 server_cookie=d8347cc45b080c90 in_seq=0 out_seq=0 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.767+0000 7f62beff5640 10 client.17601 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62beff5640 1 -- 172.21.15.60:0/166584388 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558a60c2ad00 con 0x558a60d4c520 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62beff5640 10 client.17601 handle_command_reply: tid=0 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 client.17601 shutdown 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 -- 172.21.15.60:0/166584388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 msgr2=0x558a60ce8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60ce8710 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0a5d20 tx=0x7f62cc0a1990 comp rx=0 tx=0).stop 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 -- 172.21.15.60:0/166584388 shutdown_connections 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x558a60d4c520 0x558a60d4e940 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a60ccd6c0 0x558a60ce9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a60cccda0 0x558a60ce8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62beff5640 0 client.17601 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 --2- 172.21.15.60:0/166584388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x558a60cc7d60 0x558a60ce8710 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 -- 172.21.15.60:0/166584388 >> 172.21.15.60:0/166584388 conn(0x558a60cb9ba0 msgr2=0x558a60ccf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 -- 172.21.15.60:0/166584388 shutdown_connections 2024-09-12T00:08:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 1 -- 172.21.15.60:0/166584388 wait complete. 2024-09-12T00:08:27.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.768+0000 7f62e387e740 20 client.17601 trim_cache size 0 max 16384 2024-09-12T00:08:27.773 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:08:27.774 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:08:27.774 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "738dadfa-1104-4462-a566-6021dd26ec2c", 2024-09-12T00:08:27.774 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:08:27.774 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:08:27.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 -- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f62c40a2cf0 msgr2=0x7f62c40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f62c40a2cf0 0x7f62c40a51b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005c40 tx=0x7f62d4004ab0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 -- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc100e20 msgr2=0x7f62dc1974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc100e20 0x7f62dc1974c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00af30 tx=0x7f62cc00cdd0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 -- 172.21.15.60:0/830407029 shutdown_connections 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f62c40a2cf0 0x7f62c40a51b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62dc102ef0 0x7f62dc19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62dc102570 0x7f62dc197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 --2- 172.21.15.60:0/830407029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62dc100e20 0x7f62dc1974c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 -- 172.21.15.60:0/830407029 >> 172.21.15.60:0/830407029 conn(0x7f62dc0fc7d0 msgr2=0x7f62dc105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 -- 172.21.15.60:0/830407029 shutdown_connections 2024-09-12T00:08:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:27.769+0000 7f62e14a5640 1 -- 172.21.15.60:0/830407029 wait complete. 2024-09-12T00:08:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:28 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:08:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:28 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:28 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:08:28.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:28 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:28.518 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:28 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:08:28.518 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:28 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:28.519 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:28 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:08:28.519 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:28 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:28.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:28 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:08:28.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:28 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:28.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:28 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:08:28.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:28 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:28.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:08:28.805 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:29.321 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:29 smithi060 ceph-mon[30953]: pgmap v282: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T00:08:29.321 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:29 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 -- 172.21.15.60:0/1358767757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714102790 msgr2=0x7f47141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 --2- 172.21.15.60:0/1358767757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714102790 0x7f47141067e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f4700009900 tx=0x7f470002a410 comp rx=0 tx=0).stop 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 -- 172.21.15.60:0/1358767757 shutdown_connections 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 --2- 172.21.15.60:0/1358767757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714106f10 0x7f471410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 --2- 172.21.15.60:0/1358767757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714102790 0x7f47141067e0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 --2- 172.21.15.60:0/1358767757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714101de0 0x7f47141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 -- 172.21.15.60:0/1358767757 >> 172.21.15.60:0/1358767757 conn(0x7f47140fd8c0 msgr2=0x7f47140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 -- 172.21.15.60:0/1358767757 shutdown_connections 2024-09-12T00:08:29.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.316+0000 7f471afa9640 1 -- 172.21.15.60:0/1358767757 wait complete. 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f471afa9640 1 Processor -- start 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f471afa9640 1 -- start start 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f471afa9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714101de0 0x7f47141985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f471afa9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102790 0x7f4714198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f471afa9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714106f10 0x7f471419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f471afa9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47141120d0 con 0x7f4714101de0 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f471afa9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4714111f50 con 0x7f4714102790 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f471afa9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4714112250 con 0x7f4714106f10 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4718d45640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714101de0 0x7f47141985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4718d45640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714101de0 0x7f47141985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46904/0 (socket says 172.21.15.60:46904) 2024-09-12T00:08:29.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4718d45640 1 -- 172.21.15.60:0/2658011614 learned_addr learned my addr 172.21.15.60:0/2658011614 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:29.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4713fff640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102790 0x7f4714198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4719546640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714106f10 0x7f471419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4718d45640 1 -- 172.21.15.60:0/2658011614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714106f10 msgr2=0x7f471419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4718d45640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714106f10 0x7f471419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4718d45640 1 -- 172.21.15.60:0/2658011614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102790 msgr2=0x7f4714198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4718d45640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102790 0x7f4714198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4718d45640 1 -- 172.21.15.60:0/2658011614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471419d580 con 0x7f4714101de0 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4719546640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714106f10 0x7f471419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.317+0000 7f4713fff640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102790 0x7f4714198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.318+0000 7f4718d45640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714101de0 0x7f47141985d0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f470800d950 tx=0x7f470800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.318+0000 7f4711ffb640 1 -- 172.21.15.60:0/2658011614 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708017070 con 0x7f4714101de0 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.318+0000 7f4711ffb640 1 -- 172.21.15.60:0/2658011614 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4708009c30 con 0x7f4714101de0 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.318+0000 7f471afa9640 1 -- 172.21.15.60:0/2658011614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471419d870 con 0x7f4714101de0 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.318+0000 7f4711ffb640 1 -- 172.21.15.60:0/2658011614 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470800f740 con 0x7f4714101de0 2024-09-12T00:08:29.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.318+0000 7f471afa9640 1 -- 172.21.15.60:0/2658011614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a5150 con 0x7f4714101de0 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.320+0000 7f4711ffb640 1 -- 172.21.15.60:0/2658011614 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4708010a80 con 0x7f4714101de0 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f471d382740 1 Processor -- start 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f471d382740 1 -- start start 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f471d382740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631360 0x563df2631740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f4711ffb640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47040a2cf0 0x7f47040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f471d382740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df2640550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f471d382740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2640a90 0x563df2642e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f471d382740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563df25972e0 con 0x563df2631c80 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f471d382740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563df253ece0 con 0x563df2640a90 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f471d382740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563df25932a0 con 0x563df2631360 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f4718d45640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47040a2cf0 0x7f47040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f4713fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df2640550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f4711ffb640 1 -- 172.21.15.60:0/2658011614 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f47080cf190 con 0x7f4714101de0 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f4719546640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2640a90 0x563df2642e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f4713fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df2640550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46912/0 (socket says 172.21.15.60:46912) 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f4713fff640 1 -- 172.21.15.60:0/1962817813 learned_addr learned my addr 172.21.15.60:0/1962817813 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.321+0000 7f4719546640 1 --2- 172.21.15.60:0/1962817813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631360 0x563df2631740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f4713fff640 1 -- 172.21.15.60:0/1962817813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631360 msgr2=0x563df2631740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f4713fff640 1 --2- 172.21.15.60:0/1962817813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631360 0x563df2631740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f4713fff640 1 -- 172.21.15.60:0/1962817813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2640a90 msgr2=0x563df2642e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f4713fff640 1 --2- 172.21.15.60:0/1962817813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2640a90 0x563df2642e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f4713fff640 1 -- 172.21.15.60:0/1962817813 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563df2523440 con 0x563df2631c80 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f4718d45640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47040a2cf0 0x7f47040a51b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4708097ad0 tx=0x7f4708086040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f4713fff640 1 --2- 172.21.15.60:0/1962817813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df2640550 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f4700009900 tx=0x7f4700032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19f123abe523971 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:29.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f46feffd640 1 -- 172.21.15.60:0/1962817813 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470003f070 con 0x563df2631c80 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f46feffd640 1 -- 172.21.15.60:0/1962817813 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4700031840 con 0x563df2631c80 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.322+0000 7f46feffd640 1 -- 172.21.15.60:0/1962817813 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4700035070 con 0x563df2631c80 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 -- 172.21.15.60:0/1962817813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 msgr2=0x563df2640550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 --2- 172.21.15.60:0/1962817813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df2640550 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f4700009900 tx=0x7f4700032d30 comp rx=0 tx=0).stop 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 -- 172.21.15.60:0/1962817813 shutdown_connections 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 --2- 172.21.15.60:0/1962817813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2640a90 0x563df2642e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 --2- 172.21.15.60:0/1962817813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df2640550 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 --2- 172.21.15.60:0/1962817813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631360 0x563df2631740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 -- 172.21.15.60:0/1962817813 >> 172.21.15.60:0/1962817813 conn(0x563df262da30 msgr2=0x563df262de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 -- 172.21.15.60:0/1962817813 shutdown_connections 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 -- 172.21.15.60:0/1962817813 wait complete. 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.323+0000 7f471d382740 1 -- start start 2024-09-12T00:08:29.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f471d382740 1 Processor -- start 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f471d382740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df2640410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f471d382740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df263d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f471d382740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2640a90 0x563df263dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f471d382740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563df2643600 con 0x563df2631c80 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f471d382740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563df2552050 con 0x563df2631360 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f471d382740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563df2643780 con 0x563df2640a90 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f471d382740 10 client.0 _ll_register_callbacks cb 0x563df2592160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4713fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df263d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4713fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df263d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46926/0 (socket says 172.21.15.60:46926) 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4713fff640 1 -- 172.21.15.60:0/3726312579 learned_addr learned my addr 172.21.15.60:0/3726312579 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4719546640 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df2640410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4713fff640 1 -- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2640a90 msgr2=0x563df263dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:29.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4719546640 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2640a90 0x563df263dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4713fff640 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2640a90 0x563df263dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4713fff640 1 -- 172.21.15.60:0/3726312579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 msgr2=0x563df2640410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.324+0000 7f4713fff640 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df2640410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f4713fff640 1 -- 172.21.15.60:0/3726312579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563df23083c0 con 0x563df2631c80 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f4719546640 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2640a90 0x563df263dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f4713fff640 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df263d6c0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f470002a930 tx=0x7f4700005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322e364227202bd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f46f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f46f3fff640 1 -- 172.21.15.60:0/3726312579 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470003f070 con 0x563df2631c80 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f46f3fff640 1 -- 172.21.15.60:0/3726312579 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f4700004240 con 0x563df2631c80 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f471d382740 1 -- 172.21.15.60:0/3726312579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4700031840 con 0x563df2631c80 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f46f3fff640 1 -- 172.21.15.60:0/3726312579 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f4700054050 con 0x563df2631c80 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f471d382740 10 client.17613 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:29.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f471d382740 1 -- 172.21.15.60:0/3726312579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563df264f030 con 0x563df2631c80 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.325+0000 7f46f3fff640 1 -- 172.21.15.60:0/3726312579 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4700031840 con 0x563df2631c80 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f46f3fff640 1 -- 172.21.15.60:0/3726312579 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f4700003820 con 0x563df2631c80 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f471d382740 10 client.17613 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f471d382740 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f471d382740 20 client.17613 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f471d382740 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563df2650380 0x563df2652770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f471d382740 4 client.17613 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f471d382740 1 -- 172.21.15.60:0/3726312579 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563df25a4850 con 0x563df2650380 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f4719546640 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563df2650380 0x563df2652770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f4719546640 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563df2650380 0x563df2652770 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0652baea29fb81 server_cookie=efbd455e2738ef38 in_seq=0 out_seq=0 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.326+0000 7f46f3fff640 10 client.17613 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f46f3fff640 1 -- 172.21.15.60:0/3726312579 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563df25a4850 con 0x563df2650380 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f46f3fff640 10 client.17613 handle_command_reply: tid=0 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 client.17613 shutdown 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 -- 172.21.15.60:0/3726312579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 msgr2=0x563df263d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df263d6c0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f470002a930 tx=0x7f4700005390 comp rx=0 tx=0).stop 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 -- 172.21.15.60:0/3726312579 shutdown_connections 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563df2650380 0x563df2652770 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2640a90 0x563df263dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f46f3fff640 0 client.17613 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2631c80 0x563df263d6c0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 --2- 172.21.15.60:0/3726312579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df2640410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.327+0000 7f471d382740 1 -- 172.21.15.60:0/3726312579 >> 172.21.15.60:0/3726312579 conn(0x563df262da30 msgr2=0x563df2633790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.328+0000 7f471d382740 1 -- 172.21.15.60:0/3726312579 shutdown_connections 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.328+0000 7f471d382740 1 -- 172.21.15.60:0/3726312579 wait complete. 2024-09-12T00:08:29.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.328+0000 7f471d382740 20 client.17613 trim_cache size 0 max 16384 2024-09-12T00:08:29.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f471d382740 1 Processor -- start 2024-09-12T00:08:29.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f471d382740 1 -- start start 2024-09-12T00:08:29.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f471d382740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df264c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f471d382740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 0x563df263f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f471d382740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df2657d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f471d382740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ab600 con 0x563df2640a90 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f471d382740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ad140 con 0x563df2631360 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f471d382740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47141abcd0 con 0x563df2631c80 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f4719546640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df2657d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f4719546640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df2657d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46936/0 (socket says 172.21.15.60:46936) 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.345+0000 7f4719546640 1 -- 172.21.15.60:0/3409955452 learned_addr learned my addr 172.21.15.60:0/3409955452 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f4719546640 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df264c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f4713fff640 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 0x563df263f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f4719546640 1 -- 172.21.15.60:0/3409955452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 msgr2=0x563df263f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f4719546640 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 0x563df263f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f4719546640 1 -- 172.21.15.60:0/3409955452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 msgr2=0x563df264c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f4719546640 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df264c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f4719546640 1 -- 172.21.15.60:0/3409955452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563df262e6c0 con 0x563df2640a90 2024-09-12T00:08:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f4719546640 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df2657d70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f470c000f80 tx=0x7f470c017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0012bdc59caf2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f46fe7fc640 1 -- 172.21.15.60:0/3409955452 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c011400 con 0x563df2640a90 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f46fe7fc640 1 -- 172.21.15.60:0/3409955452 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f470c011aa0 con 0x563df2640a90 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.346+0000 7f46fe7fc640 1 -- 172.21.15.60:0/3409955452 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c01e930 con 0x563df2640a90 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 -- 172.21.15.60:0/3409955452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 msgr2=0x563df2657d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df2657d70 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f470c000f80 tx=0x7f470c017040 comp rx=0 tx=0).stop 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 -- 172.21.15.60:0/3409955452 shutdown_connections 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df2657d70 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 0x563df263f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 --2- 172.21.15.60:0/3409955452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df264c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 -- 172.21.15.60:0/3409955452 >> 172.21.15.60:0/3409955452 conn(0x563df262da30 msgr2=0x563df263ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 -- 172.21.15.60:0/3409955452 shutdown_connections 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 -- 172.21.15.60:0/3409955452 wait complete. 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 -- start start 2024-09-12T00:08:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.347+0000 7f471d382740 1 Processor -- start 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f471d382740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df2644830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f471d382740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 0x563df2644d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f471d382740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df26452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f471d382740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47141aca70 con 0x563df2640a90 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f471d382740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ac3a0 con 0x563df2631360 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f471d382740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47141a95e0 con 0x563df2631c80 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f471d382740 10 client.0 _ll_register_callbacks cb 0x7f470c00ab90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df26452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df26452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46942/0 (socket says 172.21.15.60:46942) 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 -- 172.21.15.60:0/1385320940 learned_addr learned my addr 172.21.15.60:0/1385320940 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df2644830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4713fff640 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 0x563df2644d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 -- 172.21.15.60:0/1385320940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 msgr2=0x563df2644d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 0x563df2644d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 -- 172.21.15.60:0/1385320940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 msgr2=0x563df2644830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df2644830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.348+0000 7f4719546640 1 -- 172.21.15.60:0/1385320940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563df26b9e10 con 0x563df2640a90 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f4719546640 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df26452b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f470c014ac0 tx=0x7f470c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad50786846ec006 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f46f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f46f3fff640 1 -- 172.21.15.60:0/1385320940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c033060 con 0x563df2640a90 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f46f3fff640 1 -- 172.21.15.60:0/1385320940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f470c011600 con 0x563df2640a90 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f471d382740 1 -- 172.21.15.60:0/1385320940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f470c011aa0 con 0x563df2640a90 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f46f3fff640 1 -- 172.21.15.60:0/1385320940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f470c011e60 con 0x563df2640a90 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f471d382740 10 client.17619 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f471d382740 1 -- 172.21.15.60:0/1385320940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563df26bb100 con 0x563df2640a90 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f46f3fff640 1 -- 172.21.15.60:0/1385320940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f470c011aa0 con 0x563df2640a90 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f46f3fff640 1 -- 172.21.15.60:0/1385320940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f470c010040 con 0x563df2640a90 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f471d382740 10 client.17619 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f471d382740 10 client.17619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f471d382740 20 client.17619 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f471d382740 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563df2650380 0x563df26bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.349+0000 7f471d382740 4 client.17619 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.350+0000 7f471d382740 1 -- 172.21.15.60:0/1385320940 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563df259ed60 con 0x563df2650380 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.350+0000 7f4713fff640 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563df2650380 0x563df26bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.350+0000 7f46f3fff640 10 client.17619 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.350+0000 7f4713fff640 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563df2650380 0x563df26bd760 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2570ad50fb43361e server_cookie=c15523b373e4418a in_seq=0 out_seq=0 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.350+0000 7f46f3fff640 1 -- 172.21.15.60:0/1385320940 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563df259ed60 con 0x563df2650380 2024-09-12T00:08:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.350+0000 7f46f3fff640 10 client.17619 handle_command_reply: tid=0 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.350+0000 7f471d382740 1 client.17619 shutdown 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 -- 172.21.15.60:0/1385320940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 msgr2=0x563df26452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df26452b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f470c014ac0 tx=0x7f470c016040 comp rx=0 tx=0).stop 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 -- 172.21.15.60:0/1385320940 shutdown_connections 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563df2650380 0x563df26bd760 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563df2640a90 0x563df26452b0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563df2631c80 0x563df2644d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 --2- 172.21.15.60:0/1385320940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563df2631360 0x563df2644830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f46f3fff640 0 client.17619 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 -- 172.21.15.60:0/1385320940 >> 172.21.15.60:0/1385320940 conn(0x563df262da30 msgr2=0x563df263f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 -- 172.21.15.60:0/1385320940 shutdown_connections 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 1 -- 172.21.15.60:0/1385320940 wait complete. 2024-09-12T00:08:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.351+0000 7f471d382740 20 client.17619 trim_cache size 0 max 16384 2024-09-12T00:08:29.363 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:08:29.363 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:08:29.363 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:08:29.363 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 -- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47040a2cf0 msgr2=0x7f47040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47040a2cf0 0x7f47040a51b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4708097ad0 tx=0x7f4708086040 comp rx=0 tx=0).stop 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 -- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714101de0 msgr2=0x7f47141985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714101de0 0x7f47141985d0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f470800d950 tx=0x7f470800de10 comp rx=0 tx=0).stop 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 -- 172.21.15.60:0/2658011614 shutdown_connections 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47040a2cf0 0x7f47040a51b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714106f10 0x7f471419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102790 0x7f4714198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 --2- 172.21.15.60:0/2658011614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4714101de0 0x7f47141985d0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 -- 172.21.15.60:0/2658011614 >> 172.21.15.60:0/2658011614 conn(0x7f47140fd8c0 msgr2=0x7f47140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 -- 172.21.15.60:0/2658011614 shutdown_connections 2024-09-12T00:08:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:29.352+0000 7f471afa9640 1 -- 172.21.15.60:0/2658011614 wait complete. 2024-09-12T00:08:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:29 smithi105 ceph-mon[34805]: pgmap v282: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T00:08:29.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:29 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:08:29.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:29 smithi192 ceph-mon[35487]: pgmap v282: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T00:08:29.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:29 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:08:30.157 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:08:30.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:08:30.423 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:30.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 -- 172.21.15.60:0/4095445512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440101de0 msgr2=0x7fe4401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 --2- 172.21.15.60:0/4095445512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440101de0 0x7fe4401021c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009900 tx=0x7fe43c02a410 comp rx=0 tx=0).stop 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 -- 172.21.15.60:0/4095445512 shutdown_connections 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 --2- 172.21.15.60:0/4095445512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe440106f10 0x7fe44010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 --2- 172.21.15.60:0/4095445512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe440102790 0x7fe4401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 --2- 172.21.15.60:0/4095445512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440101de0 0x7fe4401021c0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 -- 172.21.15.60:0/4095445512 >> 172.21.15.60:0/4095445512 conn(0x7fe4400fd8c0 msgr2=0x7fe4400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 -- 172.21.15.60:0/4095445512 shutdown_connections 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.924+0000 7fe44871b640 1 -- 172.21.15.60:0/4095445512 wait complete. 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe44871b640 1 Processor -- start 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe44871b640 1 -- start start 2024-09-12T00:08:30.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe44871b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe440101de0 0x7fe44019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe44871b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe440102790 0x7fe44019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe44871b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440106f10 0x7fe44010dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe44871b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe440112090 con 0x7fe440106f10 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe44871b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe440111f10 con 0x7fe440102790 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe44871b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe440112210 con 0x7fe440101de0 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.925+0000 7fe446cb8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440106f10 0x7fe44010dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe446cb8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440106f10 0x7fe44010dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46968/0 (socket says 172.21.15.60:46968) 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe446cb8640 1 -- 172.21.15.60:0/1201944363 learned_addr learned my addr 172.21.15.60:0/1201944363 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe4464b7640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe440101de0 0x7fe44019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe445cb6640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe440102790 0x7fe44019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe446cb8640 1 -- 172.21.15.60:0/1201944363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe440101de0 msgr2=0x7fe44019f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:30.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe446cb8640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe440101de0 0x7fe44019f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe446cb8640 1 -- 172.21.15.60:0/1201944363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe440102790 msgr2=0x7fe44019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe446cb8640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe440102790 0x7fe44019f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe446cb8640 1 -- 172.21.15.60:0/1201944363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44010e5b0 con 0x7fe440106f10 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe446cb8640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440106f10 0x7fe44010dcf0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe43800eaa0 tx=0x7fe43800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe4377fe640 1 -- 172.21.15.60:0/1201944363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43800cdb0 con 0x7fe440106f10 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe4377fe640 1 -- 172.21.15.60:0/1201944363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe438004b20 con 0x7fe440106f10 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44010e8a0 con 0x7fe440106f10 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe4377fe640 1 -- 172.21.15.60:0/1201944363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438011760 con 0x7fe440106f10 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.926+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44019adc0 con 0x7fe440106f10 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.927+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4401021c0 con 0x7fe440106f10 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.928+0000 7fe4377fe640 1 -- 172.21.15.60:0/1201944363 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe438004cd0 con 0x7fe440106f10 2024-09-12T00:08:30.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.929+0000 7fe4377fe640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe42c0a2cf0 0x7fe42c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:30.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.929+0000 7fe4464b7640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe42c0a2cf0 0x7fe42c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:30.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.929+0000 7fe4377fe640 1 -- 172.21.15.60:0/1201944363 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7fe4380cf640 con 0x7fe440106f10 2024-09-12T00:08:30.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.929+0000 7fe4464b7640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe42c0a2cf0 0x7fe42c0a51b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009230 tx=0x7fe43c0058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:30.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:30.933+0000 7fe4377fe640 1 -- 172.21.15.60:0/1201944363 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe438016030 con 0x7fe440106f10 2024-09-12T00:08:31.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.145+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe44019b840 con 0x7fe440106f10 2024-09-12T00:08:31.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.146+0000 7fe4377fe640 1 -- 172.21.15.60:0/1201944363 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7fe43809c280 con 0x7fe440106f10 2024-09-12T00:08:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:08:31.145 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:08:31.146 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:08:31.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe42c0a2cf0 msgr2=0x7fe42c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:31.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe42c0a2cf0 0x7fe42c0a51b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009230 tx=0x7fe43c0058d0 comp rx=0 tx=0).stop 2024-09-12T00:08:31.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440106f10 msgr2=0x7fe44010dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:31.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440106f10 0x7fe44010dcf0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe43800eaa0 tx=0x7fe43800ef60 comp rx=0 tx=0).stop 2024-09-12T00:08:31.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 shutdown_connections 2024-09-12T00:08:31.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fe42c0a2cf0 0x7fe42c0a51b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:31.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe440106f10 0x7fe44010dcf0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:31.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe440102790 0x7fe44019f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:31.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 --2- 172.21.15.60:0/1201944363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe440101de0 0x7fe44019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:31.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.148+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 >> 172.21.15.60:0/1201944363 conn(0x7fe4400fd8c0 msgr2=0x7fe4400feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:31.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.149+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 shutdown_connections 2024-09-12T00:08:31.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:31.149+0000 7fe44871b640 1 -- 172.21.15.60:0/1201944363 wait complete. 2024-09-12T00:08:31.455 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:31 smithi060 ceph-mon[30953]: pgmap v283: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:31.456 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:31 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1201944363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:08:31.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:31 smithi105 ceph-mon[34805]: pgmap v283: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:31.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:31 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1201944363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:08:31.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:31 smithi192 ceph-mon[35487]: pgmap v283: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:31.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:31 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1201944363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:08:31.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:08:32.144 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.639+0000 7f2a0f46c640 1 -- 172.21.15.60:0/987773153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08102ef0 msgr2=0x7f2a0810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/987773153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08102ef0 0x7f2a0810da40 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009900 tx=0x7f2a0002a480 comp rx=0 tx=0).stop 2024-09-12T00:08:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 -- 172.21.15.60:0/987773153 shutdown_connections 2024-09-12T00:08:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/987773153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08102ef0 0x7f2a0810da40 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/987773153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a08102570 0x7f2a081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/987773153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a08100e20 0x7f2a08101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 -- 172.21.15.60:0/987773153 >> 172.21.15.60:0/987773153 conn(0x7f2a080fc7d0 msgr2=0x7f2a080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:32.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 -- 172.21.15.60:0/987773153 shutdown_connections 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 -- 172.21.15.60:0/987773153 wait complete. 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.640+0000 7f2a0f46c640 1 Processor -- start 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0f46c640 1 -- start start 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0f46c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08100e20 0x7f2a08198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0f46c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a08102570 0x7f2a08198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0f46c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a08102ef0 0x7f2a0819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0f46c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081121c0 con 0x7f2a08100e20 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0f46c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08112040 con 0x7f2a08102ef0 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0f46c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a08112340 con 0x7f2a08102570 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0d208640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08100e20 0x7f2a08198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0d208640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08100e20 0x7f2a08198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48840/0 (socket says 172.21.15.60:48840) 2024-09-12T00:08:32.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0d208640 1 -- 172.21.15.60:0/4283235428 learned_addr learned my addr 172.21.15.60:0/4283235428 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0ca07640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a08102570 0x7f2a08198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0da09640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a08102ef0 0x7f2a0819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0d208640 1 -- 172.21.15.60:0/4283235428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a08102570 msgr2=0x7f2a08198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0d208640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a08102570 0x7f2a08198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0d208640 1 -- 172.21.15.60:0/4283235428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a08102ef0 msgr2=0x7f2a0819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0d208640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a08102ef0 0x7f2a0819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.641+0000 7f2a0d208640 1 -- 172.21.15.60:0/4283235428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0819d530 con 0x7f2a08100e20 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.642+0000 7f2a0d208640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08100e20 0x7f2a08198580 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f29f800eab0 tx=0x7f29f800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.642+0000 7f2a067fc640 1 -- 172.21.15.60:0/4283235428 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f800ce40 con 0x7f2a08100e20 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.642+0000 7f2a067fc640 1 -- 172.21.15.60:0/4283235428 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29f8011970 con 0x7f2a08100e20 2024-09-12T00:08:32.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.642+0000 7f2a0f46c640 1 -- 172.21.15.60:0/4283235428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0819d820 con 0x7f2a08100e20 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.642+0000 7f2a067fc640 1 -- 172.21.15.60:0/4283235428 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8010bb0 con 0x7f2a08100e20 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.642+0000 7f2a0f46c640 1 -- 172.21.15.60:0/4283235428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a081a5100 con 0x7f2a08100e20 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.644+0000 7f2a067fc640 1 -- 172.21.15.60:0/4283235428 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f29f8010d50 con 0x7f2a08100e20 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a11845740 1 Processor -- start 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a11845740 1 -- start start 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a11845740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c085c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a11845740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c085ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a11845740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c0869b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a11845740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5631c07be2f0 con 0x5631c085c9e0 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a11845740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5631c0765cf0 con 0x5631c0867780 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a11845740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5631c07ba2b0 con 0x5631c085df50 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a067fc640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f29f00a2cf0 0x7f29f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a0da09640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f29f00a2cf0 0x7f29f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a0d208640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c085ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a0d208640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c085ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48844/0 (socket says 172.21.15.60:48844) 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a0d208640 1 -- 172.21.15.60:0/2696443006 learned_addr learned my addr 172.21.15.60:0/2696443006 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a0ca07640 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c0869b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a067fc640 1 -- 172.21.15.60:0/4283235428 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f29f80cfa10 con 0x7f2a08100e20 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.645+0000 7f2a0da09640 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c085c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f2a0ca07640 1 -- 172.21.15.60:0/2696443006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 msgr2=0x5631c085c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f2a0ca07640 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c085c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f2a0ca07640 1 -- 172.21.15.60:0/2696443006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 msgr2=0x5631c085ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f2a0ca07640 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c085ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f2a0ca07640 1 -- 172.21.15.60:0/2696443006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c074a3a0 con 0x5631c0867780 2024-09-12T00:08:32.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f2a0da09640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f29f00a2cf0 0x7f29f00a51b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005ec0 tx=0x7f2a00032e00 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f2a0ca07640 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c0869b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29fc005fd0 tx=0x7f29fc00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3be7acb4de594c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f29ef7fe640 1 -- 172.21.15.60:0/2696443006 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc003b50 con 0x5631c0867780 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f29ef7fe640 1 -- 172.21.15.60:0/2696443006 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29fc015070 con 0x5631c0867780 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.646+0000 7f29ef7fe640 1 -- 172.21.15.60:0/2696443006 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc004d90 con 0x5631c0867780 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 -- 172.21.15.60:0/2696443006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 msgr2=0x5631c0869b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c0869b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29fc005fd0 tx=0x7f29fc00bb20 comp rx=0 tx=0).stop 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 -- 172.21.15.60:0/2696443006 shutdown_connections 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c0869b70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c085ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 --2- 172.21.15.60:0/2696443006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c085c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 -- 172.21.15.60:0/2696443006 >> 172.21.15.60:0/2696443006 conn(0x5631c0821310 msgr2=0x5631c0859070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 -- 172.21.15.60:0/2696443006 shutdown_connections 2024-09-12T00:08:32.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 -- 172.21.15.60:0/2696443006 wait complete. 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 -- start start 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.647+0000 7f2a11845740 1 Processor -- start 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a11845740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 0x5631c0867160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a11845740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c0864410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a11845740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c08649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a11845740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5631c086a480 con 0x5631c0867780 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a11845740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5631c0779060 con 0x5631c085c9e0 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a11845740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5631c086a600 con 0x5631c085df50 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a11845740 10 client.0 _ll_register_callbacks cb 0x5631c04cc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c08649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c08649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48848/0 (socket says 172.21.15.60:48848) 2024-09-12T00:08:32.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 -- 172.21.15.60:0/2620727763 learned_addr learned my addr 172.21.15.60:0/2620727763 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0d208640 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 0x5631c0867160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 -- 172.21.15.60:0/2620727763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 msgr2=0x5631c0864410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0ca07640 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c0864410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c0864410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 -- 172.21.15.60:0/2620727763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 msgr2=0x5631c0867160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 0x5631c0867160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 -- 172.21.15.60:0/2620727763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c052f3c0 con 0x5631c0867780 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f2a0da09640 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c08649e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005c00 tx=0x7f2a00044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a86dbc9cda8a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.648+0000 7f29ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f29ecff9640 1 -- 172.21.15.60:0/2620727763 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00050070 con 0x5631c0867780 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f29ecff9640 1 -- 172.21.15.60:0/2620727763 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f2a00005220 con 0x5631c0867780 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 1 -- 172.21.15.60:0/2620727763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29fc015070 con 0x5631c0867780 2024-09-12T00:08:32.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f29ecff9640 1 -- 172.21.15.60:0/2620727763 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2a0005b050 con 0x5631c0867780 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 10 client.17637 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 1 -- 172.21.15.60:0/2620727763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5631c0875f00 con 0x5631c0867780 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f29ecff9640 1 -- 172.21.15.60:0/2620727763 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29fc015070 con 0x5631c0867780 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f29ecff9640 1 -- 172.21.15.60:0/2620727763 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f2a000047a0 con 0x5631c0867780 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 10 client.17637 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 10 client.17637 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 20 client.17637 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5631c0877360 0x5631c0879800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 4 client.17637 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.649+0000 7f2a11845740 1 -- 172.21.15.60:0/2620727763 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631c07cb860 con 0x5631c0877360 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.650+0000 7f2a0d208640 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5631c0877360 0x5631c0879800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.650+0000 7f2a0d208640 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5631c0877360 0x5631c0879800 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=376c7d0c895a4743 server_cookie=6185f5e0bd8ca0ac in_seq=0 out_seq=0 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.650+0000 7f29ecff9640 10 client.17637 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f29ecff9640 1 -- 172.21.15.60:0/2620727763 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631c07cb860 con 0x5631c0877360 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f29ecff9640 10 client.17637 handle_command_reply: tid=0 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 client.17637 shutdown 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 -- 172.21.15.60:0/2620727763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 msgr2=0x5631c08649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c08649e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005c00 tx=0x7f2a00044000 comp rx=0 tx=0).stop 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 -- 172.21.15.60:0/2620727763 shutdown_connections 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c08649e0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c0864410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5631c0877360 0x5631c0879800 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 --2- 172.21.15.60:0/2620727763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 0x5631c0867160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 -- 172.21.15.60:0/2620727763 >> 172.21.15.60:0/2620727763 conn(0x5631c0821310 msgr2=0x5631c085ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:32.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f29ecff9640 0 client.17637 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:08:32.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 -- 172.21.15.60:0/2620727763 shutdown_connections 2024-09-12T00:08:32.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 1 -- 172.21.15.60:0/2620727763 wait complete. 2024-09-12T00:08:32.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.651+0000 7f2a11845740 20 client.17637 trim_cache size 0 max 16384 2024-09-12T00:08:32.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.664+0000 7f2a11845740 1 Processor -- start 2024-09-12T00:08:32.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.664+0000 7f2a11845740 1 -- start start 2024-09-12T00:08:32.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a11845740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c0873720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a11845740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c087f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a11845740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c087f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a11845740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081ab5b0 con 0x5631c085c9e0 2024-09-12T00:08:32.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a11845740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081ad0f0 con 0x5631c0867780 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a11845740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081abc80 con 0x5631c085df50 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c0873720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c0873720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48860/0 (socket says 172.21.15.60:48860) 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 -- 172.21.15.60:0/458384148 learned_addr learned my addr 172.21.15.60:0/458384148 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0da09640 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c087f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0ca07640 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c087f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 -- 172.21.15.60:0/458384148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 msgr2=0x5631c087f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c087f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 -- 172.21.15.60:0/458384148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 msgr2=0x5631c087f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c087f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 -- 172.21.15.60:0/458384148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c085f530 con 0x5631c085c9e0 2024-09-12T00:08:32.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0da09640 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c087f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f2a0d208640 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c0873720 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c700 tx=0x7f29f806deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b2e4b55cc069d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.665+0000 7f29eeffd640 1 -- 172.21.15.60:0/458384148 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f80a4b60 con 0x5631c085c9e0 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f29eeffd640 1 -- 172.21.15.60:0/458384148 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29f809a1f0 con 0x5631c085c9e0 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f29eeffd640 1 -- 172.21.15.60:0/458384148 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f80cd3a0 con 0x5631c085c9e0 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 -- 172.21.15.60:0/458384148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 msgr2=0x5631c0873720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c0873720 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c700 tx=0x7f29f806deb0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 -- 172.21.15.60:0/458384148 shutdown_connections 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c0867780 0x5631c087f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c087f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 --2- 172.21.15.60:0/458384148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c085c9e0 0x5631c0873720 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 -- 172.21.15.60:0/458384148 >> 172.21.15.60:0/458384148 conn(0x5631c0821310 msgr2=0x5631c0862ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 -- 172.21.15.60:0/458384148 shutdown_connections 2024-09-12T00:08:32.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.666+0000 7f2a11845740 1 -- 172.21.15.60:0/458384148 wait complete. 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 1 -- start start 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 1 Processor -- start 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 0x5631c086ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c086b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c086b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081aca20 con 0x5631c0867780 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081ac350 con 0x5631c085c9e0 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a081a95b0 con 0x5631c085df50 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a11845740 10 client.0 _ll_register_callbacks cb 0x7f2a000316e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a0da09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c086b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a0da09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c086b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48870/0 (socket says 172.21.15.60:48870) 2024-09-12T00:08:32.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a0da09640 1 -- 172.21.15.60:0/558692106 learned_addr learned my addr 172.21.15.60:0/558692106 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a0d208640 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 0x5631c086ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.667+0000 7f2a0ca07640 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c086b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a0da09640 1 -- 172.21.15.60:0/558692106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 msgr2=0x5631c086b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a0da09640 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c086b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a0da09640 1 -- 172.21.15.60:0/558692106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 msgr2=0x5631c086ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a0da09640 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 0x5631c086ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a0da09640 1 -- 172.21.15.60:0/558692106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c086bfd0 con 0x5631c0867780 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a0da09640 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c086b7f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2a000096c0 tx=0x7f2a00031790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8915019c5fe7e4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:32.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f29ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f29ecff9640 1 -- 172.21.15.60:0/558692106 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00050040 con 0x5631c0867780 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f29ecff9640 1 -- 172.21.15.60:0/558692106 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f2a00003a00 con 0x5631c0867780 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a11845740 1 -- 172.21.15.60:0/558692106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29f809a1f0 con 0x5631c0867780 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f29ecff9640 1 -- 172.21.15.60:0/558692106 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2a00003c00 con 0x5631c0867780 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a11845740 10 client.17643 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f2a11845740 1 -- 172.21.15.60:0/558692106 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5631c08e2050 con 0x5631c0867780 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.668+0000 7f29ecff9640 1 -- 172.21.15.60:0/558692106 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f29f809a1f0 con 0x5631c0867780 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f29ecff9640 1 -- 172.21.15.60:0/558692106 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f2a0004a570 con 0x5631c0867780 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f2a11845740 10 client.17643 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f2a11845740 10 client.17643 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f2a11845740 20 client.17643 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f2a11845740 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5631c08e2710 0x5631c08e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f2a11845740 4 client.17643 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f2a11845740 1 -- 172.21.15.60:0/558692106 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631c07c5d70 con 0x5631c08e2710 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f2a0d208640 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5631c08e2710 0x5631c08e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f29ecff9640 10 client.17643 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.669+0000 7f2a0d208640 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5631c08e2710 0x5631c08e4b30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b65d790d0bf96d02 server_cookie=dab75b060c97d292 in_seq=0 out_seq=0 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f29ecff9640 1 -- 172.21.15.60:0/558692106 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631c07c5d70 con 0x5631c08e2710 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f29ecff9640 10 client.17643 handle_command_reply: tid=0 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 client.17643 shutdown 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 -- 172.21.15.60:0/558692106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 msgr2=0x5631c086b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c086b7f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2a000096c0 tx=0x7f2a00031790 comp rx=0 tx=0).stop 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 -- 172.21.15.60:0/558692106 shutdown_connections 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631c0867780 0x5631c086b7f0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631c085df50 0x5631c086b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5631c08e2710 0x5631c08e4b30 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 --2- 172.21.15.60:0/558692106 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631c085c9e0 0x5631c086ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 -- 172.21.15.60:0/558692106 >> 172.21.15.60:0/558692106 conn(0x5631c0821310 msgr2=0x5631c0865c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f29ecff9640 0 client.17643 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:08:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 -- 172.21.15.60:0/558692106 shutdown_connections 2024-09-12T00:08:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 1 -- 172.21.15.60:0/558692106 wait complete. 2024-09-12T00:08:32.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a11845740 20 client.17643 trim_cache size 0 max 16384 2024-09-12T00:08:32.676 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a0f46c640 1 -- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f29f00a2cf0 msgr2=0x7f29f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f29f00a2cf0 0x7f29f00a51b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a00005ec0 tx=0x7f2a00032e00 comp rx=0 tx=0).stop 2024-09-12T00:08:32.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a0f46c640 1 -- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08100e20 msgr2=0x7f2a08198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.670+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08100e20 0x7f2a08198580 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f29f800eab0 tx=0x7f29f800ef70 comp rx=0 tx=0).stop 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.671+0000 7f2a0f46c640 1 -- 172.21.15.60:0/4283235428 shutdown_connections 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.671+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f29f00a2cf0 0x7f29f00a51b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.671+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a08102ef0 0x7f2a0819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.671+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a08102570 0x7f2a08198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.671+0000 7f2a0f46c640 1 --2- 172.21.15.60:0/4283235428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a08100e20 0x7f2a08198580 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.671+0000 7f2a0f46c640 1 -- 172.21.15.60:0/4283235428 >> 172.21.15.60:0/4283235428 conn(0x7f2a080fc7d0 msgr2=0x7f2a08106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.671+0000 7f2a0f46c640 1 -- 172.21.15.60:0/4283235428 shutdown_connections 2024-09-12T00:08:32.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:32.671+0000 7f2a0f46c640 1 -- 172.21.15.60:0/4283235428 wait complete. 2024-09-12T00:08:33.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:08:33.470 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:33 smithi060 ceph-mon[30953]: pgmap v284: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:33.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:33 smithi105 ceph-mon[34805]: pgmap v284: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:33.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:33 smithi192 ceph-mon[35487]: pgmap v284: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:08:33.710 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:34.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 -- 172.21.15.60:0/1032788947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141082a0 msgr2=0x7f471410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1032788947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141082a0 0x7f471410ec40 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f470c009cd0 tx=0x7f470c02a8e0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 -- 172.21.15.60:0/1032788947 shutdown_connections 2024-09-12T00:08:34.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1032788947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141082a0 0x7f471410ec40 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1032788947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47141036e0 0x7f4714107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1032788947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102d30 0x7f4714103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 -- 172.21.15.60:0/1032788947 >> 172.21.15.60:0/1032788947 conn(0x7f47140fc7d0 msgr2=0x7f47140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:34.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 -- 172.21.15.60:0/1032788947 shutdown_connections 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.170+0000 7f4719cc8640 1 -- 172.21.15.60:0/1032788947 wait complete. 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4719cc8640 1 Processor -- start 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4719cc8640 1 -- start start 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4719cc8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102d30 0x7f47141985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4719cc8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141036e0 0x7f4714198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4719cc8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47141082a0 0x7f471419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4719cc8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47141121c0 con 0x7f47141036e0 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4719cc8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4714112040 con 0x7f4714102d30 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4719cc8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4714112340 con 0x7f47141082a0 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f470affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141036e0 0x7f4714198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f470affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141036e0 0x7f4714198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48890/0 (socket says 172.21.15.60:48890) 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f470affd640 1 -- 172.21.15.60:0/1124792156 learned_addr learned my addr 172.21.15.60:0/1124792156 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:34.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f4713fff640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47141082a0 0x7f471419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f47137fe640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102d30 0x7f47141985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f470affd640 1 -- 172.21.15.60:0/1124792156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47141082a0 msgr2=0x7f471419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f470affd640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47141082a0 0x7f471419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f470affd640 1 -- 172.21.15.60:0/1124792156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102d30 msgr2=0x7f47141985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.171+0000 7f470affd640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102d30 0x7f47141985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.172+0000 7f470affd640 1 -- 172.21.15.60:0/1124792156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471419d5a0 con 0x7f47141036e0 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.172+0000 7f47137fe640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102d30 0x7f47141985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.172+0000 7f470affd640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141036e0 0x7f4714198b30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c8c0 tx=0x7f46fc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.172+0000 7f47117fa640 1 -- 172.21.15.60:0/1124792156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc007bb0 con 0x7f47141036e0 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.172+0000 7f47117fa640 1 -- 172.21.15.60:0/1124792156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f46fc007d50 con 0x7f47141036e0 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.172+0000 7f4719cc8640 1 -- 172.21.15.60:0/1124792156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471419d890 con 0x7f47141036e0 2024-09-12T00:08:34.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.172+0000 7f47117fa640 1 -- 172.21.15.60:0/1124792156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc018930 con 0x7f47141036e0 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.172+0000 7f4719cc8640 1 -- 172.21.15.60:0/1124792156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a5170 con 0x7f47141036e0 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.174+0000 7f47117fa640 1 -- 172.21.15.60:0/1124792156 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f46fc018ad0 con 0x7f47141036e0 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f471c0a1740 1 Processor -- start 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f471c0a1740 1 -- start start 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 0x564d5cc5f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc5fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc6e780 0x564d5cc70b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f471c0a1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564d5cbc52f0 con 0x564d5cc5f5d0 2024-09-12T00:08:34.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f471c0a1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564d5cb6ccf0 con 0x564d5cc60b40 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f471c0a1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564d5cbc12b0 con 0x564d5cc6e780 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc5fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc5fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48906/0 (socket says 172.21.15.60:48906) 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47137fe640 1 -- 172.21.15.60:0/3305999093 learned_addr learned my addr 172.21.15.60:0/3305999093 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47117fa640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47000a2cf0 0x7f47000a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f470affd640 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc6e780 0x564d5cc70b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f4713fff640 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 0x564d5cc5f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f4713fff640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47000a2cf0 0x7f47000a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47117fa640 1 -- 172.21.15.60:0/1124792156 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f46fc0cf5e0 con 0x7f47141036e0 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47137fe640 1 -- 172.21.15.60:0/3305999093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc6e780 msgr2=0x564d5cc70b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47137fe640 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc6e780 0x564d5cc70b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47137fe640 1 -- 172.21.15.60:0/3305999093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 msgr2=0x564d5cc5f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47137fe640 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 0x564d5cc5f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f47137fe640 1 -- 172.21.15.60:0/3305999093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d5cb513a0 con 0x564d5cc5f5d0 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.175+0000 7f470affd640 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc6e780 0x564d5cc70b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.176+0000 7f47137fe640 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc5fa10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4704009c50 tx=0x7f470400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257edc7e4180e02e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.176+0000 7f4713fff640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47000a2cf0 0x7f47000a51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f470c005fe0 tx=0x7f470c031000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.176+0000 7f4709ffb640 1 -- 172.21.15.60:0/3305999093 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704016070 con 0x564d5cc5f5d0 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.176+0000 7f4709ffb640 1 -- 172.21.15.60:0/3305999093 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4704005520 con 0x564d5cc5f5d0 2024-09-12T00:08:34.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.176+0000 7f4709ffb640 1 -- 172.21.15.60:0/3305999093 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704011670 con 0x564d5cc5f5d0 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.176+0000 7f471c0a1740 1 -- 172.21.15.60:0/3305999093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 msgr2=0x564d5cc5fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.176+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc5fa10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4704009c50 tx=0x7f470400e6c0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 -- 172.21.15.60:0/3305999093 shutdown_connections 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc6e780 0x564d5cc70b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc5fa10 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3305999093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 0x564d5cc5f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 -- 172.21.15.60:0/3305999093 >> 172.21.15.60:0/3305999093 conn(0x564d5cc28310 msgr2=0x564d5cc5bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 -- 172.21.15.60:0/3305999093 shutdown_connections 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 -- 172.21.15.60:0/3305999093 wait complete. 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 -- start start 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.177+0000 7f471c0a1740 1 Processor -- start 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc5f5d0 0x564d5cc6e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc60b40 0x564d5cc6b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc6e780 0x564d5cc6b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f471c0a1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564d5cc71480 con 0x564d5cc6e780 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f471c0a1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564d5cb80060 con 0x564d5cc5f5d0 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f471c0a1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564d5cc71600 con 0x564d5cc60b40 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f471c0a1740 10 client.0 _ll_register_callbacks cb 0x564d5c8d38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc6e780 0x564d5cc6b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc6e780 0x564d5cc6b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48910/0 (socket says 172.21.15.60:48910) 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 -- 172.21.15.60:0/3860982415 learned_addr learned my addr 172.21.15.60:0/3860982415 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f470affd640 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc60b40 0x564d5cc6b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f47137fe640 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc5f5d0 0x564d5cc6e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 -- 172.21.15.60:0/3860982415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc60b40 msgr2=0x564d5cc6b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc60b40 0x564d5cc6b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 -- 172.21.15.60:0/3860982415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc5f5d0 msgr2=0x564d5cc6e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc5f5d0 0x564d5cc6e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 -- 172.21.15.60:0/3860982415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d5c9363c0 con 0x564d5cc6e780 2024-09-12T00:08:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f4713fff640 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc6e780 0x564d5cc6b8b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f470c035000 tx=0x7f470c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61043e52371fa576 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:34.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.178+0000 7f46f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f46f2ffd640 1 -- 172.21.15.60:0/3860982415 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c050020 con 0x564d5cc6e780 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f46f2ffd640 1 -- 172.21.15.60:0/3860982415 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f470c0307a0 con 0x564d5cc6e780 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 1 -- 172.21.15.60:0/3860982415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4704005520 con 0x564d5cc6e780 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f46f2ffd640 1 -- 172.21.15.60:0/3860982415 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f470c0309a0 con 0x564d5cc6e780 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 10 client.17655 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 1 -- 172.21.15.60:0/3860982415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564d5cc7ce70 con 0x564d5cc6e780 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f46f2ffd640 1 -- 172.21.15.60:0/3860982415 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4704005520 con 0x564d5cc6e780 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f46f2ffd640 1 -- 172.21.15.60:0/3860982415 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f470c030070 con 0x564d5cc6e780 2024-09-12T00:08:34.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 10 client.17655 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 10 client.17655 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 20 client.17655 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564d5cc7e640 0x564d5cc80ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 4 client.17655 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.179+0000 7f471c0a1740 1 -- 172.21.15.60:0/3860982415 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d5cbd2860 con 0x564d5cc7e640 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.180+0000 7f47137fe640 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564d5cc7e640 0x564d5cc80ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.180+0000 7f46f2ffd640 10 client.17655 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.180+0000 7f47137fe640 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564d5cc7e640 0x564d5cc80ae0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2aae910a2aaeb9f8 server_cookie=612edbdb920e8be1 in_seq=0 out_seq=0 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f46f2ffd640 1 -- 172.21.15.60:0/3860982415 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d5cbd2860 con 0x564d5cc7e640 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f46f2ffd640 10 client.17655 handle_command_reply: tid=0 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 client.17655 shutdown 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 -- 172.21.15.60:0/3860982415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc6e780 msgr2=0x564d5cc6b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc6e780 0x564d5cc6b8b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f470c035000 tx=0x7f470c0095c0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 -- 172.21.15.60:0/3860982415 shutdown_connections 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564d5cc7e640 0x564d5cc80ae0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc6e780 0x564d5cc6b8b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc60b40 0x564d5cc6b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f46f2ffd640 0 client.17655 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 --2- 172.21.15.60:0/3860982415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc5f5d0 0x564d5cc6e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 -- 172.21.15.60:0/3860982415 >> 172.21.15.60:0/3860982415 conn(0x564d5cc28310 msgr2=0x564d5cc61930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 -- 172.21.15.60:0/3860982415 shutdown_connections 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 1 -- 172.21.15.60:0/3860982415 wait complete. 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.181+0000 7f471c0a1740 20 client.17655 trim_cache size 0 max 16384 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.194+0000 7f471c0a1740 1 Processor -- start 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.194+0000 7f471c0a1740 1 -- start start 2024-09-12T00:08:34.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.194+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc28310 0x564d5cc5be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.194+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc7a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.194+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 0x564d5cc6ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.194+0000 7f471c0a1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ab720 con 0x564d5cc5f5d0 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.194+0000 7f471c0a1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ad260 con 0x564d5cc60b40 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.194+0000 7f471c0a1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47141abdf0 con 0x564d5cc28310 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc7a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc7a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48926/0 (socket says 172.21.15.60:48926) 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 -- 172.21.15.60:0/1402330887 learned_addr learned my addr 172.21.15.60:0/1402330887 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f47137fe640 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc28310 0x564d5cc5be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f4713fff640 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 0x564d5cc6ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 -- 172.21.15.60:0/1402330887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc28310 msgr2=0x564d5cc5be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:34.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc28310 0x564d5cc5be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 -- 172.21.15.60:0/1402330887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 msgr2=0x564d5cc6ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 0x564d5cc6ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 -- 172.21.15.60:0/1402330887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d5cc698c0 con 0x564d5cc5f5d0 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f470affd640 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc7a720 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f46fc000c00 tx=0x7f46fc06eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e767c2b17ca2db4f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f47097fa640 1 -- 172.21.15.60:0/1402330887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0a4730 con 0x564d5cc5f5d0 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f47097fa640 1 -- 172.21.15.60:0/1402330887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f46fc00dda0 con 0x564d5cc5f5d0 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.195+0000 7f47097fa640 1 -- 172.21.15.60:0/1402330887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0a42a0 con 0x564d5cc5f5d0 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 -- 172.21.15.60:0/1402330887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 msgr2=0x564d5cc7a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc7a720 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f46fc000c00 tx=0x7f46fc06eb30 comp rx=0 tx=0).stop 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 -- 172.21.15.60:0/1402330887 shutdown_connections 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc60b40 0x564d5cc6ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc5f5d0 0x564d5cc7a720 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 --2- 172.21.15.60:0/1402330887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc28310 0x564d5cc5be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 -- 172.21.15.60:0/1402330887 >> 172.21.15.60:0/1402330887 conn(0x564d5cc6ba10 msgr2=0x564d5cc5b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 -- 172.21.15.60:0/1402330887 shutdown_connections 2024-09-12T00:08:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 -- 172.21.15.60:0/1402330887 wait complete. 2024-09-12T00:08:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.196+0000 7f471c0a1740 1 -- start start 2024-09-12T00:08:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f471c0a1740 1 Processor -- start 2024-09-12T00:08:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc28310 0x564d5cc72850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc5f5d0 0x564d5cc72d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f471c0a1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc60b40 0x564d5cc732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f471c0a1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47141acb90 con 0x564d5cc60b40 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f471c0a1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47141ac4c0 con 0x564d5cc28310 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f471c0a1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47141a9720 con 0x564d5cc5f5d0 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f471c0a1740 10 client.0 _ll_register_callbacks cb 0x7f470c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f4713fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc60b40 0x564d5cc732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f4713fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc60b40 0x564d5cc732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48928/0 (socket says 172.21.15.60:48928) 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f47137fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc28310 0x564d5cc72850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f4713fff640 1 -- 172.21.15.60:0/299849944 learned_addr learned my addr 172.21.15.60:0/299849944 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f470affd640 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc5f5d0 0x564d5cc72d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.197+0000 7f4713fff640 1 -- 172.21.15.60:0/299849944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc5f5d0 msgr2=0x564d5cc72d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.198+0000 7f4713fff640 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc5f5d0 0x564d5cc72d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.198+0000 7f4713fff640 1 -- 172.21.15.60:0/299849944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc28310 msgr2=0x564d5cc72850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.198+0000 7f4713fff640 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc28310 0x564d5cc72850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.198+0000 7f4713fff640 1 -- 172.21.15.60:0/299849944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d5cce8610 con 0x564d5cc60b40 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.198+0000 7f47137fe640 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc28310 0x564d5cc72850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.198+0000 7f4713fff640 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc60b40 0x564d5cc732d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f470c02a920 tx=0x7f470c005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced9c35c39edf142 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.198+0000 7f46f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.200+0000 7f46f2ffd640 1 -- 172.21.15.60:0/299849944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c050070 con 0x564d5cc60b40 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.200+0000 7f46f2ffd640 1 -- 172.21.15.60:0/299849944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f470c030d40 con 0x564d5cc60b40 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.200+0000 7f471c0a1740 1 -- 172.21.15.60:0/299849944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46fc00dda0 con 0x564d5cc60b40 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.200+0000 7f46f2ffd640 1 -- 172.21.15.60:0/299849944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f470c068050 con 0x564d5cc60b40 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.200+0000 7f471c0a1740 10 client.17661 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:34.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f471c0a1740 1 -- 172.21.15.60:0/299849944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564d5cce9910 con 0x564d5cc60b40 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f46f2ffd640 1 -- 172.21.15.60:0/299849944 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f46fc00dda0 con 0x564d5cc60b40 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f46f2ffd640 1 -- 172.21.15.60:0/299849944 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f470c04a750 con 0x564d5cc60b40 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f471c0a1740 10 client.17661 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f471c0a1740 10 client.17661 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f471c0a1740 20 client.17661 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f471c0a1740 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564d5cc6e780 0x564d5ccec060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f471c0a1740 4 client.17661 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f471c0a1740 1 -- 172.21.15.60:0/299849944 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564d5cbccd70 con 0x564d5cc6e780 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.201+0000 7f47137fe640 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564d5cc6e780 0x564d5ccec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f46f2ffd640 10 client.17661 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f47137fe640 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564d5cc6e780 0x564d5ccec060 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=201502f006944d95 server_cookie=5192204c5ac5d5e2 in_seq=0 out_seq=0 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f46f2ffd640 1 -- 172.21.15.60:0/299849944 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564d5cbccd70 con 0x564d5cc6e780 2024-09-12T00:08:34.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f46f2ffd640 10 client.17661 handle_command_reply: tid=0 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 client.17661 shutdown 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 -- 172.21.15.60:0/299849944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc60b40 msgr2=0x564d5cc732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc60b40 0x564d5cc732d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f470c02a920 tx=0x7f470c005da0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 -- 172.21.15.60:0/299849944 shutdown_connections 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x564d5cc6e780 0x564d5ccec060 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564d5cc60b40 0x564d5cc732d0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564d5cc5f5d0 0x564d5cc72d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 --2- 172.21.15.60:0/299849944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x564d5cc28310 0x564d5cc72850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 -- 172.21.15.60:0/299849944 >> 172.21.15.60:0/299849944 conn(0x564d5cc6ba10 msgr2=0x564d5cc6cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f46f2ffd640 0 client.17661 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 -- 172.21.15.60:0/299849944 shutdown_connections 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 1 -- 172.21.15.60:0/299849944 wait complete. 2024-09-12T00:08:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.202+0000 7f471c0a1740 20 client.17661 trim_cache size 0 max 16384 2024-09-12T00:08:34.223 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 -- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47000a2cf0 msgr2=0x7f47000a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47000a2cf0 0x7f47000a51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f470c005fe0 tx=0x7f470c031000 comp rx=0 tx=0).stop 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 -- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141036e0 msgr2=0x7f4714198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141036e0 0x7f4714198b30 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c8c0 tx=0x7f46fc00cd80 comp rx=0 tx=0).stop 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 -- 172.21.15.60:0/1124792156 shutdown_connections 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f47000a2cf0 0x7f47000a51b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47141082a0 0x7f471419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47141036e0 0x7f4714198b30 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 --2- 172.21.15.60:0/1124792156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4714102d30 0x7f47141985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 -- 172.21.15.60:0/1124792156 >> 172.21.15.60:0/1124792156 conn(0x7f47140fc7d0 msgr2=0x7f47140fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 -- 172.21.15.60:0/1124792156 shutdown_connections 2024-09-12T00:08:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:34.203+0000 7f4719cc8640 1 -- 172.21.15.60:0/1124792156 wait complete. 2024-09-12T00:08:34.952 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:08:35.253 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:35.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:35 smithi105 ceph-mon[34805]: pgmap v285: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:35.505 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:35 smithi060 ceph-mon[30953]: pgmap v285: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:35.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:35 smithi192 ceph-mon[35487]: pgmap v285: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 -- 172.21.15.60:0/1393519091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102570 msgr2=0x7f10181029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1393519091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102570 0x7f10181029b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1000009900 tx=0x7f100002a480 comp rx=0 tx=0).stop 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 -- 172.21.15.60:0/1393519091 shutdown_connections 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1393519091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1018102ef0 0x7f101810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1393519091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018102570 0x7f10181029b0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1393519091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018100e20 0x7f1018101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 -- 172.21.15.60:0/1393519091 >> 172.21.15.60:0/1393519091 conn(0x7f10180fc7d0 msgr2=0x7f10180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 -- 172.21.15.60:0/1393519091 shutdown_connections 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.727+0000 7f101e9a5640 1 -- 172.21.15.60:0/1393519091 wait complete. 2024-09-12T00:08:35.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f101e9a5640 1 Processor -- start 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f101e9a5640 1 -- start start 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f101e9a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018100e20 0x7f101819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f101e9a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018102570 0x7f101819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f101e9a5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1018102ef0 0x7f101819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f101e9a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1018111070 con 0x7f1018100e20 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f101e9a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1018110ef0 con 0x7f1018102570 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f101e9a5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10181111f0 con 0x7f1018102ef0 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f1017fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018100e20 0x7f101819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f1017fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018100e20 0x7f101819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48950/0 (socket says 172.21.15.60:48950) 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.728+0000 7f1017fff640 1 -- 172.21.15.60:0/1162619457 learned_addr learned my addr 172.21.15.60:0/1162619457 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f101cf42640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1018102ef0 0x7f101819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f100ffff640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018102570 0x7f101819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1017fff640 1 -- 172.21.15.60:0/1162619457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1018102ef0 msgr2=0x7f101819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1017fff640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1018102ef0 0x7f101819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1017fff640 1 -- 172.21.15.60:0/1162619457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018102570 msgr2=0x7f101819ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1017fff640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018102570 0x7f101819ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1017fff640 1 -- 172.21.15.60:0/1162619457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101819f6f0 con 0x7f1018100e20 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1017fff640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018100e20 0x7f101819a740 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f100800d950 tx=0x7f100800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1015ffb640 1 -- 172.21.15.60:0/1162619457 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008017030 con 0x7f1018100e20 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f101e9a5640 1 -- 172.21.15.60:0/1162619457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101819f9e0 con 0x7f1018100e20 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1015ffb640 1 -- 172.21.15.60:0/1162619457 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1008004020 con 0x7f1018100e20 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f1015ffb640 1 -- 172.21.15.60:0/1162619457 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008004a00 con 0x7f1018100e20 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.729+0000 7f101e9a5640 1 -- 172.21.15.60:0/1162619457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10181a72c0 con 0x7f1018100e20 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.731+0000 7f1015ffb640 1 -- 172.21.15.60:0/1162619457 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f10080041d0 con 0x7f1018100e20 2024-09-12T00:08:35.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.731+0000 7f1020d7e740 1 Processor -- start 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1020d7e740 1 -- start start 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc620090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc620a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 0x5558bc62d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1020d7e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5558bc5862f0 con 0x5558bc6205d0 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1020d7e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5558bc52dcf0 con 0x5558bc62b370 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1020d7e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5558bc5822b0 con 0x5558bc621b40 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1017fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc620a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1017fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc620a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48956/0 (socket says 172.21.15.60:48956) 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1017fff640 1 -- 172.21.15.60:0/1248585684 learned_addr learned my addr 172.21.15.60:0/1248585684 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f101cf42640 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc620090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f100ffff640 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 0x5558bc62d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1017fff640 1 -- 172.21.15.60:0/1248585684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 msgr2=0x5558bc620090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1017fff640 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc620090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1017fff640 1 -- 172.21.15.60:0/1248585684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 msgr2=0x5558bc62d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1017fff640 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 0x5558bc62d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1017fff640 1 -- 172.21.15.60:0/1248585684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558bc5123a0 con 0x5558bc6205d0 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f1015ffb640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10040a2d70 0x7f10040a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.732+0000 7f101cf42640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10040a2d70 0x7f10040a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1017fff640 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc620a10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f10080cc580 tx=0x7f10080d74b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e263fcc29b52bba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1015ffb640 1 -- 172.21.15.60:0/1162619457 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f10080ceea0 con 0x7f1018100e20 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f100e7fc640 1 -- 172.21.15.60:0/1248585684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100809b1b0 con 0x5558bc6205d0 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f100e7fc640 1 -- 172.21.15.60:0/1248585684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f100809bae0 con 0x5558bc6205d0 2024-09-12T00:08:35.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f100e7fc640 1 -- 172.21.15.60:0/1248585684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100809ad40 con 0x5558bc6205d0 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1020d7e740 1 -- 172.21.15.60:0/1248585684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 msgr2=0x5558bc620a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc620a10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f10080cc580 tx=0x7f10080d74b0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f101cf42640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10040a2d70 0x7f10040a5230 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1010005cc0 tx=0x7f101000b340 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1020d7e740 1 -- 172.21.15.60:0/1248585684 shutdown_connections 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 0x5558bc62d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc620a10 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1248585684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc620090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.733+0000 7f1020d7e740 1 -- 172.21.15.60:0/1248585684 >> 172.21.15.60:0/1248585684 conn(0x5558bc5e9310 msgr2=0x5558bc61cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 -- 172.21.15.60:0/1248585684 shutdown_connections 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 -- 172.21.15.60:0/1248585684 wait complete. 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 -- start start 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 Processor -- start 2024-09-12T00:08:35.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc62adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc621b40 0x5558bc628070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc62b370 0x5558bc628800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5558bc62e070 con 0x5558bc6205d0 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5558bc541060 con 0x5558bc621b40 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5558bc62e1f0 con 0x5558bc62b370 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1020d7e740 10 client.0 _ll_register_callbacks cb 0x5558bc2948c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.734+0000 7f1017fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc62adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1017fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc62adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48960/0 (socket says 172.21.15.60:48960) 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1017fff640 1 -- 172.21.15.60:0/1054141148 learned_addr learned my addr 172.21.15.60:0/1054141148 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f100ffff640 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc621b40 0x5558bc628070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f101cf42640 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc62b370 0x5558bc628800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1017fff640 1 -- 172.21.15.60:0/1054141148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc62b370 msgr2=0x5558bc628800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1017fff640 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc62b370 0x5558bc628800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1017fff640 1 -- 172.21.15.60:0/1054141148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc621b40 msgr2=0x5558bc628070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1017fff640 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc621b40 0x5558bc628070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1017fff640 1 -- 172.21.15.60:0/1054141148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558bc2f73c0 con 0x5558bc6205d0 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1017fff640 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc62adc0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f10080ccc10 tx=0x7f10080052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96070a2b783f9882 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f0ff77fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1054141148 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100809af20 con 0x5558bc6205d0 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1054141148 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f1008097a50 con 0x5558bc6205d0 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f1020d7e740 1 -- 172.21.15.60:0/1054141148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f100809bae0 con 0x5558bc6205d0 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.735+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1054141148 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f100809ad40 con 0x5558bc6205d0 2024-09-12T00:08:35.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f1020d7e740 10 client.17673 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f1020d7e740 1 -- 172.21.15.60:0/1054141148 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5558bc62e070 con 0x5558bc6205d0 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1054141148 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f100809bae0 con 0x5558bc6205d0 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1054141148 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f10080d20f0 con 0x5558bc6205d0 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f1020d7e740 10 client.17673 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f1020d7e740 10 client.17673 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f1020d7e740 20 client.17673 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5558bc63ad00 0x5558bc63d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f1020d7e740 4 client.17673 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f1020d7e740 1 -- 172.21.15.60:0/1054141148 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558bc593860 con 0x5558bc63ad00 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.736+0000 7f100ffff640 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5558bc63ad00 0x5558bc63d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.737+0000 7f100ffff640 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5558bc63ad00 0x5558bc63d0f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa9d10fcb11adaaf server_cookie=745b320b4cfa196c in_seq=0 out_seq=0 2024-09-12T00:08:35.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.737+0000 7f0ff77fe640 10 client.17673 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.737+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1054141148 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558bc593860 con 0x5558bc63ad00 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.737+0000 7f0ff77fe640 10 client.17673 handle_command_reply: tid=0 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 client.17673 shutdown 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 -- 172.21.15.60:0/1054141148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 msgr2=0x5558bc62adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc62adc0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f10080ccc10 tx=0x7f10080052d0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 -- 172.21.15.60:0/1054141148 shutdown_connections 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5558bc63ad00 0x5558bc63d0f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc62b370 0x5558bc628800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc621b40 0x5558bc628070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f0ff77fe640 0 client.17673 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:08:35.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1054141148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc6205d0 0x5558bc62adc0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 -- 172.21.15.60:0/1054141148 >> 172.21.15.60:0/1054141148 conn(0x5558bc5e9310 msgr2=0x5558bc622960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:35.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 -- 172.21.15.60:0/1054141148 shutdown_connections 2024-09-12T00:08:35.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 1 -- 172.21.15.60:0/1054141148 wait complete. 2024-09-12T00:08:35.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.738+0000 7f1020d7e740 20 client.17673 trim_cache size 0 max 16384 2024-09-12T00:08:35.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f1020d7e740 1 Processor -- start 2024-09-12T00:08:35.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f1020d7e740 1 -- start start 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc6205d0 0x5558bc642690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc621b40 0x5558bc642bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 0x5558bc625350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f1020d7e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f10181afab0 con 0x5558bc621b40 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f1020d7e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10181b15f0 con 0x5558bc62b370 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f1020d7e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10181b0180 con 0x5558bc6205d0 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.751+0000 7f100ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc621b40 0x5558bc642bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc621b40 0x5558bc642bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48966/0 (socket says 172.21.15.60:48966) 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100ffff640 1 -- 172.21.15.60:0/2662772942 learned_addr learned my addr 172.21.15.60:0/2662772942 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f1017fff640 1 --2- 172.21.15.60:0/2662772942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc6205d0 0x5558bc642690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100ffff640 1 -- 172.21.15.60:0/2662772942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc6205d0 msgr2=0x5558bc642690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:35.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100ffff640 1 --2- 172.21.15.60:0/2662772942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc6205d0 0x5558bc642690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100ffff640 1 -- 172.21.15.60:0/2662772942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 msgr2=0x5558bc625350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100ffff640 1 --2- 172.21.15.60:0/2662772942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 0x5558bc625350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100ffff640 1 -- 172.21.15.60:0/2662772942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558bc62b130 con 0x5558bc621b40 2024-09-12T00:08:35.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100ffff640 1 --2- 172.21.15.60:0/2662772942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc621b40 0x5558bc642bd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f1000009230 tx=0x7f100002ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48e341055c2f933 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100dffb640 1 -- 172.21.15.60:0/2662772942 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000048070 con 0x5558bc621b40 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100dffb640 1 -- 172.21.15.60:0/2662772942 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1000005040 con 0x5558bc621b40 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.752+0000 7f100dffb640 1 -- 172.21.15.60:0/2662772942 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000035040 con 0x5558bc621b40 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 -- 172.21.15.60:0/2662772942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc621b40 msgr2=0x5558bc642bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 --2- 172.21.15.60:0/2662772942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc621b40 0x5558bc642bd0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f1000009230 tx=0x7f100002ac00 comp rx=0 tx=0).stop 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 -- 172.21.15.60:0/2662772942 shutdown_connections 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 --2- 172.21.15.60:0/2662772942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc62b370 0x5558bc625350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 --2- 172.21.15.60:0/2662772942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc621b40 0x5558bc642bd0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 --2- 172.21.15.60:0/2662772942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc6205d0 0x5558bc642690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 -- 172.21.15.60:0/2662772942 >> 172.21.15.60:0/2662772942 conn(0x5558bc5e9310 msgr2=0x5558bc6271c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:35.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 -- 172.21.15.60:0/2662772942 shutdown_connections 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 -- 172.21.15.60:0/2662772942 wait complete. 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 -- start start 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.753+0000 7f1020d7e740 1 Processor -- start 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc6205d0 0x5558bc633480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc6339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1020d7e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc62b370 0x5558bc630450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1020d7e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f10181b0f20 con 0x5558bc62b370 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1020d7e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10181b0850 con 0x5558bc6205d0 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1020d7e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10181adab0 con 0x5558bc621b40 2024-09-12T00:08:35.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1020d7e740 10 client.0 _ll_register_callbacks cb 0x7f1008095f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc62b370 0x5558bc630450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc62b370 0x5558bc630450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48970/0 (socket says 172.21.15.60:48970) 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 -- 172.21.15.60:0/1561830388 learned_addr learned my addr 172.21.15.60:0/1561830388 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1017fff640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc6205d0 0x5558bc633480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f100ffff640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc6339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 -- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 msgr2=0x5558bc6339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc6339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 -- 172.21.15.60:0/1561830388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc6205d0 msgr2=0x5558bc633480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc6205d0 0x5558bc633480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 -- 172.21.15.60:0/1561830388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558bc628b70 con 0x5558bc62b370 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f100ffff640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc6339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f1017fff640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc6205d0 0x5558bc633480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:35.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f101cf42640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc62b370 0x5558bc630450 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f1010011e20 tx=0x7f1010004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238871b917a33239 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.754+0000 7f0ff77fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1561830388 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101001a7b0 con 0x5558bc62b370 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1561830388 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f101001a950 con 0x5558bc62b370 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 1 -- 172.21.15.60:0/1561830388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1000005040 con 0x5558bc62b370 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1561830388 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f101001ab50 con 0x5558bc62b370 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 10 client.17679 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 1 -- 172.21.15.60:0/1561830388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5558bc6a5d90 con 0x5558bc62b370 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1561830388 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1000005040 con 0x5558bc62b370 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1561830388 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f101002f070 con 0x5558bc62b370 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 10 client.17679 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 10 client.17679 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 20 client.17679 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:35.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5558bc6a6590 0x5558bc6a89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 4 client.17679 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.755+0000 7f1020d7e740 1 -- 172.21.15.60:0/1561830388 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558bc58dd70 con 0x5558bc6a6590 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1017fff640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5558bc6a6590 0x5558bc6a89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f0ff77fe640 10 client.17679 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1017fff640 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5558bc6a6590 0x5558bc6a89b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dacd21d7b7a0c15d server_cookie=91c31168f44e2469 in_seq=0 out_seq=0 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f0ff77fe640 1 -- 172.21.15.60:0/1561830388 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558bc58dd70 con 0x5558bc6a6590 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f0ff77fe640 10 client.17679 handle_command_reply: tid=0 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 client.17679 shutdown 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 -- 172.21.15.60:0/1561830388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc62b370 msgr2=0x5558bc630450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc62b370 0x5558bc630450 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f1010011e20 tx=0x7f1010004ab0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 -- 172.21.15.60:0/1561830388 shutdown_connections 2024-09-12T00:08:35.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5558bc6a6590 0x5558bc6a89b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558bc62b370 0x5558bc630450 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5558bc621b40 0x5558bc6339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 --2- 172.21.15.60:0/1561830388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5558bc6205d0 0x5558bc633480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 -- 172.21.15.60:0/1561830388 >> 172.21.15.60:0/1561830388 conn(0x5558bc5e9310 msgr2=0x5558bc61b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f0ff77fe640 0 client.17679 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.756+0000 7f1020d7e740 1 -- 172.21.15.60:0/1561830388 shutdown_connections 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f1020d7e740 1 -- 172.21.15.60:0/1561830388 wait complete. 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f1020d7e740 20 client.17679 trim_cache size 0 max 16384 2024-09-12T00:08:35.761 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:35.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 -- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10040a2d70 msgr2=0x7f10040a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10040a2d70 0x7f10040a5230 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1010005cc0 tx=0x7f101000b340 comp rx=0 tx=0).stop 2024-09-12T00:08:35.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 -- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018100e20 msgr2=0x7f101819a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:35.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018100e20 0x7f101819a740 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f100800d950 tx=0x7f100800de10 comp rx=0 tx=0).stop 2024-09-12T00:08:35.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 -- 172.21.15.60:0/1162619457 shutdown_connections 2024-09-12T00:08:35.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f10040a2d70 0x7f10040a5230 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1018102ef0 0x7f101819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018102570 0x7f101819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 --2- 172.21.15.60:0/1162619457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018100e20 0x7f101819a740 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:35.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 -- 172.21.15.60:0/1162619457 >> 172.21.15.60:0/1162619457 conn(0x7f10180fc7d0 msgr2=0x7f101806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:35.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 -- 172.21.15.60:0/1162619457 shutdown_connections 2024-09-12T00:08:35.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:35.757+0000 7f101e9a5640 1 -- 172.21.15.60:0/1162619457 wait complete. 2024-09-12T00:08:36.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:36 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:08:36.715 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:36 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:08:36.715 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:36 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:08:36.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:08:36.974 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:37.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:37 smithi060 ceph-mon[30953]: pgmap v286: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:37.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:37 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:08:37.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:37 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:08:37.349 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:37 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:08:37.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 -- 172.21.15.60:0/889529830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 msgr2=0x7ff3981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 --2- 172.21.15.60:0/889529830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 0x7ff3981067e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff388009900 tx=0x7ff38802a410 comp rx=0 tx=0).stop 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 -- 172.21.15.60:0/889529830 shutdown_connections 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 --2- 172.21.15.60:0/889529830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff398106f10 0x7ff39810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 --2- 172.21.15.60:0/889529830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 0x7ff3981067e0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 --2- 172.21.15.60:0/889529830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff398101de0 0x7ff3981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 -- 172.21.15.60:0/889529830 >> 172.21.15.60:0/889529830 conn(0x7ff3980fd8c0 msgr2=0x7ff3980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 -- 172.21.15.60:0/889529830 shutdown_connections 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 -- 172.21.15.60:0/889529830 wait complete. 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.431+0000 7ff3a0560640 1 Processor -- start 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff3a0560640 1 -- start start 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff3a0560640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff398101de0 0x7ff3980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff3a0560640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 0x7ff398074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff3a0560640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff398106f10 0x7ff398074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff3a0560640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981120d0 con 0x7ff398102790 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff3a0560640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff398111f50 con 0x7ff398106f10 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff3a0560640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff398112250 con 0x7ff398101de0 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39dafb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 0x7ff398074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39dafb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 0x7ff398074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48984/0 (socket says 172.21.15.60:48984) 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39dafb640 1 -- 172.21.15.60:0/2096747090 learned_addr learned my addr 172.21.15.60:0/2096747090 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39eafd640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff398106f10 0x7ff398074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff398101de0 0x7ff3980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39dafb640 1 -- 172.21.15.60:0/2096747090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff398101de0 msgr2=0x7ff3980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39dafb640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff398101de0 0x7ff3980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39dafb640 1 -- 172.21.15.60:0/2096747090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff398106f10 msgr2=0x7ff398074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39dafb640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff398106f10 0x7ff398074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39dafb640 1 -- 172.21.15.60:0/2096747090 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3981a69f0 con 0x7ff398102790 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.432+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff398101de0 0x7ff3980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.433+0000 7ff39dafb640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 0x7ff398074a30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff388006010 tx=0x7ff3880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.433+0000 7ff38f7fe640 1 -- 172.21.15.60:0/2096747090 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38803f030 con 0x7ff398102790 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.433+0000 7ff38f7fe640 1 -- 172.21.15.60:0/2096747090 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff388003d00 con 0x7ff398102790 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.433+0000 7ff3a0560640 1 -- 172.21.15.60:0/2096747090 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3981a6c80 con 0x7ff398102790 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.433+0000 7ff38f7fe640 1 -- 172.21.15.60:0/2096747090 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388035070 con 0x7ff398102790 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.433+0000 7ff3a0560640 1 -- 172.21.15.60:0/2096747090 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3981a71b0 con 0x7ff398102790 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.435+0000 7ff38f7fe640 1 -- 172.21.15.60:0/2096747090 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff388042030 con 0x7ff398102790 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.435+0000 7ff3a2939740 1 Processor -- start 2024-09-12T00:08:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.435+0000 7ff3a2939740 1 -- start start 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227fb40 0x55e42227e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227e5d0 0x55e42227ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e42228b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff3a2939740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e4221e42f0 con 0x55e42227e5d0 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff3a2939740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e42218bcf0 con 0x55e422289370 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff3a2939740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e4221e02b0 con 0x55e42227fb40 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227e5d0 0x55e42227ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227e5d0 0x55e42227ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48988/0 (socket says 172.21.15.60:48988) 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 -- 172.21.15.60:0/1626990467 learned_addr learned my addr 172.21.15.60:0/1626990467 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39eafd640 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227fb40 0x55e42227e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39dafb640 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e42228b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff38f7fe640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff3840a2d70 0x7ff3840a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 -- 172.21.15.60:0/1626990467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227fb40 msgr2=0x55e42227e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227fb40 0x55e42227e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 -- 172.21.15.60:0/1626990467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 msgr2=0x55e42228b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e42228b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 -- 172.21.15.60:0/1626990467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4221703a0 con 0x55e42227e5d0 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39eafd640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff3840a2d70 0x7ff3840a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff38f7fe640 1 -- 172.21.15.60:0/2096747090 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7ff3880ef910 con 0x7ff398102790 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.436+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227e5d0 0x55e42227ea10 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff394009c50 tx=0x7ff39400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6b5d1507ad02a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff38cff9640 1 -- 172.21.15.60:0/1626990467 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394016070 con 0x55e42227e5d0 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff38cff9640 1 -- 172.21.15.60:0/1626990467 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff394005520 con 0x55e42227e5d0 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff38cff9640 1 -- 172.21.15.60:0/1626990467 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3940116d0 con 0x55e42227e5d0 2024-09-12T00:08:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff3a2939740 1 -- 172.21.15.60:0/1626990467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227e5d0 msgr2=0x55e42227ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff39eafd640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff3840a2d70 0x7ff3840a5230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff390009fd0 tx=0x7ff390004b50 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff3a2939740 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227e5d0 0x55e42227ea10 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff394009c50 tx=0x7ff39400e6c0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff3a2939740 1 -- 172.21.15.60:0/1626990467 shutdown_connections 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff3a2939740 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e42228b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff3a2939740 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227e5d0 0x55e42227ea10 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff3a2939740 1 --2- 172.21.15.60:0/1626990467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227fb40 0x55e42227e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.437+0000 7ff3a2939740 1 -- 172.21.15.60:0/1626990467 >> 172.21.15.60:0/1626990467 conn(0x55e422247310 msgr2=0x55e42227ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 -- 172.21.15.60:0/1626990467 shutdown_connections 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 -- 172.21.15.60:0/1626990467 wait complete. 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 -- start start 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 Processor -- start 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422288d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e422285fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e4222865d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e42228c070 con 0x55e42227fb40 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e42219f060 con 0x55e422289370 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e42228c1f0 con 0x55e42227e5d0 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff3a2939740 10 client.0 _ll_register_callbacks cb 0x55e421ef28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff39dafb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e422285fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff39dafb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e422285fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48994/0 (socket says 172.21.15.60:48994) 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff39dafb640 1 -- 172.21.15.60:0/960586756 learned_addr learned my addr 172.21.15.60:0/960586756 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422288d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.438+0000 7ff39eafd640 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e4222865d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff39dafb640 1 -- 172.21.15.60:0/960586756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 msgr2=0x55e422288d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff39dafb640 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422288d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff39dafb640 1 -- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 msgr2=0x55e4222865d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff39dafb640 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e4222865d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff39dafb640 1 -- 172.21.15.60:0/960586756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e421f553c0 con 0x55e42227fb40 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff39eafd640 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e4222865d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff39dafb640 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e422285fe0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff3880b8370 tx=0x7ff388009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfacefc3e6b16c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff381ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff381ffb640 1 -- 172.21.15.60:0/960586756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388049030 con 0x55e42227fb40 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff381ffb640 1 -- 172.21.15.60:0/960586756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7ff3880b8580 con 0x55e42227fb40 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff3a2939740 1 -- 172.21.15.60:0/960586756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff394005520 con 0x55e42227fb40 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff381ffb640 1 -- 172.21.15.60:0/960586756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff3880bba50 con 0x55e42227fb40 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff3a2939740 10 client.17691 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff3a2939740 1 -- 172.21.15.60:0/960586756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55e422297ad0 con 0x55e42227fb40 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff381ffb640 1 -- 172.21.15.60:0/960586756 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff394005520 con 0x55e42227fb40 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff381ffb640 1 -- 172.21.15.60:0/960586756 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7ff38803b460 con 0x55e42227fb40 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff3a2939740 10 client.17691 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.439+0000 7ff3a2939740 10 client.17691 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.440+0000 7ff3a2939740 20 client.17691 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.440+0000 7ff3a2939740 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e422298f30 0x55e42229b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.440+0000 7ff3a2939740 4 client.17691 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.440+0000 7ff3a2939740 1 -- 172.21.15.60:0/960586756 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4221f1860 con 0x55e422298f30 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.440+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e422298f30 0x55e42229b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.440+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e422298f30 0x55e42229b340 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc79998574b923bb server_cookie=a118dc1049ce7f0f in_seq=0 out_seq=0 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.440+0000 7ff381ffb640 10 client.17691 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff381ffb640 1 -- 172.21.15.60:0/960586756 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4221f1860 con 0x55e422298f30 2024-09-12T00:08:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff381ffb640 10 client.17691 handle_command_reply: tid=0 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 client.17691 shutdown 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 -- 172.21.15.60:0/960586756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 msgr2=0x55e422285fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e422285fe0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff3880b8370 tx=0x7ff388009620 comp rx=0 tx=0).stop 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 -- 172.21.15.60:0/960586756 shutdown_connections 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e422298f30 0x55e42229b340 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e4222865d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e422285fe0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 --2- 172.21.15.60:0/960586756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422288d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 -- 172.21.15.60:0/960586756 >> 172.21.15.60:0/960586756 conn(0x55e422247310 msgr2=0x55e422280960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff381ffb640 0 client.17691 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 -- 172.21.15.60:0/960586756 shutdown_connections 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 1 -- 172.21.15.60:0/960586756 wait complete. 2024-09-12T00:08:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.441+0000 7ff3a2939740 20 client.17691 trim_cache size 0 max 16384 2024-09-12T00:08:37.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.454+0000 7ff3a2939740 1 Processor -- start 2024-09-12T00:08:37.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.454+0000 7ff3a2939740 1 -- start start 2024-09-12T00:08:37.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422295310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e42227fb40 0x55e4222858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e422289370 0x55e42227a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff3a2939740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981afb20 con 0x55e422289370 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff3a2939740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981b1660 con 0x55e42227fb40 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff3a2939740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981b01f0 con 0x55e42227e5d0 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39eafd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e422289370 0x55e42227a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39eafd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e422289370 0x55e42227a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48996/0 (socket says 172.21.15.60:48996) 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39eafd640 1 -- 172.21.15.60:0/1615876495 learned_addr learned my addr 172.21.15.60:0/1615876495 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39dafb640 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e42227fb40 0x55e4222858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422295310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39dafb640 1 -- 172.21.15.60:0/1615876495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 msgr2=0x55e422295310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39dafb640 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422295310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39dafb640 1 -- 172.21.15.60:0/1615876495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e422289370 msgr2=0x55e42227a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39dafb640 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e422289370 0x55e42227a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39dafb640 1 -- 172.21.15.60:0/1615876495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e422281120 con 0x55e42227fb40 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422295310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff39dafb640 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e42227fb40 0x55e4222858a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff3880b88e0 tx=0x7ff3880ba420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abf3bc67ede06ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff383fff640 1 -- 172.21.15.60:0/1615876495 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388049070 con 0x55e42227fb40 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff383fff640 1 -- 172.21.15.60:0/1615876495 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff3880f5240 con 0x55e42227fb40 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.455+0000 7ff383fff640 1 -- 172.21.15.60:0/1615876495 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3880bb870 con 0x55e42227fb40 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 -- 172.21.15.60:0/1615876495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e42227fb40 msgr2=0x55e4222858a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e42227fb40 0x55e4222858a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff3880b88e0 tx=0x7ff3880ba420 comp rx=0 tx=0).stop 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 -- 172.21.15.60:0/1615876495 shutdown_connections 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e422289370 0x55e42227a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e42227fb40 0x55e4222858a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 --2- 172.21.15.60:0/1615876495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e422295310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 -- 172.21.15.60:0/1615876495 >> 172.21.15.60:0/1615876495 conn(0x55e422247310 msgr2=0x55e422281310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 -- 172.21.15.60:0/1615876495 shutdown_connections 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 -- 172.21.15.60:0/1615876495 wait complete. 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 -- start start 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.456+0000 7ff3a2939740 1 Processor -- start 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e4222918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e42228cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff3a2939740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e42228d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff3a2939740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981b0f90 con 0x55e42227fb40 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff3a2939740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981b08c0 con 0x55e422289370 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff3a2939740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981adb20 con 0x55e42227e5d0 2024-09-12T00:08:37.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff3a2939740 10 client.0 _ll_register_callbacks cb 0x7ff388005e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e42228cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e42228cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49006/0 (socket says 172.21.15.60:49006) 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 -- 172.21.15.60:0/2262119527 learned_addr learned my addr 172.21.15.60:0/2262119527 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39eafd640 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e42228d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e4222918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 -- 172.21.15.60:0/2262119527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 msgr2=0x55e4222918b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e4222918b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 -- 172.21.15.60:0/2262119527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 msgr2=0x55e42228d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e42228d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 -- 172.21.15.60:0/2262119527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42228d660 con 0x55e42227fb40 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff39dafb640 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e42228cbe0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff3880b7bf0 tx=0x7ff3880c02c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50db2e5f884c31a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:37.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.457+0000 7ff381ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff381ffb640 1 -- 172.21.15.60:0/2262119527 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388049070 con 0x55e42227fb40 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff381ffb640 1 -- 172.21.15.60:0/2262119527 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7ff38803b460 con 0x55e42227fb40 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 1 -- 172.21.15.60:0/2262119527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3880f5240 con 0x55e42227fb40 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff381ffb640 1 -- 172.21.15.60:0/2262119527 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff3880b4050 con 0x55e42227fb40 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 10 client.17697 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 1 -- 172.21.15.60:0/2262119527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55e42228d660 con 0x55e42227fb40 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff381ffb640 1 -- 172.21.15.60:0/2262119527 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff3880f5240 con 0x55e42227fb40 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff381ffb640 1 -- 172.21.15.60:0/2262119527 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7ff3880a6bd0 con 0x55e42227fb40 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 10 client.17697 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 10 client.17697 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 20 client.17697 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e422303bc0 0x55e422305fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:37.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 4 client.17697 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff3a2939740 1 -- 172.21.15.60:0/2262119527 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e4221ebd70 con 0x55e422303bc0 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.458+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e422303bc0 0x55e422305fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff39e2fc640 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e422303bc0 0x55e422305fe0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ade7f739f892e457 server_cookie=4df5cd1651012292 in_seq=0 out_seq=0 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff381ffb640 10 client.17697 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff381ffb640 1 -- 172.21.15.60:0/2262119527 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e4221ebd70 con 0x55e422303bc0 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff381ffb640 10 client.17697 handle_command_reply: tid=0 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 client.17697 shutdown 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 -- 172.21.15.60:0/2262119527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 msgr2=0x55e42228cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e42228cbe0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff3880b7bf0 tx=0x7ff3880c02c0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 -- 172.21.15.60:0/2262119527 shutdown_connections 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55e422303bc0 0x55e422305fe0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e422289370 0x55e42228d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e42227fb40 0x55e42228cbe0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 --2- 172.21.15.60:0/2262119527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e42227e5d0 0x55e4222918b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 -- 172.21.15.60:0/2262119527 >> 172.21.15.60:0/2262119527 conn(0x55e422247310 msgr2=0x55e42227a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:37.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff381ffb640 0 client.17697 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:08:37.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 -- 172.21.15.60:0/2262119527 shutdown_connections 2024-09-12T00:08:37.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 1 -- 172.21.15.60:0/2262119527 wait complete. 2024-09-12T00:08:37.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.459+0000 7ff3a2939740 20 client.17697 trim_cache size 0 max 16384 2024-09-12T00:08:37.467 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 -- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff3840a2d70 msgr2=0x7ff3840a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff3840a2d70 0x7ff3840a5230 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff390009fd0 tx=0x7ff390004b50 comp rx=0 tx=0).stop 2024-09-12T00:08:37.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 -- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 msgr2=0x7ff398074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 0x7ff398074a30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7ff388006010 tx=0x7ff3880042f0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 -- 172.21.15.60:0/2096747090 shutdown_connections 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff3840a2d70 0x7ff3840a5230 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff398106f10 0x7ff398074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff398102790 0x7ff398074a30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 --2- 172.21.15.60:0/2096747090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff398101de0 0x7ff3980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 -- 172.21.15.60:0/2096747090 >> 172.21.15.60:0/2096747090 conn(0x7ff3980fd8c0 msgr2=0x7ff3980febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 -- 172.21.15.60:0/2096747090 shutdown_connections 2024-09-12T00:08:37.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:37.460+0000 7ff3a0560640 1 -- 172.21.15.60:0/2096747090 wait complete. 2024-09-12T00:08:37.478 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:37 smithi105 ceph-mon[34805]: pgmap v286: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:37 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:08:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:37 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:08:37.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:37 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:08:37.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:37 smithi192 ceph-mon[35487]: pgmap v286: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:37.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:37 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:08:37.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:37 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:08:37.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:37 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:08:38.306 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:08:38.564 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:39.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 -- 172.21.15.60:0/1179321143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264106a80 msgr2=0x7ff264106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 --2- 172.21.15.60:0/1179321143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264106a80 0x7ff264106e60 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff260009930 tx=0x7ff26002a420 comp rx=0 tx=0).stop 2024-09-12T00:08:39.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 -- 172.21.15.60:0/1179321143 shutdown_connections 2024-09-12T00:08:39.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 --2- 172.21.15.60:0/1179321143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff264101420 0x7ff26410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 --2- 172.21.15.60:0/1179321143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff264100a80 0x7ff264100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 --2- 172.21.15.60:0/1179321143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264106a80 0x7ff264106e60 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 -- 172.21.15.60:0/1179321143 >> 172.21.15.60:0/1179321143 conn(0x7ff2640fc7a0 msgr2=0x7ff2640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 -- 172.21.15.60:0/1179321143 shutdown_connections 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.042+0000 7ff26b613640 1 -- 172.21.15.60:0/1179321143 wait complete. 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff26b613640 1 Processor -- start 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff26b613640 1 -- start start 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff26b613640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264100a80 0x7ff2640fcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff26b613640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff264101420 0x7ff2640fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff26b613640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff264106a80 0x7ff2640fd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff26b613640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff264110f60 con 0x7ff264100a80 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff26b613640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff264110de0 con 0x7ff264101420 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff26b613640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641110e0 con 0x7ff264106a80 2024-09-12T00:08:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff2693af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264100a80 0x7ff2640fcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff2693af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264100a80 0x7ff2640fcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49026/0 (socket says 172.21.15.60:49026) 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.043+0000 7ff2693af640 1 -- 172.21.15.60:0/3542178389 learned_addr learned my addr 172.21.15.60:0/3542178389 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff268bae640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff264101420 0x7ff2640fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff269bb0640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff264106a80 0x7ff2640fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff2693af640 1 -- 172.21.15.60:0/3542178389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff264106a80 msgr2=0x7ff2640fd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff2693af640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff264106a80 0x7ff2640fd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff2693af640 1 -- 172.21.15.60:0/3542178389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff264101420 msgr2=0x7ff2640fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff2693af640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff264101420 0x7ff2640fd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff2693af640 1 -- 172.21.15.60:0/3542178389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2641a6a20 con 0x7ff264100a80 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff2693af640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264100a80 0x7ff2640fcdb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ff260009230 tx=0x7ff260004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff25a7fc640 1 -- 172.21.15.60:0/3542178389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26003f030 con 0x7ff264100a80 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff26b613640 1 -- 172.21.15.60:0/3542178389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2641a6cb0 con 0x7ff264100a80 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff25a7fc640 1 -- 172.21.15.60:0/3542178389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff260003af0 con 0x7ff264100a80 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff25a7fc640 1 -- 172.21.15.60:0/3542178389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260035070 con 0x7ff264100a80 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.044+0000 7ff26b613640 1 -- 172.21.15.60:0/3542178389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2641a7190 con 0x7ff264100a80 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.046+0000 7ff25a7fc640 1 -- 172.21.15.60:0/3542178389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff260042030 con 0x7ff264100a80 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff26d9ec740 1 Processor -- start 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff26d9ec740 1 -- start start 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379651c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 0x56379651ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x563796529760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5637964822f0 con 0x56379651db40 2024-09-12T00:08:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563796429cf0 con 0x563796527370 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56379647e2b0 con 0x56379651c5d0 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff269bb0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379651c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff269bb0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379651c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49038/0 (socket says 172.21.15.60:49038) 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff269bb0640 1 -- 172.21.15.60:0/2215960536 learned_addr learned my addr 172.21.15.60:0/2215960536 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.047+0000 7ff25a7fc640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2500a2cf0 0x7ff2500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff2693af640 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 0x56379651ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff268bae640 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x563796529760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff269bb0640 1 -- 172.21.15.60:0/2215960536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 msgr2=0x56379651ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff269bb0640 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 0x56379651ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff269bb0640 1 -- 172.21.15.60:0/2215960536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 msgr2=0x563796529760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff269bb0640 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x563796529760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff269bb0640 1 -- 172.21.15.60:0/2215960536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379640e3a0 con 0x56379651db40 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff269bb0640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2500a2cf0 0x7ff2500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff25a7fc640 1 -- 172.21.15.60:0/3542178389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7ff2600efd10 con 0x7ff264100a80 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff269bb0640 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379651c090 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009fc0 tx=0x7ff25c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ee38844bc876d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff24f7fe640 1 -- 172.21.15.60:0/2215960536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c01c900 con 0x56379651db40 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff24f7fe640 1 -- 172.21.15.60:0/2215960536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff25c01b3d0 con 0x56379651db40 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.048+0000 7ff24f7fe640 1 -- 172.21.15.60:0/2215960536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c026680 con 0x56379651db40 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff269bb0640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2500a2cf0 0x7ff2500a51b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff25c020000 tx=0x7ff25c01d000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2215960536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 msgr2=0x56379651c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379651c090 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009fc0 tx=0x7ff25c010800 comp rx=0 tx=0).stop 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2215960536 shutdown_connections 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x563796529760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 0x56379651ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2215960536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379651c090 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2215960536 >> 172.21.15.60:0/2215960536 conn(0x5637964e5310 msgr2=0x563796518c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2215960536 shutdown_connections 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2215960536 wait complete. 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 -- start start 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.049+0000 7ff26d9ec740 1 Processor -- start 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56379651c5d0 0x563796526d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x563796523fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563796527370 0x563796524570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56379652a070 con 0x56379651db40 2024-09-12T00:08:39.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56379643d060 con 0x56379651c5d0 2024-09-12T00:08:39.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56379652a1f0 con 0x563796527370 2024-09-12T00:08:39.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff26d9ec740 10 client.0 _ll_register_callbacks cb 0x5637961908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:39.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff268bae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x563796523fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff268bae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x563796523fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49040/0 (socket says 172.21.15.60:49040) 2024-09-12T00:08:39.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff268bae640 1 -- 172.21.15.60:0/2715595908 learned_addr learned my addr 172.21.15.60:0/2715595908 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff2693af640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56379651c5d0 0x563796526d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff269bb0640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563796527370 0x563796524570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff268bae640 1 -- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563796527370 msgr2=0x563796524570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff268bae640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563796527370 0x563796524570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff268bae640 1 -- 172.21.15.60:0/2715595908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56379651c5d0 msgr2=0x563796526d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff268bae640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56379651c5d0 0x563796526d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff268bae640 1 -- 172.21.15.60:0/2715595908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637961f33c0 con 0x56379651db40 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff2693af640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56379651c5d0 0x563796526d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.050+0000 7ff269bb0640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563796527370 0x563796524570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff268bae640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x563796523fd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ff254010740 tx=0x7ff254010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8913ecb2d221a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff24cff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff24cff9640 1 -- 172.21.15.60:0/2715595908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25400cd20 con 0x56379651db40 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff24cff9640 1 -- 172.21.15.60:0/2715595908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7ff254011440 con 0x56379651db40 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2715595908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff25c01b3d0 con 0x56379651db40 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff24cff9640 1 -- 172.21.15.60:0/2715595908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff254010e50 con 0x56379651db40 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 10 client.17709 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2715595908 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563796535b70 con 0x56379651db40 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff24cff9640 1 -- 172.21.15.60:0/2715595908 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff25c01b3d0 con 0x56379651db40 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff24cff9640 1 -- 172.21.15.60:0/2715595908 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7ff254022020 con 0x56379651db40 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 10 client.17709 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 10 client.17709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 20 client.17709 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563796536fd0 0x563796539410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 4 client.17709 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.051+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2715595908 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56379648f860 con 0x563796536fd0 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.052+0000 7ff2693af640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563796536fd0 0x563796539410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.052+0000 7ff24cff9640 10 client.17709 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.052+0000 7ff2693af640 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563796536fd0 0x563796539410 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3a8bbf9c6fa09be server_cookie=2fc82e8d3fb05011 in_seq=0 out_seq=0 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff24cff9640 1 -- 172.21.15.60:0/2715595908 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56379648f860 con 0x563796536fd0 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff24cff9640 10 client.17709 handle_command_reply: tid=0 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 client.17709 shutdown 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2715595908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 msgr2=0x563796523fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x563796523fd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ff254010740 tx=0x7ff254010c00 comp rx=0 tx=0).stop 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2715595908 shutdown_connections 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563796536fd0 0x563796539410 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563796527370 0x563796524570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x563796523fd0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/2715595908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56379651c5d0 0x563796526d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2715595908 >> 172.21.15.60:0/2715595908 conn(0x5637964e5310 msgr2=0x56379651e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff24cff9640 0 client.17709 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2715595908 shutdown_connections 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 1 -- 172.21.15.60:0/2715595908 wait complete. 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.053+0000 7ff26d9ec740 20 client.17709 trim_cache size 0 max 16384 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.066+0000 7ff26d9ec740 1 Processor -- start 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.066+0000 7ff26d9ec740 1 -- start start 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.066+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651c5d0 0x563796533310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.066+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651db40 0x56379651f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.066+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379651f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.066+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641afa20 con 0x56379651c5d0 2024-09-12T00:08:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.066+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641b1560 con 0x563796527370 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.066+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641b00f0 con 0x56379651db40 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651c5d0 0x563796533310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651c5d0 0x563796533310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49046/0 (socket says 172.21.15.60:49046) 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 -- 172.21.15.60:0/3134897892 learned_addr learned my addr 172.21.15.60:0/3134897892 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff269bb0640 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379651f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff268bae640 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651db40 0x56379651f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 -- 172.21.15.60:0/3134897892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651db40 msgr2=0x56379651f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651db40 0x56379651f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 -- 172.21.15.60:0/3134897892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 msgr2=0x56379651f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379651f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 -- 172.21.15.60:0/3134897892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563796517310 con 0x56379651c5d0 2024-09-12T00:08:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff269bb0640 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379651f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff2693af640 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651c5d0 0x563796533310 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff2600096c0 tx=0x7ff2600c0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68334c375ed5e006 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff24effd640 1 -- 172.21.15.60:0/3134897892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260049040 con 0x56379651c5d0 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff24effd640 1 -- 172.21.15.60:0/3134897892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2600c0660 con 0x56379651c5d0 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.067+0000 7ff24effd640 1 -- 172.21.15.60:0/3134897892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26003b580 con 0x56379651c5d0 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 -- 172.21.15.60:0/3134897892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651c5d0 msgr2=0x563796533310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651c5d0 0x563796533310 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff2600096c0 tx=0x7ff2600c0040 comp rx=0 tx=0).stop 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 -- 172.21.15.60:0/3134897892 shutdown_connections 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379651f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651db40 0x56379651f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/3134897892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651c5d0 0x563796533310 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 -- 172.21.15.60:0/3134897892 >> 172.21.15.60:0/3134897892 conn(0x5637964e5310 msgr2=0x563796519730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 -- 172.21.15.60:0/3134897892 shutdown_connections 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 -- 172.21.15.60:0/3134897892 wait complete. 2024-09-12T00:08:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 -- start start 2024-09-12T00:08:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.068+0000 7ff26d9ec740 1 Processor -- start 2024-09-12T00:08:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 0x56379652f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379652fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff26d9ec740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379652aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641b0e90 con 0x56379651db40 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641b07c0 con 0x563796527370 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff26d9ec740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641ada20 con 0x56379651c5d0 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff26d9ec740 10 client.0 _ll_register_callbacks cb 0x7ff25400e390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff268bae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379652fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff268bae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379652fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49060/0 (socket says 172.21.15.60:49060) 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff268bae640 1 -- 172.21.15.60:0/476698075 learned_addr learned my addr 172.21.15.60:0/476698075 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff269bb0640 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379652aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff2693af640 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 0x56379652f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff268bae640 1 -- 172.21.15.60:0/476698075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 msgr2=0x56379652f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff268bae640 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 0x56379652f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff268bae640 1 -- 172.21.15.60:0/476698075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 msgr2=0x56379652aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff268bae640 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379652aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.069+0000 7ff268bae640 1 -- 172.21.15.60:0/476698075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379652b310 con 0x56379651db40 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff268bae640 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379652fc90 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff254011010 tx=0x7ff254024710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4a22abbd2e85fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff24cff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff24cff9640 1 -- 172.21.15.60:0/476698075 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25400c700 con 0x56379651db40 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff24cff9640 1 -- 172.21.15.60:0/476698075 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7ff254005040 con 0x56379651db40 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 1 -- 172.21.15.60:0/476698075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2600c0660 con 0x56379651db40 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff24cff9640 1 -- 172.21.15.60:0/476698075 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff25400e560 con 0x56379651db40 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 10 client.17715 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 1 -- 172.21.15.60:0/476698075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5637965a17a0 con 0x56379651db40 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff24cff9640 1 -- 172.21.15.60:0/476698075 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2600c0660 con 0x56379651db40 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff24cff9640 1 -- 172.21.15.60:0/476698075 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7ff254022050 con 0x56379651db40 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 10 client.17715 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 10 client.17715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 20 client.17715 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5637965a1f70 0x5637965a4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 4 client.17715 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.070+0000 7ff26d9ec740 1 -- 172.21.15.60:0/476698075 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563796489d70 con 0x5637965a1f70 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff2693af640 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5637965a1f70 0x5637965a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff2693af640 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5637965a1f70 0x5637965a4390 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6688bdf29cbbb104 server_cookie=eb9391fa1c5ee40b in_seq=0 out_seq=0 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff24cff9640 10 client.17715 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff24cff9640 1 -- 172.21.15.60:0/476698075 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563796489d70 con 0x5637965a1f70 2024-09-12T00:08:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff24cff9640 10 client.17715 handle_command_reply: tid=0 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 client.17715 shutdown 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 -- 172.21.15.60:0/476698075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 msgr2=0x56379652fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379652fc90 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff254011010 tx=0x7ff254024710 comp rx=0 tx=0).stop 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 -- 172.21.15.60:0/476698075 shutdown_connections 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5637965a1f70 0x5637965a4390 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff24cff9640 0 client.17715 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563796527370 0x56379652aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56379651db40 0x56379652fc90 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 --2- 172.21.15.60:0/476698075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56379651c5d0 0x56379652f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.071+0000 7ff26d9ec740 1 -- 172.21.15.60:0/476698075 >> 172.21.15.60:0/476698075 conn(0x5637964e5310 msgr2=0x5637965228a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26d9ec740 1 -- 172.21.15.60:0/476698075 shutdown_connections 2024-09-12T00:08:39.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26d9ec740 1 -- 172.21.15.60:0/476698075 wait complete. 2024-09-12T00:08:39.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26d9ec740 20 client.17715 trim_cache size 0 max 16384 2024-09-12T00:08:39.089 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:08:39.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 -- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2500a2cf0 msgr2=0x7ff2500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2500a2cf0 0x7ff2500a51b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff25c020000 tx=0x7ff25c01d000 comp rx=0 tx=0).stop 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 -- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264100a80 msgr2=0x7ff2640fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264100a80 0x7ff2640fcdb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ff260009230 tx=0x7ff260004270 comp rx=0 tx=0).stop 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 -- 172.21.15.60:0/3542178389 shutdown_connections 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7ff2500a2cf0 0x7ff2500a51b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff264106a80 0x7ff2640fd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff264101420 0x7ff2640fd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 --2- 172.21.15.60:0/3542178389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff264100a80 0x7ff2640fcdb0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 -- 172.21.15.60:0/3542178389 >> 172.21.15.60:0/3542178389 conn(0x7ff2640fc7a0 msgr2=0x7ff26406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 -- 172.21.15.60:0/3542178389 shutdown_connections 2024-09-12T00:08:39.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:39.072+0000 7ff26b613640 1 -- 172.21.15.60:0/3542178389 wait complete. 2024-09-12T00:08:39.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:39 smithi060 ceph-mon[30953]: pgmap v287: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:39.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:39 smithi105 ceph-mon[34805]: pgmap v287: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:39.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:39 smithi192 ceph-mon[35487]: pgmap v287: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:40.930 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:08:40.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:08:41.203 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:41.325 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:41 smithi060 ceph-mon[30953]: pgmap v288: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:41.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:41 smithi105 ceph-mon[34805]: pgmap v288: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:41.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:41 smithi192 ceph-mon[35487]: pgmap v288: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 -- 172.21.15.60:0/954980236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8106f10 msgr2=0x7f40d810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/954980236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8106f10 0x7f40d810ea90 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009900 tx=0x7f40c802a410 comp rx=0 tx=0).stop 2024-09-12T00:08:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 -- 172.21.15.60:0/954980236 shutdown_connections 2024-09-12T00:08:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/954980236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8106f10 0x7f40d810ea90 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/954980236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40d8102790 0x7f40d81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/954980236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d8101de0 0x7f40d81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 -- 172.21.15.60:0/954980236 >> 172.21.15.60:0/954980236 conn(0x7f40d80fd8c0 msgr2=0x7f40d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 -- 172.21.15.60:0/954980236 shutdown_connections 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.647+0000 7f40dd8b4640 1 -- 172.21.15.60:0/954980236 wait complete. 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40dd8b4640 1 Processor -- start 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40dd8b4640 1 -- start start 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40dd8b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8101de0 0x7f40d8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40dd8b4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d8102790 0x7f40d8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40dd8b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40d8106f10 0x7f40d819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40dd8b4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8112090 con 0x7f40d8101de0 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40dd8b4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8111f10 con 0x7f40d8106f10 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40dd8b4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8112210 con 0x7f40d8102790 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40d6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8101de0 0x7f40d8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40d6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8101de0 0x7f40d8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44402/0 (socket says 172.21.15.60:44402) 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40d6ffd640 1 -- 172.21.15.60:0/1290659848 learned_addr learned my addr 172.21.15.60:0/1290659848 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40d67fc640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d8102790 0x7f40d8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.648+0000 7f40d77fe640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40d8106f10 0x7f40d819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40d6ffd640 1 -- 172.21.15.60:0/1290659848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d8102790 msgr2=0x7f40d8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d8102790 0x7f40d8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40d6ffd640 1 -- 172.21.15.60:0/1290659848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40d8106f10 msgr2=0x7f40d819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40d8106f10 0x7f40d819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40d6ffd640 1 -- 172.21.15.60:0/1290659848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d819d400 con 0x7f40d8101de0 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40d77fe640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40d8106f10 0x7f40d819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8101de0 0x7f40d8198450 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f40d000eab0 tx=0x7f40d000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40dc8b2640 1 -- 172.21.15.60:0/1290659848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d000ce40 con 0x7f40d8101de0 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40dc8b2640 1 -- 172.21.15.60:0/1290659848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40d0011970 con 0x7f40d8101de0 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40dd8b4640 1 -- 172.21.15.60:0/1290659848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d819d6f0 con 0x7f40d8101de0 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40dc8b2640 1 -- 172.21.15.60:0/1290659848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0010bb0 con 0x7f40d8101de0 2024-09-12T00:08:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.649+0000 7f40dd8b4640 1 -- 172.21.15.60:0/1290659848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d81a4fd0 con 0x7f40d8101de0 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.651+0000 7f40dc8b2640 1 -- 172.21.15.60:0/1290659848 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f40d0010d50 con 0x7f40d8101de0 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dfc8d740 1 Processor -- start 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dfc8d740 1 -- start start 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c4ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c59800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cfa3bb4280 con 0x55cfa3c59d40 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cfa3b5bb10 con 0x55cfa3c4f480 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cfa3bb0240 con 0x55cfa3c4eb60 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44414/0 (socket says 172.21.15.60:44414) 2024-09-12T00:08:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40d67fc640 1 -- 172.21.15.60:0/1627549550 learned_addr learned my addr 172.21.15.60:0/1627549550 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40d77fe640 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c4ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c59800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40dc8b2640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f40c40a2cf0 0x7f40c40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.652+0000 7f40d67fc640 1 -- 172.21.15.60:0/1627549550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 msgr2=0x55cfa3c4ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40d67fc640 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c4ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40d67fc640 1 -- 172.21.15.60:0/1627549550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 msgr2=0x55cfa3c59800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40d67fc640 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c59800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40d67fc640 1 -- 172.21.15.60:0/1627549550 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa3b681f0 con 0x55cfa3c59d40 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40d77fe640 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c4ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40d77fe640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f40c40a2cf0 0x7f40c40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40dc8b2640 1 -- 172.21.15.60:0/1290659848 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f40d00cfab0 con 0x7f40d8101de0 2024-09-12T00:08:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40d67fc640 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5c130 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f40c000bc30 tx=0x7f40c00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4e73211d98d27e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40cdffb640 1 -- 172.21.15.60:0/1627549550 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c001c480 con 0x55cfa3c59d40 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40cdffb640 1 -- 172.21.15.60:0/1627549550 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40c001cb20 con 0x55cfa3c59d40 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.653+0000 7f40cdffb640 1 -- 172.21.15.60:0/1627549550 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0011bc0 con 0x55cfa3c59d40 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1627549550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c59d40 msgr2=0x55cfa3c5c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40d77fe640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f40c40a2cf0 0x7f40c40a51b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f40c80315e0 tx=0x7f40c8009260 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5c130 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f40c000bc30 tx=0x7f40c00107a0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1627549550 shutdown_connections 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5c130 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c59800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1627549550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c4ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1627549550 >> 172.21.15.60:0/1627549550 conn(0x55cfa3c4b0f0 msgr2=0x55cfa3c4b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1627549550 shutdown_connections 2024-09-12T00:08:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1627549550 wait complete. 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.654+0000 7f40dfc8d740 1 -- start start 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40dfc8d740 1 Processor -- start 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c56bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c57110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c59d40 0x55cfa3c57650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cfa3c5c910 con 0x55cfa3c4eb60 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55cfa3b6ef10 con 0x55cfa3c4f480 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cfa3c5ca90 con 0x55cfa3c59d40 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40dfc8d740 10 client.0 _ll_register_callbacks cb 0x55cfa3b37a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c56bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c56bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44416/0 (socket says 172.21.15.60:44416) 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d6ffd640 1 -- 172.21.15.60:0/3350242253 learned_addr learned my addr 172.21.15.60:0/3350242253 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d67fc640 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c57110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d77fe640 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c59d40 0x55cfa3c57650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d6ffd640 1 -- 172.21.15.60:0/3350242253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c59d40 msgr2=0x55cfa3c57650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c59d40 0x55cfa3c57650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d6ffd640 1 -- 172.21.15.60:0/3350242253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 msgr2=0x55cfa3c57110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c57110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d6ffd640 1 -- 172.21.15.60:0/3350242253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa39256a0 con 0x55cfa3c4eb60 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.655+0000 7f40d67fc640 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c57110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c56bd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f40d00cd220 tx=0x7f40d0098600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d53ce117ce187b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40b6ffd640 1 -- 172.21.15.60:0/3350242253 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d009bad0 con 0x55cfa3c4eb60 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40b6ffd640 1 -- 172.21.15.60:0/3350242253 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f40d00badd0 con 0x55cfa3c4eb60 2024-09-12T00:08:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 1 -- 172.21.15.60:0/3350242253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40c001cb20 con 0x55cfa3c4eb60 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40b6ffd640 1 -- 172.21.15.60:0/3350242253 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f40d00cd650 con 0x55cfa3c4eb60 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 10 client.17727 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 1 -- 172.21.15.60:0/3350242253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55cfa3c68520 con 0x55cfa3c4eb60 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40b6ffd640 1 -- 172.21.15.60:0/3350242253 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40c001cb20 con 0x55cfa3c4eb60 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40b6ffd640 1 -- 172.21.15.60:0/3350242253 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f40d000f040 con 0x55cfa3c4eb60 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 10 client.17727 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 10 client.17727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 20 client.17727 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cfa3c69930 0x55cfa3c6bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 4 client.17727 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.656+0000 7f40dfc8d740 1 -- 172.21.15.60:0/3350242253 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfa3bc17f0 con 0x55cfa3c69930 2024-09-12T00:08:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.657+0000 7f40d67fc640 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cfa3c69930 0x55cfa3c6bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.657+0000 7f40d67fc640 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cfa3c69930 0x55cfa3c6bd60 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1bcad956d607138 server_cookie=75d3a4295c30719a in_seq=0 out_seq=0 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.657+0000 7f40b6ffd640 10 client.17727 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40b6ffd640 1 -- 172.21.15.60:0/3350242253 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfa3bc17f0 con 0x55cfa3c69930 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40b6ffd640 10 client.17727 handle_command_reply: tid=0 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 client.17727 shutdown 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 -- 172.21.15.60:0/3350242253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4eb60 msgr2=0x55cfa3c56bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c56bd0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f40d00cd220 tx=0x7f40d0098600 comp rx=0 tx=0).stop 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 -- 172.21.15.60:0/3350242253 shutdown_connections 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cfa3c69930 0x55cfa3c6bd60 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c59d40 0x55cfa3c57650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c4f480 0x55cfa3c57110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/3350242253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c56bd0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40b6ffd640 0 client.17727 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.658+0000 7f40dfc8d740 1 -- 172.21.15.60:0/3350242253 >> 172.21.15.60:0/3350242253 conn(0x55cfa3c4b0f0 msgr2=0x55cfa3c50dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.659+0000 7f40dfc8d740 1 -- 172.21.15.60:0/3350242253 shutdown_connections 2024-09-12T00:08:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.659+0000 7f40dfc8d740 1 -- 172.21.15.60:0/3350242253 wait complete. 2024-09-12T00:08:41.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.659+0000 7f40dfc8d740 20 client.17727 trim_cache size 0 max 16384 2024-09-12T00:08:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40dfc8d740 1 Processor -- start 2024-09-12T00:08:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40dfc8d740 1 -- start start 2024-09-12T00:08:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c50cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c71b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81ad850 con 0x55cfa3c4f480 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81af390 con 0x55cfa3c59d40 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81adf20 con 0x55cfa3c4eb60 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44428/0 (socket says 172.21.15.60:44428) 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.676+0000 7f40d67fc640 1 -- 172.21.15.60:0/4267174001 learned_addr learned my addr 172.21.15.60:0/4267174001 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c50cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d67fc640 1 -- 172.21.15.60:0/4267174001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 msgr2=0x55cfa3c50cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d77fe640 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c71b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d67fc640 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c50cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d67fc640 1 -- 172.21.15.60:0/4267174001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 msgr2=0x55cfa3c71b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d67fc640 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c71b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d67fc640 1 -- 172.21.15.60:0/4267174001 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfa3c4af20 con 0x55cfa3c4f480 2024-09-12T00:08:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c50cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d77fe640 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c71b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:08:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40d67fc640 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c715d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000c00 tx=0x7f40c0013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c02188a2b2d69c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40cd7fa640 1 -- 172.21.15.60:0/4267174001 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c0005040 con 0x55cfa3c4f480 2024-09-12T00:08:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40cd7fa640 1 -- 172.21.15.60:0/4267174001 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40c001c480 con 0x55cfa3c4f480 2024-09-12T00:08:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.677+0000 7f40cd7fa640 1 -- 172.21.15.60:0/4267174001 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c00048e0 con 0x55cfa3c4f480 2024-09-12T00:08:41.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 -- 172.21.15.60:0/4267174001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 msgr2=0x55cfa3c715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c715d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000c00 tx=0x7f40c0013040 comp rx=0 tx=0).stop 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 -- 172.21.15.60:0/4267174001 shutdown_connections 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c71b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c715d0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/4267174001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c50cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 -- 172.21.15.60:0/4267174001 >> 172.21.15.60:0/4267174001 conn(0x55cfa3c4b0f0 msgr2=0x55cfa3c505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 -- 172.21.15.60:0/4267174001 shutdown_connections 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 -- 172.21.15.60:0/4267174001 wait complete. 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 -- start start 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.678+0000 7f40dfc8d740 1 Processor -- start 2024-09-12T00:08:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c61cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c62230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40dfc8d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81aecc0 con 0x55cfa3c4f480 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81ae5f0 con 0x55cfa3c59d40 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40dfc8d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81ab850 con 0x55cfa3c4eb60 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40dfc8d740 10 client.0 _ll_register_callbacks cb 0x7f40d00103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c62230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c62230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44438/0 (socket says 172.21.15.60:44438) 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 -- 172.21.15.60:0/1810396282 learned_addr learned my addr 172.21.15.60:0/1810396282 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d77fe640 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c61cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 -- 172.21.15.60:0/1810396282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 msgr2=0x55cfa3c61cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c61cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 -- 172.21.15.60:0/1810396282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 msgr2=0x55cfa3c5cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 -- 172.21.15.60:0/1810396282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfa3c5d1e0 con 0x55cfa3c4f480 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40d67fc640 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c62230 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f40c0010ca0 tx=0x7f40c000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82016a05cdabc6fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.679+0000 7f40b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40b6ffd640 1 -- 172.21.15.60:0/1810396282 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c001cb00 con 0x55cfa3c4f480 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40b6ffd640 1 -- 172.21.15.60:0/1810396282 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7f40c0005040 con 0x55cfa3c4f480 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1810396282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40c001c480 con 0x55cfa3c4f480 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40b6ffd640 1 -- 172.21.15.60:0/1810396282 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f40c0005240 con 0x55cfa3c4f480 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 10 client.17733 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1810396282 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55cfa3cd4d10 con 0x55cfa3c4f480 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40b6ffd640 1 -- 172.21.15.60:0/1810396282 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40c001c480 con 0x55cfa3c4f480 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40b6ffd640 1 -- 172.21.15.60:0/1810396282 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f40c0030070 con 0x55cfa3c4f480 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 10 client.17733 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 10 client.17733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 20 client.17733 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cfa3cd5220 0x55cfa3cd7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 4 client.17733 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.680+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1810396282 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cfa3bbbd00 con 0x55cfa3cd5220 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.681+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cfa3cd5220 0x55cfa3cd7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.681+0000 7f40d6ffd640 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cfa3cd5220 0x55cfa3cd7610 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d60bad81d9442e0 server_cookie=c72f8817e664fbbe in_seq=0 out_seq=0 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.681+0000 7f40b6ffd640 10 client.17733 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:41.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40b6ffd640 1 -- 172.21.15.60:0/1810396282 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cfa3bbbd00 con 0x55cfa3cd5220 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40b6ffd640 10 client.17733 handle_command_reply: tid=0 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 client.17733 shutdown 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1810396282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 msgr2=0x55cfa3c62230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c62230 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f40c0010ca0 tx=0x7f40c000bea0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1810396282 shutdown_connections 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55cfa3cd5220 0x55cfa3cd7610 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55cfa3c59d40 0x55cfa3c5cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cfa3c4f480 0x55cfa3c62230 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 --2- 172.21.15.60:0/1810396282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cfa3c4eb60 0x55cfa3c61cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1810396282 >> 172.21.15.60:0/1810396282 conn(0x55cfa3c4b0f0 msgr2=0x55cfa3c4a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40b6ffd640 0 client.17733 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1810396282 shutdown_connections 2024-09-12T00:08:41.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 1 -- 172.21.15.60:0/1810396282 wait complete. 2024-09-12T00:08:41.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.682+0000 7f40dfc8d740 20 client.17733 trim_cache size 0 max 16384 2024-09-12T00:08:41.688 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:08:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:08:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "6c099353-78d1-43e2-89da-2d456f89342e", 2024-09-12T00:08:41.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:08:41.688 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:08:41.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 -- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f40c40a2cf0 msgr2=0x7f40c40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f40c40a2cf0 0x7f40c40a51b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f40c80315e0 tx=0x7f40c8009260 comp rx=0 tx=0).stop 2024-09-12T00:08:41.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 -- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8101de0 msgr2=0x7f40d8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:41.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8101de0 0x7f40d8198450 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f40d000eab0 tx=0x7f40d000ef70 comp rx=0 tx=0).stop 2024-09-12T00:08:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 -- 172.21.15.60:0/1290659848 shutdown_connections 2024-09-12T00:08:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f40c40a2cf0 0x7f40c40a51b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40d8106f10 0x7f40d819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40d8102790 0x7f40d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 --2- 172.21.15.60:0/1290659848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d8101de0 0x7f40d8198450 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 -- 172.21.15.60:0/1290659848 >> 172.21.15.60:0/1290659848 conn(0x7f40d80fd8c0 msgr2=0x7f40d80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:41.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 -- 172.21.15.60:0/1290659848 shutdown_connections 2024-09-12T00:08:41.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:41.683+0000 7f40dd8b4640 1 -- 172.21.15.60:0/1290659848 wait complete. 2024-09-12T00:08:42.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:42 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:08:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:42 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:08:42.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:42 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:42 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:08:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:42 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:08:42.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:42 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:42.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:08:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:42 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:08:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:42 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:08:42.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:42 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:08:42.756 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:08:43.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 -- 172.21.15.60:0/2864627743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 msgr2=0x7fa0541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 --2- 172.21.15.60:0/2864627743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 0x7fa0541067e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa048009900 tx=0x7fa04802a410 comp rx=0 tx=0).stop 2024-09-12T00:08:43.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 -- 172.21.15.60:0/2864627743 shutdown_connections 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 --2- 172.21.15.60:0/2864627743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa054106f10 0x7fa05410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 --2- 172.21.15.60:0/2864627743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 0x7fa0541067e0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 --2- 172.21.15.60:0/2864627743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa054101de0 0x7fa0541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 -- 172.21.15.60:0/2864627743 >> 172.21.15.60:0/2864627743 conn(0x7fa0540fd8c0 msgr2=0x7fa0540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 -- 172.21.15.60:0/2864627743 shutdown_connections 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.206+0000 7fa05a61e640 1 -- 172.21.15.60:0/2864627743 wait complete. 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.207+0000 7fa05a61e640 1 Processor -- start 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa05a61e640 1 -- start start 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa05a61e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa054101de0 0x7fa054198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa05a61e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 0x7fa054198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa05a61e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa054106f10 0x7fa05419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa05a61e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0541120a0 con 0x7fa054102790 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa05a61e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa054111f20 con 0x7fa054106f10 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa05a61e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa054112220 con 0x7fa054101de0 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa0537fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 0x7fa054198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa0537fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 0x7fa054198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44456/0 (socket says 172.21.15.60:44456) 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa0537fe640 1 -- 172.21.15.60:0/348520743 learned_addr learned my addr 172.21.15.60:0/348520743 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa053fff640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa054101de0 0x7fa054198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa058bbb640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa054106f10 0x7fa05419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa0537fe640 1 -- 172.21.15.60:0/348520743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa054101de0 msgr2=0x7fa054198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa0537fe640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa054101de0 0x7fa054198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa0537fe640 1 -- 172.21.15.60:0/348520743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa054106f10 msgr2=0x7fa05419ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa0537fe640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa054106f10 0x7fa05419ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.208+0000 7fa0537fe640 1 -- 172.21.15.60:0/348520743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05419d530 con 0x7fa054102790 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.209+0000 7fa0537fe640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 0x7fa054198ac0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa048004770 tx=0x7fa048032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.209+0000 7fa0517fa640 1 -- 172.21.15.60:0/348520743 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04803f030 con 0x7fa054102790 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.209+0000 7fa05a61e640 1 -- 172.21.15.60:0/348520743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05419d7c0 con 0x7fa054102790 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.209+0000 7fa0517fa640 1 -- 172.21.15.60:0/348520743 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa048003d00 con 0x7fa054102790 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.209+0000 7fa0517fa640 1 -- 172.21.15.60:0/348520743 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048035070 con 0x7fa054102790 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.209+0000 7fa05a61e640 1 -- 172.21.15.60:0/348520743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0541a5100 con 0x7fa054102790 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.211+0000 7fa0517fa640 1 -- 172.21.15.60:0/348520743 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa048042030 con 0x7fa054102790 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa05c9f7740 1 Processor -- start 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa0517fa640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa03c0a2cf0 0x7fa03c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa05c9f7740 1 -- start start 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa058bbb640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa03c0a2cf0 0x7fa03c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa0517fa640 1 -- 172.21.15.60:0/348520743 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7fa0480ef8c0 con 0x7fa054102790 2024-09-12T00:08:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b643a0 0x563da2b64780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b73550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b73a90 0x563da2b75e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563da2aca2e0 con 0x563da2b73a90 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563da2a71ce0 con 0x563da2b643a0 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.212+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563da2ac62a0 con 0x563da2b64cc0 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b73a90 0x563da2b75e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b73a90 0x563da2b75e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44472/0 (socket says 172.21.15.60:44472) 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 -- 172.21.15.60:0/18799620 learned_addr learned my addr 172.21.15.60:0/18799620 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa0537fe640 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b73550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa053fff640 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b643a0 0x563da2b64780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa03c0a2cf0 0x7fa03c0a51b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005fd0 tx=0x7fa04c010740 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:43.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 -- 172.21.15.60:0/18799620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 msgr2=0x563da2b73550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b73550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 -- 172.21.15.60:0/18799620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b643a0 msgr2=0x563da2b64780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b643a0 0x563da2b64780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 -- 172.21.15.60:0/18799620 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563da2a56440 con 0x563da2b73a90 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa0537fe640 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b73550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa058bbb640 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b73a90 0x563da2b75e80 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fa04c013790 tx=0x7fa04c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6923d315b997165 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa03a7fc640 1 -- 172.21.15.60:0/18799620 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c003970 con 0x563da2b73a90 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa03a7fc640 1 -- 172.21.15.60:0/18799620 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa04c01cdc0 con 0x563da2b73a90 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.213+0000 7fa03a7fc640 1 -- 172.21.15.60:0/18799620 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c004680 con 0x563da2b73a90 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 -- 172.21.15.60:0/18799620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b73a90 msgr2=0x563da2b75e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b73a90 0x563da2b75e80 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fa04c013790 tx=0x7fa04c01b000 comp rx=0 tx=0).stop 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 -- 172.21.15.60:0/18799620 shutdown_connections 2024-09-12T00:08:43.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b73a90 0x563da2b75e80 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b73550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/18799620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b643a0 0x563da2b64780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 -- 172.21.15.60:0/18799620 >> 172.21.15.60:0/18799620 conn(0x563da2b60a30 msgr2=0x563da2b60e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 -- 172.21.15.60:0/18799620 shutdown_connections 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.214+0000 7fa05c9f7740 1 -- 172.21.15.60:0/18799620 wait complete. 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 1 -- start start 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 1 Processor -- start 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b73440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b70c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563da2b766c0 con 0x563da2b643a0 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563da2a85050 con 0x563da2b73a90 2024-09-12T00:08:43.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563da2b76840 con 0x563da2b64cc0 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa05c9f7740 10 client.0 _ll_register_callbacks cb 0x563da2ac5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa053fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b73440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa053fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b73440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44474/0 (socket says 172.21.15.60:44474) 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa053fff640 1 -- 172.21.15.60:0/4183217366 learned_addr learned my addr 172.21.15.60:0/4183217366 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.215+0000 7fa0537fe640 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa053fff640 1 -- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 msgr2=0x563da2b706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa053fff640 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa053fff640 1 -- 172.21.15.60:0/4183217366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 msgr2=0x563da2b70c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa053fff640 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b70c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa053fff640 1 -- 172.21.15.60:0/4183217366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563da283b3c0 con 0x563da2b643a0 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa0537fe640 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa053fff640 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b73440 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa04400ba80 tx=0x7fa04400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44182a078c7f491d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:43.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa0337fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:43.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa0337fe640 1 -- 172.21.15.60:0/4183217366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044003e80 con 0x563da2b643a0 2024-09-12T00:08:43.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa0337fe640 1 -- 172.21.15.60:0/4183217366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7fa044011440 con 0x563da2b643a0 2024-09-12T00:08:43.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa05c9f7740 1 -- 172.21.15.60:0/4183217366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa04c01cdc0 con 0x563da2b643a0 2024-09-12T00:08:43.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.216+0000 7fa0337fe640 1 -- 172.21.15.60:0/4183217366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fa044011680 con 0x563da2b643a0 2024-09-12T00:08:43.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.217+0000 7fa05c9f7740 10 client.17745 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:43.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.217+0000 7fa05c9f7740 1 -- 172.21.15.60:0/4183217366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563da2b82170 con 0x563da2b643a0 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa0337fe640 1 -- 172.21.15.60:0/4183217366 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa04c01cdc0 con 0x563da2b643a0 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa0337fe640 1 -- 172.21.15.60:0/4183217366 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fa044022070 con 0x563da2b643a0 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa05c9f7740 10 client.17745 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa05c9f7740 10 client.17745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa05c9f7740 20 client.17745 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563da2b83630 0x563da2b85af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa05c9f7740 4 client.17745 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa05c9f7740 1 -- 172.21.15.60:0/4183217366 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563da2ad7850 con 0x563da2b83630 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.220+0000 7fa0537fe640 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563da2b83630 0x563da2b85af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.221+0000 7fa0537fe640 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563da2b83630 0x563da2b85af0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73a611ba69154e48 server_cookie=4c1b77ca0e3e530e in_seq=0 out_seq=0 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.221+0000 7fa0337fe640 10 client.17745 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.221+0000 7fa0337fe640 1 -- 172.21.15.60:0/4183217366 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563da2ad7850 con 0x563da2b83630 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.221+0000 7fa0337fe640 10 client.17745 handle_command_reply: tid=0 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.221+0000 7fa05c9f7740 1 client.17745 shutdown 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 -- 172.21.15.60:0/4183217366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 msgr2=0x563da2b73440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b73440 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa04400ba80 tx=0x7fa04400be80 comp rx=0 tx=0).stop 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 -- 172.21.15.60:0/4183217366 shutdown_connections 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563da2b83630 0x563da2b85af0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b70c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/4183217366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b73440 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 -- 172.21.15.60:0/4183217366 >> 172.21.15.60:0/4183217366 conn(0x563da2b60a30 msgr2=0x563da2b66790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa0337fe640 0 client.17745 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 -- 172.21.15.60:0/4183217366 shutdown_connections 2024-09-12T00:08:43.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 1 -- 172.21.15.60:0/4183217366 wait complete. 2024-09-12T00:08:43.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.222+0000 7fa05c9f7740 20 client.17745 trim_cache size 0 max 16384 2024-09-12T00:08:43.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.239+0000 7fa05c9f7740 1 Processor -- start 2024-09-12T00:08:43.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.239+0000 7fa05c9f7740 1 -- start start 2024-09-12T00:08:43.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.239+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b7f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.239+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b6ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b66680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0541ab6c0 con 0x563da2b643a0 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0541ad200 con 0x563da2b73a90 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa0541abd90 con 0x563da2b64cc0 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b7f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b7f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44488/0 (socket says 172.21.15.60:44488) 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 -- 172.21.15.60:0/2822241066 learned_addr learned my addr 172.21.15.60:0/2822241066 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa058bbb640 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b66680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa0537fe640 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b6ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 -- 172.21.15.60:0/2822241066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 msgr2=0x563da2b6ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b6ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 -- 172.21.15.60:0/2822241066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 msgr2=0x563da2b66680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b66680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 -- 172.21.15.60:0/2822241066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563da2b6f6a0 con 0x563da2b643a0 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa058bbb640 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b66680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa053fff640 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b7f960 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c010 tx=0x7fa04400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcedd20e4f5334f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa039ffb640 1 -- 172.21.15.60:0/2822241066 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044028070 con 0x563da2b643a0 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa039ffb640 1 -- 172.21.15.60:0/2822241066 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa04401b920 con 0x563da2b643a0 2024-09-12T00:08:43.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.240+0000 7fa039ffb640 1 -- 172.21.15.60:0/2822241066 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044011a80 con 0x563da2b643a0 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 -- 172.21.15.60:0/2822241066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 msgr2=0x563da2b7f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b7f960 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c010 tx=0x7fa04400b480 comp rx=0 tx=0).stop 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 -- 172.21.15.60:0/2822241066 shutdown_connections 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b66680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b6ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/2822241066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b7f960 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 -- 172.21.15.60:0/2822241066 >> 172.21.15.60:0/2822241066 conn(0x563da2b60a30 msgr2=0x563da2b65f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 -- 172.21.15.60:0/2822241066 shutdown_connections 2024-09-12T00:08:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 -- 172.21.15.60:0/2822241066 wait complete. 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.241+0000 7fa05c9f7740 1 -- start start 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa05c9f7740 1 Processor -- start 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b777b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b77cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa05c9f7740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b78230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0541acb30 con 0x563da2b643a0 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0541ac460 con 0x563da2b73a90 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa05c9f7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa0541a96e0 con 0x563da2b64cc0 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa05c9f7740 10 client.0 _ll_register_callbacks cb 0x7fa044004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa053fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b777b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa053fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b777b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44490/0 (socket says 172.21.15.60:44490) 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa053fff640 1 -- 172.21.15.60:0/3024751173 learned_addr learned my addr 172.21.15.60:0/3024751173 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:08:43.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa0537fe640 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b77cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa058bbb640 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b78230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa053fff640 1 -- 172.21.15.60:0/3024751173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 msgr2=0x563da2b77cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.242+0000 7fa053fff640 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b77cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa053fff640 1 -- 172.21.15.60:0/3024751173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 msgr2=0x563da2b78230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa053fff640 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b78230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa053fff640 1 -- 172.21.15.60:0/3024751173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563da2b71000 con 0x563da2b643a0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa053fff640 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b777b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fa04400b3d0 tx=0x7fa04401b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d8bc5257066b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa0337fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa0337fe640 1 -- 172.21.15.60:0/3024751173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044028070 con 0x563da2b643a0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa0337fe640 1 -- 172.21.15.60:0/3024751173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8484+0+0 (secure 0 0 0) 0x7fa044011a30 con 0x563da2b643a0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa05c9f7740 1 -- 172.21.15.60:0/3024751173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa04401b920 con 0x563da2b643a0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa0337fe640 1 -- 172.21.15.60:0/3024751173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fa044011c30 con 0x563da2b643a0 2024-09-12T00:08:43.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa05c9f7740 10 client.17751 fetch_fsmap learned FSMap version 52 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa05c9f7740 1 -- 172.21.15.60:0/3024751173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563da2bee480 con 0x563da2b643a0 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.243+0000 7fa0337fe640 1 -- 172.21.15.60:0/3024751173 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa04401b920 con 0x563da2b643a0 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa0337fe640 1 -- 172.21.15.60:0/3024751173 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fa04403d070 con 0x563da2b643a0 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa05c9f7740 10 client.17751 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa05c9f7740 10 client.17751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa05c9f7740 20 client.17751 populate_metadata read hostname 'smithi060' 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563da2beea80 0x563da2bf0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa05c9f7740 4 client.17751 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa05c9f7740 1 -- 172.21.15.60:0/3024751173 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563da2ad1d60 con 0x563da2beea80 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa0537fe640 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563da2beea80 0x563da2bf0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa0537fe640 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563da2beea80 0x563da2bf0e70 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=349952fca9c9ebbd server_cookie=541b6bcdd818f06b in_seq=0 out_seq=0 2024-09-12T00:08:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.244+0000 7fa0337fe640 10 client.17751 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa0337fe640 1 -- 172.21.15.60:0/3024751173 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563da2ad1d60 con 0x563da2beea80 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa0337fe640 10 client.17751 handle_command_reply: tid=0 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 client.17751 shutdown 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 -- 172.21.15.60:0/3024751173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 msgr2=0x563da2b777b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b777b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fa04400b3d0 tx=0x7fa04401b8b0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 -- 172.21.15.60:0/3024751173 shutdown_connections 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x563da2beea80 0x563da2bf0e70 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563da2b73a90 0x563da2b78230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa0337fe640 0 client.17751 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:08:43.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563da2b64cc0 0x563da2b77cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 --2- 172.21.15.60:0/3024751173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563da2b643a0 0x563da2b777b0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 -- 172.21.15.60:0/3024751173 >> 172.21.15.60:0/3024751173 conn(0x563da2b60a30 msgr2=0x563da2b66790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 -- 172.21.15.60:0/3024751173 shutdown_connections 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 1 -- 172.21.15.60:0/3024751173 wait complete. 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.245+0000 7fa05c9f7740 20 client.17751 trim_cache size 0 max 16384 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": { 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "6c099353-78d1-43e2-89da-2d456f89342e": { 2024-09-12T00:08:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "path": "/", 2024-09-12T00:08:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "tag": "6c099353-78d1-43e2-89da-2d456f89342e", 2024-09-12T00:08:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "options": "recursive,force" 2024-09-12T00:08:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:08:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:08:43.251 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:08:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 -- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa03c0a2cf0 msgr2=0x7fa03c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa03c0a2cf0 0x7fa03c0a51b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa04c005fd0 tx=0x7fa04c010740 comp rx=0 tx=0).stop 2024-09-12T00:08:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 -- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 msgr2=0x7fa054198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:08:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 0x7fa054198ac0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa048004770 tx=0x7fa048032c90 comp rx=0 tx=0).stop 2024-09-12T00:08:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 -- 172.21.15.60:0/348520743 shutdown_connections 2024-09-12T00:08:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fa03c0a2cf0 0x7fa03c0a51b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa054106f10 0x7fa05419ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa054102790 0x7fa054198ac0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 --2- 172.21.15.60:0/348520743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa054101de0 0x7fa054198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:08:43.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 -- 172.21.15.60:0/348520743 >> 172.21.15.60:0/348520743 conn(0x7fa0540fd8c0 msgr2=0x7fa0540ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:08:43.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 -- 172.21.15.60:0/348520743 shutdown_connections 2024-09-12T00:08:43.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:08:43.246+0000 7fa05a61e640 1 -- 172.21.15.60:0/348520743 wait complete. 2024-09-12T00:08:43.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:43 smithi105 ceph-mon[34805]: pgmap v289: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:43.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:43 smithi192 ceph-mon[35487]: pgmap v289: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:43.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:43 smithi060 ceph-mon[30953]: pgmap v289: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:44.044 INFO:tasks.cephfs.filesystem:scrub status for tag:6c099353-78d1-43e2-89da-2d456f89342e - {'path': '/', 'tag': '6c099353-78d1-43e2-89da-2d456f89342e', 'options': 'recursive,force'} 2024-09-12T00:08:44.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:44 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:08:44.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:44 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:08:44.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:44 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:08:45.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:45 smithi105 ceph-mon[34805]: pgmap v290: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:08:45.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:45 smithi192 ceph-mon[35487]: pgmap v290: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:08:45.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:45 smithi060 ceph-mon[30953]: pgmap v290: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 12 op/s 2024-09-12T00:08:47.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:47 smithi105 ceph-mon[34805]: pgmap v291: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:47.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:47 smithi192 ceph-mon[35487]: pgmap v291: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:47.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:47 smithi060 ceph-mon[30953]: pgmap v291: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:49.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:49 smithi192 ceph-mon[35487]: pgmap v292: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:49.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:49 smithi060 ceph-mon[30953]: pgmap v292: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:49.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:49 smithi105 ceph-mon[34805]: pgmap v292: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-12T00:08:51.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:51 smithi192 ceph-mon[35487]: pgmap v293: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:51.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:51 smithi060 ceph-mon[30953]: pgmap v293: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:51.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:51 smithi105 ceph-mon[34805]: pgmap v293: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:53.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:53 smithi192 ceph-mon[35487]: pgmap v294: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:53.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:53 smithi060 ceph-mon[30953]: pgmap v294: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:53.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:53 smithi105 ceph-mon[34805]: pgmap v294: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-12T00:08:55.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:55 smithi192 ceph-mon[35487]: pgmap v295: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T00:08:55.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:55 smithi060 ceph-mon[30953]: pgmap v295: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T00:08:55.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:55 smithi105 ceph-mon[34805]: pgmap v295: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-12T00:08:57.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:57 smithi192 ceph-mon[35487]: pgmap v296: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:08:57.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:57 smithi060 ceph-mon[30953]: pgmap v296: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:08:57.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:57 smithi105 ceph-mon[34805]: pgmap v296: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:08:59.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:08:59 smithi192 ceph-mon[35487]: pgmap v297: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:08:59.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:08:59 smithi060 ceph-mon[30953]: pgmap v297: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:08:59.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:08:59 smithi105 ceph-mon[34805]: pgmap v297: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:09:01.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:01 smithi192 ceph-mon[35487]: pgmap v298: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:09:01.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:01 smithi060 ceph-mon[30953]: pgmap v298: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:09:01.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:01 smithi105 ceph-mon[34805]: pgmap v298: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:09:03.531 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:03 smithi105 ceph-mon[34805]: pgmap v299: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:09:03.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:03 smithi192 ceph-mon[35487]: pgmap v299: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:09:03.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:03 smithi060 ceph-mon[30953]: pgmap v299: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T00:09:05.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:05 smithi192 ceph-mon[35487]: pgmap v300: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:09:05.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:05 smithi060 ceph-mon[30953]: pgmap v300: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:09:05.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:05 smithi105 ceph-mon[34805]: pgmap v300: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:09:07.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:07 smithi192 ceph-mon[35487]: pgmap v301: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:09:07.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:07 smithi060 ceph-mon[30953]: pgmap v301: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:09:07.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:07 smithi105 ceph-mon[34805]: pgmap v301: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:09:09.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:09 smithi192 ceph-mon[35487]: pgmap v302: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:09:09.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:09 smithi060 ceph-mon[30953]: pgmap v302: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:09:09.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:09 smithi105 ceph-mon[34805]: pgmap v302: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:09:10.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:10 smithi192 ceph-mon[35487]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T00:09:10.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:10 smithi060 ceph-mon[30953]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T00:09:10.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:10 smithi105 ceph-mon[34805]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T00:09:11.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:11 smithi192 ceph-mon[35487]: pgmap v304: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:09:11.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:11 smithi060 ceph-mon[30953]: pgmap v304: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:09:11.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:11 smithi105 ceph-mon[34805]: pgmap v304: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:09:13.538 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:13 smithi192 ceph-mon[35487]: pgmap v305: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:09:13.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:13 smithi060 ceph-mon[30953]: pgmap v305: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:09:13.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:13 smithi105 ceph-mon[34805]: pgmap v305: 97 pgs: 97 active+clean; 150 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T00:09:14.045 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:09:14.321 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:14.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 -- 172.21.15.60:0/2563714804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac101de0 msgr2=0x7fb3ac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/2563714804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac101de0 0x7fb3ac1021c0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009900 tx=0x7fb39c02a410 comp rx=0 tx=0).stop 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 -- 172.21.15.60:0/2563714804 shutdown_connections 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/2563714804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ac106f10 0x7fb3ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/2563714804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3ac102790 0x7fb3ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/2563714804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac101de0 0x7fb3ac1021c0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 -- 172.21.15.60:0/2563714804 >> 172.21.15.60:0/2563714804 conn(0x7fb3ac0fd8c0 msgr2=0x7fb3ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 -- 172.21.15.60:0/2563714804 shutdown_connections 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.980+0000 7fb3b25b0640 1 -- 172.21.15.60:0/2563714804 wait complete. 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b25b0640 1 Processor -- start 2024-09-12T00:09:14.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b25b0640 1 -- start start 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b25b0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ac101de0 0x7fb3ac198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b25b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3ac102790 0x7fb3ac198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b25b0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac106f10 0x7fb3ac19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b25b0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac112090 con 0x7fb3ac106f10 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b25b0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac111f10 con 0x7fb3ac102790 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b25b0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac112210 con 0x7fb3ac101de0 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b0b4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac106f10 0x7fb3ac19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b0b4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac106f10 0x7fb3ac19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43398/0 (socket says 172.21.15.60:43398) 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/340411870 learned_addr learned my addr 172.21.15.60:0/340411870 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.981+0000 7fb3abfff640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ac101de0 0x7fb3ac198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:14.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3ac102790 0x7fb3ac198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/340411870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ac101de0 msgr2=0x7fb3ac198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ac101de0 0x7fb3ac198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/340411870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3ac102790 msgr2=0x7fb3ac198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3ac102790 0x7fb3ac198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/340411870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ac19d4c0 con 0x7fb3ac106f10 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac106f10 0x7fb3ac19cde0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400eaa0 tx=0x7fb3a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3a97fa640 1 -- 172.21.15.60:0/340411870 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a400cdb0 con 0x7fb3ac106f10 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3a97fa640 1 -- 172.21.15.60:0/340411870 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3a4004b20 con 0x7fb3ac106f10 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3b25b0640 1 -- 172.21.15.60:0/340411870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ac19d7b0 con 0x7fb3ac106f10 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3a97fa640 1 -- 172.21.15.60:0/340411870 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4011760 con 0x7fb3ac106f10 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.982+0000 7fb3b25b0640 1 -- 172.21.15.60:0/340411870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ac1a5090 con 0x7fb3ac106f10 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3a97fa640 1 -- 172.21.15.60:0/340411870 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb3a4004cd0 con 0x7fb3ac106f10 2024-09-12T00:09:14.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3b4989740 1 Processor -- start 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3b4989740 1 -- start start 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3a97fa640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3940a2cf0 0x7fb3940a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337b360 0x55b9f337b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 0x55b9f338ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3b4989740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b9f32e12e0 con 0x55b9f337b360 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3b4989740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b9f3288ce0 con 0x55b9f337bc80 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3b4989740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b9f32dd2a0 con 0x55b9f338aa90 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337b360 0x55b9f337b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3940a2cf0 0x7fb3940a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3a97fa640 1 -- 172.21.15.60:0/340411870 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8528+0+0 (secure 0 0 0) 0x7fb3a40cf660 con 0x7fb3ac106f10 2024-09-12T00:09:14.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337b360 0x55b9f337b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43414/0 (socket says 172.21.15.60:43414) 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.985+0000 7fb3abfff640 1 -- 172.21.15.60:0/3207922097 learned_addr learned my addr 172.21.15.60:0/3207922097 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 0x55b9f338ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3abfff640 1 -- 172.21.15.60:0/3207922097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 msgr2=0x55b9f338ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3abfff640 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 0x55b9f338ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3abfff640 1 -- 172.21.15.60:0/3207922097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 msgr2=0x55b9f338a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3abfff640 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3abfff640 1 -- 172.21.15.60:0/3207922097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9f326d440 con 0x55b9f337b360 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3940a2cf0 0x7fb3940a51b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac1088e0 tx=0x7fb3a00137d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3abfff640 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337b360 0x55b9f337b740 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009900 tx=0x7fb39c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738b79c145a0f533 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:14.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3927fc640 1 -- 172.21.15.60:0/3207922097 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c040070 con 0x55b9f337b360 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3927fc640 1 -- 172.21.15.60:0/3207922097 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb39c031980 con 0x55b9f337b360 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.986+0000 7fb3927fc640 1 -- 172.21.15.60:0/3207922097 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c035040 con 0x55b9f337b360 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 -- 172.21.15.60:0/3207922097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337b360 msgr2=0x55b9f337b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337b360 0x55b9f337b740 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009900 tx=0x7fb39c005c00 comp rx=0 tx=0).stop 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 -- 172.21.15.60:0/3207922097 shutdown_connections 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 0x55b9f338ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3207922097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337b360 0x55b9f337b740 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 -- 172.21.15.60:0/3207922097 >> 172.21.15.60:0/3207922097 conn(0x55b9f3377a30 msgr2=0x55b9f3377e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:14.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 -- 172.21.15.60:0/3207922097 shutdown_connections 2024-09-12T00:09:14.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 -- 172.21.15.60:0/3207922097 wait complete. 2024-09-12T00:09:14.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.987+0000 7fb3b4989740 1 -- start start 2024-09-12T00:09:14.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b4989740 1 Processor -- start 2024-09-12T00:09:14.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 0x55b9f338a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337bc80 0x55b9f3387640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 0x55b9f3387b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:14.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b4989740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b9f338d600 con 0x55b9f337bc80 2024-09-12T00:09:14.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b4989740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b9f329c050 con 0x55b9f337b360 2024-09-12T00:09:15.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b4989740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b9f338d780 con 0x55b9f338aa90 2024-09-12T00:09:15.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b4989740 10 client.0 _ll_register_callbacks cb 0x55b9f32dc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:15.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3ab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337bc80 0x55b9f3387640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3ab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337bc80 0x55b9f3387640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43428/0 (socket says 172.21.15.60:43428) 2024-09-12T00:09:15.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3ab7fe640 1 -- 172.21.15.60:0/314863418 learned_addr learned my addr 172.21.15.60:0/314863418 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:15.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3abfff640 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 0x55b9f338a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 0x55b9f3387b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3ab7fe640 1 -- 172.21.15.60:0/314863418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 msgr2=0x55b9f3387b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 0x55b9f3387b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3ab7fe640 1 -- 172.21.15.60:0/314863418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 msgr2=0x55b9f338a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 0x55b9f338a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.988+0000 7fb3ab7fe640 1 -- 172.21.15.60:0/314863418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9f30523c0 con 0x55b9f337bc80 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337bc80 0x55b9f3387640 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000f960 tx=0x7fb3a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588ac9251d0d751d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb38b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb38b7fe640 1 -- 172.21.15.60:0/314863418 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000fe20 con 0x55b9f337bc80 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb3b4989740 1 -- 172.21.15.60:0/314863418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb39c031980 con 0x55b9f337bc80 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb38b7fe640 1 -- 172.21.15.60:0/314863418 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8528+0+0 (secure 0 0 0) 0x7fb3a0010b60 con 0x55b9f337bc80 2024-09-12T00:09:15.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb38b7fe640 1 -- 172.21.15.60:0/314863418 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fb3a0010d60 con 0x55b9f337bc80 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb3b4989740 10 client.17763 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb3b4989740 1 -- 172.21.15.60:0/314863418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55b9f3399010 con 0x55b9f337bc80 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.989+0000 7fb38b7fe640 1 -- 172.21.15.60:0/314863418 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb39c031980 con 0x55b9f337bc80 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb38b7fe640 1 -- 172.21.15.60:0/314863418 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fb3a0020580 con 0x55b9f337bc80 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb3b4989740 10 client.17763 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb3b4989740 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb3b4989740 20 client.17763 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb3b4989740 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b9f339a420 0x55b9f339c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb3b4989740 4 client.17763 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb3b4989740 1 -- 172.21.15.60:0/314863418 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9f32ee850 con 0x55b9f339a420 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb3abfff640 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b9f339a420 0x55b9f339c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb3abfff640 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b9f339a420 0x55b9f339c860 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e6f2ad22f0d7fd0 server_cookie=48eb64f188b413b4 in_seq=0 out_seq=0 2024-09-12T00:09:15.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.990+0000 7fb38b7fe640 10 client.17763 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.991+0000 7fb38b7fe640 1 -- 172.21.15.60:0/314863418 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9f32ee850 con 0x55b9f339a420 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.991+0000 7fb38b7fe640 10 client.17763 handle_command_reply: tid=0 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.991+0000 7fb3b4989740 1 client.17763 shutdown 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 -- 172.21.15.60:0/314863418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337bc80 msgr2=0x55b9f3387640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337bc80 0x55b9f3387640 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000f960 tx=0x7fb3a0004730 comp rx=0 tx=0).stop 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 -- 172.21.15.60:0/314863418 shutdown_connections 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b9f339a420 0x55b9f339c860 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f338aa90 0x55b9f3387b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f337bc80 0x55b9f3387640 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 --2- 172.21.15.60:0/314863418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 0x55b9f338a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb38b7fe640 0 client.17763 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 -- 172.21.15.60:0/314863418 >> 172.21.15.60:0/314863418 conn(0x55b9f3377a30 msgr2=0x55b9f3376b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:15.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 -- 172.21.15.60:0/314863418 shutdown_connections 2024-09-12T00:09:15.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 1 -- 172.21.15.60:0/314863418 wait complete. 2024-09-12T00:09:15.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:14.992+0000 7fb3b4989740 20 client.17763 trim_cache size 0 max 16384 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b4989740 1 Processor -- start 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b4989740 1 -- start start 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 0x55b9f33968a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337bc80 0x55b9f33a2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f33a2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b4989740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1ab7c0 con 0x55b9f338aa90 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b4989740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1ad300 con 0x55b9f337b360 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b4989740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1abe90 con 0x55b9f337bc80 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b0b4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f33a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b0b4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f33a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43442/0 (socket says 172.21.15.60:43442) 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.009+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/3971268937 learned_addr learned my addr 172.21.15.60:0/3971268937 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3abfff640 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 0x55b9f33968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337bc80 0x55b9f33a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/3971268937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337bc80 msgr2=0x55b9f33a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337bc80 0x55b9f33a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/3971268937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 msgr2=0x55b9f33968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 0x55b9f33968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/3971268937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9f3385b90 con 0x55b9f338aa90 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337bc80 0x55b9f33a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f33a2670 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4097f90 tx=0x7fb3a409c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5162deca1e971e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb391ffb640 1 -- 172.21.15.60:0/3971268937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a401f040 con 0x55b9f338aa90 2024-09-12T00:09:15.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb391ffb640 1 -- 172.21.15.60:0/3971268937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3a40981f0 con 0x55b9f338aa90 2024-09-12T00:09:15.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.010+0000 7fb391ffb640 1 -- 172.21.15.60:0/3971268937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a406cbb0 con 0x55b9f338aa90 2024-09-12T00:09:15.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 -- 172.21.15.60:0/3971268937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 msgr2=0x55b9f33a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:15.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f33a2670 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4097f90 tx=0x7fb3a409c3b0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 -- 172.21.15.60:0/3971268937 shutdown_connections 2024-09-12T00:09:15.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f33a2670 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337bc80 0x55b9f33a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3971268937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337b360 0x55b9f33968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 -- 172.21.15.60:0/3971268937 >> 172.21.15.60:0/3971268937 conn(0x55b9f3377a30 msgr2=0x55b9f3385f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 -- 172.21.15.60:0/3971268937 shutdown_connections 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 -- 172.21.15.60:0/3971268937 wait complete. 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.011+0000 7fb3b4989740 1 -- start start 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b4989740 1 Processor -- start 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337b360 0x55b9f338eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b4989740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f3404100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b4989740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1acc30 con 0x55b9f338aa90 2024-09-12T00:09:15.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b4989740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1ac560 con 0x55b9f337bc80 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b4989740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ac1a97a0 con 0x55b9f337b360 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b4989740 10 client.0 _ll_register_callbacks cb 0x7fb3a0009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b0b4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f3404100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b0b4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f3404100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43448/0 (socket says 172.21.15.60:43448) 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/3479287586 learned_addr learned my addr 172.21.15.60:0/3479287586 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3abfff640 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337b360 0x55b9f338eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/3479287586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337b360 msgr2=0x55b9f338eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337b360 0x55b9f338eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/3479287586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 msgr2=0x55b9f338f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3b0b4d640 1 -- 172.21.15.60:0/3479287586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9f3404640 con 0x55b9f338aa90 2024-09-12T00:09:15.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.012+0000 7fb3ab7fe640 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b0b4d640 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f3404100 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40a42c0 tx=0x7fb3a4009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2191c3d9cb5b8f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb38b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb38b7fe640 1 -- 172.21.15.60:0/3479287586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a408a020 con 0x55b9f338aa90 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb38b7fe640 1 -- 172.21.15.60:0/3479287586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8528+0+0 (secure 0 0 0) 0x7fb3a408a3c0 con 0x55b9f338aa90 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b4989740 1 -- 172.21.15.60:0/3479287586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3a40981f0 con 0x55b9f338aa90 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb38b7fe640 1 -- 172.21.15.60:0/3479287586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fb3a401f040 con 0x55b9f338aa90 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b4989740 10 client.17769 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b4989740 1 -- 172.21.15.60:0/3479287586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55b9f34058f0 con 0x55b9f338aa90 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb38b7fe640 1 -- 172.21.15.60:0/3479287586 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3a40981f0 con 0x55b9f338aa90 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb38b7fe640 1 -- 172.21.15.60:0/3479287586 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fb3a400f040 con 0x55b9f338aa90 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b4989740 10 client.17769 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b4989740 10 client.17769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:15.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b4989740 20 client.17769 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b9f3405f00 0x55b9f3408320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.013+0000 7fb3b4989740 4 client.17769 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.014+0000 7fb3b4989740 1 -- 172.21.15.60:0/3479287586 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b9f32e8d60 con 0x55b9f3405f00 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.014+0000 7fb3abfff640 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b9f3405f00 0x55b9f3408320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.014+0000 7fb3abfff640 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b9f3405f00 0x55b9f3408320 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce0022599da11e2a server_cookie=a885db1bb5d32280 in_seq=0 out_seq=0 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.014+0000 7fb38b7fe640 10 client.17769 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.014+0000 7fb38b7fe640 1 -- 172.21.15.60:0/3479287586 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b9f32e8d60 con 0x55b9f3405f00 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.014+0000 7fb38b7fe640 10 client.17769 handle_command_reply: tid=0 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.014+0000 7fb3b4989740 1 client.17769 shutdown 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 -- 172.21.15.60:0/3479287586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 msgr2=0x55b9f3404100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f3404100 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40a42c0 tx=0x7fb3a4009290 comp rx=0 tx=0).stop 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 -- 172.21.15.60:0/3479287586 shutdown_connections 2024-09-12T00:09:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55b9f3405f00 0x55b9f3408320 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb38b7fe640 0 client.17769 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9f338aa90 0x55b9f3404100 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b9f337bc80 0x55b9f338f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 --2- 172.21.15.60:0/3479287586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b9f337b360 0x55b9f338eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 -- 172.21.15.60:0/3479287586 >> 172.21.15.60:0/3479287586 conn(0x55b9f3377a30 msgr2=0x55b9f3376350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 -- 172.21.15.60:0/3479287586 shutdown_connections 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 1 -- 172.21.15.60:0/3479287586 wait complete. 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b4989740 20 client.17769 trim_cache size 0 max 16384 2024-09-12T00:09:15.020 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:09:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:09:15.021 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:09:15.021 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:09:15.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b25b0640 1 -- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3940a2cf0 msgr2=0x7fb3940a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:15.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3940a2cf0 0x7fb3940a51b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac1088e0 tx=0x7fb3a00137d0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b25b0640 1 -- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac106f10 msgr2=0x7fb3ac19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.015+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac106f10 0x7fb3ac19cde0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400eaa0 tx=0x7fb3a400ef60 comp rx=0 tx=0).stop 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.016+0000 7fb3b25b0640 1 -- 172.21.15.60:0/340411870 shutdown_connections 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.016+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fb3940a2cf0 0x7fb3940a51b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.016+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3ac106f10 0x7fb3ac19cde0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.016+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3ac102790 0x7fb3ac198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.016+0000 7fb3b25b0640 1 --2- 172.21.15.60:0/340411870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ac101de0 0x7fb3ac198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.016+0000 7fb3b25b0640 1 -- 172.21.15.60:0/340411870 >> 172.21.15.60:0/340411870 conn(0x7fb3ac0fd8c0 msgr2=0x7fb3ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.016+0000 7fb3b25b0640 1 -- 172.21.15.60:0/340411870 shutdown_connections 2024-09-12T00:09:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:15.016+0000 7fb3b25b0640 1 -- 172.21.15.60:0/340411870 wait complete. 2024-09-12T00:09:15.527 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:15 smithi060 ceph-mon[30953]: pgmap v306: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:15.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:15 smithi192 ceph-mon[35487]: pgmap v306: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:15.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:15 smithi105 ceph-mon[34805]: pgmap v306: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:15.782 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:09:15.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:09:16.043 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:16.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 -- 172.21.15.60:0/1992576375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 msgr2=0x7f861c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:16.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 --2- 172.21.15.60:0/1992576375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 0x7f861c1031a0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8618009900 tx=0x7f861802a480 comp rx=0 tx=0).stop 2024-09-12T00:09:16.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 -- 172.21.15.60:0/1992576375 shutdown_connections 2024-09-12T00:09:16.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 --2- 172.21.15.60:0/1992576375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f861c10c160 0x7f861c10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 --2- 172.21.15.60:0/1992576375 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f861c1036e0 0x7f861c10bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 --2- 172.21.15.60:0/1992576375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 0x7f861c1031a0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 -- 172.21.15.60:0/1992576375 >> 172.21.15.60:0/1992576375 conn(0x7f861c0fc780 msgr2=0x7f861c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 -- 172.21.15.60:0/1992576375 shutdown_connections 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.687+0000 7f8622ff2640 1 -- 172.21.15.60:0/1992576375 wait complete. 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8622ff2640 1 Processor -- start 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8622ff2640 1 -- start start 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8622ff2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 0x7f861c100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8622ff2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f861c1036e0 0x7f861c100f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8622ff2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f861c10c160 0x7f861c1014a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8622ff2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f861c1120d0 con 0x7f861c102dc0 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8622ff2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f861c111f50 con 0x7f861c10c160 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8622ff2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f861c112250 con 0x7f861c1036e0 2024-09-12T00:09:16.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 0x7f861c100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 0x7f861c100a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43474/0 (socket says 172.21.15.60:43474) 2024-09-12T00:09:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 -- 172.21.15.60:0/684780368 learned_addr learned my addr 172.21.15.60:0/684780368 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f862158f640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f861c10c160 0x7f861c1014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8613fff640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f861c1036e0 0x7f861c100f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 -- 172.21.15.60:0/684780368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f861c1036e0 msgr2=0x7f861c100f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f861c1036e0 0x7f861c100f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 -- 172.21.15.60:0/684780368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f861c10c160 msgr2=0x7f861c1014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:16.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f861c10c160 0x7f861c1014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 -- 172.21.15.60:0/684780368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c1a6a30 con 0x7f861c102dc0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8613fff640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f861c1036e0 0x7f861c100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.688+0000 7f8620d8e640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 0x7f861c100a20 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8618006010 tx=0x7f86180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.689+0000 7f8611ffb640 1 -- 172.21.15.60:0/684780368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861803f030 con 0x7f861c102dc0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.689+0000 7f8611ffb640 1 -- 172.21.15.60:0/684780368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8618003d00 con 0x7f861c102dc0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.689+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861c1a6cc0 con 0x7f861c102dc0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.689+0000 7f8611ffb640 1 -- 172.21.15.60:0/684780368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618035070 con 0x7f861c102dc0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.689+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861c1a71a0 con 0x7f861c102dc0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.690+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f861c1031a0 con 0x7f861c102dc0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.691+0000 7f8611ffb640 1 -- 172.21.15.60:0/684780368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8618042030 con 0x7f861c102dc0 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.692+0000 7f8611ffb640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86040a2cf0 0x7f86040a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:16.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.692+0000 7f8611ffb640 1 -- 172.21.15.60:0/684780368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8528+0+0 (secure 0 0 0) 0x7f86180ef9c0 con 0x7f861c102dc0 2024-09-12T00:09:16.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.692+0000 7f8613fff640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86040a2cf0 0x7f86040a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:16.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.692+0000 7f8613fff640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86040a2cf0 0x7f86040a51b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f860c006fd0 tx=0x7f860c008040 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:16.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.696+0000 7f8611ffb640 1 -- 172.21.15.60:0/684780368 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86180bc660 con 0x7f861c102dc0 2024-09-12T00:09:16.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.909+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f861c02d7c0 con 0x7f861c102dc0 2024-09-12T00:09:16.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.910+0000 7f8611ffb640 1 -- 172.21.15.60:0/684780368 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7f86180bbf60 con 0x7f861c102dc0 2024-09-12T00:09:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:09:16.910 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:09:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:09:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86040a2cf0 msgr2=0x7f86040a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86040a2cf0 0x7f86040a51b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f860c006fd0 tx=0x7f860c008040 comp rx=0 tx=0).stop 2024-09-12T00:09:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 msgr2=0x7f861c100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 0x7f861c100a20 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8618006010 tx=0x7f86180042f0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 shutdown_connections 2024-09-12T00:09:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f86040a2cf0 0x7f86040a51b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f861c10c160 0x7f861c1014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f861c1036e0 0x7f861c100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 --2- 172.21.15.60:0/684780368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f861c102dc0 0x7f861c100a20 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 >> 172.21.15.60:0/684780368 conn(0x7f861c0fc780 msgr2=0x7f861c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.912+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 shutdown_connections 2024-09-12T00:09:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:16.913+0000 7f8622ff2640 1 -- 172.21.15.60:0/684780368 wait complete. 2024-09-12T00:09:17.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:17 smithi192 ceph-mon[35487]: pgmap v307: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:17.534 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:17 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/684780368' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:09:17.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:17 smithi060 ceph-mon[30953]: pgmap v307: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:17.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:17 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/684780368' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:09:17.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:17 smithi105 ceph-mon[34805]: pgmap v307: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:17.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:17 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/684780368' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:09:17.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:09:18.010 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:18.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 -- 172.21.15.60:0/2482789862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800102790 msgr2=0x7f18001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 --2- 172.21.15.60:0/2482789862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800102790 0x7f18001067e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009900 tx=0x7f17e802a410 comp rx=0 tx=0).stop 2024-09-12T00:09:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 -- 172.21.15.60:0/2482789862 shutdown_connections 2024-09-12T00:09:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 --2- 172.21.15.60:0/2482789862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1800106f10 0x7f180010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 --2- 172.21.15.60:0/2482789862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800102790 0x7f18001067e0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 --2- 172.21.15.60:0/2482789862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800101de0 0x7f18001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 -- 172.21.15.60:0/2482789862 >> 172.21.15.60:0/2482789862 conn(0x7f18000fd8c0 msgr2=0x7f18000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 -- 172.21.15.60:0/2482789862 shutdown_connections 2024-09-12T00:09:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.490+0000 7f1804ac6640 1 -- 172.21.15.60:0/2482789862 wait complete. 2024-09-12T00:09:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f1804ac6640 1 Processor -- start 2024-09-12T00:09:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f1804ac6640 1 -- start start 2024-09-12T00:09:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f1804ac6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1800101de0 0x7f1800198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f1804ac6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800102790 0x7f1800198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f1804ac6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800106f10 0x7f180019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f1804ac6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1800112150 con 0x7f1800106f10 2024-09-12T00:09:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f1804ac6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1800111fd0 con 0x7f1800101de0 2024-09-12T00:09:18.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f1804ac6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f18001122d0 con 0x7f1800102790 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f17fed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800106f10 0x7f180019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f17fed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800106f10 0x7f180019cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43494/0 (socket says 172.21.15.60:43494) 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.491+0000 7f17fed9d640 1 -- 172.21.15.60:0/1281297829 learned_addr learned my addr 172.21.15.60:0/1281297829 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17fe59c640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1800101de0 0x7f1800198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17f7fff640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800102790 0x7f1800198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17fed9d640 1 -- 172.21.15.60:0/1281297829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800102790 msgr2=0x7f1800198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17fed9d640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800102790 0x7f1800198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17fed9d640 1 -- 172.21.15.60:0/1281297829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1800101de0 msgr2=0x7f1800198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17fed9d640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1800101de0 0x7f1800198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17fed9d640 1 -- 172.21.15.60:0/1281297829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180019d620 con 0x7f1800106f10 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17fed9d640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800106f10 0x7f180019cf40 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f17f800b970 tx=0x7f17f800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:18.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17f77fe640 1 -- 172.21.15.60:0/1281297829 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8019070 con 0x7f1800106f10 2024-09-12T00:09:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f1804ac6640 1 -- 172.21.15.60:0/1281297829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180019d910 con 0x7f1800106f10 2024-09-12T00:09:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17f77fe640 1 -- 172.21.15.60:0/1281297829 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17f8014440 con 0x7f1800106f10 2024-09-12T00:09:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f17f77fe640 1 -- 172.21.15.60:0/1281297829 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f80075d0 con 0x7f1800106f10 2024-09-12T00:09:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.492+0000 7f1804ac6640 1 -- 172.21.15.60:0/1281297829 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1800074420 con 0x7f1800106f10 2024-09-12T00:09:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.495+0000 7f17f77fe640 1 -- 172.21.15.60:0/1281297829 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f17f801c070 con 0x7f1800106f10 2024-09-12T00:09:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.495+0000 7f1806e9f740 1 Processor -- start 2024-09-12T00:09:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.495+0000 7f1806e9f740 1 -- start start 2024-09-12T00:09:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.495+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.495+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f1806e9f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5640810112f0 con 0x5640810acb40 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f1806e9f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564080fb8cf0 con 0x5640810b6370 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f1806e9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56408100d2b0 con 0x5640810ab5d0 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43508/0 (socket says 172.21.15.60:43508) 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 -- 172.21.15.60:0/1966649804 learned_addr learned my addr 172.21.15.60:0/1966649804 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f77fe640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f17ec0a2cf0 0x7f17ec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17fed9d640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f17ec0a2cf0 0x7f17ec0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17fe59c640 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 -- 172.21.15.60:0/1966649804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 msgr2=0x5640810aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 -- 172.21.15.60:0/1966649804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 msgr2=0x5640810b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f77fe640 1 -- 172.21.15.60:0/1281297829 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f17f80ce800 con 0x7f1800106f10 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 -- 172.21.15.60:0/1966649804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564080f9d3a0 con 0x5640810acb40 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.496+0000 7f17f7fff640 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810ab090 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f17e802a930 tx=0x7f17e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18beca04c8af925 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:18.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f17f4ff9640 1 -- 172.21.15.60:0/1966649804 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8035040 con 0x5640810acb40 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f17fed9d640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f17ec0a2cf0 0x7f17ec0a51b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f17f80cc570 tx=0x7f17f8004b50 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f17f4ff9640 1 -- 172.21.15.60:0/1966649804 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17e8005020 con 0x5640810acb40 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f17f4ff9640 1 -- 172.21.15.60:0/1966649804 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8004a90 con 0x5640810acb40 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f1806e9f740 1 -- 172.21.15.60:0/1966649804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 msgr2=0x5640810ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f1806e9f740 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810ab090 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f17e802a930 tx=0x7f17e8000bc0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f1806e9f740 1 -- 172.21.15.60:0/1966649804 shutdown_connections 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f1806e9f740 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f1806e9f740 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f1806e9f740 1 --2- 172.21.15.60:0/1966649804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810ab090 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f1806e9f740 1 -- 172.21.15.60:0/1966649804 >> 172.21.15.60:0/1966649804 conn(0x564081074310 msgr2=0x5640810a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.497+0000 7f1806e9f740 1 -- 172.21.15.60:0/1966649804 shutdown_connections 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 -- 172.21.15.60:0/1966649804 wait complete. 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 -- start start 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 Processor -- start 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810ab5d0 0x5640810b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810acb40 0x5640810b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5640810b9010 con 0x5640810ab5d0 2024-09-12T00:09:18.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x564080fcc060 con 0x5640810b6370 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5640810b9190 con 0x5640810acb40 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f1806e9f740 10 client.0 _ll_register_callbacks cb 0x564080d1f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810ab5d0 0x5640810b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f17f7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810ab5d0 0x5640810b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43514/0 (socket says 172.21.15.60:43514) 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.498+0000 7f17f7fff640 1 -- 172.21.15.60:0/992436190 learned_addr learned my addr 172.21.15.60:0/992436190 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17fe59c640 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810acb40 0x5640810b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17f7fff640 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17f7fff640 1 -- 172.21.15.60:0/992436190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810acb40 msgr2=0x5640810b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:18.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17f7fff640 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810acb40 0x5640810b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17f7fff640 1 -- 172.21.15.60:0/992436190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 msgr2=0x5640810b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17f7fff640 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17f7fff640 1 -- 172.21.15.60:0/992436190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564080d823c0 con 0x5640810ab5d0 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17f7fff640 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810ab5d0 0x5640810b5d30 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f17e8031bf0 tx=0x7f17e8009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0bca9064114029 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17e5ffb640 1 -- 172.21.15.60:0/992436190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8035040 con 0x5640810ab5d0 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17e5ffb640 1 -- 172.21.15.60:0/992436190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f17e8005460 con 0x5640810ab5d0 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f1806e9f740 1 -- 172.21.15.60:0/992436190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e8005020 con 0x5640810ab5d0 2024-09-12T00:09:18.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17e5ffb640 1 -- 172.21.15.60:0/992436190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f17e805d050 con 0x5640810ab5d0 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f1806e9f740 10 client.17787 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f1806e9f740 1 -- 172.21.15.60:0/992436190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5640810c4a70 con 0x5640810ab5d0 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.499+0000 7f17e5ffb640 1 -- 172.21.15.60:0/992436190 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17e8005020 con 0x5640810ab5d0 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f17e5ffb640 1 -- 172.21.15.60:0/992436190 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f17e8003a40 con 0x5640810ab5d0 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f1806e9f740 10 client.17787 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f1806e9f740 10 client.17787 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f1806e9f740 20 client.17787 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f1806e9f740 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5640810c5dc0 0x5640810c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f1806e9f740 4 client.17787 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f1806e9f740 1 -- 172.21.15.60:0/992436190 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56408101e860 con 0x5640810c5dc0 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f17fe59c640 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5640810c5dc0 0x5640810c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f17fe59c640 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5640810c5dc0 0x5640810c81b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2fecd4cc0b5c256 server_cookie=70b7ee16b40211de in_seq=0 out_seq=0 2024-09-12T00:09:18.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.500+0000 7f17e5ffb640 10 client.17787 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f17e5ffb640 1 -- 172.21.15.60:0/992436190 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56408101e860 con 0x5640810c5dc0 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f17e5ffb640 10 client.17787 handle_command_reply: tid=0 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 client.17787 shutdown 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 -- 172.21.15.60:0/992436190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810ab5d0 msgr2=0x5640810b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810ab5d0 0x5640810b5d30 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f17e8031bf0 tx=0x7f17e8009640 comp rx=0 tx=0).stop 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 -- 172.21.15.60:0/992436190 shutdown_connections 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5640810c5dc0 0x5640810c81b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f17e5ffb640 0 client.17787 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810acb40 0x5640810b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 --2- 172.21.15.60:0/992436190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810ab5d0 0x5640810b5d30 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.501+0000 7f1806e9f740 1 -- 172.21.15.60:0/992436190 >> 172.21.15.60:0/992436190 conn(0x564081074310 msgr2=0x5640810ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:18.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.502+0000 7f1806e9f740 1 -- 172.21.15.60:0/992436190 shutdown_connections 2024-09-12T00:09:18.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.502+0000 7f1806e9f740 1 -- 172.21.15.60:0/992436190 wait complete. 2024-09-12T00:09:18.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.502+0000 7f1806e9f740 20 client.17787 trim_cache size 0 max 16384 2024-09-12T00:09:18.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f1806e9f740 1 Processor -- start 2024-09-12T00:09:18.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f1806e9f740 1 -- start start 2024-09-12T00:09:18.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810ab5d0 0x5640810a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810b6370 0x5640810b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f1806e9f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f18001afb60 con 0x5640810acb40 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f1806e9f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18001b16a0 con 0x5640810ab5d0 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f1806e9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f18001b0230 con 0x5640810b6370 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43518/0 (socket says 172.21.15.60:43518) 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 -- 172.21.15.60:0/1270774680 learned_addr learned my addr 172.21.15.60:0/1270774680 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17f7fff640 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810ab5d0 0x5640810a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17f7fff640 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810b6370 0x5640810b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 -- 172.21.15.60:0/1270774680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810b6370 msgr2=0x5640810b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810b6370 0x5640810b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 -- 172.21.15.60:0/1270774680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810ab5d0 msgr2=0x5640810a6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:18.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810ab5d0 0x5640810a6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 -- 172.21.15.60:0/1270774680 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640810ae120 con 0x5640810acb40 2024-09-12T00:09:18.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.515+0000 7f17fe59c640 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810b0240 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009940 tx=0x7f17f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f0f565513dac33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:18.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f17e7fff640 1 -- 172.21.15.60:0/1270774680 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0017e40 con 0x5640810acb40 2024-09-12T00:09:18.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f17e7fff640 1 -- 172.21.15.60:0/1270774680 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17f0021030 con 0x5640810acb40 2024-09-12T00:09:18.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f17e7fff640 1 -- 172.21.15.60:0/1270774680 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f001d470 con 0x5640810acb40 2024-09-12T00:09:18.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 -- 172.21.15.60:0/1270774680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 msgr2=0x5640810b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810b0240 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009940 tx=0x7f17f0008040 comp rx=0 tx=0).stop 2024-09-12T00:09:18.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 -- 172.21.15.60:0/1270774680 shutdown_connections 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810b6370 0x5640810b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810b0240 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 --2- 172.21.15.60:0/1270774680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810ab5d0 0x5640810a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 -- 172.21.15.60:0/1270774680 >> 172.21.15.60:0/1270774680 conn(0x564081074310 msgr2=0x5640810a6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 -- 172.21.15.60:0/1270774680 shutdown_connections 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.516+0000 7f1806e9f740 1 -- 172.21.15.60:0/1270774680 wait complete. 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 1 -- start start 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 1 Processor -- start 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f18001b0fd0 con 0x5640810acb40 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18001b0900 con 0x5640810b6370 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f18001adb40 con 0x5640810ab5d0 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f1806e9f740 10 client.0 _ll_register_callbacks cb 0x7f17e8031940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17fe59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17fe59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43526/0 (socket says 172.21.15.60:43526) 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17fe59c640 1 -- 172.21.15.60:0/2592080851 learned_addr learned my addr 172.21.15.60:0/2592080851 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17f7fff640 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17f7fff640 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17fe59c640 1 -- 172.21.15.60:0/2592080851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 msgr2=0x5640810cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17fe59c640 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17fe59c640 1 -- 172.21.15.60:0/2592080851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 msgr2=0x5640810c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:18.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17fe59c640 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17fe59c640 1 -- 172.21.15.60:0/2592080851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640810c9a00 con 0x5640810acb40 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.517+0000 7f17f7fff640 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f17fe59c640 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810c8cc0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f17f0000c00 tx=0x7f17f0009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6205a82e3ab3d416 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f17e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f17e5ffb640 1 -- 172.21.15.60:0/2592080851 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f001d5f0 con 0x5640810acb40 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f17e5ffb640 1 -- 172.21.15.60:0/2592080851 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f17f001d790 con 0x5640810acb40 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 1 -- 172.21.15.60:0/2592080851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17f0021030 con 0x5640810acb40 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f17e5ffb640 1 -- 172.21.15.60:0/2592080851 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f17f001d990 con 0x5640810acb40 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 10 client.17793 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 1 -- 172.21.15.60:0/2592080851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x564081130730 con 0x5640810acb40 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f17e5ffb640 1 -- 172.21.15.60:0/2592080851 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17f0021030 con 0x5640810acb40 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f17e5ffb640 1 -- 172.21.15.60:0/2592080851 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f17f0026420 con 0x5640810acb40 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 10 client.17793 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 10 client.17793 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 20 client.17793 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5640810c5dc0 0x564081132de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 4 client.17793 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.518+0000 7f1806e9f740 1 -- 172.21.15.60:0/2592080851 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564081018d70 con 0x5640810c5dc0 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f17f7fff640 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5640810c5dc0 0x564081132de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f17f7fff640 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5640810c5dc0 0x564081132de0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=804ec787e6e252d2 server_cookie=c8ec50ea81bac1df in_seq=0 out_seq=0 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f17e5ffb640 10 client.17793 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f17e5ffb640 1 -- 172.21.15.60:0/2592080851 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564081018d70 con 0x5640810c5dc0 2024-09-12T00:09:18.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f17e5ffb640 10 client.17793 handle_command_reply: tid=0 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f1806e9f740 1 client.17793 shutdown 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f1806e9f740 1 -- 172.21.15.60:0/2592080851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 msgr2=0x5640810c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f1806e9f740 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810c8cc0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f17f0000c00 tx=0x7f17f0009c90 comp rx=0 tx=0).stop 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f1806e9f740 1 -- 172.21.15.60:0/2592080851 shutdown_connections 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.519+0000 7f1806e9f740 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x5640810c5dc0 0x564081132de0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1806e9f740 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5640810b6370 0x5640810c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f17e5ffb640 0 client.17793 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1806e9f740 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5640810acb40 0x5640810c8cc0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1806e9f740 1 --2- 172.21.15.60:0/2592080851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5640810ab5d0 0x5640810cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1806e9f740 1 -- 172.21.15.60:0/2592080851 >> 172.21.15.60:0/2592080851 conn(0x564081074310 msgr2=0x5640810ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1806e9f740 1 -- 172.21.15.60:0/2592080851 shutdown_connections 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1806e9f740 1 -- 172.21.15.60:0/2592080851 wait complete. 2024-09-12T00:09:18.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1806e9f740 20 client.17793 trim_cache size 0 max 16384 2024-09-12T00:09:18.526 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 -- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f17ec0a2cf0 msgr2=0x7f17ec0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f17ec0a2cf0 0x7f17ec0a51b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f17f80cc570 tx=0x7f17f8004b50 comp rx=0 tx=0).stop 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 -- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800106f10 msgr2=0x7f180019cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800106f10 0x7f180019cf40 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f17f800b970 tx=0x7f17f800bd70 comp rx=0 tx=0).stop 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 -- 172.21.15.60:0/1281297829 shutdown_connections 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f17ec0a2cf0 0x7f17ec0a51b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1800106f10 0x7f180019cf40 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1800102790 0x7f1800198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 --2- 172.21.15.60:0/1281297829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1800101de0 0x7f1800198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.520+0000 7f1804ac6640 1 -- 172.21.15.60:0/1281297829 >> 172.21.15.60:0/1281297829 conn(0x7f18000fd8c0 msgr2=0x7f18000fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:18.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.521+0000 7f1804ac6640 1 -- 172.21.15.60:0/1281297829 shutdown_connections 2024-09-12T00:09:18.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:18.521+0000 7f1804ac6640 1 -- 172.21.15.60:0/1281297829 wait complete. 2024-09-12T00:09:19.147 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:19 smithi060 ceph-mon[30953]: pgmap v308: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:19.147 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:19 smithi060 ceph-mon[30953]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T00:09:19.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:19 smithi192 ceph-mon[35487]: pgmap v308: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:19.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:19 smithi192 ceph-mon[35487]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T00:09:19.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:09:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:19 smithi105 ceph-mon[34805]: pgmap v308: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:19 smithi105 ceph-mon[34805]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T00:09:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:20.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 -- 172.21.15.60:0/614277913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8101420 msgr2=0x7fbad810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/614277913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8101420 0x7fbad810d950 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009cd0 tx=0x7fbad002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 -- 172.21.15.60:0/614277913 shutdown_connections 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/614277913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8101420 0x7fbad810d950 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/614277913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbad8100a80 0x7fbad8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/614277913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbad8106a80 0x7fbad8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 -- 172.21.15.60:0/614277913 >> 172.21.15.60:0/614277913 conn(0x7fbad80fc7a0 msgr2=0x7fbad80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 -- 172.21.15.60:0/614277913 shutdown_connections 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.150+0000 7fbadf7d0640 1 -- 172.21.15.60:0/614277913 wait complete. 2024-09-12T00:09:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadf7d0640 1 Processor -- start 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadf7d0640 1 -- start start 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadf7d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbad8100a80 0x7fbad8197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadf7d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbad8101420 0x7fbad8197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadf7d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8106a80 0x7fbad819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadf7d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbad8110fe0 con 0x7fbad8106a80 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadf7d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbad8110e60 con 0x7fbad8101420 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadf7d0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbad8111160 con 0x7fbad8100a80 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbaddd6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8106a80 0x7fbad819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbaddd6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8106a80 0x7fbad819bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43542/0 (socket says 172.21.15.60:43542) 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbaddd6d640 1 -- 172.21.15.60:0/3894685734 learned_addr learned my addr 172.21.15.60:0/3894685734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.151+0000 7fbadd56c640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbad8100a80 0x7fbad8197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbad8101420 0x7fbad8197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbaddd6d640 1 -- 172.21.15.60:0/3894685734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbad8100a80 msgr2=0x7fbad8197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbad8100a80 0x7fbad8197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbaddd6d640 1 -- 172.21.15.60:0/3894685734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbad8101420 msgr2=0x7fbad8197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbad8101420 0x7fbad8197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbaddd6d640 1 -- 172.21.15.60:0/3894685734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad819c3d0 con 0x7fbad8106a80 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8106a80 0x7fbad819bcf0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fbad0006010 tx=0x7fbad0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbace7fc640 1 -- 172.21.15.60:0/3894685734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0004040 con 0x7fbad8106a80 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbace7fc640 1 -- 172.21.15.60:0/3894685734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbad00046e0 con 0x7fbad8106a80 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbadf7d0640 1 -- 172.21.15.60:0/3894685734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad819c660 con 0x7fbad8106a80 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbace7fc640 1 -- 172.21.15.60:0/3894685734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0030da0 con 0x7fbad8106a80 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.152+0000 7fbadf7d0640 1 -- 172.21.15.60:0/3894685734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad81a3fa0 con 0x7fbad8106a80 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.155+0000 7fbae1ba9740 1 Processor -- start 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.155+0000 7fbace7fc640 1 -- 172.21.15.60:0/3894685734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fbad00305a0 con 0x7fbad8106a80 2024-09-12T00:09:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.155+0000 7fbae1ba9740 1 -- start start 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70831090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a708315d0 0x556a70831a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a7083e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556a707972f0 con 0x556a7083c370 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556a7073ecf0 con 0x556a70832b40 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556a707932b0 con 0x556a708315d0 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a7083e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70831090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70831090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:40876/0 (socket says 172.21.15.60:40876) 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 -- 172.21.15.60:0/4138868759 learned_addr learned my addr 172.21.15.60:0/4138868759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadd56c640 1 --2- 172.21.15.60:0/4138868759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a708315d0 0x556a70831a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 -- 172.21.15.60:0/4138868759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a708315d0 msgr2=0x556a70831a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/4138868759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a708315d0 0x556a70831a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 -- 172.21.15.60:0/4138868759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 msgr2=0x556a70831090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/4138868759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70831090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 -- 172.21.15.60:0/4138868759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a707233a0 con 0x556a7083c370 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbace7fc640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbac40a2cf0 0x7fbac40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/4138868759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a7083e760 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fbac8014a40 tx=0x7fbac8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd04d0475a260b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.156+0000 7fbadd56c640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbac40a2cf0 0x7fbac40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbace7fc640 1 -- 172.21.15.60:0/3894685734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fbad002e030 con 0x7fbad8106a80 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbac37fe640 1 -- 172.21.15.60:0/4138868759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80142d0 con 0x556a7083c370 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbac37fe640 1 -- 172.21.15.60:0/4138868759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbac8014520 con 0x556a7083c370 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbac37fe640 1 -- 172.21.15.60:0/4138868759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8003850 con 0x556a7083c370 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbae1ba9740 1 -- 172.21.15.60:0/4138868759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 msgr2=0x556a7083e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbadd56c640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbac40a2cf0 0x7fbac40a51b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x556a7082eac0 tx=0x7fbad4009110 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/4138868759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a7083e760 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fbac8014a40 tx=0x7fbac8005850 comp rx=0 tx=0).stop 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbae1ba9740 1 -- 172.21.15.60:0/4138868759 shutdown_connections 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/4138868759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a7083e760 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/4138868759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a708315d0 0x556a70831a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/4138868759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70831090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.157+0000 7fbae1ba9740 1 -- 172.21.15.60:0/4138868759 >> 172.21.15.60:0/4138868759 conn(0x556a707fa310 msgr2=0x556a7082dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.158+0000 7fbae1ba9740 1 -- 172.21.15.60:0/4138868759 shutdown_connections 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.158+0000 7fbae1ba9740 1 -- 172.21.15.60:0/4138868759 wait complete. 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.158+0000 7fbae1ba9740 1 -- start start 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.158+0000 7fbae1ba9740 1 Processor -- start 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 0x556a7083bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a70832b40 0x556a70839060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a708397f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556a70841220 con 0x556a7083c370 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556a70752060 con 0x556a708315d0 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556a708413a0 con 0x556a70832b40 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbae1ba9740 10 client.0 _ll_register_callbacks cb 0x556a704a58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a708397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a708397f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43552/0 (socket says 172.21.15.60:43552) 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 -- 172.21.15.60:0/1615884028 learned_addr learned my addr 172.21.15.60:0/1615884028 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbadd56c640 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 0x556a7083bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a70832b40 0x556a70839060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 -- 172.21.15.60:0/1615884028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a70832b40 msgr2=0x556a70839060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a70832b40 0x556a70839060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 -- 172.21.15.60:0/1615884028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 msgr2=0x556a7083bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 0x556a7083bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 -- 172.21.15.60:0/1615884028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a705083c0 con 0x556a7083c370 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a708397f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fbad00bd0b0 tx=0x7fbad00bcc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9570f77c014ea46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbac0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbac0ff9640 1 -- 172.21.15.60:0/1615884028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad00bd120 con 0x556a7083c370 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbae1ba9740 1 -- 172.21.15.60:0/1615884028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbac8014520 con 0x556a7083c370 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.159+0000 7fbac0ff9640 1 -- 172.21.15.60:0/1615884028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fbad00b9790 con 0x556a7083c370 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbac0ff9640 1 -- 172.21.15.60:0/1615884028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fbad00c14d0 con 0x556a7083c370 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbae1ba9740 10 client.17805 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbae1ba9740 1 -- 172.21.15.60:0/1615884028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x556a7084cd10 con 0x556a7083c370 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbac0ff9640 1 -- 172.21.15.60:0/1615884028 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbac8014520 con 0x556a7083c370 2024-09-12T00:09:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbac0ff9640 1 -- 172.21.15.60:0/1615884028 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fbad004e070 con 0x556a7083c370 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbae1ba9740 10 client.17805 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbae1ba9740 10 client.17805 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbae1ba9740 20 client.17805 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x556a7084e100 0x556a70850540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbae1ba9740 4 client.17805 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbae1ba9740 1 -- 172.21.15.60:0/1615884028 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a707a4860 con 0x556a7084e100 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.160+0000 7fbadd56c640 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x556a7084e100 0x556a70850540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.161+0000 7fbadd56c640 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x556a7084e100 0x556a70850540 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=69b0103da535deee server_cookie=985245d1a1850c7e in_seq=0 out_seq=0 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.161+0000 7fbac0ff9640 10 client.17805 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.161+0000 7fbac0ff9640 1 -- 172.21.15.60:0/1615884028 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a707a4860 con 0x556a7084e100 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.161+0000 7fbac0ff9640 10 client.17805 handle_command_reply: tid=0 2024-09-12T00:09:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.161+0000 7fbae1ba9740 1 client.17805 shutdown 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 -- 172.21.15.60:0/1615884028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 msgr2=0x556a708397f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a708397f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fbad00bd0b0 tx=0x7fbad00bcc60 comp rx=0 tx=0).stop 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 -- 172.21.15.60:0/1615884028 shutdown_connections 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x556a7084e100 0x556a70850540 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a7083c370 0x556a708397f0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a70832b40 0x556a70839060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbac0ff9640 0 client.17805 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/1615884028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 0x556a7083bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 -- 172.21.15.60:0/1615884028 >> 172.21.15.60:0/1615884028 conn(0x556a707fa310 msgr2=0x556a70833960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 -- 172.21.15.60:0/1615884028 shutdown_connections 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 1 -- 172.21.15.60:0/1615884028 wait complete. 2024-09-12T00:09:20.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.162+0000 7fbae1ba9740 20 client.17805 trim_cache size 0 max 16384 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbae1ba9740 1 Processor -- start 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbae1ba9740 1 -- start start 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 0x556a70838920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a70832b40 0x556a7082cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a70834120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81ab550 con 0x556a70832b40 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81ad090 con 0x556a708315d0 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81abc20 con 0x556a7083c370 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadcd6b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a70832b40 0x556a7082cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadcd6b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a70832b40 0x556a7082cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43560/0 (socket says 172.21.15.60:43560) 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadcd6b640 1 -- 172.21.15.60:0/2256350063 learned_addr learned my addr 172.21.15.60:0/2256350063 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadd56c640 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 0x556a70838920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a70834120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadcd6b640 1 -- 172.21.15.60:0/2256350063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 msgr2=0x556a70834120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a70834120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadcd6b640 1 -- 172.21.15.60:0/2256350063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 msgr2=0x556a70838920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 0x556a70838920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbadcd6b640 1 -- 172.21.15.60:0/2256350063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a70850bc0 con 0x556a70832b40 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.175+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a70834120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a70832b40 0x556a7082cbf0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fbac800cd10 tx=0x7fbac800cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6aacbfd13c52ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbac2ffd640 1 -- 172.21.15.60:0/2256350063 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac800c960 con 0x556a70832b40 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbac2ffd640 1 -- 172.21.15.60:0/2256350063 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbac8005040 con 0x556a70832b40 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbac2ffd640 1 -- 172.21.15.60:0/2256350063 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80143c0 con 0x556a70832b40 2024-09-12T00:09:20.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2256350063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a70832b40 msgr2=0x556a7082cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a70832b40 0x556a7082cbf0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fbac800cd10 tx=0x7fbac800cd40 comp rx=0 tx=0).stop 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2256350063 shutdown_connections 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a70834120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a70832b40 0x556a7082cbf0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2256350063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a708315d0 0x556a70838920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.176+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2256350063 >> 172.21.15.60:0/2256350063 conn(0x556a707fa310 msgr2=0x556a7082c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2256350063 shutdown_connections 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2256350063 wait complete. 2024-09-12T00:09:20.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 -- start start 2024-09-12T00:09:20.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 Processor -- start 2024-09-12T00:09:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a708315d0 0x556a70846f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70842260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a708429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81ac9c0 con 0x556a708315d0 2024-09-12T00:09:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81ac2f0 con 0x556a70832b40 2024-09-12T00:09:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbad81a9550 con 0x556a7083c370 2024-09-12T00:09:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.177+0000 7fbae1ba9740 10 client.0 _ll_register_callbacks cb 0x7fbad0004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:20.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a708315d0 0x556a70846f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a708315d0 0x556a70846f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43572/0 (socket says 172.21.15.60:43572) 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 -- 172.21.15.60:0/2767935548 learned_addr learned my addr 172.21.15.60:0/2767935548 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a708429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70842260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 -- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 msgr2=0x556a708429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a708429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 -- 172.21.15.60:0/2767935548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 msgr2=0x556a70842260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70842260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 -- 172.21.15.60:0/2767935548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a708b7e20 con 0x556a708315d0 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbaddd6d640 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a708429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:20.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbadd56c640 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a708315d0 0x556a70846f30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x556a70850dc0 tx=0x7fbad4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09b16eae991a346 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbac0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbac0ff9640 1 -- 172.21.15.60:0/2767935548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4014440 con 0x556a708315d0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbac0ff9640 1 -- 172.21.15.60:0/2767935548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fbad40145e0 con 0x556a708315d0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2767935548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbac8005040 con 0x556a708315d0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbac0ff9640 1 -- 172.21.15.60:0/2767935548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fbad40147e0 con 0x556a708315d0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbae1ba9740 10 client.17811 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.178+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2767935548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x556a708b8fb0 con 0x556a708315d0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbac0ff9640 1 -- 172.21.15.60:0/2767935548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbac8005040 con 0x556a708315d0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbac0ff9640 1 -- 172.21.15.60:0/2767935548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fbad4020040 con 0x556a708315d0 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbae1ba9740 10 client.17811 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbae1ba9740 10 client.17811 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbae1ba9740 20 client.17811 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x556a708b96b0 0x556a708bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbae1ba9740 4 client.17811 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2767935548 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a7079ed70 con 0x556a708b96b0 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.179+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x556a708b96b0 0x556a708bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbadcd6b640 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x556a708b96b0 0x556a708bbad0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fbed34c63496a96e server_cookie=535f6ba86dadb453 in_seq=0 out_seq=0 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbac0ff9640 10 client.17811 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbac0ff9640 1 -- 172.21.15.60:0/2767935548 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a7079ed70 con 0x556a708b96b0 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbac0ff9640 10 client.17811 handle_command_reply: tid=0 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 client.17811 shutdown 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2767935548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a708315d0 msgr2=0x556a70846f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a708315d0 0x556a70846f30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x556a70850dc0 tx=0x7fbad4014000 comp rx=0 tx=0).stop 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2767935548 shutdown_connections 2024-09-12T00:09:20.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x556a708b96b0 0x556a708bbad0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556a7083c370 0x556a708429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556a70832b40 0x556a70842260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbac0ff9640 0 client.17811 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 --2- 172.21.15.60:0/2767935548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556a708315d0 0x556a70846f30 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2767935548 >> 172.21.15.60:0/2767935548 conn(0x556a707fa310 msgr2=0x556a7083a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2767935548 shutdown_connections 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 1 -- 172.21.15.60:0/2767935548 wait complete. 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.180+0000 7fbae1ba9740 20 client.17811 trim_cache size 0 max 16384 2024-09-12T00:09:20.197 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 -- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbac40a2cf0 msgr2=0x7fbac40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbac40a2cf0 0x7fbac40a51b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x556a7082eac0 tx=0x7fbad4009110 comp rx=0 tx=0).stop 2024-09-12T00:09:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 -- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8106a80 msgr2=0x7fbad819bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8106a80 0x7fbad819bcf0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fbad0006010 tx=0x7fbad0003f10 comp rx=0 tx=0).stop 2024-09-12T00:09:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 -- 172.21.15.60:0/3894685734 shutdown_connections 2024-09-12T00:09:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbac40a2cf0 0x7fbac40a51b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbad8106a80 0x7fbad819bcf0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbad8101420 0x7fbad8197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 --2- 172.21.15.60:0/3894685734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbad8100a80 0x7fbad8197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 -- 172.21.15.60:0/3894685734 >> 172.21.15.60:0/3894685734 conn(0x7fbad80fc7a0 msgr2=0x7fbad80fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 -- 172.21.15.60:0/3894685734 shutdown_connections 2024-09-12T00:09:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:20.181+0000 7fbadf7d0640 1 -- 172.21.15.60:0/3894685734 wait complete. 2024-09-12T00:09:20.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:09:21.104 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:21 smithi060 ceph-mon[30953]: pgmap v310: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:21.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:21 smithi192 ceph-mon[35487]: pgmap v310: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:21.346 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:21.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:21 smithi105 ceph-mon[34805]: pgmap v310: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.837+0000 7fd75fa38640 1 -- 172.21.15.60:0/1695426757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 msgr2=0x7fd75810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.837+0000 7fd75fa38640 1 --2- 172.21.15.60:0/1695426757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 0x7fd75810bb50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd748009900 tx=0x7fd74802a480 comp rx=0 tx=0).stop 2024-09-12T00:09:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.837+0000 7fd75fa38640 1 -- 172.21.15.60:0/1695426757 shutdown_connections 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.837+0000 7fd75fa38640 1 --2- 172.21.15.60:0/1695426757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd75810c170 0x7fd75810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.837+0000 7fd75fa38640 1 --2- 172.21.15.60:0/1695426757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 0x7fd75810bb50 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.837+0000 7fd75fa38640 1 --2- 172.21.15.60:0/1695426757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758102d40 0x7fd758103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.837+0000 7fd75fa38640 1 -- 172.21.15.60:0/1695426757 >> 172.21.15.60:0/1695426757 conn(0x7fd7580fc7a0 msgr2=0x7fd7580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.838+0000 7fd75fa38640 1 -- 172.21.15.60:0/1695426757 shutdown_connections 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.838+0000 7fd75fa38640 1 -- 172.21.15.60:0/1695426757 wait complete. 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.838+0000 7fd75fa38640 1 Processor -- start 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.838+0000 7fd75fa38640 1 -- start start 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75fa38640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd758102d40 0x7fd758198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75fa38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 0x7fd758198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75fa38640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd75810c170 0x7fd75819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75fa38640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd758112090 con 0x7fd758103660 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75fa38640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd758111f10 con 0x7fd758102d40 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75fa38640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd758112210 con 0x7fd75810c170 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 0x7fd758198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 0x7fd758198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45380/0 (socket says 172.21.15.60:45380) 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 -- 172.21.15.60:0/3156488857 learned_addr learned my addr 172.21.15.60:0/3156488857 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75d7d4640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd758102d40 0x7fd758198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd75810c170 0x7fd75819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 -- 172.21.15.60:0/3156488857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd75810c170 msgr2=0x7fd75819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd75810c170 0x7fd75819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 -- 172.21.15.60:0/3156488857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd758102d40 msgr2=0x7fd758198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd758102d40 0x7fd758198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 -- 172.21.15.60:0/3156488857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75819d4f0 con 0x7fd758103660 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 0x7fd758198a80 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd748006010 tx=0x7fd7480040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.839+0000 7fd74e7fc640 1 -- 172.21.15.60:0/3156488857 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74803f030 con 0x7fd758103660 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.840+0000 7fd74e7fc640 1 -- 172.21.15.60:0/3156488857 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd7480044c0 con 0x7fd758103660 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.840+0000 7fd75fa38640 1 -- 172.21.15.60:0/3156488857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75819d780 con 0x7fd758103660 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.840+0000 7fd74e7fc640 1 -- 172.21.15.60:0/3156488857 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748035070 con 0x7fd758103660 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.840+0000 7fd75fa38640 1 -- 172.21.15.60:0/3156488857 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7581a50c0 con 0x7fd758103660 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd74e7fc640 1 -- 172.21.15.60:0/3156488857 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd748042030 con 0x7fd758103660 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd761e11740 1 Processor -- start 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd761e11740 1 -- start start 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd761e11740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d2595090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd761e11740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 0x5622d2595a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd761e11740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d25a2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd761e11740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5622d24fb2f0 con 0x5622d2596b40 2024-09-12T00:09:21.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd761e11740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5622d24a2cf0 con 0x5622d25955d0 2024-09-12T00:09:21.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.842+0000 7fd761e11740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5622d24f72b0 con 0x5622d25a0370 2024-09-12T00:09:21.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d2595090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d2595090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45394/0 (socket says 172.21.15.60:45394) 2024-09-12T00:09:21.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 -- 172.21.15.60:0/127339431 learned_addr learned my addr 172.21.15.60:0/127339431 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:21.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd74e7fc640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd7440a2d70 0x7fd7440a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d25a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75d7d4640 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 0x5622d2595a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 -- 172.21.15.60:0/127339431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 msgr2=0x5622d25a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d25a2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 -- 172.21.15.60:0/127339431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 msgr2=0x5622d2595a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 0x5622d2595a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 -- 172.21.15.60:0/127339431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d24873a0 con 0x5622d2596b40 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d25a2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd74e7fc640 1 -- 172.21.15.60:0/3156488857 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd7480ef6f0 con 0x7fd758103660 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd7440a2d70 0x7fd7440a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d2595090 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd750009eb0 tx=0x7fd75000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f10abd242c02cee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd7437fe640 1 -- 172.21.15.60:0/127339431 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75001a610 con 0x5622d2596b40 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd7437fe640 1 -- 172.21.15.60:0/127339431 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd750012e40 con 0x5622d2596b40 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd7437fe640 1 -- 172.21.15.60:0/127339431 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7500109b0 con 0x5622d2596b40 2024-09-12T00:09:21.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.843+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd7440a2d70 0x7fd7440a5230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd750020000 tx=0x7fd75001d000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 -- 172.21.15.60:0/127339431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 msgr2=0x5622d2595090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d2595090 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd750009eb0 tx=0x7fd75000f730 comp rx=0 tx=0).stop 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 -- 172.21.15.60:0/127339431 shutdown_connections 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d25a2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 0x5622d2595a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 --2- 172.21.15.60:0/127339431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d2595090 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 -- 172.21.15.60:0/127339431 >> 172.21.15.60:0/127339431 conn(0x5622d255e310 msgr2=0x5622d2591c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 -- 172.21.15.60:0/127339431 shutdown_connections 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.844+0000 7fd761e11740 1 -- 172.21.15.60:0/127339431 wait complete. 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 1 -- start start 2024-09-12T00:09:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 1 Processor -- start 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d25955d0 0x5622d259fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d2596b40 0x5622d259cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d259d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5622d25a3070 con 0x5622d25955d0 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5622d24b6060 con 0x5622d2596b40 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5622d25a31f0 con 0x5622d25a0370 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd761e11740 10 client.0 _ll_register_callbacks cb 0x5622d22098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd75d7d4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d25955d0 0x5622d259fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd75d7d4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d25955d0 0x5622d259fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45406/0 (socket says 172.21.15.60:45406) 2024-09-12T00:09:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd75d7d4640 1 -- 172.21.15.60:0/2122657244 learned_addr learned my addr 172.21.15.60:0/2122657244 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d259d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.845+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d2596b40 0x5622d259cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd75d7d4640 1 -- 172.21.15.60:0/2122657244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 msgr2=0x5622d259d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd75d7d4640 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d259d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd75d7d4640 1 -- 172.21.15.60:0/2122657244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d2596b40 msgr2=0x5622d259cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:21.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd75d7d4640 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d2596b40 0x5622d259cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd75d7d4640 1 -- 172.21.15.60:0/2122657244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d226c3c0 con 0x5622d25955d0 2024-09-12T00:09:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d2596b40 0x5622d259cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd75d7d4640 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d25955d0 0x5622d259fd30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd754012700 tx=0x7fd754012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c24bb62ce9c49e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd740ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd740ff9640 1 -- 172.21.15.60:0/2122657244 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754004050 con 0x5622d25955d0 2024-09-12T00:09:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd740ff9640 1 -- 172.21.15.60:0/2122657244 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd7540041f0 con 0x5622d25955d0 2024-09-12T00:09:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd761e11740 1 -- 172.21.15.60:0/2122657244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622d2508860 con 0x5622d25955d0 2024-09-12T00:09:21.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd740ff9640 1 -- 172.21.15.60:0/2122657244 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fd7540043f0 con 0x5622d25955d0 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd761e11740 10 client.17823 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd761e11740 1 -- 172.21.15.60:0/2122657244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5622d25aeb30 con 0x5622d25955d0 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.846+0000 7fd740ff9640 1 -- 172.21.15.60:0/2122657244 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x5622d2508860 con 0x5622d25955d0 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd740ff9640 1 -- 172.21.15.60:0/2122657244 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fd754023020 con 0x5622d25955d0 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd761e11740 10 client.17823 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd761e11740 10 client.17823 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd761e11740 20 client.17823 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd761e11740 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5622d25aff40 0x5622d25b2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd761e11740 4 client.17823 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:21.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd761e11740 1 -- 172.21.15.60:0/2122657244 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622d2502d70 con 0x5622d25aff40 2024-09-12T00:09:21.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5622d25aff40 0x5622d25b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5622d25aff40 0x5622d25b2350 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64740225e6a37e9f server_cookie=70c1a1bfadbf7bc2 in_seq=0 out_seq=0 2024-09-12T00:09:21.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.847+0000 7fd740ff9640 10 client.17823 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:09:21.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd740ff9640 1 -- 172.21.15.60:0/2122657244 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622d2502d70 con 0x5622d25aff40 2024-09-12T00:09:21.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd740ff9640 10 client.17823 handle_command_reply: tid=0 2024-09-12T00:09:21.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 client.17823 shutdown 2024-09-12T00:09:21.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 -- 172.21.15.60:0/2122657244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d25955d0 msgr2=0x5622d259fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d25955d0 0x5622d259fd30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd754012700 tx=0x7fd754012bc0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 -- 172.21.15.60:0/2122657244 shutdown_connections 2024-09-12T00:09:21.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5622d25aff40 0x5622d25b2350 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d259d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d2596b40 0x5622d259cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 --2- 172.21.15.60:0/2122657244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d25955d0 0x5622d259fd30 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd761e11740 1 -- 172.21.15.60:0/2122657244 >> 172.21.15.60:0/2122657244 conn(0x5622d255e310 msgr2=0x5622d2597930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:21.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.848+0000 7fd740ff9640 0 client.17823 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:09:21.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.849+0000 7fd761e11740 1 -- 172.21.15.60:0/2122657244 shutdown_connections 2024-09-12T00:09:21.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.849+0000 7fd761e11740 1 -- 172.21.15.60:0/2122657244 wait complete. 2024-09-12T00:09:21.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.849+0000 7fd761e11740 20 client.17823 trim_cache size 0 max 16384 2024-09-12T00:09:21.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd761e11740 1 Processor -- start 2024-09-12T00:09:21.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd761e11740 1 -- start start 2024-09-12T00:09:21.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd761e11740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25955d0 0x5622d2591e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd761e11740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25ac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd761e11740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25a0370 0x5622d2598120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd761e11740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581ad8f0 con 0x5622d2596b40 2024-09-12T00:09:21.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd761e11740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581af430 con 0x5622d25a0370 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd761e11740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581adfc0 con 0x5622d25955d0 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75cfd3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75cfd3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45408/0 (socket says 172.21.15.60:45408) 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75cfd3640 1 -- 172.21.15.60:0/2638418441 learned_addr learned my addr 172.21.15.60:0/2638418441 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75d7d4640 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25955d0 0x5622d2591e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25a0370 0x5622d2598120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75cfd3640 1 -- 172.21.15.60:0/2638418441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25955d0 msgr2=0x5622d2591e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25955d0 0x5622d2591e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75cfd3640 1 -- 172.21.15.60:0/2638418441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25a0370 msgr2=0x5622d2598120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25a0370 0x5622d2598120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.862+0000 7fd75cfd3640 1 -- 172.21.15.60:0/2638418441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d2592960 con 0x5622d2596b40 2024-09-12T00:09:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25ac310 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd74803b680 tx=0x7fd7480b7ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1273c81a950746d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd742ffd640 1 -- 172.21.15.60:0/2638418441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748049070 con 0x5622d2596b40 2024-09-12T00:09:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd742ffd640 1 -- 172.21.15.60:0/2638418441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd7480bbc30 con 0x5622d2596b40 2024-09-12T00:09:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd742ffd640 1 -- 172.21.15.60:0/2638418441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7480a6040 con 0x5622d2596b40 2024-09-12T00:09:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd761e11740 1 -- 172.21.15.60:0/2638418441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 msgr2=0x5622d25ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd761e11740 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25ac310 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd74803b680 tx=0x7fd7480b7ed0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd761e11740 1 -- 172.21.15.60:0/2638418441 shutdown_connections 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd761e11740 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25a0370 0x5622d2598120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd761e11740 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25ac310 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd761e11740 1 --2- 172.21.15.60:0/2638418441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25955d0 0x5622d2591e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.863+0000 7fd761e11740 1 -- 172.21.15.60:0/2638418441 >> 172.21.15.60:0/2638418441 conn(0x5622d255e310 msgr2=0x5622d2591700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 -- 172.21.15.60:0/2638418441 shutdown_connections 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 -- 172.21.15.60:0/2638418441 wait complete. 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 -- start start 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 Processor -- start 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 0x5622d25a8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d2599630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581aed60 con 0x5622d2596b40 2024-09-12T00:09:21.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581ae690 con 0x5622d25955d0 2024-09-12T00:09:21.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd7581ab8f0 con 0x5622d25a0370 2024-09-12T00:09:21.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd761e11740 10 client.0 _ll_register_callbacks cb 0x7fd754009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:21.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.864+0000 7fd75cfd3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75cfd3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45422/0 (socket says 172.21.15.60:45422) 2024-09-12T00:09:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75d7d4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 0x5622d25a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75cfd3640 1 -- 172.21.15.60:0/4028633313 learned_addr learned my addr 172.21.15.60:0/4028633313 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75dfd5640 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d2599630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75cfd3640 1 -- 172.21.15.60:0/4028633313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 msgr2=0x5622d2599630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d2599630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75cfd3640 1 -- 172.21.15.60:0/4028633313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 msgr2=0x5622d25a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 0x5622d25a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75cfd3640 1 -- 172.21.15.60:0/4028633313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d2599b70 con 0x5622d2596b40 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd75cfd3640 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25a89c0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd7480b8600 tx=0x7fd74802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389b2dd1454e306c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd740ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd740ff9640 1 -- 172.21.15.60:0/4028633313 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748049070 con 0x5622d2596b40 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd740ff9640 1 -- 172.21.15.60:0/4028633313 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd7480b82a0 con 0x5622d2596b40 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd761e11740 1 -- 172.21.15.60:0/4028633313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7480bbc30 con 0x5622d2596b40 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd740ff9640 1 -- 172.21.15.60:0/4028633313 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fd7480a6040 con 0x5622d2596b40 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd761e11740 10 client.17829 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.865+0000 7fd761e11740 1 -- 172.21.15.60:0/4028633313 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5622d261a370 con 0x5622d2596b40 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd740ff9640 1 -- 172.21.15.60:0/4028633313 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd7480bbc30 con 0x5622d2596b40 2024-09-12T00:09:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd740ff9640 1 -- 172.21.15.60:0/4028633313 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fd74803bbc0 con 0x5622d2596b40 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd761e11740 10 client.17829 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd761e11740 10 client.17829 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd761e11740 20 client.17829 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd761e11740 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5622d261a850 0x5622d261cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd761e11740 4 client.17829 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd761e11740 1 -- 172.21.15.60:0/4028633313 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622d247f170 con 0x5622d261a850 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd75d7d4640 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5622d261a850 0x5622d261cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd75d7d4640 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5622d261a850 0x5622d261cc40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af747f19d4b9ccae server_cookie=e3b17bd5a3afc7e8 in_seq=0 out_seq=0 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.866+0000 7fd740ff9640 10 client.17829 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:09:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd740ff9640 1 -- 172.21.15.60:0/4028633313 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622d247f170 con 0x5622d261a850 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd740ff9640 10 client.17829 handle_command_reply: tid=0 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 client.17829 shutdown 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 -- 172.21.15.60:0/4028633313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 msgr2=0x5622d25a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25a89c0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd7480b8600 tx=0x7fd74802a480 comp rx=0 tx=0).stop 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 -- 172.21.15.60:0/4028633313 shutdown_connections 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x5622d261a850 0x5622d261cc40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd740ff9640 0 client.17829 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d25a0370 0x5622d2599630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622d2596b40 0x5622d25a89c0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 --2- 172.21.15.60:0/4028633313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5622d25955d0 0x5622d25a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 -- 172.21.15.60:0/4028633313 >> 172.21.15.60:0/4028633313 conn(0x5622d255e310 msgr2=0x5622d25904e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:21.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 -- 172.21.15.60:0/4028633313 shutdown_connections 2024-09-12T00:09:21.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 1 -- 172.21.15.60:0/4028633313 wait complete. 2024-09-12T00:09:21.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.867+0000 7fd761e11740 20 client.17829 trim_cache size 0 max 16384 2024-09-12T00:09:21.882 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:21.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 -- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd7440a2d70 msgr2=0x7fd7440a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd7440a2d70 0x7fd7440a5230 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd750020000 tx=0x7fd75001d000 comp rx=0 tx=0).stop 2024-09-12T00:09:21.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 -- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 msgr2=0x7fd758198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:21.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 0x7fd758198a80 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd748006010 tx=0x7fd7480040c0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 -- 172.21.15.60:0/3156488857 shutdown_connections 2024-09-12T00:09:21.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd7440a2d70 0x7fd7440a5230 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd75810c170 0x7fd75819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd758103660 0x7fd758198a80 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 --2- 172.21.15.60:0/3156488857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd758102d40 0x7fd758198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:21.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 -- 172.21.15.60:0/3156488857 >> 172.21.15.60:0/3156488857 conn(0x7fd7580fc7a0 msgr2=0x7fd7580fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:21.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 -- 172.21.15.60:0/3156488857 shutdown_connections 2024-09-12T00:09:21.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:21.868+0000 7fd75fa38640 1 -- 172.21.15.60:0/3156488857 wait complete. 2024-09-12T00:09:22.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:09:22.971 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:23.259 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:23 smithi060 ceph-mon[30953]: pgmap v311: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:23.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:23 smithi192 ceph-mon[35487]: pgmap v311: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:23.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:23 smithi105 ceph-mon[34805]: pgmap v311: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T00:09:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1276128895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 msgr2=0x7f3a14107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1276128895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 0x7f3a14107b90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009930 tx=0x7f39fc02a420 comp rx=0 tx=0).stop 2024-09-12T00:09:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1276128895 shutdown_connections 2024-09-12T00:09:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1276128895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a141082a0 0x7f3a1410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1276128895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 0x7f3a14107b90 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1276128895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a14102d30 0x7f3a14103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1276128895 >> 172.21.15.60:0/1276128895 conn(0x7f3a140fc7d0 msgr2=0x7f3a140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1276128895 shutdown_connections 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.516+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1276128895 wait complete. 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a1a91f640 1 Processor -- start 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a1a91f640 1 -- start start 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a1a91f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a14102d30 0x7f3a141986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a1a91f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 0x7f3a14198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a1a91f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a141082a0 0x7f3a1419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a1a91f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141121c0 con 0x7f3a141036e0 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a1a91f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a14112040 con 0x7f3a141082a0 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a1a91f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3a14112340 con 0x7f3a14102d30 2024-09-12T00:09:23.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 0x7f3a14198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a0bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 0x7f3a14198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45448/0 (socket says 172.21.15.60:45448) 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a0bfff640 1 -- 172.21.15.60:0/1363748974 learned_addr learned my addr 172.21.15.60:0/1363748974 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a13fff640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a14102d30 0x7f3a141986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.517+0000 7f3a18ebc640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a141082a0 0x7f3a1419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a0bfff640 1 -- 172.21.15.60:0/1363748974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a14102d30 msgr2=0x7f3a141986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a14102d30 0x7f3a141986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a0bfff640 1 -- 172.21.15.60:0/1363748974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a141082a0 msgr2=0x7f3a1419cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a141082a0 0x7f3a1419cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a0bfff640 1 -- 172.21.15.60:0/1363748974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1419d670 con 0x7f3a141036e0 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 0x7f3a14198c00 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f39fc004770 tx=0x7f39fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:23.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a11ffb640 1 -- 172.21.15.60:0/1363748974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc03f030 con 0x7f3a141036e0 2024-09-12T00:09:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1363748974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1419d900 con 0x7f3a141036e0 2024-09-12T00:09:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1363748974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a141a5240 con 0x7f3a141036e0 2024-09-12T00:09:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a11ffb640 1 -- 172.21.15.60:0/1363748974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39fc003d00 con 0x7f3a141036e0 2024-09-12T00:09:23.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.518+0000 7f3a11ffb640 1 -- 172.21.15.60:0/1363748974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39fc035070 con 0x7f3a141036e0 2024-09-12T00:09:23.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.521+0000 7f3a1ccf8740 1 Processor -- start 2024-09-12T00:09:23.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.521+0000 7f3a1ccf8740 1 -- start start 2024-09-12T00:09:23.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.521+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b889b40 0x55b87b888090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b888a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 0x55b87b895760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b87b7ee2f0 con 0x55b87b889b40 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b87b795cf0 con 0x55b87b8885d0 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b87b7ea2b0 con 0x55b87b893370 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a18ebc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b889b40 0x55b87b888090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a18ebc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b889b40 0x55b87b888090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45450/0 (socket says 172.21.15.60:45450) 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a18ebc640 1 -- 172.21.15.60:0/2208465054 learned_addr learned my addr 172.21.15.60:0/2208465054 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a11ffb640 1 -- 172.21.15.60:0/1363748974 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f39fc042030 con 0x7f3a141036e0 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a13fff640 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b888a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 0x55b87b895760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a18ebc640 1 -- 172.21.15.60:0/2208465054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 msgr2=0x55b87b895760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a18ebc640 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 0x55b87b895760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a18ebc640 1 -- 172.21.15.60:0/2208465054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 msgr2=0x55b87b888a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a18ebc640 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b888a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a18ebc640 1 -- 172.21.15.60:0/2208465054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b87b77a3a0 con 0x55b87b889b40 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 0x55b87b895760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.522+0000 7f3a13fff640 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b888a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.523+0000 7f3a18ebc640 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b889b40 0x55b87b888090 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009f90 tx=0x7f3a0c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fb251aec97eb10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.523+0000 7f3a11ffb640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a000a2d70 0x7f3a000a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.523+0000 7f3a0a7fc640 1 -- 172.21.15.60:0/2208465054 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c011700 con 0x55b87b889b40 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.523+0000 7f3a0a7fc640 1 -- 172.21.15.60:0/2208465054 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a0c011da0 con 0x55b87b889b40 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.523+0000 7f3a0a7fc640 1 -- 172.21.15.60:0/2208465054 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c018380 con 0x55b87b889b40 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.523+0000 7f3a13fff640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a000a2d70 0x7f3a000a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.523+0000 7f3a11ffb640 1 -- 172.21.15.60:0/1363748974 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f39fc0ef7d0 con 0x7f3a141036e0 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2208465054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b889b40 msgr2=0x55b87b888090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b889b40 0x55b87b888090 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009f90 tx=0x7f3a0c010860 comp rx=0 tx=0).stop 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a13fff640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a000a2d70 0x7f3a000a5230 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55b87b885ac0 tx=0x7f3a0400b390 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2208465054 shutdown_connections 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 0x55b87b895760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b888a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2208465054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b889b40 0x55b87b888090 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2208465054 >> 172.21.15.60:0/2208465054 conn(0x55b87b851310 msgr2=0x55b87b884c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2208465054 shutdown_connections 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2208465054 wait complete. 2024-09-12T00:09:23.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 -- start start 2024-09-12T00:09:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.524+0000 7f3a1ccf8740 1 Processor -- start 2024-09-12T00:09:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b892d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b889b40 0x55b87b88ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 0x55b87b890560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b87b89a480 con 0x55b87b8885d0 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b87b7a9060 con 0x55b87b889b40 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b87b89a600 con 0x55b87b893370 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a1ccf8740 10 client.0 _ll_register_callbacks cb 0x55b87b4fc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b892d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b892d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45454/0 (socket says 172.21.15.60:45454) 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 -- 172.21.15.60:0/2899235261 learned_addr learned my addr 172.21.15.60:0/2899235261 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b889b40 0x55b87b88ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 -- 172.21.15.60:0/2899235261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 msgr2=0x55b87b890560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 0x55b87b890560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 -- 172.21.15.60:0/2899235261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b889b40 msgr2=0x55b87b88ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b889b40 0x55b87b88ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 -- 172.21.15.60:0/2899235261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b87b55f3c0 con 0x55b87b8885d0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f3a13fff640 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b892d10 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f3a040043f0 tx=0x7f3a04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f9832f10445840 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.525+0000 7f39f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f39f37fe640 1 -- 172.21.15.60:0/2899235261 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0402c060 con 0x55b87b8885d0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f39f37fe640 1 -- 172.21.15.60:0/2899235261 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f3a04017030 con 0x55b87b8885d0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2899235261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a0c011da0 con 0x55b87b8885d0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f39f37fe640 1 -- 172.21.15.60:0/2899235261 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3a04027410 con 0x55b87b8885d0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 10 client.17841 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2899235261 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55b87b8a5ef0 con 0x55b87b8885d0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f39f37fe640 1 -- 172.21.15.60:0/2899235261 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a0c011da0 con 0x55b87b8885d0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f39f37fe640 1 -- 172.21.15.60:0/2899235261 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f3a0401c510 con 0x55b87b8885d0 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 10 client.17841 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 10 client.17841 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:09:23.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 20 client.17841 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b87b8a73b0 0x55b87b8a9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 4 client.17841 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.526+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2899235261 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b87b7fb860 con 0x55b87b8a73b0 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.527+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b87b8a73b0 0x55b87b8a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.527+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b87b8a73b0 0x55b87b8a9820 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf43f0692dac9e71 server_cookie=829308447bbdc2c8 in_seq=0 out_seq=0 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.527+0000 7f39f37fe640 10 client.17841 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f39f37fe640 1 -- 172.21.15.60:0/2899235261 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b87b7fb860 con 0x55b87b8a73b0 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f39f37fe640 10 client.17841 handle_command_reply: tid=0 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 client.17841 shutdown 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2899235261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 msgr2=0x55b87b892d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b892d10 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f3a040043f0 tx=0x7f3a04004730 comp rx=0 tx=0).stop 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2899235261 shutdown_connections 2024-09-12T00:09:23.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b87b8a73b0 0x55b87b8a9820 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b893370 0x55b87b890560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b889b40 0x55b87b88ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/2899235261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b892d10 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2899235261 >> 172.21.15.60:0/2899235261 conn(0x55b87b851310 msgr2=0x55b87b88a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f39f37fe640 0 client.17841 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:09:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2899235261 shutdown_connections 2024-09-12T00:09:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/2899235261 wait complete. 2024-09-12T00:09:23.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.528+0000 7f3a1ccf8740 20 client.17841 trim_cache size 0 max 16384 2024-09-12T00:09:23.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a1ccf8740 1 Processor -- start 2024-09-12T00:09:23.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a1ccf8740 1 -- start start 2024-09-12T00:09:23.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b8a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 0x55b87b87fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b893370 0x55b87b88e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141ab720 con 0x55b87b893370 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141ad260 con 0x55b87b8885d0 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141abdf0 con 0x55b87b889b40 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a18ebc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b893370 0x55b87b88e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a18ebc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b893370 0x55b87b88e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45464/0 (socket says 172.21.15.60:45464) 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.546+0000 7f3a18ebc640 1 -- 172.21.15.60:0/4238003841 learned_addr learned my addr 172.21.15.60:0/4238003841 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 0x55b87b87fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a13fff640 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b8a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a18ebc640 1 -- 172.21.15.60:0/4238003841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 msgr2=0x55b87b87fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:23.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a18ebc640 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 0x55b87b87fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a18ebc640 1 -- 172.21.15.60:0/4238003841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 msgr2=0x55b87b8a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:23.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a18ebc640 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b8a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a18ebc640 1 -- 172.21.15.60:0/4238003841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b87b892830 con 0x55b87b893370 2024-09-12T00:09:23.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a13fff640 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b8a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:23.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a18ebc640 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b893370 0x55b87b88e890 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009960 tx=0x7f3a0c009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f646ac7f5ab6ea1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a09ffb640 1 -- 172.21.15.60:0/4238003841 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c028070 con 0x55b87b893370 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a09ffb640 1 -- 172.21.15.60:0/4238003841 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a0c011500 con 0x55b87b893370 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.547+0000 7f3a09ffb640 1 -- 172.21.15.60:0/4238003841 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0052a0 con 0x55b87b893370 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/4238003841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b893370 msgr2=0x55b87b88e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b893370 0x55b87b88e890 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009960 tx=0x7f3a0c009b70 comp rx=0 tx=0).stop 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/4238003841 shutdown_connections 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b893370 0x55b87b88e890 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 0x55b87b87fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/4238003841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b8885d0 0x55b87b8a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/4238003841 >> 172.21.15.60:0/4238003841 conn(0x55b87b851310 msgr2=0x55b87b88b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/4238003841 shutdown_connections 2024-09-12T00:09:23.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/4238003841 wait complete. 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.548+0000 7f3a1ccf8740 1 -- start start 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a1ccf8740 1 Processor -- start 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b89f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 0x55b87b89fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a1ccf8740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b893370 0x55b87b88c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141acb90 con 0x55b87b8885d0 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141ac4c0 con 0x55b87b893370 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a1ccf8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3a141a9720 con 0x55b87b889b40 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a1ccf8740 10 client.0 _ll_register_callbacks cb 0x7f3a04003bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b89f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a13fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b89f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45474/0 (socket says 172.21.15.60:45474) 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a13fff640 1 -- 172.21.15.60:0/1117171453 learned_addr learned my addr 172.21.15.60:0/1117171453 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:23.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 0x55b87b89fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a18ebc640 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b893370 0x55b87b88c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a13fff640 1 -- 172.21.15.60:0/1117171453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 msgr2=0x55b87b89fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:23.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a13fff640 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 0x55b87b89fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a13fff640 1 -- 172.21.15.60:0/1117171453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b893370 msgr2=0x55b87b88c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:23.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a13fff640 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b893370 0x55b87b88c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.549+0000 7f3a13fff640 1 -- 172.21.15.60:0/1117171453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b87b88cc30 con 0x55b87b8885d0 2024-09-12T00:09:23.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f3a13fff640 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b89f890 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3a04004700 tx=0x7f3a0400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b170d0900807ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:23.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f39f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f39f37fe640 1 -- 172.21.15.60:0/1117171453 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04005020 con 0x55b87b8885d0 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f39f37fe640 1 -- 172.21.15.60:0/1117171453 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f3a040051c0 con 0x55b87b8885d0 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/1117171453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a0c011500 con 0x55b87b8885d0 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f39f37fe640 1 -- 172.21.15.60:0/1117171453 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3a0402c020 con 0x55b87b8885d0 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f3a1ccf8740 10 client.17847 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/1117171453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55b87b911a00 con 0x55b87b8885d0 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f39f37fe640 1 -- 172.21.15.60:0/1117171453 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a0c011500 con 0x55b87b8885d0 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f39f37fe640 1 -- 172.21.15.60:0/1117171453 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f3a0403f030 con 0x55b87b8885d0 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f3a1ccf8740 10 client.17847 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.550+0000 7f3a1ccf8740 10 client.17847 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.551+0000 7f3a1ccf8740 20 client.17847 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:23.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.551+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b87b9121d0 0x55b87b9145f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.551+0000 7f3a1ccf8740 4 client.17847 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.551+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/1117171453 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b87b7f5d70 con 0x55b87b9121d0 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.551+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b87b9121d0 0x55b87b9145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.551+0000 7f39f37fe640 10 client.17847 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.551+0000 7f3a0bfff640 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b87b9121d0 0x55b87b9145f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b12e0b5bc72d681 server_cookie=9a337c946ba46a24 in_seq=0 out_seq=0 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f39f37fe640 1 -- 172.21.15.60:0/1117171453 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b87b7f5d70 con 0x55b87b9121d0 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f39f37fe640 10 client.17847 handle_command_reply: tid=0 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 client.17847 shutdown 2024-09-12T00:09:23.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/1117171453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 msgr2=0x55b87b89f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b89f890 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3a04004700 tx=0x7f3a0400b840 comp rx=0 tx=0).stop 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/1117171453 shutdown_connections 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x55b87b9121d0 0x55b87b9145f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b87b893370 0x55b87b88c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f39f37fe640 0 client.17847 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b87b889b40 0x55b87b89fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 --2- 172.21.15.60:0/1117171453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b87b8885d0 0x55b87b89f890 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/1117171453 >> 172.21.15.60:0/1117171453 conn(0x55b87b851310 msgr2=0x55b87b88b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/1117171453 shutdown_connections 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 1 -- 172.21.15.60:0/1117171453 wait complete. 2024-09-12T00:09:23.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.552+0000 7f3a1ccf8740 20 client.17847 trim_cache size 0 max 16384 2024-09-12T00:09:23.568 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a000a2d70 msgr2=0x7f3a000a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a000a2d70 0x7f3a000a5230 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55b87b885ac0 tx=0x7f3a0400b390 comp rx=0 tx=0).stop 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 msgr2=0x7f3a14198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 0x7f3a14198c00 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f39fc004770 tx=0x7f39fc0042f0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1363748974 shutdown_connections 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f3a000a2d70 0x7f3a000a5230 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a141082a0 0x7f3a1419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a141036e0 0x7f3a14198c00 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 --2- 172.21.15.60:0/1363748974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a14102d30 0x7f3a141986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1363748974 >> 172.21.15.60:0/1363748974 conn(0x7f3a140fc7d0 msgr2=0x7f3a14105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:23.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1363748974 shutdown_connections 2024-09-12T00:09:23.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:23.553+0000 7f3a1a91f640 1 -- 172.21.15.60:0/1363748974 wait complete. 2024-09-12T00:09:24.339 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:09:23 smithi060 sudo[108424]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:24.339 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:09:23 smithi060 sudo[108424]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:24.339 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:09:23 smithi060 sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:24.339 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:09:23 smithi060 sudo[108424]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:24.397 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:09:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:24.778 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:09:24 smithi060 sudo[108430]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:24.778 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:09:24 smithi060 sudo[108430]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:24.778 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:09:24 smithi060 sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:24.778 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:09:24 smithi060 sudo[108430]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:24.945 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:09:24 smithi105 sudo[69641]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:24.945 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:09:24 smithi105 sudo[69641]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:24.945 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:09:24 smithi105 sudo[69641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:24.945 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:09:24 smithi105 sudo[69641]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:25.075 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:25 smithi060 ceph-mon[30953]: pgmap v312: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:09:25.076 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:25.076 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:25 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 -- 172.21.15.60:0/3346199762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641082a0 msgr2=0x7f826410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 --2- 172.21.15.60:0/3346199762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641082a0 0x7f826410ec40 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f825c009930 tx=0x7f825c02a420 comp rx=0 tx=0).stop 2024-09-12T00:09:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 -- 172.21.15.60:0/3346199762 shutdown_connections 2024-09-12T00:09:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 --2- 172.21.15.60:0/3346199762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641082a0 0x7f826410ec40 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 --2- 172.21.15.60:0/3346199762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82641036e0 0x7f8264107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 --2- 172.21.15.60:0/3346199762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264102d30 0x7f8264103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 -- 172.21.15.60:0/3346199762 >> 172.21.15.60:0/3346199762 conn(0x7f82640fc7d0 msgr2=0x7f82640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 -- 172.21.15.60:0/3346199762 shutdown_connections 2024-09-12T00:09:25.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.159+0000 7f8268ccf640 1 -- 172.21.15.60:0/3346199762 wait complete. 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8268ccf640 1 Processor -- start 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8268ccf640 1 -- start start 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8268ccf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264102d30 0x7f8264100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8268ccf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641036e0 0x7f8264100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8268ccf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82641082a0 0x7f8264101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8268ccf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82641121e0 con 0x7f82641036e0 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8268ccf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8264112060 con 0x7f8264102d30 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8268ccf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8264112360 con 0x7f82641082a0 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8261d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641036e0 0x7f8264100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8261d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641036e0 0x7f8264100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45482/0 (socket says 172.21.15.60:45482) 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8261d9b640 1 -- 172.21.15.60:0/437953285 learned_addr learned my addr 172.21.15.60:0/437953285 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f8262d9d640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82641082a0 0x7f8264101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.160+0000 7f826259c640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264102d30 0x7f8264100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f8261d9b640 1 -- 172.21.15.60:0/437953285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82641082a0 msgr2=0x7f8264101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f8261d9b640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82641082a0 0x7f8264101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f8261d9b640 1 -- 172.21.15.60:0/437953285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264102d30 msgr2=0x7f8264100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f8261d9b640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264102d30 0x7f8264100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f8261d9b640 1 -- 172.21.15.60:0/437953285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82641a6b20 con 0x7f82641036e0 2024-09-12T00:09:25.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f826259c640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264102d30 0x7f8264100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f8261d9b640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641036e0 0x7f8264100ed0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f825800e9c0 tx=0x7f825800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f82537fe640 1 -- 172.21.15.60:0/437953285 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825800ccc0 con 0x7f82641036e0 2024-09-12T00:09:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f8268ccf640 1 -- 172.21.15.60:0/437953285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82641a6e10 con 0x7f82641036e0 2024-09-12T00:09:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f82537fe640 1 -- 172.21.15.60:0/437953285 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8258005520 con 0x7f82641036e0 2024-09-12T00:09:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f82537fe640 1 -- 172.21.15.60:0/437953285 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258010690 con 0x7f82641036e0 2024-09-12T00:09:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.161+0000 7f8268ccf640 1 -- 172.21.15.60:0/437953285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82641a72c0 con 0x7f82641036e0 2024-09-12T00:09:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.163+0000 7f82537fe640 1 -- 172.21.15.60:0/437953285 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f82580046c0 con 0x7f82641036e0 2024-09-12T00:09:25.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.163+0000 7f826b0a8740 1 Processor -- start 2024-09-12T00:09:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826b0a8740 1 -- start start 2024-09-12T00:09:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826b0a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5575e633a2f0 con 0x5575e63d45d0 2024-09-12T00:09:25.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826b0a8740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5575e62e1cf0 con 0x5575e63d5b40 2024-09-12T00:09:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826b0a8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5575e63362b0 con 0x5575e63df370 2024-09-12T00:09:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63d4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45492/0 (socket says 172.21.15.60:45492) 2024-09-12T00:09:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f826259c640 1 -- 172.21.15.60:0/1692952649 learned_addr learned my addr 172.21.15.60:0/1692952649 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f8261d9b640 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.164+0000 7f8262d9d640 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8261d9b640 1 -- 172.21.15.60:0/1692952649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 msgr2=0x5575e63d4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8261d9b640 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63d4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8261d9b640 1 -- 172.21.15.60:0/1692952649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 msgr2=0x5575e63d4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8261d9b640 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63d4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8261d9b640 1 -- 172.21.15.60:0/1692952649 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e62c63a0 con 0x5575e63df370 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f826259c640 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63d4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f82537fe640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f824c0a2cf0 0x7f824c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8262d9d640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f824c0a2cf0 0x7f824c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8261d9b640 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e1760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f82580ccf00 tx=0x7f82580d5b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8de47d6a703c1d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f82537fe640 1 -- 172.21.15.60:0/437953285 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f82580cf7f0 con 0x7f82641036e0 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8250ff9640 1 -- 172.21.15.60:0/1692952649 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258097f70 con 0x5575e63df370 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8250ff9640 1 -- 172.21.15.60:0/1692952649 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f825809c3d0 con 0x5575e63df370 2024-09-12T00:09:25.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.165+0000 7f8250ff9640 1 -- 172.21.15.60:0/1692952649 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825809b630 con 0x5575e63df370 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 -- 172.21.15.60:0/1692952649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 msgr2=0x5575e63e1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e1760 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f82580ccf00 tx=0x7f82580d5b20 comp rx=0 tx=0).stop 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f8262d9d640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f824c0a2cf0 0x7f824c0a51b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f825c006010 tx=0x7f825c009560 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 -- 172.21.15.60:0/1692952649 shutdown_connections 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e1760 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63d4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1692952649 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 -- 172.21.15.60:0/1692952649 >> 172.21.15.60:0/1692952649 conn(0x5575e639d310 msgr2=0x5575e63d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 -- 172.21.15.60:0/1692952649 shutdown_connections 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 -- 172.21.15.60:0/1692952649 wait complete. 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 -- start start 2024-09-12T00:09:25.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.166+0000 7f826b0a8740 1 Processor -- start 2024-09-12T00:09:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63d45d0 0x5575e63decc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63dbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63df370 0x5575e63dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f826b0a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5575e63e2070 con 0x5575e63df370 2024-09-12T00:09:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f826b0a8740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5575e62f5060 con 0x5575e63d5b40 2024-09-12T00:09:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f826b0a8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5575e63e21f0 con 0x5575e63d45d0 2024-09-12T00:09:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f826b0a8740 10 client.0 _ll_register_callbacks cb 0x5575e60488c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:25.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63df370 0x5575e63dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63df370 0x5575e63dc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45506/0 (socket says 172.21.15.60:45506) 2024-09-12T00:09:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 -- 172.21.15.60:0/3214614356 learned_addr learned my addr 172.21.15.60:0/3214614356 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8261d9b640 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63dbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f826259c640 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63d45d0 0x5575e63decc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 -- 172.21.15.60:0/3214614356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63d45d0 msgr2=0x5575e63decc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63d45d0 0x5575e63decc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 -- 172.21.15.60:0/3214614356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 msgr2=0x5575e63dbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:25.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63dbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 -- 172.21.15.60:0/3214614356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e60ab3c0 con 0x5575e63df370 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8261d9b640 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63dbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8262d9d640 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63df370 0x5575e63dc4d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f825c033000 tx=0x7f825c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ef6ccad1e5210f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.167+0000 7f8249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f8249ffb640 1 -- 172.21.15.60:0/3214614356 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c04e070 con 0x5575e63df370 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f8249ffb640 1 -- 172.21.15.60:0/3214614356 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f825c003a00 con 0x5575e63df370 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 1 -- 172.21.15.60:0/3214614356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f825809c3d0 con 0x5575e63df370 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f8249ffb640 1 -- 172.21.15.60:0/3214614356 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f825c05a050 con 0x5575e63df370 2024-09-12T00:09:25.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 10 client.17859 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 1 -- 172.21.15.60:0/3214614356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5575e63edb30 con 0x5575e63df370 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f8249ffb640 1 -- 172.21.15.60:0/3214614356 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f825809c3d0 con 0x5575e63df370 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f8249ffb640 1 -- 172.21.15.60:0/3214614356 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f825c03d450 con 0x5575e63df370 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 10 client.17859 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 10 client.17859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 20 client.17859 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5575e63eef40 0x5575e63f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 4 client.17859 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826b0a8740 1 -- 172.21.15.60:0/3214614356 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e6347860 con 0x5575e63eef40 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.168+0000 7f826259c640 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5575e63eef40 0x5575e63f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.169+0000 7f826259c640 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5575e63eef40 0x5575e63f13a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c50c69b84fd6755 server_cookie=2c6cdbbf8beb34b9 in_seq=0 out_seq=0 2024-09-12T00:09:25.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.169+0000 7f8249ffb640 10 client.17859 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:25.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f8249ffb640 1 -- 172.21.15.60:0/3214614356 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575e6347860 con 0x5575e63eef40 2024-09-12T00:09:25.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f8249ffb640 10 client.17859 handle_command_reply: tid=0 2024-09-12T00:09:25.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 client.17859 shutdown 2024-09-12T00:09:25.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 -- 172.21.15.60:0/3214614356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63df370 msgr2=0x5575e63dc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63df370 0x5575e63dc4d0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f825c033000 tx=0x7f825c009260 comp rx=0 tx=0).stop 2024-09-12T00:09:25.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 -- 172.21.15.60:0/3214614356 shutdown_connections 2024-09-12T00:09:25.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5575e63eef40 0x5575e63f13a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63df370 0x5575e63dc4d0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63dbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 --2- 172.21.15.60:0/3214614356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63d45d0 0x5575e63decc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f8249ffb640 0 client.17859 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:25.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 -- 172.21.15.60:0/3214614356 >> 172.21.15.60:0/3214614356 conn(0x5575e639d310 msgr2=0x5575e63d6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:25.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 -- 172.21.15.60:0/3214614356 shutdown_connections 2024-09-12T00:09:25.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 1 -- 172.21.15.60:0/3214614356 wait complete. 2024-09-12T00:09:25.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.170+0000 7f826b0a8740 20 client.17859 trim_cache size 0 max 16384 2024-09-12T00:09:25.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f826b0a8740 1 Processor -- start 2024-09-12T00:09:25.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f826b0a8740 1 -- start start 2024-09-12T00:09:25.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d45d0 0x5575e63eb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d5b40 0x5575e63d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f826b0a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82641afa90 con 0x5575e63d5b40 2024-09-12T00:09:25.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f826b0a8740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82641b15d0 con 0x5575e63d45d0 2024-09-12T00:09:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f826b0a8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f82641b0160 con 0x5575e63df370 2024-09-12T00:09:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f8261d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d5b40 0x5575e63d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f8261d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d5b40 0x5575e63d0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45520/0 (socket says 172.21.15.60:45520) 2024-09-12T00:09:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.183+0000 7f8261d9b640 1 -- 172.21.15.60:0/4086411456 learned_addr learned my addr 172.21.15.60:0/4086411456 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f8262d9d640 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f826259c640 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d45d0 0x5575e63eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f8261d9b640 1 -- 172.21.15.60:0/4086411456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 msgr2=0x5575e63d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f8261d9b640 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63d0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f8261d9b640 1 -- 172.21.15.60:0/4086411456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d45d0 msgr2=0x5575e63eb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f8261d9b640 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d45d0 0x5575e63eb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f8261d9b640 1 -- 172.21.15.60:0/4086411456 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e63d1180 con 0x5575e63d5b40 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f826259c640 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d45d0 0x5575e63eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f8261d9b640 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d5b40 0x5575e63d0700 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f8258098650 tx=0x7f82580d57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a11e371b0ae78d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f824bfff640 1 -- 172.21.15.60:0/4086411456 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825809b810 con 0x5575e63d5b40 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f824bfff640 1 -- 172.21.15.60:0/4086411456 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f82580d5300 con 0x5575e63d5b40 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.184+0000 7f824bfff640 1 -- 172.21.15.60:0/4086411456 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825809baa0 con 0x5575e63d5b40 2024-09-12T00:09:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- 172.21.15.60:0/4086411456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d5b40 msgr2=0x5575e63d0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d5b40 0x5575e63d0700 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f8258098650 tx=0x7f82580d57e0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- 172.21.15.60:0/4086411456 shutdown_connections 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d5b40 0x5575e63d0700 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 --2- 172.21.15.60:0/4086411456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d45d0 0x5575e63eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- 172.21.15.60:0/4086411456 >> 172.21.15.60:0/4086411456 conn(0x5575e639d310 msgr2=0x5575e63dbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- 172.21.15.60:0/4086411456 shutdown_connections 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- 172.21.15.60:0/4086411456 wait complete. 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- start start 2024-09-12T00:09:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 Processor -- start 2024-09-12T00:09:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82641b0f00 con 0x5575e63d45d0 2024-09-12T00:09:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82641b0830 con 0x5575e63d5b40 2024-09-12T00:09:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.185+0000 7f826b0a8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f82641ada90 con 0x5575e63df370 2024-09-12T00:09:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f826b0a8740 10 client.0 _ll_register_callbacks cb 0x7f825c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f826259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f826259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63e7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45532/0 (socket says 172.21.15.60:45532) 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8261d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f826259c640 1 -- 172.21.15.60:0/1691169721 learned_addr learned my addr 172.21.15.60:0/1691169721 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8262d9d640 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8261d9b640 1 -- 172.21.15.60:0/1691169721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 msgr2=0x5575e63e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8261d9b640 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8261d9b640 1 -- 172.21.15.60:0/1691169721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 msgr2=0x5575e63e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8261d9b640 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8261d9b640 1 -- 172.21.15.60:0/1691169721 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e63e39c0 con 0x5575e63d5b40 2024-09-12T00:09:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f826259c640 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8261d9b640 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63e2de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5575e63da6a0 tx=0x7f82580d5b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dec6a40a8b60812f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:09:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8249ffb640 1 -- 172.21.15.60:0/1691169721 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825809baa0 con 0x5575e63d5b40 2024-09-12T00:09:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8249ffb640 1 -- 172.21.15.60:0/1691169721 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f82580cfbe0 con 0x5575e63d5b40 2024-09-12T00:09:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f826b0a8740 1 -- 172.21.15.60:0/1691169721 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82580d5300 con 0x5575e63d5b40 2024-09-12T00:09:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f8249ffb640 1 -- 172.21.15.60:0/1691169721 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8258097f70 con 0x5575e63d5b40 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f826b0a8740 10 client.27152 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.186+0000 7f826b0a8740 1 -- 172.21.15.60:0/1691169721 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5575e6459b00 con 0x5575e63d5b40 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f8249ffb640 1 -- 172.21.15.60:0/1691169721 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f82580d5300 con 0x5575e63d5b40 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f8249ffb640 1 -- 172.21.15.60:0/1691169721 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f82580b3070 con 0x5575e63d5b40 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f826b0a8740 10 client.27152 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f826b0a8740 10 client.27152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f826b0a8740 20 client.27152 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5575e6459d20 0x5575e645c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f826b0a8740 4 client.27152 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f826b0a8740 1 -- 172.21.15.60:0/1691169721 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575e6341d70 con 0x5575e6459d20 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f826259c640 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5575e6459d20 0x5575e645c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f826259c640 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5575e6459d20 0x5575e645c110 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6329c9b50c843a7 server_cookie=ed97b985d1cef895 in_seq=0 out_seq=0 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.187+0000 7f8249ffb640 10 client.27152 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8249ffb640 1 -- 172.21.15.60:0/1691169721 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575e6341d70 con 0x5575e6459d20 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8249ffb640 10 client.27152 handle_command_reply: tid=0 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 client.27152 shutdown 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 -- 172.21.15.60:0/1691169721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 msgr2=0x5575e63e2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63e2de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5575e63da6a0 tx=0x7f82580d5b20 comp rx=0 tx=0).stop 2024-09-12T00:09:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 -- 172.21.15.60:0/1691169721 shutdown_connections 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5575e6459d20 0x5575e645c110 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5575e63df370 0x5575e63e3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5575e63d5b40 0x5575e63e2de0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8249ffb640 0 client.27152 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 --2- 172.21.15.60:0/1691169721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575e63d45d0 0x5575e63e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 -- 172.21.15.60:0/1691169721 >> 172.21.15.60:0/1691169721 conn(0x5575e639d310 msgr2=0x5575e63dbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 -- 172.21.15.60:0/1691169721 shutdown_connections 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 1 -- 172.21.15.60:0/1691169721 wait complete. 2024-09-12T00:09:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f826b0a8740 20 client.27152 trim_cache size 0 max 16384 2024-09-12T00:09:25.210 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 -- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f824c0a2cf0 msgr2=0x7f824c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f824c0a2cf0 0x7f824c0a51b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f825c006010 tx=0x7f825c009560 comp rx=0 tx=0).stop 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 -- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641036e0 msgr2=0x7f8264100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641036e0 0x7f8264100ed0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f825800e9c0 tx=0x7f825800ee80 comp rx=0 tx=0).stop 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 -- 172.21.15.60:0/437953285 shutdown_connections 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f824c0a2cf0 0x7f824c0a51b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82641082a0 0x7f8264101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82641036e0 0x7f8264100ed0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 --2- 172.21.15.60:0/437953285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264102d30 0x7f8264100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.188+0000 7f8268ccf640 1 -- 172.21.15.60:0/437953285 >> 172.21.15.60:0/437953285 conn(0x7f82640fc7d0 msgr2=0x7f82640fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.189+0000 7f8268ccf640 1 -- 172.21.15.60:0/437953285 shutdown_connections 2024-09-12T00:09:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:25.189+0000 7f8268ccf640 1 -- 172.21.15.60:0/437953285 wait complete. 2024-09-12T00:09:25.229 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:25 smithi105 ceph-mon[34805]: pgmap v312: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:09:25.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:25.230 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:25 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:25.230 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:09:24 smithi105 sudo[69644]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:25.230 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:09:24 smithi105 sudo[69644]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:25.230 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:09:24 smithi105 sudo[69644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:25.230 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:09:24 smithi105 sudo[69644]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:25.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:25 smithi192 ceph-mon[35487]: pgmap v312: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:09:25.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:25.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:25 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:25.285 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:09:25 smithi192 sudo[70300]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:25.285 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:09:25 smithi192 sudo[70300]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:25.285 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:09:25 smithi192 sudo[70300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:25.285 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:09:25 smithi192 sudo[70300]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:25.783 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:09:25 smithi192 sudo[70303]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:25.783 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:09:25 smithi192 sudo[70303]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:25.784 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:09:25 smithi192 sudo[70303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:25.784 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:09:25 smithi192 sudo[70303]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:26.338 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:09:25 smithi060 sudo[108573]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:26.339 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:09:25 smithi060 sudo[108573]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:26.339 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:09:25 smithi060 sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:26.339 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:09:25 smithi060 sudo[108573]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:26.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:26 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:26.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:26 smithi192 ceph-mon[35487]: pgmap v313: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:09:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:26 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:26.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:26 smithi060 ceph-mon[30953]: pgmap v313: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:09:26.839 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:09:26 smithi060 sudo[108576]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:26.839 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:09:26 smithi060 sudo[108576]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:26.840 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:09:26 smithi060 sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:26.840 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:09:26 smithi060 sudo[108576]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:26.895 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-12T00:09:26.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-12T00:09:26.925 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:26 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:26.925 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:26 smithi105 ceph-mon[34805]: pgmap v313: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T00:09:26.925 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:09:26 smithi105 sudo[69647]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:26.925 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:09:26 smithi105 sudo[69647]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:26.925 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:09:26 smithi105 sudo[69647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:26.926 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:09:26 smithi105 sudo[69647]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:27.229 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:09:26 smithi105 sudo[69650]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:27.229 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:09:26 smithi105 sudo[69650]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:27.229 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:09:26 smithi105 sudo[69650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:27.229 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:09:26 smithi105 sudo[69650]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:27.439 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:09:27 smithi192 sudo[70306]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:27.439 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:09:27 smithi192 sudo[70306]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:27.439 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:09:27 smithi192 sudo[70306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:27.439 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:09:27 smithi192 sudo[70306]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 -- 172.21.15.60:0/1573873796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4100e20 msgr2=0x7f87f4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/1573873796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4100e20 0x7f87f4101200 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009900 tx=0x7f87f002a480 comp rx=0 tx=0).stop 2024-09-12T00:09:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 -- 172.21.15.60:0/1573873796 shutdown_connections 2024-09-12T00:09:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/1573873796 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f4102ef0 0x7f87f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/1573873796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4102570 0x7f87f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/1573873796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4100e20 0x7f87f4101200 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 -- 172.21.15.60:0/1573873796 >> 172.21.15.60:0/1573873796 conn(0x7f87f40fc7d0 msgr2=0x7f87f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 -- 172.21.15.60:0/1573873796 shutdown_connections 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 -- 172.21.15.60:0/1573873796 wait complete. 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 Processor -- start 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.650+0000 7f87fb4f8640 1 -- start start 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87fb4f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f4100e20 0x7f87f4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87fb4f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4102570 0x7f87f4198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87fb4f8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4102ef0 0x7f87f419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87fb4f8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41110a0 con 0x7f87f4102570 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87fb4f8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4110f20 con 0x7f87f4100e20 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87fb4f8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4111220 con 0x7f87f4102ef0 2024-09-12T00:09:27.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4102570 0x7f87f4198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4102570 0x7f87f4198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45548/0 (socket says 172.21.15.60:45548) 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 -- 172.21.15.60:0/354005770 learned_addr learned my addr 172.21.15.60:0/354005770 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f9294640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f4100e20 0x7f87f4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f9a95640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4102ef0 0x7f87f419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 -- 172.21.15.60:0/354005770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4102ef0 msgr2=0x7f87f419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4102ef0 0x7f87f419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 -- 172.21.15.60:0/354005770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f4100e20 msgr2=0x7f87f4198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f4100e20 0x7f87f4198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 -- 172.21.15.60:0/354005770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f419d5f0 con 0x7f87f4102570 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87f8a93640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4102570 0x7f87f4198b80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f87e400d770 tx=0x7f87e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.651+0000 7f87ea7fc640 1 -- 172.21.15.60:0/354005770 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4017070 con 0x7f87f4102570 2024-09-12T00:09:27.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.652+0000 7f87ea7fc640 1 -- 172.21.15.60:0/354005770 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87e4005520 con 0x7f87f4102570 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.652+0000 7f87fb4f8640 1 -- 172.21.15.60:0/354005770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f419d8e0 con 0x7f87f4102570 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.652+0000 7f87ea7fc640 1 -- 172.21.15.60:0/354005770 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4010460 con 0x7f87f4102570 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.652+0000 7f87fb4f8640 1 -- 172.21.15.60:0/354005770 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f41a51c0 con 0x7f87f4102570 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.654+0000 7f87ea7fc640 1 -- 172.21.15.60:0/354005770 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f87e4004ea0 con 0x7f87f4102570 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.654+0000 7f87fd8d1740 1 Processor -- start 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87fd8d1740 1 -- start start 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711472e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711481c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 0x559711484540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5597113d8280 con 0x559711473380 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55971137fb10 con 0x559711482150 2024-09-12T00:09:27.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5597113d4240 con 0x559711472a60 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9294640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711481c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9294640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711481c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45558/0 (socket says 172.21.15.60:45558) 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9294640 1 -- 172.21.15.60:0/1385934630 learned_addr learned my addr 172.21.15.60:0/1385934630 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87ea7fc640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f87e00a2cf0 0x7f87e00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9a95640 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711472e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f8a93640 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 0x559711484540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9a95640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f87e00a2cf0 0x7f87e00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9294640 1 -- 172.21.15.60:0/1385934630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 msgr2=0x559711472e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:27.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9294640 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711472e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9294640 1 -- 172.21.15.60:0/1385934630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 msgr2=0x559711484540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9294640 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 0x559711484540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87f9294640 1 -- 172.21.15.60:0/1385934630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55971138c1f0 con 0x559711473380 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.655+0000 7f87ea7fc640 1 -- 172.21.15.60:0/354005770 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f87e40ceeb0 con 0x7f87f4102570 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.656+0000 7f87f9294640 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711481c10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009900 tx=0x7f87f0005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65fa9b02b802d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.656+0000 7f87df7fe640 1 -- 172.21.15.60:0/1385934630 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0040070 con 0x559711473380 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.656+0000 7f87f9a95640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f87e00a2cf0 0x7f87e00a51b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f87ec005fd0 tx=0x7f87ec004ab0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.656+0000 7f87df7fe640 1 -- 172.21.15.60:0/1385934630 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87f00319a0 con 0x559711473380 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.656+0000 7f87df7fe640 1 -- 172.21.15.60:0/1385934630 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0035040 con 0x559711473380 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 -- 172.21.15.60:0/1385934630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 msgr2=0x559711481c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711481c10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009900 tx=0x7f87f0005c00 comp rx=0 tx=0).stop 2024-09-12T00:09:27.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 -- 172.21.15.60:0/1385934630 shutdown_connections 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 0x559711484540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711481c10 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/1385934630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711472e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 -- 172.21.15.60:0/1385934630 >> 172.21.15.60:0/1385934630 conn(0x55971146f0f0 msgr2=0x55971146f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 -- 172.21.15.60:0/1385934630 shutdown_connections 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 -- 172.21.15.60:0/1385934630 wait complete. 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 -- start start 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.657+0000 7f87fd8d1740 1 Processor -- start 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x55971147eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x55971147f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x55971147fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559711484d20 con 0x559711482150 2024-09-12T00:09:27.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559711392f10 con 0x559711473380 2024-09-12T00:09:27.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559711484ea0 con 0x559711472a60 2024-09-12T00:09:27.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87fd8d1740 10 client.0 _ll_register_callbacks cb 0x55971135ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:27.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x55971147fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9294640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x55971147eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f8a93640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x55971147f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x55971147fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45572/0 (socket says 172.21.15.60:45572) 2024-09-12T00:09:27.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 -- 172.21.15.60:0/185437241 learned_addr learned my addr 172.21.15.60:0/185437241 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 -- 172.21.15.60:0/185437241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 msgr2=0x55971147eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x55971147eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 -- 172.21.15.60:0/185437241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 msgr2=0x55971147f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x55971147f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 -- 172.21.15.60:0/185437241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597111496a0 con 0x559711482150 2024-09-12T00:09:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87f9a95640 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x55971147fa70 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f87ec012ad0 tx=0x7f87ec009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821193e917c74d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:27.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.658+0000 7f87dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87dcff9640 1 -- 172.21.15.60:0/185437241 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec028470 con 0x559711482150 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 1 -- 172.21.15.60:0/185437241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87f00319a0 con 0x559711482150 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87dcff9640 1 -- 172.21.15.60:0/185437241 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f87ec01f420 con 0x559711482150 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87dcff9640 1 -- 172.21.15.60:0/185437241 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f87ec01f620 con 0x559711482150 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 10 client.17877 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 1 -- 172.21.15.60:0/185437241 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5597114909e0 con 0x559711482150 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87dcff9640 1 -- 172.21.15.60:0/185437241 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87f00319a0 con 0x559711482150 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87dcff9640 1 -- 172.21.15.60:0/185437241 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f87ec02f020 con 0x559711482150 2024-09-12T00:09:27.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 10 client.17877 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 10 client.17877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 20 client.17877 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559711491df0 0x559711494240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 4 client.17877 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.659+0000 7f87fd8d1740 1 -- 172.21.15.60:0/185437241 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597113e57f0 con 0x559711491df0 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.660+0000 7f87f9294640 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559711491df0 0x559711494240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.660+0000 7f87f9294640 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559711491df0 0x559711494240 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6af0e8f9b0dcba8f server_cookie=6cf7549c0fcc011c in_seq=0 out_seq=0 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.660+0000 7f87dcff9640 10 client.17877 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87dcff9640 1 -- 172.21.15.60:0/185437241 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597113e57f0 con 0x559711491df0 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87dcff9640 10 client.17877 handle_command_reply: tid=0 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 client.17877 shutdown 2024-09-12T00:09:27.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 -- 172.21.15.60:0/185437241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 msgr2=0x55971147fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x55971147fa70 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f87ec012ad0 tx=0x7f87ec009600 comp rx=0 tx=0).stop 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 -- 172.21.15.60:0/185437241 shutdown_connections 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x559711491df0 0x559711494240 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x55971147fa70 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x55971147f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/185437241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x55971147eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 -- 172.21.15.60:0/185437241 >> 172.21.15.60:0/185437241 conn(0x55971146f0f0 msgr2=0x559711474e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87dcff9640 0 client.17877 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 -- 172.21.15.60:0/185437241 shutdown_connections 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 1 -- 172.21.15.60:0/185437241 wait complete. 2024-09-12T00:09:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.661+0000 7f87fd8d1740 20 client.17877 trim_cache size 0 max 16384 2024-09-12T00:09:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.693+0000 7f87fd8d1740 1 Processor -- start 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87fd8d1740 1 -- start start 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711480e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711499b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 0x55971149a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41ab670 con 0x559711473380 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41ad1b0 con 0x559711482150 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41abd40 con 0x559711472a60 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711499b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711499b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45584/0 (socket says 172.21.15.60:45584) 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 -- 172.21.15.60:0/868230251 learned_addr learned my addr 172.21.15.60:0/868230251 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f9294640 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711480e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f9a95640 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 0x55971149a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 -- 172.21.15.60:0/868230251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 msgr2=0x559711480e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711480e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 -- 172.21.15.60:0/868230251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 msgr2=0x55971149a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 0x55971149a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 -- 172.21.15.60:0/868230251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55971146a830 con 0x559711473380 2024-09-12T00:09:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f9294640 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711480e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.694+0000 7f87f8a93640 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711499b10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009fd0 tx=0x7f87e406d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249de320e0ddf1c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87deffd640 1 -- 172.21.15.60:0/868230251 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4020040 con 0x559711473380 2024-09-12T00:09:27.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87deffd640 1 -- 172.21.15.60:0/868230251 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87e409b4a0 con 0x559711473380 2024-09-12T00:09:27.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87deffd640 1 -- 172.21.15.60:0/868230251 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4005190 con 0x559711473380 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 -- 172.21.15.60:0/868230251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 msgr2=0x559711499b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711499b10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009fd0 tx=0x7f87e406d460 comp rx=0 tx=0).stop 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 -- 172.21.15.60:0/868230251 shutdown_connections 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711482150 0x55971149a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711473380 0x559711499b10 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/868230251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x559711480e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 -- 172.21.15.60:0/868230251 >> 172.21.15.60:0/868230251 conn(0x55971146f0f0 msgr2=0x559711480740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 -- 172.21.15.60:0/868230251 shutdown_connections 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.695+0000 7f87fd8d1740 1 -- 172.21.15.60:0/868230251 wait complete. 2024-09-12T00:09:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 1 -- start start 2024-09-12T00:09:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 1 Processor -- start 2024-09-12T00:09:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x55971148a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x559711485c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x5597114861a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41acae0 con 0x559711482150 2024-09-12T00:09:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41ac410 con 0x559711473380 2024-09-12T00:09:27.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41a9670 con 0x559711472a60 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.696+0000 7f87fd8d1740 10 client.0 _ll_register_callbacks cb 0x7f87ec012720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f9a95640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x5597114861a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x559711485c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x559711485c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38792/0 (socket says 172.21.15.60:38792) 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 -- 172.21.15.60:0/2222900971 learned_addr learned my addr 172.21.15.60:0/2222900971 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f9294640 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x55971148a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 -- 172.21.15.60:0/2222900971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 msgr2=0x55971148a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x55971148a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 -- 172.21.15.60:0/2222900971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 msgr2=0x5597114861a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x5597114861a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 -- 172.21.15.60:0/2222900971 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597114869d0 con 0x559711473380 2024-09-12T00:09:27.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f9a95640 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x5597114861a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87f8a93640 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x559711485c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87e409b1a0 tx=0x7f87e40a40e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31398bc1ad272039 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87dcff9640 1 -- 172.21.15.60:0/2222900971 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4020030 con 0x559711473380 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87dcff9640 1 -- 172.21.15.60:0/2222900971 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f87e4097b10 con 0x559711473380 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87fd8d1740 1 -- 172.21.15.60:0/2222900971 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87e409b4a0 con 0x559711473380 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87dcff9640 1 -- 172.21.15.60:0/2222900971 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f87e4005190 con 0x559711473380 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.697+0000 7f87fd8d1740 10 client.27170 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87fd8d1740 1 -- 172.21.15.60:0/2222900971 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5597114fcbb0 con 0x559711473380 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87dcff9640 1 -- 172.21.15.60:0/2222900971 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87e409b4a0 con 0x559711473380 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87dcff9640 1 -- 172.21.15.60:0/2222900971 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f87e409a8f0 con 0x559711473380 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87fd8d1740 10 client.27170 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87fd8d1740 10 client.27170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:27.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87fd8d1740 20 client.27170 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5597114fd250 0x5597114ff670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87fd8d1740 4 client.27170 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87fd8d1740 1 -- 172.21.15.60:0/2222900971 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5597113dfd00 con 0x5597114fd250 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.698+0000 7f87f9294640 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5597114fd250 0x5597114ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.699+0000 7f87dcff9640 10 client.27170 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.699+0000 7f87f9294640 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5597114fd250 0x5597114ff670 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef09eaed2c70ed server_cookie=4a24948fa699b2a1 in_seq=0 out_seq=0 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87dcff9640 1 -- 172.21.15.60:0/2222900971 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5597113dfd00 con 0x5597114fd250 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87dcff9640 10 client.27170 handle_command_reply: tid=0 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 client.27170 shutdown 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 -- 172.21.15.60:0/2222900971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 msgr2=0x559711485c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x559711485c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87e409b1a0 tx=0x7f87e40a40e0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 -- 172.21.15.60:0/2222900971 shutdown_connections 2024-09-12T00:09:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x5597114fd250 0x5597114ff670 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559711482150 0x5597114861a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559711473380 0x559711485c40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 --2- 172.21.15.60:0/2222900971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559711472a60 0x55971148a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 -- 172.21.15.60:0/2222900971 >> 172.21.15.60:0/2222900971 conn(0x55971146f0f0 msgr2=0x55971146e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87dcff9640 0 client.27170 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 -- 172.21.15.60:0/2222900971 shutdown_connections 2024-09-12T00:09:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.700+0000 7f87fd8d1740 1 -- 172.21.15.60:0/2222900971 wait complete. 2024-09-12T00:09:27.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fd8d1740 20 client.27170 trim_cache size 0 max 16384 2024-09-12T00:09:27.709 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:09:27.709 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2024-09-12T00:09:27.709 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_tag": "8729fa02-f337-4a53-bd7c-3edcbe584263", 2024-09-12T00:09:27.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": "asynchronous" 2024-09-12T00:09:27.709 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:09:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 -- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f87e00a2cf0 msgr2=0x7f87e00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f87e00a2cf0 0x7f87e00a51b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f87ec005fd0 tx=0x7f87ec004ab0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 -- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4102570 msgr2=0x7f87f4198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4102570 0x7f87f4198b80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f87e400d770 tx=0x7f87e400dc30 comp rx=0 tx=0).stop 2024-09-12T00:09:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 -- 172.21.15.60:0/354005770 shutdown_connections 2024-09-12T00:09:27.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f87e00a2cf0 0x7f87e00a51b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4102ef0 0x7f87f419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87f4102570 0x7f87f4198b80 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 --2- 172.21.15.60:0/354005770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f4100e20 0x7f87f4198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 -- 172.21.15.60:0/354005770 >> 172.21.15.60:0/354005770 conn(0x7f87f40fc7d0 msgr2=0x7f87f406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 -- 172.21.15.60:0/354005770 shutdown_connections 2024-09-12T00:09:27.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:27.701+0000 7f87fb4f8640 1 -- 172.21.15.60:0/354005770 wait complete. 2024-09-12T00:09:27.783 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:09:27 smithi192 sudo[70309]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:27.784 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:09:27 smithi192 sudo[70309]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:27.784 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:09:27 smithi192 sudo[70309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:27.784 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:09:27 smithi192 sudo[70309]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:28.169 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:09:27 smithi060 sudo[108716]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:28.169 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:09:27 smithi060 sudo[108716]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:28.169 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:09:27 smithi060 sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:28.169 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:09:27 smithi060 sudo[108716]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:28.561 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:09:28 smithi060 sudo[108721]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:28.561 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:09:28 smithi060 sudo[108721]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:28.561 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:09:28 smithi060 sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:28.561 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:09:28 smithi060 sudo[108721]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:28.588 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-12T00:09:28.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:28 smithi060 ceph-mon[30953]: pgmap v314: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 118 KiB/s wr, 20 op/s 2024-09-12T00:09:28.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:28 smithi060 ceph-mon[30953]: scrub queued for path: / 2024-09-12T00:09:28.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:28 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:09:28.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:28 smithi060 ceph-mon[30953]: scrub summary: active paths [/] 2024-09-12T00:09:28.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:28 smithi060 ceph-mon[30953]: scrub summary: idle+waiting paths [/] 2024-09-12T00:09:28.847 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:28.880 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:09:28 smithi105 sudo[69653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:28.880 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:09:28 smithi105 sudo[69653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:28.880 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:09:28 smithi105 sudo[69653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:28.880 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:09:28 smithi105 sudo[69653]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:28.880 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:28 smithi105 ceph-mon[34805]: pgmap v314: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 118 KiB/s wr, 20 op/s 2024-09-12T00:09:28.880 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:28 smithi105 ceph-mon[34805]: scrub queued for path: / 2024-09-12T00:09:28.880 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:28 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:09:28.880 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:28 smithi105 ceph-mon[34805]: scrub summary: active paths [/] 2024-09-12T00:09:28.881 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:28 smithi105 ceph-mon[34805]: scrub summary: idle+waiting paths [/] 2024-09-12T00:09:29.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:28 smithi192 ceph-mon[35487]: pgmap v314: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 118 KiB/s wr, 20 op/s 2024-09-12T00:09:29.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:28 smithi192 ceph-mon[35487]: scrub queued for path: / 2024-09-12T00:09:29.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:28 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:09:29.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:28 smithi192 ceph-mon[35487]: scrub summary: active paths [/] 2024-09-12T00:09:29.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:28 smithi192 ceph-mon[35487]: scrub summary: idle+waiting paths [/] 2024-09-12T00:09:29.229 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:09:28 smithi105 sudo[69656]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:29.229 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:09:28 smithi105 sudo[69656]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:29.229 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:09:28 smithi105 sudo[69656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:29.229 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:09:28 smithi105 sudo[69656]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 -- 172.21.15.60:0/269634312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 msgr2=0x7f09e0103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 --2- 172.21.15.60:0/269634312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 0x7f09e0103180 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009900 tx=0x7f09dc02a480 comp rx=0 tx=0).stop 2024-09-12T00:09:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 -- 172.21.15.60:0/269634312 shutdown_connections 2024-09-12T00:09:29.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 --2- 172.21.15.60:0/269634312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09e010c180 0x7f09e010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 --2- 172.21.15.60:0/269634312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09e01036c0 0x7f09e010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 --2- 172.21.15.60:0/269634312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 0x7f09e0103180 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 -- 172.21.15.60:0/269634312 >> 172.21.15.60:0/269634312 conn(0x7f09e00fc7a0 msgr2=0x7f09e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 -- 172.21.15.60:0/269634312 shutdown_connections 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.334+0000 7f09e7724640 1 -- 172.21.15.60:0/269634312 wait complete. 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e7724640 1 Processor -- start 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e7724640 1 -- start start 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e7724640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 0x7f09e0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e7724640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09e01036c0 0x7f09e0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e7724640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09e010c180 0x7f09e019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e7724640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09e0112080 con 0x7f09e0102da0 2024-09-12T00:09:29.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e7724640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f09e0111f00 con 0x7f09e010c180 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e7724640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f09e0112200 con 0x7f09e01036c0 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e54c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 0x7f09e0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e54c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 0x7f09e0198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45600/0 (socket says 172.21.15.60:45600) 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e54c0640 1 -- 172.21.15.60:0/1942095867 learned_addr learned my addr 172.21.15.60:0/1942095867 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09e01036c0 0x7f09e0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.335+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09e010c180 0x7f09e019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09e54c0640 1 -- 172.21.15.60:0/1942095867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09e01036c0 msgr2=0x7f09e0198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09e54c0640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09e01036c0 0x7f09e0198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09e54c0640 1 -- 172.21.15.60:0/1942095867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09e010c180 msgr2=0x7f09e019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09e54c0640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09e010c180 0x7f09e019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09e54c0640 1 -- 172.21.15.60:0/1942095867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e019d4b0 con 0x7f09e0102da0 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09e54c0640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 0x7f09e0198500 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f09dc006010 tx=0x7f09dc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09d67fc640 1 -- 172.21.15.60:0/1942095867 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc03f030 con 0x7f09e0102da0 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09d67fc640 1 -- 172.21.15.60:0/1942095867 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f09dc0044c0 con 0x7f09e0102da0 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09e7724640 1 -- 172.21.15.60:0/1942095867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e019d740 con 0x7f09e0102da0 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09d67fc640 1 -- 172.21.15.60:0/1942095867 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc035070 con 0x7f09e0102da0 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.336+0000 7f09e7724640 1 -- 172.21.15.60:0/1942095867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e01a5080 con 0x7f09e0102da0 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.338+0000 7f09d67fc640 1 -- 172.21.15.60:0/1942095867 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f09dc042030 con 0x7f09e0102da0 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e9afd740 1 Processor -- start 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e9afd740 1 -- start start 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40e6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e9afd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fbd404c2e0 con 0x55fbd40e63a0 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e9afd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fbd3ff3ce0 con 0x55fbd40e6cc0 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e9afd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fbd40482a0 con 0x55fbd40f5a90 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e5cc1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e5cc1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40e6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45602/0 (socket says 172.21.15.60:45602) 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e5cc1640 1 -- 172.21.15.60:0/908572916 learned_addr learned my addr 172.21.15.60:0/908572916 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e54c0640 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09d67fc640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f09cc0a2cf0 0x7f09cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e5cc1640 1 -- 172.21.15.60:0/908572916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 msgr2=0x55fbd40f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e5cc1640 1 -- 172.21.15.60:0/908572916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 msgr2=0x55fbd40f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e5cc1640 1 -- 172.21.15.60:0/908572916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbd3fd8440 con 0x55fbd40e63a0 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.339+0000 7f09e54c0640 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.340+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f09cc0a2cf0 0x7f09cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.340+0000 7f09d67fc640 1 -- 172.21.15.60:0/1942095867 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f09dc0ef730 con 0x7f09e0102da0 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.340+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40e6780 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f09d8010520 tx=0x7f09d80109e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99340908e9aca04b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.340+0000 7f09cb7fe640 1 -- 172.21.15.60:0/908572916 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8019070 con 0x55fbd40e63a0 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.340+0000 7f09cb7fe640 1 -- 172.21.15.60:0/908572916 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f09d8003e10 con 0x55fbd40e63a0 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.340+0000 7f09cb7fe640 1 -- 172.21.15.60:0/908572916 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d8011800 con 0x55fbd40e63a0 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 -- 172.21.15.60:0/908572916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 msgr2=0x55fbd40e6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f09cc0a2cf0 0x7f09cc0a51b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09d8021000 tx=0x7f09d801e000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40e6780 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f09d8010520 tx=0x7f09d80109e0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 -- 172.21.15.60:0/908572916 shutdown_connections 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 --2- 172.21.15.60:0/908572916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40e6780 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 -- 172.21.15.60:0/908572916 >> 172.21.15.60:0/908572916 conn(0x55fbd40e2a30 msgr2=0x55fbd40e2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 -- 172.21.15.60:0/908572916 shutdown_connections 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 -- 172.21.15.60:0/908572916 wait complete. 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 -- start start 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.341+0000 7f09e9afd740 1 Processor -- start 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40f5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e9afd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fbd40f86c0 con 0x55fbd40e63a0 2024-09-12T00:09:29.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e9afd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fbd4007050 con 0x55fbd40e6cc0 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e9afd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fbd40f8840 con 0x55fbd40f5a90 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e9afd740 10 client.0 _ll_register_callbacks cb 0x55fbd4047160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e54c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e54c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45614/0 (socket says 172.21.15.60:45614) 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e54c0640 1 -- 172.21.15.60:0/2429690833 learned_addr learned my addr 172.21.15.60:0/2429690833 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e4cbf640 1 -- 172.21.15.60:0/2429690833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 msgr2=0x55fbd40f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e4cbf640 1 -- 172.21.15.60:0/2429690833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 msgr2=0x55fbd40f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e4cbf640 1 -- 172.21.15.60:0/2429690833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbd3dbd3c0 con 0x55fbd40e6cc0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e54c0640 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f2730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09e010d5a0 tx=0x7f09d0012aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d07fa5151662dd6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.342+0000 7f09c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09c8ff9640 1 -- 172.21.15.60:0/2429690833 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d000f5e0 con 0x55fbd40e6cc0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 1 -- 172.21.15.60:0/2429690833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09d8003e10 con 0x55fbd40e6cc0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09c8ff9640 1 -- 172.21.15.60:0/2429690833 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f09d000f780 con 0x55fbd40e6cc0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09c8ff9640 1 -- 172.21.15.60:0/2429690833 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f09d000f980 con 0x55fbd40e6cc0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 10 client.27182 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 1 -- 172.21.15.60:0/2429690833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55fbd4104210 con 0x55fbd40e6cc0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09c8ff9640 1 -- 172.21.15.60:0/2429690833 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f09d8003e10 con 0x55fbd40e6cc0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09c8ff9640 1 -- 172.21.15.60:0/2429690833 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f09d0023070 con 0x55fbd40e6cc0 2024-09-12T00:09:29.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 10 client.27182 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 10 client.27182 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 20 client.27182 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55fbd4105670 0x55fbd4107af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 4 client.27182 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e9afd740 1 -- 172.21.15.60:0/2429690833 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbd4059850 con 0x55fbd4105670 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.343+0000 7f09e54c0640 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55fbd4105670 0x55fbd4107af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.344+0000 7f09e54c0640 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55fbd4105670 0x55fbd4107af0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=541d5025507db838 server_cookie=e8dc0526e6403344 in_seq=0 out_seq=0 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.344+0000 7f09c8ff9640 10 client.27182 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.344+0000 7f09c8ff9640 1 -- 172.21.15.60:0/2429690833 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbd4059850 con 0x55fbd4105670 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.344+0000 7f09c8ff9640 10 client.27182 handle_command_reply: tid=0 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 client.27182 shutdown 2024-09-12T00:09:29.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 -- 172.21.15.60:0/2429690833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 msgr2=0x55fbd40f2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f2730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f09e010d5a0 tx=0x7f09d0012aa0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 -- 172.21.15.60:0/2429690833 shutdown_connections 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55fbd4105670 0x55fbd4107af0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f2730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 --2- 172.21.15.60:0/2429690833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd40f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09c8ff9640 0 client.27182 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 -- 172.21.15.60:0/2429690833 >> 172.21.15.60:0/2429690833 conn(0x55fbd40e2a30 msgr2=0x55fbd40e8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 -- 172.21.15.60:0/2429690833 shutdown_connections 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 1 -- 172.21.15.60:0/2429690833 wait complete. 2024-09-12T00:09:29.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.345+0000 7f09e9afd740 20 client.27182 trim_cache size 0 max 16384 2024-09-12T00:09:29.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e9afd740 1 Processor -- start 2024-09-12T00:09:29.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e9afd740 1 -- start start 2024-09-12T00:09:29.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd4101960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e9afd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ab6c0 con 0x55fbd40e63a0 2024-09-12T00:09:29.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e9afd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ad200 con 0x55fbd40e6cc0 2024-09-12T00:09:29.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e9afd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01abd90 con 0x55fbd40f5a90 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.362+0000 7f09e54c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd4101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e54c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd4101960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45620/0 (socket says 172.21.15.60:45620) 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e54c0640 1 -- 172.21.15.60:0/937307262 learned_addr learned my addr 172.21.15.60:0/937307262 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e54c0640 1 -- 172.21.15.60:0/937307262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 msgr2=0x55fbd40f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e54c0640 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e54c0640 1 -- 172.21.15.60:0/937307262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 msgr2=0x55fbd40f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e54c0640 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e54c0640 1 -- 172.21.15.60:0/937307262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbd40f16e0 con 0x55fbd40e63a0 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:29.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09e54c0640 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd4101960 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0bb970 tx=0x7f09dc0f5550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2802c82afd7701a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09caffd640 1 -- 172.21.15.60:0/937307262 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc049040 con 0x55fbd40e63a0 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09caffd640 1 -- 172.21.15.60:0/937307262 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f09dc003e10 con 0x55fbd40e63a0 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.363+0000 7f09caffd640 1 -- 172.21.15.60:0/937307262 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0b8370 con 0x55fbd40e63a0 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 -- 172.21.15.60:0/937307262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 msgr2=0x55fbd4101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd4101960 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0bb970 tx=0x7f09dc0f5550 comp rx=0 tx=0).stop 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 -- 172.21.15.60:0/937307262 shutdown_connections 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e6cc0 0x55fbd40f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 --2- 172.21.15.60:0/937307262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e63a0 0x55fbd4101960 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 -- 172.21.15.60:0/937307262 >> 172.21.15.60:0/937307262 conn(0x55fbd40e2a30 msgr2=0x55fbd40f3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 -- 172.21.15.60:0/937307262 shutdown_connections 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 -- 172.21.15.60:0/937307262 wait complete. 2024-09-12T00:09:29.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 -- start start 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.364+0000 7f09e9afd740 1 Processor -- start 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e63a0 0x55fbd40fdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e6cc0 0x55fbd40fe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e9afd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e9afd740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01acb30 con 0x55fbd40e6cc0 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e9afd740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01ac460 con 0x55fbd40e63a0 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e9afd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f09e01a96c0 con 0x55fbd40f5a90 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e9afd740 10 client.0 _ll_register_callbacks cb 0x7f09d0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e4cbf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e6cc0 0x55fbd40fe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e4cbf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e6cc0 0x55fbd40fe010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45636/0 (socket says 172.21.15.60:45636) 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e4cbf640 1 -- 172.21.15.60:0/355671598 learned_addr learned my addr 172.21.15.60:0/355671598 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e54c0640 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e63a0 0x55fbd40fdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e5cc1640 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e4cbf640 1 -- 172.21.15.60:0/355671598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 msgr2=0x55fbd40faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e4cbf640 1 -- 172.21.15.60:0/355671598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e63a0 msgr2=0x55fbd40fdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e63a0 0x55fbd40fdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e4cbf640 1 -- 172.21.15.60:0/355671598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbd40e6af0 con 0x55fbd40e6cc0 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.365+0000 7f09e54c0640 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e63a0 0x55fbd40fdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e4cbf640 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e6cc0 0x55fbd40fe010 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f09d0000c00 tx=0x7f09d00096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9436c546e0ab92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09c8ff9640 1 -- 172.21.15.60:0/355671598 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0029070 con 0x55fbd40e6cc0 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 1 -- 172.21.15.60:0/355671598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fbd4053d60 con 0x55fbd40e6cc0 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09c8ff9640 1 -- 172.21.15.60:0/355671598 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f09d000fb20 con 0x55fbd40e6cc0 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09c8ff9640 1 -- 172.21.15.60:0/355671598 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f09d0032050 con 0x55fbd40e6cc0 2024-09-12T00:09:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 10 client.17901 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 1 -- 172.21.15.60:0/355671598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55fbd40f3090 con 0x55fbd40e6cc0 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09c8ff9640 1 -- 172.21.15.60:0/355671598 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55fbd4053d60 con 0x55fbd40e6cc0 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09c8ff9640 1 -- 172.21.15.60:0/355671598 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f09d002c030 con 0x55fbd40e6cc0 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 10 client.17901 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 10 client.17901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 20 client.17901 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55fbd4170e50 0x55fbd4173270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 4 client.17901 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.366+0000 7f09e9afd740 1 -- 172.21.15.60:0/355671598 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fbd3fd0210 con 0x55fbd4170e50 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e54c0640 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55fbd4170e50 0x55fbd4173270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e54c0640 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55fbd4170e50 0x55fbd4173270 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa57a075b4749709 server_cookie=8bcf19cb641375a in_seq=0 out_seq=0 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09c8ff9640 10 client.17901 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09c8ff9640 1 -- 172.21.15.60:0/355671598 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fbd3fd0210 con 0x55fbd4170e50 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09c8ff9640 10 client.17901 handle_command_reply: tid=0 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 client.17901 shutdown 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 -- 172.21.15.60:0/355671598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e6cc0 msgr2=0x55fbd40fe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e6cc0 0x55fbd40fe010 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f09d0000c00 tx=0x7f09d00096b0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 -- 172.21.15.60:0/355671598 shutdown_connections 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55fbd4170e50 0x55fbd4173270 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fbd40f5a90 0x55fbd40faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fbd40e6cc0 0x55fbd40fe010 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 --2- 172.21.15.60:0/355671598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fbd40e63a0 0x55fbd40fdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 -- 172.21.15.60:0/355671598 >> 172.21.15.60:0/355671598 conn(0x55fbd40e2a30 msgr2=0x55fbd40f47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09c8ff9640 0 client.17901 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 -- 172.21.15.60:0/355671598 shutdown_connections 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.367+0000 7f09e9afd740 1 -- 172.21.15.60:0/355671598 wait complete. 2024-09-12T00:09:29.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e9afd740 20 client.17901 trim_cache size 0 max 16384 2024-09-12T00:09:29.379 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:09:29.379 INFO:teuthology.orchestra.run.smithi060.stdout: "status": "no active scrubs running", 2024-09-12T00:09:29.379 INFO:teuthology.orchestra.run.smithi060.stdout: "scrubs": {} 2024-09-12T00:09:29.379 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 -- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f09cc0a2cf0 msgr2=0x7f09cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f09cc0a2cf0 0x7f09cc0a51b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09d8021000 tx=0x7f09d801e000 comp rx=0 tx=0).stop 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 -- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 msgr2=0x7f09e0198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 0x7f09e0198500 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f09dc006010 tx=0x7f09dc0040c0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 -- 172.21.15.60:0/1942095867 shutdown_connections 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f09cc0a2cf0 0x7f09cc0a51b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09e010c180 0x7f09e019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09e01036c0 0x7f09e0198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 --2- 172.21.15.60:0/1942095867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09e0102da0 0x7f09e0198500 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 -- 172.21.15.60:0/1942095867 >> 172.21.15.60:0/1942095867 conn(0x7f09e00fc7a0 msgr2=0x7f09e00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:29.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 -- 172.21.15.60:0/1942095867 shutdown_connections 2024-09-12T00:09:29.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:29.368+0000 7f09e7724640 1 -- 172.21.15.60:0/1942095867 wait complete. 2024-09-12T00:09:29.406 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:09:29 smithi192 sudo[70312]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:29.406 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:09:29 smithi192 sudo[70312]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:29.406 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:09:29 smithi192 sudo[70312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:29.407 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:09:29 smithi192 sudo[70312]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:29.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:29 smithi192 ceph-mon[35487]: scrub summary: idle 2024-09-12T00:09:29.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:09:29 smithi192 sudo[70315]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:29.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:09:29 smithi192 sudo[70315]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:29.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:09:29 smithi192 sudo[70315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:29.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:09:29 smithi192 sudo[70315]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:29.868 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:29 smithi060 ceph-mon[30953]: scrub summary: idle 2024-09-12T00:09:29.978 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:29 smithi105 ceph-mon[34805]: scrub summary: idle 2024-09-12T00:09:30.057 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-12T00:09:30.058 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:09:30.314 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:30.329 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:09:29 smithi060 sudo[108860]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:30.329 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:09:29 smithi060 sudo[108860]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:30.329 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:09:29 smithi060 sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:30.329 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:09:29 smithi060 sudo[108860]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:30.580 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:09:30 smithi060 sudo[108923]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:30.580 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:09:30 smithi060 sudo[108923]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:30.581 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:09:30 smithi060 sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:30.581 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:09:30 smithi060 sudo[108923]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:30.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 -- 172.21.15.60:0/1732233359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0101de0 msgr2=0x7efcd01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:30.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 --2- 172.21.15.60:0/1732233359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0101de0 0x7efcd01021c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009900 tx=0x7efcc002a410 comp rx=0 tx=0).stop 2024-09-12T00:09:30.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 -- 172.21.15.60:0/1732233359 shutdown_connections 2024-09-12T00:09:30.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 --2- 172.21.15.60:0/1732233359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd0106f10 0x7efcd010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:30.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 --2- 172.21.15.60:0/1732233359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcd0102790 0x7efcd01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 --2- 172.21.15.60:0/1732233359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0101de0 0x7efcd01021c0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 -- 172.21.15.60:0/1732233359 >> 172.21.15.60:0/1732233359 conn(0x7efcd00fd8c0 msgr2=0x7efcd00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 -- 172.21.15.60:0/1732233359 shutdown_connections 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.815+0000 7efcd49ec640 1 -- 172.21.15.60:0/1732233359 wait complete. 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcd49ec640 1 Processor -- start 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcd49ec640 1 -- start start 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcd49ec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcd0101de0 0x7efcd0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcd49ec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0102790 0x7efcd0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcd49ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd0106f10 0x7efcd019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcd49ec640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0112090 con 0x7efcd0102790 2024-09-12T00:09:30.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcd49ec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0111f10 con 0x7efcd0101de0 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcd49ec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efcd0112210 con 0x7efcd0106f10 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcc7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0102790 0x7efcd0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcce59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcd0101de0 0x7efcd0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcc7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0102790 0x7efcd0198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45654/0 (socket says 172.21.15.60:45654) 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcc7fff640 1 -- 172.21.15.60:0/69838579 learned_addr learned my addr 172.21.15.60:0/69838579 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcce59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcd0101de0 0x7efcd0198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38862/0 (socket says 172.21.15.60:38862) 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.816+0000 7efcced9d640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd0106f10 0x7efcd019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcce59c640 1 -- 172.21.15.60:0/69838579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd0106f10 msgr2=0x7efcd019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcce59c640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd0106f10 0x7efcd019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcce59c640 1 -- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0102790 msgr2=0x7efcd0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcce59c640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0102790 0x7efcd0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcce59c640 1 -- 172.21.15.60:0/69838579 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd019d4c0 con 0x7efcd0101de0 2024-09-12T00:09:30.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcc7fff640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0102790 0x7efcd0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcced9d640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd0106f10 0x7efcd019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcce59c640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcd0101de0 0x7efcd0198510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efcc0005940 tx=0x7efcc00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcc77fe640 1 -- 172.21.15.60:0/69838579 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc003f030 con 0x7efcd0101de0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcc77fe640 1 -- 172.21.15.60:0/69838579 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efcc00044c0 con 0x7efcd0101de0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd019d750 con 0x7efcd0101de0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcc77fe640 1 -- 172.21.15.60:0/69838579 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0035070 con 0x7efcd0101de0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.817+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd01a5090 con 0x7efcd0101de0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.818+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd01021c0 con 0x7efcd0101de0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.819+0000 7efcc77fe640 1 -- 172.21.15.60:0/69838579 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7efcc0042030 con 0x7efcd0101de0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.820+0000 7efcc77fe640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efcbc0a2d70 0x7efcbc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.820+0000 7efcc7fff640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efcbc0a2d70 0x7efcbc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.820+0000 7efcc77fe640 1 -- 172.21.15.60:0/69838579 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7efcc00efa10 con 0x7efcd0101de0 2024-09-12T00:09:30.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.820+0000 7efcc7fff640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efcbc0a2d70 0x7efcbc0a5230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efcb80095f0 tx=0x7efcb8005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:30.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:30.823+0000 7efcc77fe640 1 -- 172.21.15.60:0/69838579 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcc00bc5f0 con 0x7efcd0101de0 2024-09-12T00:09:30.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:30 smithi060 ceph-mon[30953]: pgmap v315: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 102 KiB/s wr, 17 op/s 2024-09-12T00:09:30.853 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:30 smithi105 ceph-mon[34805]: pgmap v315: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 102 KiB/s wr, 17 op/s 2024-09-12T00:09:30.854 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:09:30 smithi105 sudo[69659]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:30.854 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:09:30 smithi105 sudo[69659]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:30.854 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:09:30 smithi105 sudo[69659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:30.854 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:09:30 smithi105 sudo[69659]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:31.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:30 smithi192 ceph-mon[35487]: pgmap v315: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 102 KiB/s wr, 17 op/s 2024-09-12T00:09:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.037+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcd0199870 con 0x7efcd0101de0 2024-09-12T00:09:31.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.038+0000 7efcc77fe640 1 -- 172.21.15.60:0/69838579 <== mon.2 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7efcc00bbef0 con 0x7efcd0101de0 2024-09-12T00:09:31.038 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:09:31.039 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:09:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:09:31.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efcbc0a2d70 msgr2=0x7efcbc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:31.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efcbc0a2d70 0x7efcbc0a5230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efcb80095f0 tx=0x7efcb8005f90 comp rx=0 tx=0).stop 2024-09-12T00:09:31.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcd0101de0 msgr2=0x7efcd0198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:31.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcd0101de0 0x7efcd0198510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efcc0005940 tx=0x7efcc00040c0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 shutdown_connections 2024-09-12T00:09:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efcbc0a2d70 0x7efcbc0a5230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcd0106f10 0x7efcd019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcd0102790 0x7efcd0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 --2- 172.21.15.60:0/69838579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcd0101de0 0x7efcd0198510 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.040+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 >> 172.21.15.60:0/69838579 conn(0x7efcd00fd8c0 msgr2=0x7efcd00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.041+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 shutdown_connections 2024-09-12T00:09:31.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.041+0000 7efcd49ec640 1 -- 172.21.15.60:0/69838579 wait complete. 2024-09-12T00:09:31.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:09:30 smithi105 sudo[69662]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:31.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:09:30 smithi105 sudo[69662]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:31.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:09:30 smithi105 sudo[69662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:31.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:09:30 smithi105 sudo[69662]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:31.365 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:09:31 smithi192 sudo[70318]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:31.365 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:09:31 smithi192 sudo[70318]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:31.365 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:09:31 smithi192 sudo[70318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:31.365 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:09:31 smithi192 sudo[70318]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:31.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-12T00:09:31.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T00:09:31.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:09:31 smithi192 sudo[70321]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:31.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:09:31 smithi192 sudo[70321]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:31.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:09:31 smithi192 sudo[70321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:31.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:09:31 smithi192 sudo[70321]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 -- 172.21.15.60:0/2266017314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0102d40 msgr2=0x7f77e0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/2266017314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0102d40 0x7f77e0103120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009900 tx=0x7f77dc02a480 comp rx=0 tx=0).stop 2024-09-12T00:09:31.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 -- 172.21.15.60:0/2266017314 shutdown_connections 2024-09-12T00:09:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/2266017314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e010c110 0x7f77e010e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/2266017314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0103660 0x7f77e010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/2266017314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0102d40 0x7f77e0103120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 -- 172.21.15.60:0/2266017314 >> 172.21.15.60:0/2266017314 conn(0x7f77e0077990 msgr2=0x7f77e00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 -- 172.21.15.60:0/2266017314 shutdown_connections 2024-09-12T00:09:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.900+0000 7f77e7e2e640 1 -- 172.21.15.60:0/2266017314 wait complete. 2024-09-12T00:09:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.901+0000 7f77e7e2e640 1 Processor -- start 2024-09-12T00:09:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.901+0000 7f77e7e2e640 1 -- start start 2024-09-12T00:09:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e7e2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0102d40 0x7f77e0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e7e2e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0103660 0x7f77e0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e7e2e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e010c110 0x7f77e0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e7e2e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0112020 con 0x7f77e0102d40 2024-09-12T00:09:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e7e2e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0111ea0 con 0x7f77e010c110 2024-09-12T00:09:31.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e7e2e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01121a0 con 0x7f77e0103660 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e5bca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0102d40 0x7f77e0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e5bca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0102d40 0x7f77e0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46038/0 (socket says 172.21.15.60:46038) 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e5bca640 1 -- 172.21.15.60:0/189924660 learned_addr learned my addr 172.21.15.60:0/189924660 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e53c9640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0103660 0x7f77e0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e63cb640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e010c110 0x7f77e0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e53c9640 1 -- 172.21.15.60:0/189924660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e010c110 msgr2=0x7f77e0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e53c9640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e010c110 0x7f77e0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e53c9640 1 -- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0102d40 msgr2=0x7f77e0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.902+0000 7f77e53c9640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0102d40 0x7f77e0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.903+0000 7f77e53c9640 1 -- 172.21.15.60:0/189924660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e01a6930 con 0x7f77e0103660 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.903+0000 7f77e53c9640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0103660 0x7f77e0100ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77d000e9f0 tx=0x7f77d000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:31.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.903+0000 7f77d6ffd640 1 -- 172.21.15.60:0/189924660 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d000ccc0 con 0x7f77e0103660 2024-09-12T00:09:31.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.903+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e01a6c20 con 0x7f77e0103660 2024-09-12T00:09:31.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.903+0000 7f77d6ffd640 1 -- 172.21.15.60:0/189924660 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77d0010930 con 0x7f77e0103660 2024-09-12T00:09:31.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.903+0000 7f77d6ffd640 1 -- 172.21.15.60:0/189924660 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0018920 con 0x7f77e0103660 2024-09-12T00:09:31.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.903+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e01a7170 con 0x7f77e0103660 2024-09-12T00:09:31.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.904+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e0103120 con 0x7f77e0103660 2024-09-12T00:09:31.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.905+0000 7f77d6ffd640 1 -- 172.21.15.60:0/189924660 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f77d0010ae0 con 0x7f77e0103660 2024-09-12T00:09:31.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.906+0000 7f77d6ffd640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77cc0a2da0 0x7f77cc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:31.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.906+0000 7f77d6ffd640 1 -- 172.21.15.60:0/189924660 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f77d00cfa20 con 0x7f77e0103660 2024-09-12T00:09:31.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.906+0000 7f77e5bca640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77cc0a2da0 0x7f77cc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:31.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.907+0000 7f77e5bca640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77cc0a2da0 0x7f77cc0a5260 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0096c0 tx=0x7f77dc0046c0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:31.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:31.909+0000 7f77d6ffd640 1 -- 172.21.15.60:0/189924660 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77d009c600 con 0x7f77e0103660 2024-09-12T00:09:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:32.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:31 smithi060 sudo[109015]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:32.088 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:31 smithi060 sudo[109015]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:32.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:31 smithi060 sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:32.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:31 smithi060 sudo[109015]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:32.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.151+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f77e00fd6b0 con 0x7f77cc0a2da0 2024-09-12T00:09:32.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.159+0000 7f77d6ffd640 1 -- 172.21.15.60:0/189924660 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f77e00fd6b0 con 0x7f77cc0a2da0 2024-09-12T00:09:32.159 INFO:teuthology.orchestra.run.smithi060.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-11T00:00:00", "created": "2024-09-11T23:59:30", "first": "2024-09-12T00:00:00", "last": "2024-09-12T00:09:00", "last_pruned": "2024-09-12T00:09:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-12T00:09:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77cc0a2da0 msgr2=0x7f77cc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77cc0a2da0 0x7f77cc0a5260 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0096c0 tx=0x7f77dc0046c0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0103660 msgr2=0x7f77e0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0103660 0x7f77e0100ed0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77d000e9f0 tx=0x7f77d000edf0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 shutdown_connections 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77cc0a2da0 0x7f77cc0a5260 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e010c110 0x7f77e0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0103660 0x7f77e0100ed0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 --2- 172.21.15.60:0/189924660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77e0102d40 0x7f77e0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 >> 172.21.15.60:0/189924660 conn(0x7f77e0077990 msgr2=0x7f77e00fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 shutdown_connections 2024-09-12T00:09:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.161+0000 7f77e7e2e640 1 -- 172.21.15.60:0/189924660 wait complete. 2024-09-12T00:09:32.174 DEBUG:teuthology.orchestra.run.smithi060:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T00:09:32.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/283307137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec103620 msgr2=0x7f0fec10bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/283307137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec103620 0x7f0fec10bb00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009900 tx=0x7f0fd802a480 comp rx=0 tx=0).stop 2024-09-12T00:09:32.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/283307137 shutdown_connections 2024-09-12T00:09:32.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/283307137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fec10c0d0 0x7f0fec10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/283307137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec103620 0x7f0fec10bb00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/283307137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fec102d00 0x7f0fec1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/283307137 >> 172.21.15.60:0/283307137 conn(0x7f0fec077990 msgr2=0x7f0fec0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/283307137 shutdown_connections 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.285+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/283307137 wait complete. 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff2ffd640 1 Processor -- start 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff2ffd640 1 -- start start 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec102d00 0x7f0fec198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff2ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fec103620 0x7f0fec198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fec10c0d0 0x7f0fec19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff2ffd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec111fd0 con 0x7f0fec10c0d0 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff2ffd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec111e50 con 0x7f0fec102d00 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff2ffd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec112150 con 0x7f0fec103620 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff0d99640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec102d00 0x7f0fec198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff159a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fec10c0d0 0x7f0fec19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff0d99640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec102d00 0x7f0fec198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:36490/0 (socket says 172.21.15.60:36490) 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0ff0d99640 1 -- 172.21.15.60:0/3672558317 learned_addr learned my addr 172.21.15.60:0/3672558317 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.286+0000 7f0febfff640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fec103620 0x7f0fec198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0ff0d99640 1 -- 172.21.15.60:0/3672558317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fec103620 msgr2=0x7f0fec198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0ff0d99640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fec103620 0x7f0fec198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0ff0d99640 1 -- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fec10c0d0 msgr2=0x7f0fec19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0ff0d99640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fec10c0d0 0x7f0fec19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0ff0d99640 1 -- 172.21.15.60:0/3672558317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fec19d410 con 0x7f0fec102d00 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0ff0d99640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec102d00 0x7f0fec198420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000d950 tx=0x7f0fe000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0fe9ffb640 1 -- 172.21.15.60:0/3672558317 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0017070 con 0x7f0fec102d00 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0fe9ffb640 1 -- 172.21.15.60:0/3672558317 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fe0009c30 con 0x7f0fec102d00 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fec19d700 con 0x7f0fec102d00 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0fe9ffb640 1 -- 172.21.15.60:0/3672558317 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000f740 con 0x7f0fec102d00 2024-09-12T00:09:32.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.287+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fec1a4f90 con 0x7f0fec102d00 2024-09-12T00:09:32.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.288+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fec1030e0 con 0x7f0fec102d00 2024-09-12T00:09:32.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.290+0000 7f0fe9ffb640 1 -- 172.21.15.60:0/3672558317 <== mon.2 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0fe0010a80 con 0x7f0fec102d00 2024-09-12T00:09:32.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.291+0000 7f0fe9ffb640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0fdc0a2da0 0x7f0fdc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.291+0000 7f0febfff640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0fdc0a2da0 0x7f0fdc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.291+0000 7f0fe9ffb640 1 -- 172.21.15.60:0/3672558317 <== mon.2 v2:172.21.15.105:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f0fe00cefd0 con 0x7f0fec102d00 2024-09-12T00:09:32.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.291+0000 7f0febfff640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0fdc0a2da0 0x7f0fdc0a5260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009230 tx=0x7f0fd80058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:32.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.294+0000 7f0fe9ffb640 1 -- 172.21.15.60:0/3672558317 <== mon.2 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fe0009de0 con 0x7f0fec102d00 2024-09-12T00:09:32.444 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:32 smithi060 sudo[109132]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:32.445 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:32 smithi060 sudo[109132]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:32.445 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:32 smithi060 sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:32.445 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:32 smithi060 sudo[109132]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:32.445 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:32 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/69838579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:09:32.445 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:32 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:32.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.513+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 --> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f0fec0fd6f0 con 0x7f0fdc0a2da0 2024-09-12T00:09:32.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.520+0000 7f0fe9ffb640 1 -- 172.21.15.60:0/3672558317 <== mgr.15216 v2:172.21.15.60:6800/1761817386 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f0fec0fd6f0 con 0x7f0fdc0a2da0 2024-09-12T00:09:32.520 INFO:teuthology.orchestra.run.smithi060.stdout:/ 1m 6m3h 2024-09-12T00:09:32.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0fdc0a2da0 msgr2=0x7f0fdc0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0fdc0a2da0 0x7f0fdc0a5260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8009230 tx=0x7f0fd80058d0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec102d00 msgr2=0x7f0fec198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec102d00 0x7f0fec198420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000d950 tx=0x7f0fe000de10 comp rx=0 tx=0).stop 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 shutdown_connections 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f0fdc0a2da0 0x7f0fdc0a5260 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fec10c0d0 0x7f0fec19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fec103620 0x7f0fec198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.522+0000 7f0ff2ffd640 1 --2- 172.21.15.60:0/3672558317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fec102d00 0x7f0fec198420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.523+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 >> 172.21.15.60:0/3672558317 conn(0x7f0fec077990 msgr2=0x7f0fec0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.523+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 shutdown_connections 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.523+0000 7f0ff2ffd640 1 -- 172.21.15.60:0/3672558317 wait complete. 2024-09-12T00:09:32.534 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-12T00:09:32.548 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-12T00:09:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.540+0000 7fdbd6027640 1 -- 172.21.15.60:0/1464109190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 msgr2=0x7fdbd01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 --2- 172.21.15.60:0/1464109190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 0x7fdbd01067e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009900 tx=0x7fdbb802a410 comp rx=0 tx=0).stop 2024-09-12T00:09:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 -- 172.21.15.60:0/1464109190 shutdown_connections 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 --2- 172.21.15.60:0/1464109190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd0106f10 0x7fdbd010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 --2- 172.21.15.60:0/1464109190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 0x7fdbd01067e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 --2- 172.21.15.60:0/1464109190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd0101de0 0x7fdbd01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 -- 172.21.15.60:0/1464109190 >> 172.21.15.60:0/1464109190 conn(0x7fdbd00fd8c0 msgr2=0x7fdbd00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 -- 172.21.15.60:0/1464109190 shutdown_connections 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 -- 172.21.15.60:0/1464109190 wait complete. 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 Processor -- start 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.541+0000 7fdbd6027640 1 -- start start 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbd6027640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd0101de0 0x7fdbd019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbd6027640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 0x7fdbd019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbd6027640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd0106f10 0x7fdbd019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbd6027640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0112090 con 0x7fdbd0102790 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbd6027640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0111f10 con 0x7fdbd0101de0 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbd6027640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd0112210 con 0x7fdbd0106f10 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 0x7fdbd019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 0x7fdbd019acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46074/0 (socket says 172.21.15.60:46074) 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 -- 172.21.15.60:0/3613368658 learned_addr learned my addr 172.21.15.60:0/3613368658 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbcffff640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd0106f10 0x7fdbd019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd0101de0 0x7fdbd019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 -- 172.21.15.60:0/3613368658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd0106f10 msgr2=0x7fdbd019df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd0106f10 0x7fdbd019df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 -- 172.21.15.60:0/3613368658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd0101de0 msgr2=0x7fdbd019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd0101de0 0x7fdbd019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 -- 172.21.15.60:0/3613368658 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd019e6c0 con 0x7fdbd0102790 2024-09-12T00:09:32.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbceffd640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 0x7fdbd019acb0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8006010 tx=0x7fdbb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.542+0000 7fdbccff9640 1 -- 172.21.15.60:0/3613368658 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb803f030 con 0x7fdbd0102790 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.543+0000 7fdbccff9640 1 -- 172.21.15.60:0/3613368658 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbb8003d00 con 0x7fdbd0102790 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.543+0000 7fdbd6027640 1 -- 172.21.15.60:0/3613368658 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd019e950 con 0x7fdbd0102790 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.543+0000 7fdbccff9640 1 -- 172.21.15.60:0/3613368658 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8035070 con 0x7fdbd0102790 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.543+0000 7fdbd6027640 1 -- 172.21.15.60:0/3613368658 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd01a7320 con 0x7fdbd0102790 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbd8400740 1 Processor -- start 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbd8400740 1 -- start start 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac4c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbccff9640 1 -- 172.21.15.60:0/3613368658 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdbb8042030 con 0x7fdbd0102790 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac4ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 0x56141ac59760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbd8400740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56141abb22f0 con 0x56141ac4db40 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbd8400740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56141ab59cf0 con 0x56141ac4c5d0 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.545+0000 7fdbd8400740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56141abae2b0 con 0x56141ac57370 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac4ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac4ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:36510/0 (socket says 172.21.15.60:36510) 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/3723348589 learned_addr learned my addr 172.21.15.60:0/3723348589 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcffff640 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac4c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbceffd640 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 0x56141ac59760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/3723348589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 msgr2=0x56141ac59760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 0x56141ac59760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/3723348589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 msgr2=0x56141ac4c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac4c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/3723348589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56141ab3e3a0 con 0x56141ac4c5d0 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac4ca10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000af40 tx=0x7fdbc000f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8ab8eb18b9ece03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbc5ffb640 1 -- 172.21.15.60:0/3723348589 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc001d070 con 0x56141ac4c5d0 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.546+0000 7fdbc5ffb640 1 -- 172.21.15.60:0/3723348589 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbc0010e00 con 0x56141ac4c5d0 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbc5ffb640 1 -- 172.21.15.60:0/3723348589 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0016340 con 0x56141ac4c5d0 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbccff9640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdbbc0a2cf0 0x7fdbbc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbcffff640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdbbc0a2cf0 0x7fdbbc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbccff9640 1 -- 172.21.15.60:0/3613368658 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fdbb80ef5a0 con 0x7fdbd0102790 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 -- 172.21.15.60:0/3723348589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 msgr2=0x56141ac4ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac4ca10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000af40 tx=0x7fdbc000f850 comp rx=0 tx=0).stop 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbcffff640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdbbc0a2cf0 0x7fdbbc0a51b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800b6c0 tx=0x7fdbc800b2e0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 -- 172.21.15.60:0/3723348589 shutdown_connections 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 0x56141ac59760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac4ca10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 --2- 172.21.15.60:0/3723348589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac4c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 -- 172.21.15.60:0/3723348589 >> 172.21.15.60:0/3723348589 conn(0x56141ac15310 msgr2=0x56141ac48c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 -- 172.21.15.60:0/3723348589 shutdown_connections 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.547+0000 7fdbd8400740 1 -- 172.21.15.60:0/3723348589 wait complete. 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 1 -- start start 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 1 Processor -- start 2024-09-12T00:09:32.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac56cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac53fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 0x56141ac54520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56141ac5a070 con 0x56141ac4db40 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56141ab6d060 con 0x56141ac4c5d0 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56141ac5a1f0 con 0x56141ac57370 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbd8400740 10 client.0 _ll_register_callbacks cb 0x56141a8c08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbceffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac53fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbcf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac56cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.548+0000 7fdbcf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac56cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:36514/0 (socket says 172.21.15.60:36514) 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/410007838 learned_addr learned my addr 172.21.15.60:0/410007838 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbcffff640 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 0x56141ac54520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbceffd640 1 -- 172.21.15.60:0/410007838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 msgr2=0x56141ac54520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:32.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbceffd640 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 0x56141ac54520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbceffd640 1 -- 172.21.15.60:0/410007838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 msgr2=0x56141ac56cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbceffd640 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac56cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbceffd640 1 -- 172.21.15.60:0/410007838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56141a9233c0 con 0x56141ac4db40 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac56cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbceffd640 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac53fa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80ecd10 tx=0x7fdbb8009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c1b0a535644131 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbaeffd640 1 -- 172.21.15.60:0/410007838 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8049070 con 0x56141ac4db40 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbaeffd640 1 -- 172.21.15.60:0/410007838 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fdbb80b8200 con 0x56141ac4db40 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbd8400740 1 -- 172.21.15.60:0/410007838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbc0010e00 con 0x56141ac4db40 2024-09-12T00:09:32.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbaeffd640 1 -- 172.21.15.60:0/410007838 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fdbb80bb6d0 con 0x56141ac4db40 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbd8400740 10 client.17934 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.549+0000 7fdbd8400740 1 -- 172.21.15.60:0/410007838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56141ac65aa0 con 0x56141ac4db40 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbaeffd640 1 -- 172.21.15.60:0/410007838 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbc0010e00 con 0x56141ac4db40 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbaeffd640 1 -- 172.21.15.60:0/410007838 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fdbb803b460 con 0x56141ac4db40 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbd8400740 10 client.17934 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbd8400740 10 client.17934 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbd8400740 20 client.17934 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbd8400740 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x56141ac66df0 0x56141ac69200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbd8400740 4 client.17934 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbd8400740 1 -- 172.21.15.60:0/410007838 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56141abbf860 con 0x56141ac66df0 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.550+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x56141ac66df0 0x56141ac69200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.551+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x56141ac66df0 0x56141ac69200 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f4bd9c52c5d1762c server_cookie=d9b792df5f3c42eb in_seq=0 out_seq=0 2024-09-12T00:09:32.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.551+0000 7fdbaeffd640 10 client.17934 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:09:32.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.551+0000 7fdbaeffd640 1 -- 172.21.15.60:0/410007838 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56141abbf860 con 0x56141ac66df0 2024-09-12T00:09:32.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.551+0000 7fdbaeffd640 10 client.17934 handle_command_reply: tid=0 2024-09-12T00:09:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.551+0000 7fdbd8400740 1 client.17934 shutdown 2024-09-12T00:09:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.551+0000 7fdbd8400740 1 -- 172.21.15.60:0/410007838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 msgr2=0x56141ac53fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.551+0000 7fdbd8400740 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac53fa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80ecd10 tx=0x7fdbb8009620 comp rx=0 tx=0).stop 2024-09-12T00:09:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 1 -- 172.21.15.60:0/410007838 shutdown_connections 2024-09-12T00:09:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac57370 0x56141ac54520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4db40 0x56141ac53fa0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x56141ac66df0 0x56141ac69200 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 1 --2- 172.21.15.60:0/410007838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac56cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 1 -- 172.21.15.60:0/410007838 >> 172.21.15.60:0/410007838 conn(0x56141ac15310 msgr2=0x56141ac4e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbaeffd640 0 client.17934 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:09:32.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 1 -- 172.21.15.60:0/410007838 shutdown_connections 2024-09-12T00:09:32.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 1 -- 172.21.15.60:0/410007838 wait complete. 2024-09-12T00:09:32.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.552+0000 7fdbd8400740 20 client.17934 trim_cache size 0 max 16384 2024-09-12T00:09:32.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/69838579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:09:32.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:32.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 sudo[70324]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:32.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 sudo[70324]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:32.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 sudo[70324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:32.567 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 sudo[70324]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:32.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbd8400740 1 Processor -- start 2024-09-12T00:09:32.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbd8400740 1 -- start start 2024-09-12T00:09:32.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac48e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac63310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac57370 0x56141ac6ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbd8400740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd01afa80 con 0x56141ac57370 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbd8400740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd01b15c0 con 0x56141ac4c5d0 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbd8400740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd01b0150 con 0x56141ac4db40 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbcffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac57370 0x56141ac6ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbceffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac63310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbcffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac57370 0x56141ac6ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46086/0 (socket says 172.21.15.60:46086) 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbcffff640 1 -- 172.21.15.60:0/1528170417 learned_addr learned my addr 172.21.15.60:0/1528170417 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.565+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac48e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.566+0000 7fdbceffd640 1 -- 172.21.15.60:0/1528170417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 msgr2=0x56141ac48e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.566+0000 7fdbceffd640 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac48e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.566+0000 7fdbceffd640 1 -- 172.21.15.60:0/1528170417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac57370 msgr2=0x56141ac6ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.566+0000 7fdbceffd640 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac57370 0x56141ac6ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.566+0000 7fdbceffd640 1 -- 172.21.15.60:0/1528170417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56141ac52550 con 0x56141ac4db40 2024-09-12T00:09:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.566+0000 7fdbcffff640 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac57370 0x56141ac6ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:32.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.566+0000 7fdbceffd640 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac63310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80ecdc0 tx=0x7fdbb8005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6bc3ded0620be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:32.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:32 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/69838579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:09:32.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:32 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:32.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbc57fa640 1 -- 172.21.15.60:0/1528170417 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8049070 con 0x56141ac4db40 2024-09-12T00:09:32.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbc57fa640 1 -- 172.21.15.60:0/1528170417 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbb80f5140 con 0x56141ac4db40 2024-09-12T00:09:32.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbc57fa640 1 -- 172.21.15.60:0/1528170417 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80bb4f0 con 0x56141ac4db40 2024-09-12T00:09:32.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbd8400740 1 -- 172.21.15.60:0/1528170417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 msgr2=0x56141ac63310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbd8400740 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac63310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80ecdc0 tx=0x7fdbb8005be0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbd8400740 1 -- 172.21.15.60:0/1528170417 shutdown_connections 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbd8400740 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac57370 0x56141ac6ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbd8400740 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac63310 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbd8400740 1 --2- 172.21.15.60:0/1528170417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac4c5d0 0x56141ac48e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.811+0000 7fdbd8400740 1 -- 172.21.15.60:0/1528170417 >> 172.21.15.60:0/1528170417 conn(0x56141ac15310 msgr2=0x56141ac48700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.812+0000 7fdbd8400740 1 -- 172.21.15.60:0/1528170417 shutdown_connections 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.812+0000 7fdbd8400740 1 -- 172.21.15.60:0/1528170417 wait complete. 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.812+0000 7fdbd8400740 1 -- start start 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.812+0000 7fdbd8400740 1 Processor -- start 2024-09-12T00:09:32.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4c5d0 0x56141ac5fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac50e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbd8400740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac57370 0x56141ac513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbd8400740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd01b0ef0 con 0x56141ac4c5d0 2024-09-12T00:09:32.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbd8400740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd01b0820 con 0x56141ac57370 2024-09-12T00:09:32.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbcf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4c5d0 0x56141ac5fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbd8400740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd01ada80 con 0x56141ac4db40 2024-09-12T00:09:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbcf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4c5d0 0x56141ac5fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46094/0 (socket says 172.21.15.60:46094) 2024-09-12T00:09:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/69621990 learned_addr learned my addr 172.21.15.60:0/69621990 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbceffd640 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac50e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbd8400740 10 client.0 _ll_register_callbacks cb 0x7fdbb80044e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:32.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/69621990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 msgr2=0x56141ac50e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac50e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/69621990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac57370 msgr2=0x56141ac513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac57370 0x56141ac513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbcf7fe640 1 -- 172.21.15.60:0/69621990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56141ac51c20 con 0x56141ac4c5d0 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.813+0000 7fdbceffd640 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac50e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbcf7fe640 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4c5d0 0x56141ac5fcb0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000af40 tx=0x7fdbc0018720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23602ac06fad4315 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbaeffd640 1 -- 172.21.15.60:0/69621990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc001d040 con 0x56141ac4c5d0 2024-09-12T00:09:32.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbaeffd640 1 -- 172.21.15.60:0/69621990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fdbc0004df0 con 0x56141ac4c5d0 2024-09-12T00:09:32.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbd8400740 1 -- 172.21.15.60:0/69621990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb80f5140 con 0x56141ac4c5d0 2024-09-12T00:09:32.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbaeffd640 1 -- 172.21.15.60:0/69621990 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fdbc003d050 con 0x56141ac4c5d0 2024-09-12T00:09:32.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbd8400740 10 client.17940 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:32.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbd8400740 1 -- 172.21.15.60:0/69621990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56141acd1b80 con 0x56141ac4c5d0 2024-09-12T00:09:32.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.814+0000 7fdbaeffd640 1 -- 172.21.15.60:0/69621990 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbb80f5140 con 0x56141ac4c5d0 2024-09-12T00:09:32.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbaeffd640 1 -- 172.21.15.60:0/69621990 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fdbc002e070 con 0x56141ac4c5d0 2024-09-12T00:09:32.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbd8400740 10 client.17940 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:32.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbd8400740 10 client.17940 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-12T00:09:32.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbd8400740 20 client.17940 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:32.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbd8400740 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x56141acd1f60 0x56141acd4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:32.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbd8400740 4 client.17940 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:32.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbd8400740 1 -- 172.21.15.60:0/69621990 --> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56141abb9d70 con 0x56141acd1f60 2024-09-12T00:09:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbceffd640 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x56141acd1f60 0x56141acd4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbaeffd640 10 client.17940 ms_handle_connect on v2:172.21.15.105:6836/2264507638 2024-09-12T00:09:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.815+0000 7fdbceffd640 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x56141acd1f60 0x56141acd4350 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7f3495f7adf30c6a server_cookie=4cf485f85f3e38de in_seq=0 out_seq=0 2024-09-12T00:09:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbaeffd640 1 -- 172.21.15.60:0/69621990 <== mds.4 v2:172.21.15.105:6836/2264507638 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56141abb9d70 con 0x56141acd1f60 2024-09-12T00:09:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbaeffd640 10 client.17940 handle_command_reply: tid=0 2024-09-12T00:09:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 client.17940 shutdown 2024-09-12T00:09:32.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 -- 172.21.15.60:0/69621990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4c5d0 msgr2=0x56141ac5fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4c5d0 0x56141ac5fcb0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000af40 tx=0x7fdbc0018720 comp rx=0 tx=0).stop 2024-09-12T00:09:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 -- 172.21.15.60:0/69621990 shutdown_connections 2024-09-12T00:09:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.105:6836/2264507638,v1:172.21.15.105:6837/2264507638] conn(0x56141acd1f60 0x56141acd4350 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x56141ac57370 0x56141ac513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56141ac4db40 0x56141ac50e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 --2- 172.21.15.60:0/69621990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56141ac4c5d0 0x56141ac5fcb0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbaeffd640 0 client.17940 ms_handle_reset on v2:172.21.15.105:6836/2264507638 2024-09-12T00:09:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 -- 172.21.15.60:0/69621990 >> 172.21.15.60:0/69621990 conn(0x56141ac15310 msgr2=0x56141ac474e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 -- 172.21.15.60:0/69621990 shutdown_connections 2024-09-12T00:09:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 1 -- 172.21.15.60:0/69621990 wait complete. 2024-09-12T00:09:32.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.816+0000 7fdbd8400740 20 client.17940 trim_cache size 0 max 16384 2024-09-12T00:09:32.824 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 -- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdbbc0a2cf0 msgr2=0x7fdbbc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdbbc0a2cf0 0x7fdbbc0a51b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800b6c0 tx=0x7fdbc800b2e0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 -- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 msgr2=0x7fdbd019acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 0x7fdbd019acb0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8006010 tx=0x7fdbb80042f0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 -- 172.21.15.60:0/3613368658 shutdown_connections 2024-09-12T00:09:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fdbbc0a2cf0 0x7fdbbc0a51b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbd0106f10 0x7fdbd019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbd0102790 0x7fdbd019acb0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 --2- 172.21.15.60:0/3613368658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd0101de0 0x7fdbd019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 -- 172.21.15.60:0/3613368658 >> 172.21.15.60:0/3613368658 conn(0x7fdbd00fd8c0 msgr2=0x7fdbd00feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 -- 172.21.15.60:0/3613368658 shutdown_connections 2024-09-12T00:09:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:32.817+0000 7fdbd6027640 1 -- 172.21.15.60:0/3613368658 wait complete. 2024-09-12T00:09:33.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 sudo[70327]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:33.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 sudo[70327]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:33.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 sudo[70327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:33.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:32 smithi192 sudo[70327]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:33.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 sudo[69665]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T00:09:33.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 sudo[69665]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:33.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 sudo[69665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:33.309 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 sudo[69665]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: pgmap v316: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 98 KiB/s wr, 16 op/s 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='client.26962 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.510 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.511 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:33.511 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.511 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.511 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:33 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.544 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-12T00:09:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 sudo[69668]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T00:09:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 sudo[69668]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T00:09:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 sudo[69668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T00:09:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 sudo[69668]: pam_unix(sudo:session): session closed for user root 2024-09-12T00:09:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: pgmap v316: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 98 KiB/s wr, 16 op/s 2024-09-12T00:09:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='client.26962 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:09:33.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:33 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: pgmap v316: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 98 KiB/s wr, 16 op/s 2024-09-12T00:09:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='client.26962 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:09:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:33.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:33.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T00:09:33.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T00:09:33.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:33 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T00:09:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:34.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.315+0000 7fd65055a640 1 -- 172.21.15.60:0/2109059327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 msgr2=0x7fd6481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.315+0000 7fd65055a640 1 --2- 172.21.15.60:0/2109059327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 0x7fd6481021c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fd644009900 tx=0x7fd64402a410 comp rx=0 tx=0).stop 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.315+0000 7fd65055a640 1 -- 172.21.15.60:0/2109059327 shutdown_connections 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.315+0000 7fd65055a640 1 --2- 172.21.15.60:0/2109059327 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd648106f10 0x7fd64810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.315+0000 7fd65055a640 1 --2- 172.21.15.60:0/2109059327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd648102790 0x7fd6481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.315+0000 7fd65055a640 1 --2- 172.21.15.60:0/2109059327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 0x7fd6481021c0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.315+0000 7fd65055a640 1 -- 172.21.15.60:0/2109059327 >> 172.21.15.60:0/2109059327 conn(0x7fd6480fd8c0 msgr2=0x7fd6480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 -- 172.21.15.60:0/2109059327 shutdown_connections 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 -- 172.21.15.60:0/2109059327 wait complete. 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 Processor -- start 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 -- start start 2024-09-12T00:09:34.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 0x7fd64819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd648102790 0x7fd64819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd648106f10 0x7fd64819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6481120d0 con 0x7fd648101de0 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd648111f50 con 0x7fd648106f10 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.316+0000 7fd65055a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd648112250 con 0x7fd648102790 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 0x7fd64819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 0x7fd64819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46116/0 (socket says 172.21.15.60:46116) 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 -- 172.21.15.60:0/2184071813 learned_addr learned my addr 172.21.15.60:0/2184071813 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64daf5640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd648102790 0x7fd64819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd648106f10 0x7fd64819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 -- 172.21.15.60:0/2184071813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd648102790 msgr2=0x7fd64819acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd648102790 0x7fd64819acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 -- 172.21.15.60:0/2184071813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd648106f10 msgr2=0x7fd64819dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd648106f10 0x7fd64819dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 -- 172.21.15.60:0/2184071813 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64819e700 con 0x7fd648101de0 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd648106f10 0x7fd64819dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.317+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 0x7fd64819a7b0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd644006010 tx=0x7fd6440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.320+0000 7fd63f7fe640 1 -- 172.21.15.60:0/2184071813 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64403f030 con 0x7fd648101de0 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.320+0000 7fd63f7fe640 1 -- 172.21.15.60:0/2184071813 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd644003d00 con 0x7fd648101de0 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.320+0000 7fd65055a640 1 -- 172.21.15.60:0/2184071813 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64819e990 con 0x7fd648101de0 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.320+0000 7fd63f7fe640 1 -- 172.21.15.60:0/2184071813 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd644035070 con 0x7fd648101de0 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.320+0000 7fd65055a640 1 -- 172.21.15.60:0/2184071813 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6481a7360 con 0x7fd648101de0 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.323+0000 7fd63f7fe640 1 -- 172.21.15.60:0/2184071813 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd644042030 con 0x7fd648101de0 2024-09-12T00:09:34.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.323+0000 7fd63f7fe640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd6340a2cf0 0x7fd6340a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.323+0000 7fd64daf5640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd6340a2cf0 0x7fd6340a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.323+0000 7fd63f7fe640 1 -- 172.21.15.60:0/2184071813 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd6440efaa0 con 0x7fd648101de0 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd652933740 1 Processor -- start 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd652933740 1 -- start start 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd64daf5640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd6340a2cf0 0x7fd6340a51b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd6480fdf70 tx=0x7fd638009110 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd652933740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c6b40 0x55599a6c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd652933740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c55d0 0x55599a6c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd652933740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6d0370 0x55599a6d2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd652933740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55599a62b2f0 con 0x55599a6c55d0 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd652933740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55599a5d2cf0 con 0x55599a6c6b40 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd652933740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55599a6272b0 con 0x55599a6d0370 2024-09-12T00:09:34.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd64daf5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c55d0 0x55599a6c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd64daf5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c55d0 0x55599a6c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46126/0 (socket says 172.21.15.60:46126) 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd64daf5640 1 -- 172.21.15.60:0/1057642093 learned_addr learned my addr 172.21.15.60:0/1057642093 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c6b40 0x55599a6c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.324+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6d0370 0x55599a6d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd64daf5640 1 -- 172.21.15.60:0/1057642093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6d0370 msgr2=0x55599a6d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd64daf5640 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6d0370 0x55599a6d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd64daf5640 1 -- 172.21.15.60:0/1057642093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c6b40 msgr2=0x55599a6c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd64daf5640 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c6b40 0x55599a6c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd64daf5640 1 -- 172.21.15.60:0/1057642093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55599a5b73a0 con 0x55599a6c55d0 2024-09-12T00:09:34.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd64daf5640 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c55d0 0x55599a6c5a10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd63800eb20 tx=0x7fd638011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5c770a6da88e25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd63cff9640 1 -- 172.21.15.60:0/1057642093 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63801b040 con 0x55599a6c55d0 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd63cff9640 1 -- 172.21.15.60:0/1057642093 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd638024070 con 0x55599a6c55d0 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.325+0000 7fd63cff9640 1 -- 172.21.15.60:0/1057642093 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63801f3f0 con 0x55599a6c55d0 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 -- 172.21.15.60:0/1057642093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c55d0 msgr2=0x55599a6c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c55d0 0x55599a6c5a10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd63800eb20 tx=0x7fd638011000 comp rx=0 tx=0).stop 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 -- 172.21.15.60:0/1057642093 shutdown_connections 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6d0370 0x55599a6d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c55d0 0x55599a6c5a10 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 --2- 172.21.15.60:0/1057642093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c6b40 0x55599a6c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 -- 172.21.15.60:0/1057642093 >> 172.21.15.60:0/1057642093 conn(0x55599a68e310 msgr2=0x55599a6c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 -- 172.21.15.60:0/1057642093 shutdown_connections 2024-09-12T00:09:34.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.326+0000 7fd652933740 1 -- 172.21.15.60:0/1057642093 wait complete. 2024-09-12T00:09:34.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 1 -- start start 2024-09-12T00:09:34.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 1 Processor -- start 2024-09-12T00:09:34.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55599a6d3070 con 0x55599a6d0370 2024-09-12T00:09:34.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55599a5e6060 con 0x55599a6c55d0 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55599a6d31f0 con 0x55599a6c6b40 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd652933740 10 client.0 _ll_register_callbacks cb 0x55599a3398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64eaf7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64eaf7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46138/0 (socket says 172.21.15.60:46138) 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64eaf7640 1 -- 172.21.15.60:0/1964222474 learned_addr learned my addr 172.21.15.60:0/1964222474 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64daf5640 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64eaf7640 1 -- 172.21.15.60:0/1964222474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 msgr2=0x55599a6ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64eaf7640 1 -- 172.21.15.60:0/1964222474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 msgr2=0x55599a6cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64eaf7640 1 -- 172.21.15.60:0/1964222474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55599a39c3c0 con 0x55599a6d0370 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.327+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6cd560 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd640011b50 tx=0x7fd64000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b50f586b316623 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd631ffb640 1 -- 172.21.15.60:0/1964222474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640004d20 con 0x55599a6d0370 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd631ffb640 1 -- 172.21.15.60:0/1964222474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd64000e5c0 con 0x55599a6d0370 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 1 -- 172.21.15.60:0/1964222474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd638024070 con 0x55599a6d0370 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd631ffb640 1 -- 172.21.15.60:0/1964222474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fd64000e7c0 con 0x55599a6d0370 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 10 client.17952 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 1 -- 172.21.15.60:0/1964222474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55599a6deb50 con 0x55599a6d0370 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd631ffb640 1 -- 172.21.15.60:0/1964222474 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd638024070 con 0x55599a6d0370 2024-09-12T00:09:34.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd631ffb640 1 -- 172.21.15.60:0/1964222474 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fd640020070 con 0x55599a6d0370 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 10 client.17952 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 10 client.17952 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 20 client.17952 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55599a6e0010 0x55599a6e2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 4 client.17952 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.328+0000 7fd652933740 1 -- 172.21.15.60:0/1964222474 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55599a638860 con 0x55599a6e0010 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.329+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55599a6e0010 0x55599a6e2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.329+0000 7fd631ffb640 10 client.17952 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.329+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55599a6e0010 0x55599a6e2400 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b89feb98b3cc2fcc server_cookie=6e198544e2948e20 in_seq=0 out_seq=0 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd631ffb640 1 -- 172.21.15.60:0/1964222474 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55599a638860 con 0x55599a6e0010 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd631ffb640 10 client.17952 handle_command_reply: tid=0 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 client.17952 shutdown 2024-09-12T00:09:34.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 -- 172.21.15.60:0/1964222474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 msgr2=0x55599a6cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6cd560 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd640011b50 tx=0x7fd64000f790 comp rx=0 tx=0).stop 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 -- 172.21.15.60:0/1964222474 shutdown_connections 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55599a6e0010 0x55599a6e2400 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6cd560 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd631ffb640 0 client.17952 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 --2- 172.21.15.60:0/1964222474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 -- 172.21.15.60:0/1964222474 >> 172.21.15.60:0/1964222474 conn(0x55599a68e310 msgr2=0x55599a6c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 -- 172.21.15.60:0/1964222474 shutdown_connections 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 1 -- 172.21.15.60:0/1964222474 wait complete. 2024-09-12T00:09:34.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.330+0000 7fd652933740 20 client.17952 trim_cache size 0 max 16384 2024-09-12T00:09:34.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd652933740 1 Processor -- start 2024-09-12T00:09:34.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd652933740 1 -- start start 2024-09-12T00:09:34.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd652933740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c55d0 0x55599a6cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd652933740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c6b40 0x55599a6cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd652933740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6d0370 0x55599a6c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd652933740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6481afae0 con 0x55599a6c6b40 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd652933740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6481b1620 con 0x55599a6d0370 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd652933740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd6481b01b0 con 0x55599a6c55d0 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64daf5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c6b40 0x55599a6cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64daf5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c6b40 0x55599a6cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46150/0 (socket says 172.21.15.60:46150) 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64daf5640 1 -- 172.21.15.60:0/3856587168 learned_addr learned my addr 172.21.15.60:0/3856587168 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c55d0 0x55599a6cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6d0370 0x55599a6c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64daf5640 1 -- 172.21.15.60:0/3856587168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c55d0 msgr2=0x55599a6cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64daf5640 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c55d0 0x55599a6cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64daf5640 1 -- 172.21.15.60:0/3856587168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6d0370 msgr2=0x55599a6c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64daf5640 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6d0370 0x55599a6c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.344+0000 7fd64daf5640 1 -- 172.21.15.60:0/3856587168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55599a6cbf70 con 0x55599a6c6b40 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.345+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6d0370 0x55599a6c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.345+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c55d0 0x55599a6cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.345+0000 7fd64daf5640 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c6b40 0x55599a6cef30 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd638009770 tx=0x7fd638013b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7c2e5d5b9fa073 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.345+0000 7fd633fff640 1 -- 172.21.15.60:0/3856587168 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd638013e50 con 0x55599a6c6b40 2024-09-12T00:09:34.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.345+0000 7fd633fff640 1 -- 172.21.15.60:0/3856587168 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd638024040 con 0x55599a6c6b40 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.345+0000 7fd633fff640 1 -- 172.21.15.60:0/3856587168 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63801f650 con 0x55599a6c6b40 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- 172.21.15.60:0/3856587168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c6b40 msgr2=0x55599a6cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c6b40 0x55599a6cef30 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd638009770 tx=0x7fd638013b70 comp rx=0 tx=0).stop 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- 172.21.15.60:0/3856587168 shutdown_connections 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6d0370 0x55599a6c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6c6b40 0x55599a6cef30 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 --2- 172.21.15.60:0/3856587168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c55d0 0x55599a6cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- 172.21.15.60:0/3856587168 >> 172.21.15.60:0/3856587168 conn(0x55599a68e310 msgr2=0x55599a6ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- 172.21.15.60:0/3856587168 shutdown_connections 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- 172.21.15.60:0/3856587168 wait complete. 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- start start 2024-09-12T00:09:34.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 Processor -- start 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6d8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6481b0f50 con 0x55599a6d0370 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6481b0880 con 0x55599a6c55d0 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd6481adae0 con 0x55599a6c6b40 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.346+0000 7fd652933740 10 client.0 _ll_register_callbacks cb 0x7fd640007a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46156/0 (socket says 172.21.15.60:46156) 2024-09-12T00:09:34.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 -- 172.21.15.60:0/2921938154 learned_addr learned my addr 172.21.15.60:0/2921938154 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6d8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64daf5640 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 -- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 msgr2=0x55599a6c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 -- 172.21.15.60:0/2921938154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 msgr2=0x55599a6d8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6d8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 -- 172.21.15.60:0/2921938154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55599a6ca880 con 0x55599a6d0370 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64daf5640 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd64eaf7640 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6ca170 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd640011b50 tx=0x7fd6400112f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab88fe532fc0ba22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:34.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd631ffb640 1 -- 172.21.15.60:0/2921938154 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640026040 con 0x55599a6d0370 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd631ffb640 1 -- 172.21.15.60:0/2921938154 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd640003970 con 0x55599a6d0370 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd652933740 1 -- 172.21.15.60:0/2921938154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd638024040 con 0x55599a6d0370 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd631ffb640 1 -- 172.21.15.60:0/2921938154 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fd64000fc90 con 0x55599a6d0370 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd652933740 10 client.17958 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.347+0000 7fd652933740 1 -- 172.21.15.60:0/2921938154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55599a74abe0 con 0x55599a6d0370 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd631ffb640 1 -- 172.21.15.60:0/2921938154 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd638024040 con 0x55599a6d0370 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd631ffb640 1 -- 172.21.15.60:0/2921938154 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fd640032070 con 0x55599a6d0370 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd652933740 10 client.17958 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd652933740 10 client.17958 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd652933740 20 client.17958 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd652933740 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55599a74b350 0x55599a74d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:34.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd652933740 4 client.17958 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd652933740 1 -- 172.21.15.60:0/2921938154 --> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55599a632d70 con 0x55599a74b350 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.348+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55599a74b350 0x55599a74d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd631ffb640 10 client.17958 ms_handle_connect on v2:172.21.15.192:6834/968968600 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd64e2f6640 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55599a74b350 0x55599a74d770 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5aea34202063e8f server_cookie=a27ba4b63d097277 in_seq=0 out_seq=0 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd631ffb640 1 -- 172.21.15.60:0/2921938154 <== mds.3 v2:172.21.15.192:6834/968968600 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55599a632d70 con 0x55599a74b350 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd631ffb640 10 client.17958 handle_command_reply: tid=0 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 client.17958 shutdown 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 -- 172.21.15.60:0/2921938154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 msgr2=0x55599a6ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6ca170 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fd640011b50 tx=0x7fd6400112f0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 -- 172.21.15.60:0/2921938154 shutdown_connections 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:6834/968968600,v1:172.21.15.192:6835/968968600] conn(0x55599a74b350 0x55599a74d770 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd631ffb640 0 client.17958 ms_handle_reset on v2:172.21.15.192:6834/968968600 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55599a6d0370 0x55599a6ca170 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599a6c6b40 0x55599a6c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 --2- 172.21.15.60:0/2921938154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55599a6c55d0 0x55599a6d8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 -- 172.21.15.60:0/2921938154 >> 172.21.15.60:0/2921938154 conn(0x55599a68e310 msgr2=0x55599a6cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 -- 172.21.15.60:0/2921938154 shutdown_connections 2024-09-12T00:09:34.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 1 -- 172.21.15.60:0/2921938154 wait complete. 2024-09-12T00:09:34.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.349+0000 7fd652933740 20 client.17958 trim_cache size 0 max 16384 2024-09-12T00:09:34.363 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:34.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 -- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd6340a2cf0 msgr2=0x7fd6340a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd6340a2cf0 0x7fd6340a51b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd6480fdf70 tx=0x7fd638009110 comp rx=0 tx=0).stop 2024-09-12T00:09:34.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 -- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 msgr2=0x7fd64819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:34.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 0x7fd64819a7b0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd644006010 tx=0x7fd6440042f0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 -- 172.21.15.60:0/2184071813 shutdown_connections 2024-09-12T00:09:34.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd6340a2cf0 0x7fd6340a51b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd648106f10 0x7fd64819dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd648102790 0x7fd64819acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 --2- 172.21.15.60:0/2184071813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648101de0 0x7fd64819a7b0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:34.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 -- 172.21.15.60:0/2184071813 >> 172.21.15.60:0/2184071813 conn(0x7fd6480fd8c0 msgr2=0x7fd6480fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:34.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 -- 172.21.15.60:0/2184071813 shutdown_connections 2024-09-12T00:09:34.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:34.350+0000 7fd65055a640 1 -- 172.21.15.60:0/2184071813 wait complete. 2024-09-12T00:09:34.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:34 smithi060 ceph-mon[30953]: from='client.27203 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:09:34.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:34 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:34.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:34 smithi060 ceph-mon[30953]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:34 smithi105 ceph-mon[34805]: from='client.27203 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:09:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:34 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:34.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:34 smithi105 ceph-mon[34805]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:34.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:34 smithi192 ceph-mon[35487]: from='client.27203 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T00:09:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:34 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T00:09:34.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:34 smithi192 ceph-mon[35487]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T00:09:35.111 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-12T00:09:35.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:35 smithi060 ceph-mon[30953]: pgmap v317: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 98 KiB/s wr, 22 op/s 2024-09-12T00:09:35.375 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:35.732 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:35 smithi105 ceph-mon[34805]: pgmap v317: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 98 KiB/s wr, 22 op/s 2024-09-12T00:09:35.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:35 smithi192 ceph-mon[35487]: pgmap v317: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 98 KiB/s wr, 22 op/s 2024-09-12T00:09:35.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 -- 172.21.15.60:0/1978187698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0103660 msgr2=0x7fbee010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 --2- 172.21.15.60:0/1978187698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0103660 0x7fbee010bb50 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009900 tx=0x7fbed002a480 comp rx=0 tx=0).stop 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 -- 172.21.15.60:0/1978187698 shutdown_connections 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 --2- 172.21.15.60:0/1978187698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee010c170 0x7fbee010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 --2- 172.21.15.60:0/1978187698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0103660 0x7fbee010bb50 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 --2- 172.21.15.60:0/1978187698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbee0102d40 0x7fbee0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 -- 172.21.15.60:0/1978187698 >> 172.21.15.60:0/1978187698 conn(0x7fbee00fc7a0 msgr2=0x7fbee00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 -- 172.21.15.60:0/1978187698 shutdown_connections 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.866+0000 7fbee84c4640 1 -- 172.21.15.60:0/1978187698 wait complete. 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee84c4640 1 Processor -- start 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee84c4640 1 -- start start 2024-09-12T00:09:35.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee84c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0102d40 0x7fbee0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee84c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbee0103660 0x7fbee0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee84c4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee010c170 0x7fbee019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee84c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0112090 con 0x7fbee0102d40 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee84c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0111f10 con 0x7fbee0103660 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee84c4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0112210 con 0x7fbee010c170 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee6260640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0102d40 0x7fbee0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee6260640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0102d40 0x7fbee0198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46186/0 (socket says 172.21.15.60:46186) 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.867+0000 7fbee6260640 1 -- 172.21.15.60:0/3527725336 learned_addr learned my addr 172.21.15.60:0/3527725336 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee6a61640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee010c170 0x7fbee019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee5a5f640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbee0103660 0x7fbee0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee6260640 1 -- 172.21.15.60:0/3527725336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee010c170 msgr2=0x7fbee019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee6260640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee010c170 0x7fbee019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee6260640 1 -- 172.21.15.60:0/3527725336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbee0103660 msgr2=0x7fbee0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee6260640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbee0103660 0x7fbee0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee6260640 1 -- 172.21.15.60:0/3527725336 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee019d540 con 0x7fbee0102d40 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee5a5f640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbee0103660 0x7fbee0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee6260640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0102d40 0x7fbee0198590 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00c890 tx=0x7fbedc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbed77fe640 1 -- 172.21.15.60:0/3527725336 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc004220 con 0x7fbee0102d40 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee84c4640 1 -- 172.21.15.60:0/3527725336 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee019d830 con 0x7fbee0102d40 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbed77fe640 1 -- 172.21.15.60:0/3527725336 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbedc0043c0 con 0x7fbee0102d40 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbed77fe640 1 -- 172.21.15.60:0/3527725336 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc004b10 con 0x7fbee0102d40 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.868+0000 7fbee84c4640 1 -- 172.21.15.60:0/3527725336 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee01a5110 con 0x7fbee0102d40 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.870+0000 7fbed77fe640 1 -- 172.21.15.60:0/3527725336 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fbedc0051b0 con 0x7fbee0102d40 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbeea89d740 1 Processor -- start 2024-09-12T00:09:35.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbeea89d740 1 -- start start 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d84b40 0x555561d83090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d83a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d92780 0x555561d94b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbeea89d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555561ce92f0 con 0x555561d84b40 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbeea89d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555561c90cf0 con 0x555561d92780 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbeea89d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555561ce52b0 con 0x555561d835d0 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbee6a61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d84b40 0x555561d83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbee6a61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d84b40 0x555561d83090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46188/0 (socket says 172.21.15.60:46188) 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbee6a61640 1 -- 172.21.15.60:0/1878168388 learned_addr learned my addr 172.21.15.60:0/1878168388 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbed77fe640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbecc0a2cf0 0x7fbecc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.871+0000 7fbee6260640 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d83a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee5a5f640 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d92780 0x555561d94b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6a61640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbecc0a2cf0 0x7fbecc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbed77fe640 1 -- 172.21.15.60:0/3527725336 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fbedc0cf560 con 0x7fbee0102d40 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6a61640 1 -- 172.21.15.60:0/1878168388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 msgr2=0x555561d83a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6a61640 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d83a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6a61640 1 -- 172.21.15.60:0/1878168388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d92780 msgr2=0x555561d94b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6a61640 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d92780 0x555561d94b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6a61640 1 -- 172.21.15.60:0/1878168388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555561c753a0 con 0x555561d84b40 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6260640 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d83a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee5a5f640 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d92780 0x555561d94b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6a61640 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d84b40 0x555561d83090 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fbed8014940 tx=0x7fbed8014e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b09f96c6bbe2be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbed4ff9640 1 -- 172.21.15.60:0/1878168388 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8014050 con 0x555561d84b40 2024-09-12T00:09:35.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbed4ff9640 1 -- 172.21.15.60:0/1878168388 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbed80141f0 con 0x555561d84b40 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbed4ff9640 1 -- 172.21.15.60:0/1878168388 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8013660 con 0x555561d84b40 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.872+0000 7fbee6a61640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbecc0a2cf0 0x7fbecc0a51b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbed8021000 tx=0x7fbed8020000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 -- 172.21.15.60:0/1878168388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d84b40 msgr2=0x555561d83090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d84b40 0x555561d83090 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fbed8014940 tx=0x7fbed8014e00 comp rx=0 tx=0).stop 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 -- 172.21.15.60:0/1878168388 shutdown_connections 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d92780 0x555561d94b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d83a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1878168388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d84b40 0x555561d83090 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 -- 172.21.15.60:0/1878168388 >> 172.21.15.60:0/1878168388 conn(0x555561d4c310 msgr2=0x555561d7fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 -- 172.21.15.60:0/1878168388 shutdown_connections 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 -- 172.21.15.60:0/1878168388 wait complete. 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 -- start start 2024-09-12T00:09:35.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.873+0000 7fbeea89d740 1 Processor -- start 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d920e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbeea89d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555561d95480 con 0x555561d92780 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbeea89d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x555561ca4060 con 0x555561d84b40 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbeea89d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555561d95600 con 0x555561d835d0 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbeea89d740 10 client.0 _ll_register_callbacks cb 0x5555619f78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46192/0 (socket says 172.21.15.60:46192) 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6260640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d920e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 -- 172.21.15.60:0/1947287227 learned_addr learned my addr 172.21.15.60:0/1947287227 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:35.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee5a5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 -- 172.21.15.60:0/1947287227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 msgr2=0x555561d920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d920e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 -- 172.21.15.60:0/1947287227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 msgr2=0x555561d8f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 -- 172.21.15.60:0/1947287227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555561a5a3c0 con 0x555561d92780 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbee6a61640 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8f990 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbed8005a70 tx=0x7fbed8012880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99da79a4c569020e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.874+0000 7fbec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbec9ffb640 1 -- 172.21.15.60:0/1947287227 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80143a0 con 0x555561d92780 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbec9ffb640 1 -- 172.21.15.60:0/1947287227 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fbed8013400 con 0x555561d92780 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 1 -- 172.21.15.60:0/1947287227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed80141f0 con 0x555561d92780 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbec9ffb640 1 -- 172.21.15.60:0/1947287227 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fbed8039050 con 0x555561d92780 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 10 client.17970 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:35.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 1 -- 172.21.15.60:0/1947287227 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x555561da0e90 con 0x555561d92780 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbec9ffb640 1 -- 172.21.15.60:0/1947287227 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbed80141f0 con 0x555561d92780 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbec9ffb640 1 -- 172.21.15.60:0/1947287227 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fbed800f040 con 0x555561d92780 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 10 client.17970 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 10 client.17970 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 20 client.17970 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555561da2240 0x555561da4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 4 client.17970 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.875+0000 7fbeea89d740 1 -- 172.21.15.60:0/1947287227 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555561cf6860 con 0x555561da2240 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.876+0000 7fbee6260640 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555561da2240 0x555561da4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.876+0000 7fbee6260640 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555561da2240 0x555561da4630 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aec07fc485093cbe server_cookie=d641f8b9315c3e63 in_seq=0 out_seq=0 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.876+0000 7fbec9ffb640 10 client.17970 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbec9ffb640 1 -- 172.21.15.60:0/1947287227 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555561cf6860 con 0x555561da2240 2024-09-12T00:09:35.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbec9ffb640 10 client.17970 handle_command_reply: tid=0 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 client.17970 shutdown 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 -- 172.21.15.60:0/1947287227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 msgr2=0x555561d8f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8f990 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbed8005a70 tx=0x7fbed8012880 comp rx=0 tx=0).stop 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 -- 172.21.15.60:0/1947287227 shutdown_connections 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555561da2240 0x555561da4630 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8f990 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbec9ffb640 0 client.17970 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 --2- 172.21.15.60:0/1947287227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d920e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 -- 172.21.15.60:0/1947287227 >> 172.21.15.60:0/1947287227 conn(0x555561d4c310 msgr2=0x555561d85960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 -- 172.21.15.60:0/1947287227 shutdown_connections 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 1 -- 172.21.15.60:0/1947287227 wait complete. 2024-09-12T00:09:35.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.877+0000 7fbeea89d740 20 client.17970 trim_cache size 0 max 16384 2024-09-12T00:09:35.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.890+0000 7fbeea89d740 1 Processor -- start 2024-09-12T00:09:35.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.890+0000 7fbeea89d740 1 -- start start 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.890+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d9e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.890+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.890+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561da9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.890+0000 7fbeea89d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbee01ab830 con 0x555561d92780 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.890+0000 7fbeea89d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbee01ad370 con 0x555561d84b40 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.890+0000 7fbeea89d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbee01abf00 con 0x555561d835d0 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561da9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561da9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46198/0 (socket says 172.21.15.60:46198) 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 -- 172.21.15.60:0/2211856351 learned_addr learned my addr 172.21.15.60:0/2211856351 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee5a5f640 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6260640 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d9e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 -- 172.21.15.60:0/2211856351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 msgr2=0x555561d9e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d9e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 -- 172.21.15.60:0/2211856351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 msgr2=0x555561d8e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 -- 172.21.15.60:0/2211856351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555561da4bc0 con 0x555561d92780 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbee6a61640 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561da9df0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbed8014940 tx=0x7fbed8014670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7eb90701504d067 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbecbfff640 1 -- 172.21.15.60:0/2211856351 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed80055f0 con 0x555561d92780 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbecbfff640 1 -- 172.21.15.60:0/2211856351 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbed8013dc0 con 0x555561d92780 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.891+0000 7fbecbfff640 1 -- 172.21.15.60:0/2211856351 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8013660 con 0x555561d92780 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 -- 172.21.15.60:0/2211856351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 msgr2=0x555561da9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561da9df0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbed8014940 tx=0x7fbed8014670 comp rx=0 tx=0).stop 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 -- 172.21.15.60:0/2211856351 shutdown_connections 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561da9df0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 --2- 172.21.15.60:0/2211856351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d9e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 -- 172.21.15.60:0/2211856351 >> 172.21.15.60:0/2211856351 conn(0x555561d4c310 msgr2=0x555561d8dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 -- 172.21.15.60:0/2211856351 shutdown_connections 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 -- 172.21.15.60:0/2211856351 wait complete. 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 -- start start 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.892+0000 7fbeea89d740 1 Processor -- start 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d9ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbeea89d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbeea89d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbee01acca0 con 0x555561d92780 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbeea89d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbee01ac5d0 con 0x555561d84b40 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbeea89d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbee01a9830 con 0x555561d835d0 2024-09-12T00:09:35.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbeea89d740 10 client.0 _ll_register_callbacks cb 0x7fbed8014740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46200/0 (socket says 172.21.15.60:46200) 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 -- 172.21.15.60:0/4177844911 learned_addr learned my addr 172.21.15.60:0/4177844911 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee5a5f640 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6260640 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d9ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 -- 172.21.15.60:0/4177844911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 msgr2=0x555561d9ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d9ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 -- 172.21.15.60:0/4177844911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 msgr2=0x555561d8bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 -- 172.21.15.60:0/4177844911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555561d8c990 con 0x555561d92780 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee5a5f640 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbee6a61640 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8c450 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbed8005380 tx=0x7fbed80053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3895ddd70bd7e27d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.893+0000 7fbec9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbec9ffb640 1 -- 172.21.15.60:0/4177844911 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8005000 con 0x555561d92780 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbec9ffb640 1 -- 172.21.15.60:0/4177844911 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fbed8013400 con 0x555561d92780 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 1 -- 172.21.15.60:0/4177844911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbed8013dc0 con 0x555561d92780 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbec9ffb640 1 -- 172.21.15.60:0/4177844911 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fbed8013600 con 0x555561d92780 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 10 client.17976 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 1 -- 172.21.15.60:0/4177844911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x555561e0cb10 con 0x555561d92780 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbec9ffb640 1 -- 172.21.15.60:0/4177844911 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbed8013dc0 con 0x555561d92780 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbec9ffb640 1 -- 172.21.15.60:0/4177844911 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7fbed804c020 con 0x555561d92780 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 10 client.17976 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 10 client.17976 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 20 client.17976 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:35.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555561e0d1a0 0x555561e0f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 4 client.17976 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.894+0000 7fbeea89d740 1 -- 172.21.15.60:0/4177844911 --> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555561cf0d70 con 0x555561e0d1a0 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbee6260640 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555561e0d1a0 0x555561e0f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbee6260640 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555561e0d1a0 0x555561e0f5c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4365a9fb015fdf49 server_cookie=931e45ab84694886 in_seq=0 out_seq=0 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbec9ffb640 10 client.17976 ms_handle_connect on v2:172.21.15.192:6836/1338489089 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbec9ffb640 1 -- 172.21.15.60:0/4177844911 <== mds.2 v2:172.21.15.192:6836/1338489089 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555561cf0d70 con 0x555561e0d1a0 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbec9ffb640 10 client.17976 handle_command_reply: tid=0 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 client.17976 shutdown 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 -- 172.21.15.60:0/4177844911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 msgr2=0x555561d8c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8c450 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbed8005380 tx=0x7fbed80053b0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 -- 172.21.15.60:0/4177844911 shutdown_connections 2024-09-12T00:09:35.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.192:6836/1338489089,v1:172.21.15.192:6837/1338489089] conn(0x555561e0d1a0 0x555561e0f5c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555561d92780 0x555561d8c450 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x555561d84b40 0x555561d8bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 --2- 172.21.15.60:0/4177844911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555561d835d0 0x555561d9ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbeea89d740 1 -- 172.21.15.60:0/4177844911 >> 172.21.15.60:0/4177844911 conn(0x555561d4c310 msgr2=0x555561d8e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.895+0000 7fbec9ffb640 0 client.17976 ms_handle_reset on v2:172.21.15.192:6836/1338489089 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbeea89d740 1 -- 172.21.15.60:0/4177844911 shutdown_connections 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbeea89d740 1 -- 172.21.15.60:0/4177844911 wait complete. 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbeea89d740 20 client.17976 trim_cache size 0 max 16384 2024-09-12T00:09:35.903 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 -- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbecc0a2cf0 msgr2=0x7fbecc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbecc0a2cf0 0x7fbecc0a51b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbed8021000 tx=0x7fbed8020000 comp rx=0 tx=0).stop 2024-09-12T00:09:35.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 -- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0102d40 msgr2=0x7fbee0198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0102d40 0x7fbee0198590 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00c890 tx=0x7fbedc00cd50 comp rx=0 tx=0).stop 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 -- 172.21.15.60:0/3527725336 shutdown_connections 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fbecc0a2cf0 0x7fbecc0a51b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee010c170 0x7fbee019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbee0103660 0x7fbee0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 --2- 172.21.15.60:0/3527725336 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbee0102d40 0x7fbee0198590 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 -- 172.21.15.60:0/3527725336 >> 172.21.15.60:0/3527725336 conn(0x7fbee00fc7a0 msgr2=0x7fbee00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 -- 172.21.15.60:0/3527725336 shutdown_connections 2024-09-12T00:09:35.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:35.896+0000 7fbee84c4640 1 -- 172.21.15.60:0/3527725336 wait complete. 2024-09-12T00:09:36.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-12T00:09:36.812 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:37.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 -- 172.21.15.60:0/1367371381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0106f10 msgr2=0x7f03b010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/1367371381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0106f10 0x7f03b010ea90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009ca0 tx=0x7f03a802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 -- 172.21.15.60:0/1367371381 shutdown_connections 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/1367371381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0106f10 0x7f03b010ea90 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/1367371381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b0102790 0x7f03b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/1367371381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03b0101de0 0x7f03b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 -- 172.21.15.60:0/1367371381 >> 172.21.15.60:0/1367371381 conn(0x7f03b00fd8c0 msgr2=0x7f03b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 -- 172.21.15.60:0/1367371381 shutdown_connections 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.312+0000 7f03b5f3d640 1 -- 172.21.15.60:0/1367371381 wait complete. 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03b5f3d640 1 Processor -- start 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03b5f3d640 1 -- start start 2024-09-12T00:09:37.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03b5f3d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b0101de0 0x7f03b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03b5f3d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0102790 0x7f03b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03b5f3d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03b0106f10 0x7f03b0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03b5f3d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0112090 con 0x7f03b0102790 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03b5f3d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0111f10 con 0x7f03b0101de0 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03b5f3d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0112210 con 0x7f03b0106f10 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0102790 0x7f03b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0102790 0x7f03b0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46214/0 (socket says 172.21.15.60:46214) 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03aeffd640 1 -- 172.21.15.60:0/788428446 learned_addr learned my addr 172.21.15.60:0/788428446 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03affff640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03b0106f10 0x7f03b0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.313+0000 7f03af7fe640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b0101de0 0x7f03b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03aeffd640 1 -- 172.21.15.60:0/788428446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03b0106f10 msgr2=0x7f03b0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03aeffd640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03b0106f10 0x7f03b0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03aeffd640 1 -- 172.21.15.60:0/788428446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b0101de0 msgr2=0x7f03b00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03aeffd640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b0101de0 0x7f03b00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03aeffd640 1 -- 172.21.15.60:0/788428446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b01a69c0 con 0x7f03b0102790 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03aeffd640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0102790 0x7f03b0074a30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f03a400e9f0 tx=0x7f03a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03acff9640 1 -- 172.21.15.60:0/788428446 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a400cd80 con 0x7f03b0102790 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03b5f3d640 1 -- 172.21.15.60:0/788428446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b01a6cb0 con 0x7f03b0102790 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03acff9640 1 -- 172.21.15.60:0/788428446 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03a4010930 con 0x7f03b0102790 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03acff9640 1 -- 172.21.15.60:0/788428446 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4018b00 con 0x7f03b0102790 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.314+0000 7f03b5f3d640 1 -- 172.21.15.60:0/788428446 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b01a7190 con 0x7f03b0102790 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03acff9640 1 -- 172.21.15.60:0/788428446 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f03a4018ca0 con 0x7f03b0102790 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03b8316740 1 Processor -- start 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03b8316740 1 -- start start 2024-09-12T00:09:37.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03b8316740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5eb40 0x563f65d5d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03b8316740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 0x563f65d5da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03b8316740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d68370 0x563f65d6a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03b8316740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563f65cc32f0 con 0x563f65d68370 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03b8316740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563f65c6acf0 con 0x563f65d5eb40 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03b8316740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563f65cbf2b0 con 0x563f65d5d5d0 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d68370 0x563f65d6a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03affff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5eb40 0x563f65d5d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d68370 0x563f65d6a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46222/0 (socket says 172.21.15.60:46222) 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03aeffd640 1 -- 172.21.15.60:0/1733731570 learned_addr learned my addr 172.21.15.60:0/1733731570 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03af7fe640 1 --2- 172.21.15.60:0/1733731570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 0x563f65d5da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03affff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5eb40 0x563f65d5d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:36660/0 (socket says 172.21.15.60:36660) 2024-09-12T00:09:37.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.317+0000 7f03acff9640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f03980a2cf0 0x7f03980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f03affff640 1 -- 172.21.15.60:0/1733731570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 msgr2=0x563f65d5da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f03affff640 1 --2- 172.21.15.60:0/1733731570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 0x563f65d5da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f03affff640 1 -- 172.21.15.60:0/1733731570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d68370 msgr2=0x563f65d6a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f03affff640 1 --2- 172.21.15.60:0/1733731570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d68370 0x563f65d6a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f03affff640 1 -- 172.21.15.60:0/1733731570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f65c4f3a0 con 0x563f65d5eb40 2024-09-12T00:09:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f03acff9640 1 -- 172.21.15.60:0/788428446 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f03a40cf740 con 0x7f03b0102790 2024-09-12T00:09:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f03affff640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f03980a2cf0 0x7f03980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f03affff640 1 --2- 172.21.15.60:0/1733731570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5eb40 0x563f65d5d090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f03a8005e30 tx=0x7f03a80098d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da65a13522e26a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f0395ffb640 1 -- 172.21.15.60:0/1733731570 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8042040 con 0x563f65d5eb40 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f0395ffb640 1 -- 172.21.15.60:0/1733731570 <== mon.2 v2:172.21.15.105:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03a8036040 con 0x563f65d5eb40 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.318+0000 7f0395ffb640 1 -- 172.21.15.60:0/1733731570 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a802f8f0 con 0x563f65d5eb40 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03b8316740 1 -- 172.21.15.60:0/1733731570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5eb40 msgr2=0x563f65d5d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03b8316740 1 --2- 172.21.15.60:0/1733731570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5eb40 0x563f65d5d090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f03a8005e30 tx=0x7f03a80098d0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03affff640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f03980a2cf0 0x7f03980a51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f03a8006010 tx=0x7f03a804e000 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03b8316740 1 -- 172.21.15.60:0/1733731570 shutdown_connections 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03b8316740 1 --2- 172.21.15.60:0/1733731570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d68370 0x563f65d6a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03b8316740 1 --2- 172.21.15.60:0/1733731570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 0x563f65d5da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03b8316740 1 --2- 172.21.15.60:0/1733731570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5eb40 0x563f65d5d090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03b8316740 1 -- 172.21.15.60:0/1733731570 >> 172.21.15.60:0/1733731570 conn(0x563f65d26310 msgr2=0x563f65d59c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.319+0000 7f03b8316740 1 -- 172.21.15.60:0/1733731570 shutdown_connections 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.320+0000 7f03b8316740 1 -- 172.21.15.60:0/1733731570 wait complete. 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.320+0000 7f03b8316740 1 -- start start 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.320+0000 7f03b8316740 1 Processor -- start 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03b8316740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5d5d0 0x563f65d67d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03b8316740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5eb40 0x563f65d65010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03b8316740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d65600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03b8316740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563f65d6b070 con 0x563f65d5d5d0 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03b8316740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x563f65c7e060 con 0x563f65d68370 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03b8316740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563f65d6b1f0 con 0x563f65d5eb40 2024-09-12T00:09:37.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03b8316740 10 client.0 _ll_register_callbacks cb 0x563f659d18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d65600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5d5d0 0x563f65d67d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d65600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:36676/0 (socket says 172.21.15.60:36676) 2024-09-12T00:09:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 -- 172.21.15.60:0/4232854116 learned_addr learned my addr 172.21.15.60:0/4232854116 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03aeffd640 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5eb40 0x563f65d65010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 -- 172.21.15.60:0/4232854116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5eb40 msgr2=0x563f65d65010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5eb40 0x563f65d65010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 -- 172.21.15.60:0/4232854116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5d5d0 msgr2=0x563f65d67d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5d5d0 0x563f65d67d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 -- 172.21.15.60:0/4232854116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f65a343c0 con 0x563f65d68370 2024-09-12T00:09:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f03affff640 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d65600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f03a80093e0 tx=0x7f03a80048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e2b400c9a7a72a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.321+0000 7f038effd640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:09:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f038effd640 1 -- 172.21.15.60:0/4232854116 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8059070 con 0x563f65d68370 2024-09-12T00:09:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f038effd640 1 -- 172.21.15.60:0/4232854116 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f03a8003f20 con 0x563f65d68370 2024-09-12T00:09:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f03b8316740 1 -- 172.21.15.60:0/4232854116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03a8036040 con 0x563f65d68370 2024-09-12T00:09:37.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f038effd640 1 -- 172.21.15.60:0/4232854116 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f03a8065050 con 0x563f65d68370 2024-09-12T00:09:37.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f03b8316740 10 client.27254 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:37.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f03b8316740 1 -- 172.21.15.60:0/4232854116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563f65d6b070 con 0x563f65d68370 2024-09-12T00:09:37.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f038effd640 1 -- 172.21.15.60:0/4232854116 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03a8036040 con 0x563f65d68370 2024-09-12T00:09:37.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f038effd640 1 -- 172.21.15.60:0/4232854116 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f03a80308c0 con 0x563f65d68370 2024-09-12T00:09:37.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f03b8316740 10 client.27254 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:37.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f03b8316740 10 client.27254 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:09:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.322+0000 7f03b8316740 20 client.27254 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.323+0000 7f03b8316740 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x563f65d77c90 0x563f65d7a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.323+0000 7f03b8316740 4 client.27254 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.323+0000 7f03b8316740 1 -- 172.21.15.60:0/4232854116 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f65cd0860 con 0x563f65d77c90 2024-09-12T00:09:37.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.323+0000 7f03af7fe640 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x563f65d77c90 0x563f65d7a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.323+0000 7f03af7fe640 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x563f65d77c90 0x563f65d7a080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5bfecee6fb8968bc server_cookie=5286a01ebedb8136 in_seq=0 out_seq=0 2024-09-12T00:09:37.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.323+0000 7f038effd640 10 client.27254 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:09:37.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f038effd640 1 -- 172.21.15.60:0/4232854116 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f65cd0860 con 0x563f65d77c90 2024-09-12T00:09:37.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f038effd640 10 client.27254 handle_command_reply: tid=0 2024-09-12T00:09:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 client.27254 shutdown 2024-09-12T00:09:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 -- 172.21.15.60:0/4232854116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 msgr2=0x563f65d65600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d65600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f03a80093e0 tx=0x7f03a80048f0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 -- 172.21.15.60:0/4232854116 shutdown_connections 2024-09-12T00:09:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x563f65d77c90 0x563f65d7a080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d65600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5eb40 0x563f65d65010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 --2- 172.21.15.60:0/4232854116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5d5d0 0x563f65d67d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.324+0000 7f03b8316740 1 -- 172.21.15.60:0/4232854116 >> 172.21.15.60:0/4232854116 conn(0x563f65d26310 msgr2=0x563f65d5f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.325+0000 7f038effd640 0 client.27254 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:09:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.325+0000 7f03b8316740 1 -- 172.21.15.60:0/4232854116 shutdown_connections 2024-09-12T00:09:37.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.325+0000 7f03b8316740 1 -- 172.21.15.60:0/4232854116 wait complete. 2024-09-12T00:09:37.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.325+0000 7f03b8316740 20 client.27254 trim_cache size 0 max 16384 2024-09-12T00:09:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.340+0000 7f03b8316740 1 Processor -- start 2024-09-12T00:09:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.340+0000 7f03b8316740 1 -- start start 2024-09-12T00:09:37.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.340+0000 7f03b8316740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5d5d0 0x563f65d74310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.340+0000 7f03b8316740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.340+0000 7f03b8316740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d68370 0x563f65d60120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.340+0000 7f03b8316740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01afa40 con 0x563f65d5eb40 2024-09-12T00:09:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.340+0000 7f03b8316740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b1580 con 0x563f65d5d5d0 2024-09-12T00:09:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.340+0000 7f03b8316740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b0110 con 0x563f65d68370 2024-09-12T00:09:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d638e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46228/0 (socket says 172.21.15.60:46228) 2024-09-12T00:09:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03aeffd640 1 -- 172.21.15.60:0/1746106088 learned_addr learned my addr 172.21.15.60:0/1746106088 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03affff640 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d68370 0x563f65d60120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03af7fe640 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5d5d0 0x563f65d74310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03affff640 1 -- 172.21.15.60:0/1746106088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5d5d0 msgr2=0x563f65d74310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03affff640 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5d5d0 0x563f65d74310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03affff640 1 -- 172.21.15.60:0/1746106088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 msgr2=0x563f65d638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03affff640 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03affff640 1 -- 172.21.15.60:0/1746106088 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f65d680d0 con 0x563f65d68370 2024-09-12T00:09:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.341+0000 7f03affff640 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d68370 0x563f65d60120 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03a802ade0 tx=0x7f03a802f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74e04b170f4439c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03957fa640 1 -- 172.21.15.60:0/1746106088 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8059070 con 0x563f65d68370 2024-09-12T00:09:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03957fa640 1 -- 172.21.15.60:0/1746106088 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03a8030e80 con 0x563f65d68370 2024-09-12T00:09:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03957fa640 1 -- 172.21.15.60:0/1746106088 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8042070 con 0x563f65d68370 2024-09-12T00:09:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03b8316740 1 -- 172.21.15.60:0/1746106088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d68370 msgr2=0x563f65d60120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03b8316740 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d68370 0x563f65d60120 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03a802ade0 tx=0x7f03a802f680 comp rx=0 tx=0).stop 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03b8316740 1 -- 172.21.15.60:0/1746106088 shutdown_connections 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03b8316740 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d68370 0x563f65d60120 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03b8316740 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03b8316740 1 --2- 172.21.15.60:0/1746106088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d5d5d0 0x563f65d74310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.342+0000 7f03b8316740 1 -- 172.21.15.60:0/1746106088 >> 172.21.15.60:0/1746106088 conn(0x563f65d26310 msgr2=0x563f65d67090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.343+0000 7f03b8316740 1 -- 172.21.15.60:0/1746106088 shutdown_connections 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.343+0000 7f03b8316740 1 -- 172.21.15.60:0/1746106088 wait complete. 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.343+0000 7f03b8316740 1 -- start start 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.343+0000 7f03b8316740 1 Processor -- start 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.343+0000 7f03b8316740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 0x563f65d70710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.343+0000 7f03b8316740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d70c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.343+0000 7f03b8316740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d61860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03b8316740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b0eb0 con 0x563f65d5eb40 2024-09-12T00:09:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03b8316740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b07e0 con 0x563f65d68370 2024-09-12T00:09:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03b8316740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01ada40 con 0x563f65d5d5d0 2024-09-12T00:09:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03b8316740 10 client.0 _ll_register_callbacks cb 0x7f03a4098050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d70c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03affff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d61860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d70c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46232/0 (socket says 172.21.15.60:46232) 2024-09-12T00:09:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03aeffd640 1 -- 172.21.15.60:0/3599863592 learned_addr learned my addr 172.21.15.60:0/3599863592 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03af7fe640 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 0x563f65d70710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03affff640 1 -- 172.21.15.60:0/3599863592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 msgr2=0x563f65d70710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03affff640 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 0x563f65d70710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03affff640 1 -- 172.21.15.60:0/3599863592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 msgr2=0x563f65d70c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03affff640 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d70c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03affff640 1 -- 172.21.15.60:0/3599863592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f65d62090 con 0x563f65d68370 2024-09-12T00:09:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f03affff640 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d61860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x563f65d66510 tx=0x7f03a80098d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=755eb59e64525bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.344+0000 7f038effd640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.345+0000 7f038effd640 1 -- 172.21.15.60:0/3599863592 <== mon.2 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8042070 con 0x563f65d68370 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.345+0000 7f038effd640 1 -- 172.21.15.60:0/3599863592 <== mon.2 v2:172.21.15.105:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f03a80305c0 con 0x563f65d68370 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.345+0000 7f03b8316740 1 -- 172.21.15.60:0/3599863592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03a8030e80 con 0x563f65d68370 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.345+0000 7f038effd640 1 -- 172.21.15.60:0/3599863592 <== mon.2 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f03a8059070 con 0x563f65d68370 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.345+0000 7f03b8316740 10 client.27260 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.345+0000 7f03b8316740 1 -- 172.21.15.60:0/3599863592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x563f65de2290 con 0x563f65d68370 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.345+0000 7f038effd640 1 -- 172.21.15.60:0/3599863592 <== mon.2 v2:172.21.15.105:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03a8030e80 con 0x563f65d68370 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f038effd640 1 -- 172.21.15.60:0/3599863592 <== mon.2 v2:172.21.15.105:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f03a805e440 con 0x563f65d68370 2024-09-12T00:09:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f03b8316740 10 client.27260 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f03b8316740 10 client.27260 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f03b8316740 20 client.27260 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f03b8316740 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x563f65de26c0 0x563f65de4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f03b8316740 4 client.27260 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f03b8316740 1 -- 172.21.15.60:0/3599863592 --> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f65ccad70 con 0x563f65de26c0 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f03af7fe640 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x563f65de26c0 0x563f65de4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f038effd640 10 client.27260 ms_handle_connect on v2:172.21.15.105:6838/525386561 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.346+0000 7f03af7fe640 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x563f65de26c0 0x563f65de4ab0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44deba7861ce9bed server_cookie=fda64bf46af3e87e in_seq=0 out_seq=0 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f038effd640 1 -- 172.21.15.60:0/3599863592 <== mds.1 v2:172.21.15.105:6838/525386561 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f65ccad70 con 0x563f65de26c0 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f038effd640 10 client.27260 handle_command_reply: tid=0 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 client.27260 shutdown 2024-09-12T00:09:37.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 -- 172.21.15.60:0/3599863592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 msgr2=0x563f65d61860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d61860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x563f65d66510 tx=0x7f03a80098d0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 -- 172.21.15.60:0/3599863592 shutdown_connections 2024-09-12T00:09:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.105:6838/525386561,v1:172.21.15.105:6839/525386561] conn(0x563f65de26c0 0x563f65de4ab0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x563f65d68370 0x563f65d61860 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563f65d5eb40 0x563f65d70c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 --2- 172.21.15.60:0/3599863592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563f65d5d5d0 0x563f65d70710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 -- 172.21.15.60:0/3599863592 >> 172.21.15.60:0/3599863592 conn(0x563f65d26310 msgr2=0x563f65d66870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f038effd640 0 client.27260 ms_handle_reset on v2:172.21.15.105:6838/525386561 2024-09-12T00:09:37.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 -- 172.21.15.60:0/3599863592 shutdown_connections 2024-09-12T00:09:37.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 1 -- 172.21.15.60:0/3599863592 wait complete. 2024-09-12T00:09:37.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.347+0000 7f03b8316740 20 client.27260 trim_cache size 0 max 16384 2024-09-12T00:09:37.361 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 -- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f03980a2cf0 msgr2=0x7f03980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f03980a2cf0 0x7f03980a51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f03a8006010 tx=0x7f03a804e000 comp rx=0 tx=0).stop 2024-09-12T00:09:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 -- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0102790 msgr2=0x7f03b0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0102790 0x7f03b0074a30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f03a400e9f0 tx=0x7f03a400eeb0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 -- 172.21.15.60:0/788428446 shutdown_connections 2024-09-12T00:09:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f03980a2cf0 0x7f03980a51b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03b0106f10 0x7f03b0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b0102790 0x7f03b0074a30 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 --2- 172.21.15.60:0/788428446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b0101de0 0x7f03b00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 -- 172.21.15.60:0/788428446 >> 172.21.15.60:0/788428446 conn(0x7f03b00fd8c0 msgr2=0x7f03b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 -- 172.21.15.60:0/788428446 shutdown_connections 2024-09-12T00:09:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:37.348+0000 7f03b5f3d640 1 -- 172.21.15.60:0/788428446 wait complete. 2024-09-12T00:09:37.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:37 smithi060 ceph-mon[30953]: pgmap v318: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 98 KiB/s wr, 18 op/s 2024-09-12T00:09:37.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:37 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:09:37.598 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:37 smithi192 ceph-mon[35487]: pgmap v318: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 98 KiB/s wr, 18 op/s 2024-09-12T00:09:37.598 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:37 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:09:37.668 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:37 smithi105 ceph-mon[34805]: pgmap v318: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 98 KiB/s wr, 18 op/s 2024-09-12T00:09:37.669 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:37 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T00:09:38.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-12T00:09:38.880 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:39.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 -- 172.21.15.60:0/574636987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0106f10 msgr2=0x7f67f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/574636987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0106f10 0x7f67f010ea90 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009ca0 tx=0x7f67e802a8c0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 -- 172.21.15.60:0/574636987 shutdown_connections 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/574636987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0106f10 0x7f67f010ea90 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/574636987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67f0102790 0x7f67f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/574636987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0101de0 0x7f67f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 -- 172.21.15.60:0/574636987 >> 172.21.15.60:0/574636987 conn(0x7f67f00fd8c0 msgr2=0x7f67f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 -- 172.21.15.60:0/574636987 shutdown_connections 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.362+0000 7f67f7d3f640 1 -- 172.21.15.60:0/574636987 wait complete. 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f7d3f640 1 Processor -- start 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f7d3f640 1 -- start start 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f7d3f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67f0101de0 0x7f67f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f7d3f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0102790 0x7f67f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f7d3f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0106f10 0x7f67f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f7d3f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67f0112090 con 0x7f67f0102790 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f7d3f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67f0111f10 con 0x7f67f0101de0 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f7d3f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67f0112210 con 0x7f67f0106f10 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f52da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0102790 0x7f67f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f52da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0102790 0x7f67f0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46246/0 (socket says 172.21.15.60:46246) 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f52da640 1 -- 172.21.15.60:0/2472322557 learned_addr learned my addr 172.21.15.60:0/2472322557 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.363+0000 7f67f5adb640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67f0101de0 0x7f67f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f62dc640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0106f10 0x7f67f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f52da640 1 -- 172.21.15.60:0/2472322557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0106f10 msgr2=0x7f67f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f52da640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0106f10 0x7f67f0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f52da640 1 -- 172.21.15.60:0/2472322557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67f0101de0 msgr2=0x7f67f00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f52da640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67f0101de0 0x7f67f00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f52da640 1 -- 172.21.15.60:0/2472322557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f01a6930 con 0x7f67f0102790 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f52da640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0102790 0x7f67f0074a30 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f67e000c920 tx=0x7f67e000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67e6ffd640 1 -- 172.21.15.60:0/2472322557 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0007c70 con 0x7f67f0102790 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67e6ffd640 1 -- 172.21.15.60:0/2472322557 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67e0007e10 con 0x7f67f0102790 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f7d3f640 1 -- 172.21.15.60:0/2472322557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f01a6c20 con 0x7f67f0102790 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67e6ffd640 1 -- 172.21.15.60:0/2472322557 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0018940 con 0x7f67f0102790 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.364+0000 7f67f7d3f640 1 -- 172.21.15.60:0/2472322557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f01a71b0 con 0x7f67f0102790 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.366+0000 7f67fa118740 1 Processor -- start 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.366+0000 7f67e6ffd640 1 -- 172.21.15.60:0/2472322557 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f67e0018b20 con 0x7f67f0102790 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67fa118740 1 -- start start 2024-09-12T00:09:39.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67fa118740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619dab40 0x55d9619d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67fa118740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67fa118740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 0x55d9619e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67fa118740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d96193f2f0 con 0x55d9619d95d0 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67fa118740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d9618e6cf0 con 0x55d9619e4370 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67fa118740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d96193b2b0 con 0x55d9619dab40 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619d9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46254/0 (socket says 172.21.15.60:46254) 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 -- 172.21.15.60:0/809049010 learned_addr learned my addr 172.21.15.60:0/809049010 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f62dc640 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619dab40 0x55d9619d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f52da640 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 0x55d9619e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 -- 172.21.15.60:0/809049010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619dab40 msgr2=0x55d9619d9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619dab40 0x55d9619d9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 -- 172.21.15.60:0/809049010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 msgr2=0x55d9619e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 0x55d9619e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 -- 172.21.15.60:0/809049010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9618cb3a0 con 0x55d9619d95d0 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.367+0000 7f67f5adb640 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619d9a10 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00ac20 tx=0x7f67ec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27691005a7921dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67e6ffd640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67dc0a2d70 0x7f67dc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67dbfff640 1 -- 172.21.15.60:0/809049010 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec01d070 con 0x55d9619d95d0 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67dbfff640 1 -- 172.21.15.60:0/809049010 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67ec018b40 con 0x55d9619d95d0 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67dbfff640 1 -- 172.21.15.60:0/809049010 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec010c60 con 0x55d9619d95d0 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67f62dc640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67dc0a2d70 0x7f67dc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67e6ffd640 1 -- 172.21.15.60:0/2472322557 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f67e00cf4d0 con 0x7f67f0102790 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67f62dc640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67dc0a2d70 0x7f67dc0a5230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f67e802f540 tx=0x7f67e8005fd0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67fa118740 1 -- 172.21.15.60:0/809049010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 msgr2=0x55d9619d9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.368+0000 7f67fa118740 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619d9a10 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00ac20 tx=0x7f67ec00f790 comp rx=0 tx=0).stop 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 -- 172.21.15.60:0/809049010 shutdown_connections 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 0x55d9619e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619d9a10 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 --2- 172.21.15.60:0/809049010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619dab40 0x55d9619d9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 -- 172.21.15.60:0/809049010 >> 172.21.15.60:0/809049010 conn(0x55d9619a2310 msgr2=0x55d9619d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 -- 172.21.15.60:0/809049010 shutdown_connections 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 -- 172.21.15.60:0/809049010 wait complete. 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 -- start start 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.369+0000 7f67fa118740 1 Processor -- start 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67fa118740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67fa118740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619dab40 0x55d9619e0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67fa118740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 0x55d9619e15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67fa118740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d9619e7070 con 0x55d9619d95d0 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67fa118740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d9618fa060 con 0x55d9619dab40 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67fa118740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d9619e71f0 con 0x55d9619e4370 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67fa118740 10 client.0 _ll_register_callbacks cb 0x55d96164d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46256/0 (socket says 172.21.15.60:46256) 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 -- 172.21.15.60:0/2845231763 learned_addr learned my addr 172.21.15.60:0/2845231763 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f62dc640 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 0x55d9619e15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f52da640 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619dab40 0x55d9619e0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 -- 172.21.15.60:0/2845231763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 msgr2=0x55d9619e15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 0x55d9619e15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 -- 172.21.15.60:0/2845231763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619dab40 msgr2=0x55d9619e0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:39.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619dab40 0x55d9619e0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 -- 172.21.15.60:0/2845231763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9616b03c0 con 0x55d9619d95d0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f52da640 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619dab40 0x55d9619e0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67f5adb640 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619e3d40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f67ec010520 tx=0x7f67ec00a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5fbcc08743c0ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67d97fa640 1 -- 172.21.15.60:0/2845231763 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec01d050 con 0x55d9619d95d0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.370+0000 7f67d97fa640 1 -- 172.21.15.60:0/2845231763 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f67ec018650 con 0x55d9619d95d0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 1 -- 172.21.15.60:0/2845231763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67ec018b40 con 0x55d9619d95d0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67d97fa640 1 -- 172.21.15.60:0/2845231763 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f67ec031050 con 0x55d9619d95d0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 10 client.18006 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 1 -- 172.21.15.60:0/2845231763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55d9619f2ae0 con 0x55d9619d95d0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67d97fa640 1 -- 172.21.15.60:0/2845231763 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67ec018b40 con 0x55d9619d95d0 2024-09-12T00:09:39.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67d97fa640 1 -- 172.21.15.60:0/2845231763 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f67ec004660 con 0x55d9619d95d0 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 10 client.18006 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 10 client.18006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 20 client.18006 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d9619f3f40 0x55d9619f6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 4 client.18006 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67fa118740 1 -- 172.21.15.60:0/2845231763 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d96194c860 con 0x55d9619f3f40 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.371+0000 7f67f52da640 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d9619f3f40 0x55d9619f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.372+0000 7f67f52da640 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d9619f3f40 0x55d9619f6330 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c3cd0a9285d273e server_cookie=78538935875dcda2 in_seq=0 out_seq=0 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.372+0000 7f67d97fa640 10 client.18006 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.372+0000 7f67d97fa640 1 -- 172.21.15.60:0/2845231763 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d96194c860 con 0x55d9619f3f40 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.372+0000 7f67d97fa640 10 client.18006 handle_command_reply: tid=0 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.372+0000 7f67fa118740 1 client.18006 shutdown 2024-09-12T00:09:39.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 -- 172.21.15.60:0/2845231763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 msgr2=0x55d9619e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619e3d40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f67ec010520 tx=0x7f67ec00a720 comp rx=0 tx=0).stop 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 -- 172.21.15.60:0/2845231763 shutdown_connections 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d9619f3f40 0x55d9619f6330 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 0x55d9619e15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619dab40 0x55d9619e0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67d97fa640 0 client.18006 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 --2- 172.21.15.60:0/2845231763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619d95d0 0x55d9619e3d40 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 -- 172.21.15.60:0/2845231763 >> 172.21.15.60:0/2845231763 conn(0x55d9619a2310 msgr2=0x55d9619db960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 -- 172.21.15.60:0/2845231763 shutdown_connections 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 1 -- 172.21.15.60:0/2845231763 wait complete. 2024-09-12T00:09:39.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.373+0000 7f67fa118740 20 client.18006 trim_cache size 0 max 16384 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67fa118740 1 Processor -- start 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67fa118740 1 -- start start 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67fa118740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619d95d0 0x55d9619f0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67fa118740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619dc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67fa118740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 0x55d9619dc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67fa118740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67f01afa00 con 0x55d9619dab40 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67fa118740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67f01b1540 con 0x55d9619e4370 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67fa118740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67f01b00d0 con 0x55d9619d95d0 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67f52da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67f52da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619dc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46264/0 (socket says 172.21.15.60:46264) 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67f52da640 1 -- 172.21.15.60:0/3676320558 learned_addr learned my addr 172.21.15.60:0/3676320558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.386+0000 7f67f62dc640 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 0x55d9619dc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67f5adb640 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619d95d0 0x55d9619f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67f52da640 1 -- 172.21.15.60:0/3676320558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619d95d0 msgr2=0x55d9619f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67f52da640 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619d95d0 0x55d9619f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67f52da640 1 -- 172.21.15.60:0/3676320558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 msgr2=0x55d9619dc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67f52da640 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 0x55d9619dc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67f52da640 1 -- 172.21.15.60:0/3676320558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9619d6960 con 0x55d9619dab40 2024-09-12T00:09:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67f5adb640 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619d95d0 0x55d9619f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67f52da640 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619dc120 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f67e00cccf0 tx=0x7f67e0086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3b28507abedce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67db7fe640 1 -- 172.21.15.60:0/3676320558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e009fdc0 con 0x55d9619dab40 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67db7fe640 1 -- 172.21.15.60:0/3676320558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67e00a4680 con 0x55d9619dab40 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.387+0000 7f67db7fe640 1 -- 172.21.15.60:0/3676320558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e00d2e30 con 0x55d9619dab40 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 -- 172.21.15.60:0/3676320558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 msgr2=0x55d9619dc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619dc120 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f67e00cccf0 tx=0x7f67e0086040 comp rx=0 tx=0).stop 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 -- 172.21.15.60:0/3676320558 shutdown_connections 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619e4370 0x55d9619dc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619dc120 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 --2- 172.21.15.60:0/3676320558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619d95d0 0x55d9619f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 -- 172.21.15.60:0/3676320558 >> 172.21.15.60:0/3676320558 conn(0x55d9619a2310 msgr2=0x55d9619d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 -- 172.21.15.60:0/3676320558 shutdown_connections 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 -- 172.21.15.60:0/3676320558 wait complete. 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 -- start start 2024-09-12T00:09:39.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 Processor -- start 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619d95d0 0x55d9619ec940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.388+0000 7f67fa118740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67fa118740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 0x55d9619e81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67fa118740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67f01b0e70 con 0x55d9619dab40 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67fa118740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67f01b07a0 con 0x55d9619d95d0 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67fa118740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67f01ada00 con 0x55d9619e4370 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67fa118740 10 client.0 _ll_register_callbacks cb 0x7f67ec01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619e7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46268/0 (socket says 172.21.15.60:46268) 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 -- 172.21.15.60:0/2595456684 learned_addr learned my addr 172.21.15.60:0/2595456684 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f5adb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619d95d0 0x55d9619ec940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f62dc640 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 0x55d9619e81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 -- 172.21.15.60:0/2595456684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 msgr2=0x55d9619e81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 0x55d9619e81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 -- 172.21.15.60:0/2595456684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619d95d0 msgr2=0x55d9619ec940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619d95d0 0x55d9619ec940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 -- 172.21.15.60:0/2595456684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9619e8720 con 0x55d9619dab40 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f5adb640 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619d95d0 0x55d9619ec940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67f52da640 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619e7c70 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f67e00a4150 tx=0x7f67e0097d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe806f36ca35a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67d97fa640 1 -- 172.21.15.60:0/2595456684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e00b9060 con 0x55d9619dab40 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67d97fa640 1 -- 172.21.15.60:0/2595456684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f67e00ccec0 con 0x55d9619dab40 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67fa118740 1 -- 172.21.15.60:0/2595456684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67e00a4680 con 0x55d9619dab40 2024-09-12T00:09:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67d97fa640 1 -- 172.21.15.60:0/2595456684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f67e00b4070 con 0x55d9619dab40 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.389+0000 7f67fa118740 10 client.18012 fetch_fsmap learned FSMap version 52 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67fa118740 1 -- 172.21.15.60:0/2595456684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55d961a5e660 con 0x55d9619dab40 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67d97fa640 1 -- 172.21.15.60:0/2595456684 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67e00a4680 con 0x55d9619dab40 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67d97fa640 1 -- 172.21.15.60:0/2595456684 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f67e00a41f0 con 0x55d9619dab40 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67fa118740 10 client.18012 fetch_fsmap finished waiting for FSMap version 52 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67fa118740 10 client.18012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67fa118740 20 client.18012 populate_metadata read hostname 'smithi060' 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67fa118740 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d9619f3f40 0x55d961a60d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67fa118740 4 client.18012 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67fa118740 1 -- 172.21.15.60:0/2595456684 --> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d961946d70 con 0x55d9619f3f40 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.390+0000 7f67f5adb640 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d9619f3f40 0x55d961a60d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67d97fa640 10 client.18012 ms_handle_connect on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67f5adb640 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d9619f3f40 0x55d961a60d50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49908213b656e631 server_cookie=7555d3ced633e770 in_seq=0 out_seq=0 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67d97fa640 1 -- 172.21.15.60:0/2595456684 <== mds.0 v2:172.21.15.192:6838/3310133932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d961946d70 con 0x55d9619f3f40 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67d97fa640 10 client.18012 handle_command_reply: tid=0 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 client.18012 shutdown 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 -- 172.21.15.60:0/2595456684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 msgr2=0x55d9619e7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619e7c70 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f67e00a4150 tx=0x7f67e0097d30 comp rx=0 tx=0).stop 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 -- 172.21.15.60:0/2595456684 shutdown_connections 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.192:6838/3310133932,v1:172.21.15.192:6839/3310133932] conn(0x55d9619f3f40 0x55d961a60d50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9619e4370 0x55d9619e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9619dab40 0x55d9619e7c70 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 --2- 172.21.15.60:0/2595456684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d9619d95d0 0x55d9619ec940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67d97fa640 0 client.18012 ms_handle_reset on v2:172.21.15.192:6838/3310133932 2024-09-12T00:09:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 -- 172.21.15.60:0/2595456684 >> 172.21.15.60:0/2595456684 conn(0x55d9619a2310 msgr2=0x55d9619df790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:39.420 INFO:teuthology.orchestra.run.smithi060.stdout:[] 2024-09-12T00:09:39.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 -- 172.21.15.60:0/2595456684 shutdown_connections 2024-09-12T00:09:39.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 1 -- 172.21.15.60:0/2595456684 wait complete. 2024-09-12T00:09:39.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.391+0000 7f67fa118740 20 client.18012 trim_cache size 0 max 16384 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 -- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67dc0a2d70 msgr2=0x7f67dc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67dc0a2d70 0x7f67dc0a5230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f67e802f540 tx=0x7f67e8005fd0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 -- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0102790 msgr2=0x7f67f0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0102790 0x7f67f0074a30 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f67e000c920 tx=0x7f67e000cde0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 -- 172.21.15.60:0/2472322557 shutdown_connections 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f67dc0a2d70 0x7f67dc0a5230 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67f0106f10 0x7f67f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f0102790 0x7f67f0074a30 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 --2- 172.21.15.60:0/2472322557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67f0101de0 0x7f67f00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 -- 172.21.15.60:0/2472322557 >> 172.21.15.60:0/2472322557 conn(0x7f67f00fd8c0 msgr2=0x7f67f00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 -- 172.21.15.60:0/2472322557 shutdown_connections 2024-09-12T00:09:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:39.392+0000 7f67f7d3f640 1 -- 172.21.15.60:0/2472322557 wait complete. 2024-09-12T00:09:39.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: pgmap v319: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 120 KiB/s wr, 25 op/s 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:39 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: pgmap v319: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 120 KiB/s wr, 25 op/s 2024-09-12T00:09:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:39 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: pgmap v319: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 120 KiB/s wr, 25 op/s 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:39.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:39 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:40.069 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-12T00:09:40.070 INFO:tasks.fwd_scrub:done joining 2024-09-12T00:09:40.071 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T00:09:40.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:09:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1997546532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4103590 msgr2=0x7fd0b410ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1997546532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4103590 0x7fd0b410ba70 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009900 tx=0x7fd0a402a480 comp rx=0 tx=0).stop 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1997546532 shutdown_connections 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1997546532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0b410c0c0 0x7fd0b410e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1997546532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4103590 0x7fd0b410ba70 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1997546532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4102c70 0x7fd0b4103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1997546532 >> 172.21.15.60:0/1997546532 conn(0x7fd0b40fc6a0 msgr2=0x7fd0b40feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1997546532 shutdown_connections 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1997546532 wait complete. 2024-09-12T00:09:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.204+0000 7fd0bb00e640 1 Processor -- start 2024-09-12T00:09:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0bb00e640 1 -- start start 2024-09-12T00:09:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0bb00e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4102c70 0x7fd0b41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0bb00e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4103590 0x7fd0b4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0bb00e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0b410c0c0 0x7fd0b419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0bb00e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b4111fc0 con 0x7fd0b4102c70 2024-09-12T00:09:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0bb00e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b4111e40 con 0x7fd0b410c0c0 2024-09-12T00:09:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0bb00e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b4112140 con 0x7fd0b4103590 2024-09-12T00:09:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4102c70 0x7fd0b41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4102c70 0x7fd0b41984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46292/0 (socket says 172.21.15.60:46292) 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 -- 172.21.15.60:0/1239852734 learned_addr learned my addr 172.21.15.60:0/1239852734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b95ab640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0b410c0c0 0x7fd0b419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0abfff640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4103590 0x7fd0b4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 -- 172.21.15.60:0/1239852734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4103590 msgr2=0x7fd0b4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4103590 0x7fd0b4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 -- 172.21.15.60:0/1239852734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0b410c0c0 msgr2=0x7fd0b419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0b410c0c0 0x7fd0b419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 -- 172.21.15.60:0/1239852734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b419d4b0 con 0x7fd0b4102c70 2024-09-12T00:09:40.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b95ab640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0b410c0c0 0x7fd0b419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.205+0000 7fd0b8daa640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4102c70 0x7fd0b41984c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000d770 tx=0x7fd0b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.206+0000 7fd0a9ffb640 1 -- 172.21.15.60:0/1239852734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0017070 con 0x7fd0b4102c70 2024-09-12T00:09:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.206+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b419d7a0 con 0x7fd0b4102c70 2024-09-12T00:09:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.206+0000 7fd0a9ffb640 1 -- 172.21.15.60:0/1239852734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd0b0005520 con 0x7fd0b4102c70 2024-09-12T00:09:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.206+0000 7fd0a9ffb640 1 -- 172.21.15.60:0/1239852734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0010460 con 0x7fd0b4102c70 2024-09-12T00:09:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.206+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b41a5030 con 0x7fd0b4102c70 2024-09-12T00:09:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.207+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b406a8c0 con 0x7fd0b4102c70 2024-09-12T00:09:40.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.208+0000 7fd0a9ffb640 1 -- 172.21.15.60:0/1239852734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd0b0004ea0 con 0x7fd0b4102c70 2024-09-12T00:09:40.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.209+0000 7fd0a9ffb640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd09c0a2d00 0x7fd09c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.209+0000 7fd0a9ffb640 1 -- 172.21.15.60:0/1239852734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd0b00cf420 con 0x7fd0b4102c70 2024-09-12T00:09:40.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.209+0000 7fd0abfff640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd09c0a2d00 0x7fd09c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.209+0000 7fd0abfff640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd09c0a2d00 0x7fd09c0a51c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd0b410d400 tx=0x7fd0a4005a20 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:40.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.217+0000 7fd0a9ffb640 1 -- 172.21.15.60:0/1239852734 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0b009c060 con 0x7fd0b4102c70 2024-09-12T00:09:40.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.465+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0b4107130 con 0x7fd0b4102c70 2024-09-12T00:09:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.467+0000 7fd0a9ffb640 1 -- 172.21.15.60:0/1239852734 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23111 (secure 0 0 0) 0x7fd0b009b960 con 0x7fd0b4102c70 2024-09-12T00:09:40.466 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:09:40.467 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":91,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-12T00:09:18.000786+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/75586277":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3663020999":"2024-09-12T23:59:21.380056+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6801/1180183286":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2524722535":"2024-09-12T23:59:21.380056+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/1180183286":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3141588653":"2024-09-12T23:59:21.380056+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:09:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd09c0a2d00 msgr2=0x7fd09c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd09c0a2d00 0x7fd09c0a51c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd0b410d400 tx=0x7fd0a4005a20 comp rx=0 tx=0).stop 2024-09-12T00:09:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4102c70 msgr2=0x7fd0b41984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4102c70 0x7fd0b41984c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000d770 tx=0x7fd0b000dc30 comp rx=0 tx=0).stop 2024-09-12T00:09:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 shutdown_connections 2024-09-12T00:09:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd09c0a2d00 0x7fd09c0a51c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0b410c0c0 0x7fd0b419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4103590 0x7fd0b4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 --2- 172.21.15.60:0/1239852734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0b4102c70 0x7fd0b41984c0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 >> 172.21.15.60:0/1239852734 conn(0x7fd0b40fc6a0 msgr2=0x7fd0b40fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 shutdown_connections 2024-09-12T00:09:40.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.469+0000 7fd0bb00e640 1 -- 172.21.15.60:0/1239852734 wait complete. 2024-09-12T00:09:40.481 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:52:53.812220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T23:57:25.194293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T23:57:27.402156+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 90, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T00:09:40.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T00:09:40.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:40 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-12T00:09:40.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:40 smithi060 ceph-mon[30953]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T00:09:40.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:40 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-12T00:09:40.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:40 smithi060 ceph-mon[30953]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.590+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2316878586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb81069c0 msgr2=0x7f2fb8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.590+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2316878586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb81069c0 0x7f2fb8106da0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009930 tx=0x7f2fb402a440 comp rx=0 tx=0).stop 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2316878586 shutdown_connections 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2316878586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fb8101350 0x7f2fb810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2316878586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb81009b0 0x7f2fb8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2316878586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb81069c0 0x7f2fb8106da0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2316878586 >> 172.21.15.60:0/2316878586 conn(0x7f2fb80fc690 msgr2=0x7f2fb80feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2316878586 shutdown_connections 2024-09-12T00:09:40.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2316878586 wait complete. 2024-09-12T00:09:40.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 Processor -- start 2024-09-12T00:09:40.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 -- start start 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb81009b0 0x7f2fb8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb8101350 0x7f2fb81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fb81069c0 0x7f2fb819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb8110f20 con 0x7f2fb8101350 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb8110da0 con 0x7f2fb81009b0 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.591+0000 7f2fbfda6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb81110a0 con 0x7f2fb81069c0 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb8101350 0x7f2fb81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb8101350 0x7f2fb81989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46320/0 (socket says 172.21.15.60:46320) 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 -- 172.21.15.60:0/2420693333 learned_addr learned my addr 172.21.15.60:0/2420693333 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbdb42640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb81009b0 0x7f2fb8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbe343640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fb81069c0 0x7f2fb819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 -- 172.21.15.60:0/2420693333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fb81069c0 msgr2=0x7f2fb819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fb81069c0 0x7f2fb819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 -- 172.21.15.60:0/2420693333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb81009b0 msgr2=0x7f2fb8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb81009b0 0x7f2fb8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 -- 172.21.15.60:0/2420693333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb819d450 con 0x7f2fb8101350 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbdb42640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb81009b0 0x7f2fb8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbd341640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb8101350 0x7f2fb81989a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c920 tx=0x7f2fa800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2faeffd640 1 -- 172.21.15.60:0/2420693333 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8007c70 con 0x7f2fb8101350 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2faeffd640 1 -- 172.21.15.60:0/2420693333 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2fa8007e10 con 0x7f2fb8101350 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2faeffd640 1 -- 172.21.15.60:0/2420693333 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8018940 con 0x7f2fb8101350 2024-09-12T00:09:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb819d740 con 0x7f2fb8101350 2024-09-12T00:09:40.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.592+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb81a4fd0 con 0x7f2fb8101350 2024-09-12T00:09:40.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.594+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb8100e10 con 0x7f2fb8101350 2024-09-12T00:09:40.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.595+0000 7f2faeffd640 1 -- 172.21.15.60:0/2420693333 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2fa8018b20 con 0x7f2fb8101350 2024-09-12T00:09:40.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.595+0000 7f2faeffd640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2fa40a2d00 0x7f2fa40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.596+0000 7f2fbdb42640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2fa40a2d00 0x7f2fa40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.596+0000 7f2faeffd640 1 -- 172.21.15.60:0/2420693333 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f2fa80cf570 con 0x7f2fb8101350 2024-09-12T00:09:40.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.596+0000 7f2fbdb42640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2fa40a2d00 0x7f2fa40a51c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4000c00 tx=0x7f2fb4005a20 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:40.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.600+0000 7f2faeffd640 1 -- 172.21.15.60:0/2420693333 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2fa8014030 con 0x7f2fb8101350 2024-09-12T00:09:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:40 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-12T00:09:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:40 smithi105 ceph-mon[34805]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T00:09:40.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:40 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-12T00:09:40.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:40 smithi105 ceph-mon[34805]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-12T00:09:40.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.780+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2fb8109f90 con 0x7f2fb8101350 2024-09-12T00:09:40.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.780+0000 7f2faeffd640 1 -- 172.21.15.60:0/2420693333 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f2fa809c1b0 con 0x7f2fb8101350 2024-09-12T00:09:40.779 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T00:09:40.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2fa40a2d00 msgr2=0x7f2fa40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2fa40a2d00 0x7f2fa40a51c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4000c00 tx=0x7f2fb4005a20 comp rx=0 tx=0).stop 2024-09-12T00:09:40.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb8101350 msgr2=0x7f2fb81989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb8101350 0x7f2fb81989a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c920 tx=0x7f2fa800cde0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 shutdown_connections 2024-09-12T00:09:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f2fa40a2d00 0x7f2fa40a51c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fb81069c0 0x7f2fb819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2fb8101350 0x7f2fb81989a0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 --2- 172.21.15.60:0/2420693333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb81009b0 0x7f2fb8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.782+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 >> 172.21.15.60:0/2420693333 conn(0x7f2fb80fc690 msgr2=0x7f2fb806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.783+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 shutdown_connections 2024-09-12T00:09:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.783+0000 7f2fbfda6640 1 -- 172.21.15.60:0/2420693333 wait complete. 2024-09-12T00:09:40.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:40 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-12T00:09:40.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:40 smithi192 ceph-mon[35487]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T00:09:40.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:40 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi105 to 176.0M 2024-09-12T00:09:40.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:40 smithi192 ceph-mon[35487]: Unable to set osd_memory_target on smithi105 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-12T00:09:40.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T00:09:40.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 -- 172.21.15.60:0/4204453523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64106990 msgr2=0x7fde64106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 --2- 172.21.15.60:0/4204453523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64106990 0x7fde64106d70 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fde60009cd0 tx=0x7fde6002a8e0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 -- 172.21.15.60:0/4204453523 shutdown_connections 2024-09-12T00:09:40.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 --2- 172.21.15.60:0/4204453523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64101320 0x7fde6410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 --2- 172.21.15.60:0/4204453523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde64100980 0x7fde64100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 --2- 172.21.15.60:0/4204453523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64106990 0x7fde64106d70 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 -- 172.21.15.60:0/4204453523 >> 172.21.15.60:0/4204453523 conn(0x7fde640779d0 msgr2=0x7fde640fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 -- 172.21.15.60:0/4204453523 shutdown_connections 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.907+0000 7fde6c21e640 1 -- 172.21.15.60:0/4204453523 wait complete. 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6c21e640 1 Processor -- start 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6c21e640 1 -- start start 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6c21e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64100980 0x7fde640fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6c21e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64101320 0x7fde640fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6c21e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde64106990 0x7fde640fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6c21e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fde64110ef0 con 0x7fde64100980 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6c21e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde64110d70 con 0x7fde64106990 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6c21e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fde64111070 con 0x7fde64101320 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde69fba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64100980 0x7fde640fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde69fba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64100980 0x7fde640fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46330/0 (socket says 172.21.15.60:46330) 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde69fba640 1 -- 172.21.15.60:0/30997616 learned_addr learned my addr 172.21.15.60:0/30997616 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.908+0000 7fde6a7bb640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde64106990 0x7fde640fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde697b9640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64101320 0x7fde640fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde69fba640 1 -- 172.21.15.60:0/30997616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64101320 msgr2=0x7fde640fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde69fba640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64101320 0x7fde640fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde69fba640 1 -- 172.21.15.60:0/30997616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde64106990 msgr2=0x7fde640fd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde69fba640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde64106990 0x7fde640fd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde69fba640 1 -- 172.21.15.60:0/30997616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde641a6a10 con 0x7fde64100980 2024-09-12T00:09:40.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde69fba640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64100980 0x7fde640fce50 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fde60031040 tx=0x7fde60003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:40.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde5affd640 1 -- 172.21.15.60:0/30997616 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60032e60 con 0x7fde64100980 2024-09-12T00:09:40.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde5affd640 1 -- 172.21.15.60:0/30997616 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde60004540 con 0x7fde64100980 2024-09-12T00:09:40.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde641a6ca0 con 0x7fde64100980 2024-09-12T00:09:40.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde5affd640 1 -- 172.21.15.60:0/30997616 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6003b400 con 0x7fde64100980 2024-09-12T00:09:40.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.909+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde641a71a0 con 0x7fde64100980 2024-09-12T00:09:40.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.910+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde64100de0 con 0x7fde64100980 2024-09-12T00:09:40.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.911+0000 7fde5affd640 1 -- 172.21.15.60:0/30997616 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fde600046f0 con 0x7fde64100980 2024-09-12T00:09:40.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.912+0000 7fde5affd640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde500a2d00 0x7fde500a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:40.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.913+0000 7fde697b9640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde500a2d00 0x7fde500a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:40.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.913+0000 7fde5affd640 1 -- 172.21.15.60:0/30997616 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fde6002e030 con 0x7fde64100980 2024-09-12T00:09:40.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.913+0000 7fde697b9640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde500a2d00 0x7fde500a51c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fde640fe8e0 tx=0x7fde54005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:40.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:40.917+0000 7fde5affd640 1 -- 172.21.15.60:0/30997616 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde600bcf10 con 0x7fde64100980 2024-09-12T00:09:41.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.093+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fde641a73d0 con 0x7fde64100980 2024-09-12T00:09:41.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.093+0000 7fde5affd640 1 -- 172.21.15.60:0/30997616 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fde600bc810 con 0x7fde64100980 2024-09-12T00:09:41.093 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-09-12T00:09:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde500a2d00 msgr2=0x7fde500a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde500a2d00 0x7fde500a51c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fde640fe8e0 tx=0x7fde54005f90 comp rx=0 tx=0).stop 2024-09-12T00:09:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64100980 msgr2=0x7fde640fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64100980 0x7fde640fce50 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fde60031040 tx=0x7fde60003f10 comp rx=0 tx=0).stop 2024-09-12T00:09:41.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 shutdown_connections 2024-09-12T00:09:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fde500a2d00 0x7fde500a51c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde64106990 0x7fde640fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64101320 0x7fde640fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 --2- 172.21.15.60:0/30997616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde64100980 0x7fde640fce50 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 >> 172.21.15.60:0/30997616 conn(0x7fde640779d0 msgr2=0x7fde640695a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:41.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 shutdown_connections 2024-09-12T00:09:41.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.095+0000 7fde6c21e640 1 -- 172.21.15.60:0/30997616 wait complete. 2024-09-12T00:09:41.106 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T00:09:41.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3468339793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20102430 msgr2=0x7f6e2010e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3468339793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20102430 0x7f6e2010e960 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009cd0 tx=0x7f6e1802a8e0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3468339793 shutdown_connections 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3468339793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20102430 0x7f6e2010e960 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3468339793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e20101a90 0x7f6e20101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3468339793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e20107aa0 0x7f6e20107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3468339793 >> 172.21.15.60:0/3468339793 conn(0x7f6e200fd7d0 msgr2=0x7f6e200ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3468339793 shutdown_connections 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.214+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3468339793 wait complete. 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e25ea5640 1 Processor -- start 2024-09-12T00:09:41.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e25ea5640 1 -- start start 2024-09-12T00:09:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e25ea5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20101a90 0x7f6e20198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e25ea5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e20102430 0x7f6e20198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e25ea5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e20107aa0 0x7f6e2019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e25ea5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e20112000 con 0x7f6e20101a90 2024-09-12T00:09:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e25ea5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e20111e80 con 0x7f6e20102430 2024-09-12T00:09:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e25ea5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e20112180 con 0x7f6e20107aa0 2024-09-12T00:09:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20101a90 0x7f6e20198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20101a90 0x7f6e20198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46350/0 (socket says 172.21.15.60:46350) 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e1f7fe640 1 -- 172.21.15.60:0/3285860451 learned_addr learned my addr 172.21.15.60:0/3285860451 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e1ffff640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e20107aa0 0x7f6e2019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.215+0000 7f6e1effd640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e20102430 0x7f6e20198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1f7fe640 1 -- 172.21.15.60:0/3285860451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e20107aa0 msgr2=0x7f6e2019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1f7fe640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e20107aa0 0x7f6e2019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1f7fe640 1 -- 172.21.15.60:0/3285860451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e20102430 msgr2=0x7f6e20198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1f7fe640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e20102430 0x7f6e20198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1f7fe640 1 -- 172.21.15.60:0/3285860451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2019d520 con 0x7f6e20101a90 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1f7fe640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20101a90 0x7f6e20198530 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000d950 tx=0x7f6e1000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1cff9640 1 -- 172.21.15.60:0/3285860451 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10017070 con 0x7f6e20101a90 2024-09-12T00:09:41.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1cff9640 1 -- 172.21.15.60:0/3285860451 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e1000de80 con 0x7f6e20101a90 2024-09-12T00:09:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2019d810 con 0x7f6e20101a90 2024-09-12T00:09:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e1cff9640 1 -- 172.21.15.60:0/3285860451 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000f620 con 0x7f6e20101a90 2024-09-12T00:09:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.216+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e201a50a0 con 0x7f6e20101a90 2024-09-12T00:09:41.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.217+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e20101ef0 con 0x7f6e20101a90 2024-09-12T00:09:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.218+0000 7f6e1cff9640 1 -- 172.21.15.60:0/3285860451 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6e10009c30 con 0x7f6e20101a90 2024-09-12T00:09:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.219+0000 7f6e1cff9640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6e080a2d00 0x7f6e080a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.219+0000 7f6e1effd640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6e080a2d00 0x7f6e080a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.219+0000 7f6e1cff9640 1 -- 172.21.15.60:0/3285860451 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f6e100cf130 con 0x7f6e20101a90 2024-09-12T00:09:41.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.220+0000 7f6e1effd640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6e080a2d00 0x7f6e080a51c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6e20069790 tx=0x7f6e14009110 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:41.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.222+0000 7f6e1cff9640 1 -- 172.21.15.60:0/3285860451 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e1009bd10 con 0x7f6e20101a90 2024-09-12T00:09:41.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.400+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e2010a080 con 0x7f6e20101a90 2024-09-12T00:09:41.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.400+0000 7f6e1cff9640 1 -- 172.21.15.60:0/3285860451 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f6e1009b610 con 0x7f6e20101a90 2024-09-12T00:09:41.399 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2024-09-12T00:09:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6e080a2d00 msgr2=0x7f6e080a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6e080a2d00 0x7f6e080a51c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6e20069790 tx=0x7f6e14009110 comp rx=0 tx=0).stop 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20101a90 msgr2=0x7f6e20198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20101a90 0x7f6e20198530 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000d950 tx=0x7f6e1000dd50 comp rx=0 tx=0).stop 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 shutdown_connections 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f6e080a2d00 0x7f6e080a51c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e20107aa0 0x7f6e2019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e20102430 0x7f6e20198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 --2- 172.21.15.60:0/3285860451 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e20101a90 0x7f6e20198530 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 >> 172.21.15.60:0/3285860451 conn(0x7f6e200fd7d0 msgr2=0x7f6e200fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 shutdown_connections 2024-09-12T00:09:41.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.402+0000 7f6e25ea5640 1 -- 172.21.15.60:0/3285860451 wait complete. 2024-09-12T00:09:41.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: pgmap v320: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-12T00:09:41.411 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1239852734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:09:41.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2420693333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:09:41.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.413 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:09:41.413 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:09:41.413 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.413 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:41 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/30997616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:09:41.414 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T00:09:41.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 -- 172.21.15.60:0/2460855371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c101360 msgr2=0x7fd55c10d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 --2- 172.21.15.60:0/2460855371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c101360 0x7fd55c10d890 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fd554009cd0 tx=0x7fd55402a8e0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 -- 172.21.15.60:0/2460855371 shutdown_connections 2024-09-12T00:09:41.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 --2- 172.21.15.60:0/2460855371 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c101360 0x7fd55c10d890 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 --2- 172.21.15.60:0/2460855371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55c1009c0 0x7fd55c100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 --2- 172.21.15.60:0/2460855371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd55c1069d0 0x7fd55c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 -- 172.21.15.60:0/2460855371 >> 172.21.15.60:0/2460855371 conn(0x7fd55c0fc6a0 msgr2=0x7fd55c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 -- 172.21.15.60:0/2460855371 shutdown_connections 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.519+0000 7fd563a2e640 1 -- 172.21.15.60:0/2460855371 wait complete. 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd563a2e640 1 Processor -- start 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd563a2e640 1 -- start start 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd563a2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c1009c0 0x7fd55c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd563a2e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55c101360 0x7fd55c199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd563a2e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd55c1069d0 0x7fd55c1a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd563a2e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c110f30 con 0x7fd55c1009c0 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd563a2e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c110db0 con 0x7fd55c101360 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd563a2e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1110b0 con 0x7fd55c1069d0 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd5617ca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c1009c0 0x7fd55c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:41.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd5617ca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c1009c0 0x7fd55c199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46372/0 (socket says 172.21.15.60:46372) 2024-09-12T00:09:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd5617ca640 1 -- 172.21.15.60:0/4227584376 learned_addr learned my addr 172.21.15.60:0/4227584376 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:09:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd561fcb640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd55c1069d0 0x7fd55c1a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd560fc9640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55c101360 0x7fd55c199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd5617ca640 1 -- 172.21.15.60:0/4227584376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd55c1069d0 msgr2=0x7fd55c1a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd5617ca640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd55c1069d0 0x7fd55c1a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd5617ca640 1 -- 172.21.15.60:0/4227584376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55c101360 msgr2=0x7fd55c199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd5617ca640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55c101360 0x7fd55c199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd5617ca640 1 -- 172.21.15.60:0/4227584376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55c1a47d0 con 0x7fd55c1009c0 2024-09-12T00:09:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.520+0000 7fd560fc9640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55c101360 0x7fd55c199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:09:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.521+0000 7fd5617ca640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c1009c0 0x7fd55c199210 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c920 tx=0x7fd55800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.521+0000 7fd5527fc640 1 -- 172.21.15.60:0/4227584376 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558007c70 con 0x7fd55c1009c0 2024-09-12T00:09:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.521+0000 7fd5527fc640 1 -- 172.21.15.60:0/4227584376 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd558007e10 con 0x7fd55c1009c0 2024-09-12T00:09:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.521+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55c1a49a0 con 0x7fd55c1009c0 2024-09-12T00:09:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.521+0000 7fd5527fc640 1 -- 172.21.15.60:0/4227584376 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558018940 con 0x7fd55c1009c0 2024-09-12T00:09:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.521+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55c1a4f40 con 0x7fd55c1009c0 2024-09-12T00:09:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.522+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd55c100e20 con 0x7fd55c1009c0 2024-09-12T00:09:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.523+0000 7fd5527fc640 1 -- 172.21.15.60:0/4227584376 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd558018b00 con 0x7fd55c1009c0 2024-09-12T00:09:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.524+0000 7fd5527fc640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd5480a2d80 0x7fd5480a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:09:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.524+0000 7fd5527fc640 1 -- 172.21.15.60:0/4227584376 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd5580cf7d0 con 0x7fd55c1009c0 2024-09-12T00:09:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.524+0000 7fd560fc9640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd5480a2d80 0x7fd5480a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:09:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.524+0000 7fd560fc9640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd5480a2d80 0x7fd5480a5240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd55c06af50 tx=0x7fd54c005e50 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:09:41.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.527+0000 7fd5527fc640 1 -- 172.21.15.60:0/4227584376 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd558014030 con 0x7fd55c1009c0 2024-09-12T00:09:41.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: pgmap v320: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-12T00:09:41.790 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.790 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.790 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1239852734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2420693333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.791 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:41 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/30997616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:09:41.792 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: pgmap v320: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-12T00:09:41.792 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.792 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.792 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1239852734' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:09:41.792 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2420693333' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T00:09:41.792 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.793 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.793 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.793 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T00:09:41.793 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T00:09:41.793 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T00:09:41.793 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' 2024-09-12T00:09:41.793 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:41 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/30997616' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T00:09:41.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.750+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fd55c06a9f0 con 0x7fd55c1009c0 2024-09-12T00:09:41.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.758+0000 7fd5527fc640 1 -- 172.21.15.60:0/4227584376 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740902 (secure 0 0 0) 0x7fd55801f300 con 0x7fd55c1009c0 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 25, 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi060.stdout: "active_gid": 15216, 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi060.stdout: "active_name": "x", 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi060.stdout: "active_addrs": { 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1761817386 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1761817386 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:41.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "active_addr": "172.21.15.60:6801/1761817386", 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "active_change": "2024-09-11T23:59:21.380252+0000", 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "available": true, 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "standbys": [ 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "gid": 24862, 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "z", 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_features": 4540701547738038271, 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2024-09-12T00:09:41.801 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T00:09:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.803 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.804 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.806 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.807 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.808 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to", 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2024-09-12T00:09:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2024-09-12T00:09:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2024-09-12T00:09:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2024-09-12T00:09:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "read", 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap", 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap-read" 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T00:09:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2024-09-12T00:09:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2024-09-12T00:09:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2024-09-12T00:09:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T00:09:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2024-09-12T00:09:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2024-09-12T00:09:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba": { 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba", 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB container image", 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T00:09:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.872 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2024-09-12T00:09:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "grafana_dashboards_path": { 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "grafana_dashboards_path", 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "hw_monitoring": { 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hw_monitoring", 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2024-09-12T00:09:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T00:09:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2024-09-12T00:09:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "oob_default_addr": { 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "oob_default_addr", 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "169.254.1.1", 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2024-09-12T00:09:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2024-09-12T00:09:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2024-09-12T00:09:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2024-09-12T00:09:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T00:09:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T00:09:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.931 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.932 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T00:09:41.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T00:09:41.934 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2024-09-12T00:09:41.935 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.936 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.937 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.938 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.939 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.940 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.941 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.943 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.943 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.944 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.944 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.944 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.944 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.944 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.946 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.947 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.948 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.949 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T00:09:41.950 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.951 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.953 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.954 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.955 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.956 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.957 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2024-09-12T00:09:41.958 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.959 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.960 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.962 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.963 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T00:09:41.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T00:09:41.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2024-09-12T00:09:41.966 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2024-09-12T00:09:41.967 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.968 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.969 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.970 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.971 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.972 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:41.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:41.974 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.975 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.976 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.977 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.978 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.979 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.980 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.981 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.982 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-12T00:09:41.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.984 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.985 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.986 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.988 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.989 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.990 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.991 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.992 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:41.993 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T00:09:41.994 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.995 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.996 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.997 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:41.998 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:41.999 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.000 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.001 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.002 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.003 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.004 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.005 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.006 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.007 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2024-09-12T00:09:42.008 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.009 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2024-09-12T00:09:42.010 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.011 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T00:09:42.012 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.013 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.014 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.015 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.018 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.019 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.021 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.022 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2024-09-12T00:09:42.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2024-09-12T00:09:42.024 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.025 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.027 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.028 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.029 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.030 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.031 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.032 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.033 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.034 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.035 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.036 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.037 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.038 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.039 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.040 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.041 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.043 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.044 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.045 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.047 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.048 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.050 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.051 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.052 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.055 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.056 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2024-09-12T00:09:42.057 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.058 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.059 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.060 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.061 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.062 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.063 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.064 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.065 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.066 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.067 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.068 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.069 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.071 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.072 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.073 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.074 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.075 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.077 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.078 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.079 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.080 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.081 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.082 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.083 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.085 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.086 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.087 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.088 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.091 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.095 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2024-09-12T00:09:42.096 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.097 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.098 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.099 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.100 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.101 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.102 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.103 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2024-09-12T00:09:42.104 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T00:09:42.105 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.106 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.107 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.110 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.111 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.112 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:42.113 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.114 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.115 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T00:09:42.116 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.117 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.118 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.119 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.120 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.121 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.122 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2024-09-12T00:09:42.123 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.124 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.125 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.126 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.128 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2024-09-12T00:09:42.129 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-12T00:09:42.130 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.131 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.132 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.133 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.134 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.135 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.136 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.137 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.138 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.139 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2024-09-12T00:09:42.140 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-12T00:09:42.141 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.142 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.144 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.145 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.146 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.147 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.148 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.149 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.150 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:42.151 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.152 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.153 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.154 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.155 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.156 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.157 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.159 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.161 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.162 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.163 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2024-09-12T00:09:42.164 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.165 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.166 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.167 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.168 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.169 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.170 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.171 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2024-09-12T00:09:42.172 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2024-09-12T00:09:42.173 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2024-09-12T00:09:42.174 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.175 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.176 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.177 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.178 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.179 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2024-09-12T00:09:42.180 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.181 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.182 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.183 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.184 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.185 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.186 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.187 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.188 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.189 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.190 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.191 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.192 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.194 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.195 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.196 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.197 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.198 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.199 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.200 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.201 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.202 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.203 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.204 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.205 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.206 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.207 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.208 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.209 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.210 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.211 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2024-09-12T00:09:42.212 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.213 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.215 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.216 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.217 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.218 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.219 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.220 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.221 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2024-09-12T00:09:42.222 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.223 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.224 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.225 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.226 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.227 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.228 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.229 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.230 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.231 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.232 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.233 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.234 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.235 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.236 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.237 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.238 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.239 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.240 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.242 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.243 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.244 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2024-09-12T00:09:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.249 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_no_wait": { 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.250 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.251 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.253 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.254 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.255 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.256 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.257 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2024-09-12T00:09:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T00:09:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "gid": 24872, 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "y", 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_features": 4540701547738038271, 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to", 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.271 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2024-09-12T00:09:42.272 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.273 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.274 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.275 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.276 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.277 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.278 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2024-09-12T00:09:42.279 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T00:09:42.280 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.281 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-12T00:09:42.282 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2024-09-12T00:09:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.285 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.286 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.287 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.288 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.289 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.290 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.291 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.292 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.293 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.294 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.295 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "read", 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap", 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap-read" 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2024-09-12T00:09:42.296 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.297 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.299 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.300 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.301 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.302 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2024-09-12T00:09:42.303 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2024-09-12T00:09:42.304 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.307 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2024-09-12T00:09:42.308 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.309 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.310 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.311 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2024-09-12T00:09:42.312 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2024-09-12T00:09:42.313 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2024-09-12T00:09:42.314 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.315 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.317 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2024-09-12T00:09:42.318 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.319 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.320 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.321 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T00:09:42.322 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.323 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.324 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.325 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.326 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba": { 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba", 2024-09-12T00:09:42.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB container image", 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2024-09-12T00:09:42.328 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.329 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.330 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.331 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "grafana_dashboards_path": { 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "grafana_dashboards_path", 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "hw_monitoring": { 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hw_monitoring", 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2024-09-12T00:09:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2024-09-12T00:09:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T00:09:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "oob_default_addr": { 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "oob_default_addr", 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "169.254.1.1", 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2024-09-12T00:09:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2024-09-12T00:09:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T00:09:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T00:09:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T00:09:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T00:09:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T00:09:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T00:09:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2024-09-12T00:09:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-12T00:09:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-12T00:09:42.451 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.452 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2024-09-12T00:09:42.454 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2024-09-12T00:09:42.455 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.456 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.457 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.457 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.457 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.457 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.457 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.457 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.457 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.457 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.458 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.459 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.460 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.461 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.462 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.462 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.462 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.462 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.462 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.462 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.463 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.464 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2024-09-12T00:09:42.464 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2024-09-12T00:09:42.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.464 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.464 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.464 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2024-09-12T00:09:42.464 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T00:09:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.466 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.467 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.468 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2024-09-12T00:09:42.469 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.470 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.471 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2024-09-12T00:09:42.472 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.473 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.474 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.475 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.476 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.477 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.478 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.479 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.480 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.481 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.484 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2024-09-12T00:09:42.485 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.487 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.488 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.489 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.490 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.491 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.492 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.493 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.494 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.495 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.496 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.497 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.498 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.499 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.500 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2024-09-12T00:09:42.501 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2024-09-12T00:09:42.502 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.503 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.503 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.503 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:09:42.503 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.503 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd5480a2d80 msgr2=0x7fd5480a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd5480a2d80 0x7fd5480a5240 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd55c06af50 tx=0x7fd54c005e50 comp rx=0 tx=0).stop 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c1009c0 msgr2=0x7fd55c199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c1009c0 0x7fd55c199210 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c920 tx=0x7fd55800cde0 comp rx=0 tx=0).stop 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 shutdown_connections 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7fd5480a2d80 0x7fd5480a5240 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd55c1069d0 0x7fd55c1a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55c101360 0x7fd55c199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:42.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 --2- 172.21.15.60:0/4227584376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55c1009c0 0x7fd55c199210 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:09:42.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 >> 172.21.15.60:0/4227584376 conn(0x7fd55c0fc6a0 msgr2=0x7fd55c0fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:09:42.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 shutdown_connections 2024-09-12T00:09:42.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:09:41.764+0000 7fd563a2e640 1 -- 172.21.15.60:0/4227584376 wait complete. 2024-09-12T00:09:42.508 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.508 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.508 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.509 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.510 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2024-09-12T00:09:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.530 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.530 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.530 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.530 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.530 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.530 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.530 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2024-09-12T00:09:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2024-09-12T00:09:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.546 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.548 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.549 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.550 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.552 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.552 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.552 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.552 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.552 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.552 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.552 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.553 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.554 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.555 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.557 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.558 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.559 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.560 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.561 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.563 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.564 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.567 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.568 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.570 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.571 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.572 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.573 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.574 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.575 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.576 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2024-09-12T00:09:42.578 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2024-09-12T00:09:42.579 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.581 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.583 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.584 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.585 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2024-09-12T00:09:42.586 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.587 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.588 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.589 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.590 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.591 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.592 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.593 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.594 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.595 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.596 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.597 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.598 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.599 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.600 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2024-09-12T00:09:42.601 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.602 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2024-09-12T00:09:42.603 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.604 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.605 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.606 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.607 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.608 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.609 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.610 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.611 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.612 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.614 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.615 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2024-09-12T00:09:42.617 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2024-09-12T00:09:42.618 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.618 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.618 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.618 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.618 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.618 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.618 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.618 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.619 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.620 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.620 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.620 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.620 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.620 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T00:09:42.620 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T00:09:42.620 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.620 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.621 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.622 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.623 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.624 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.625 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.626 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.627 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.628 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2024-09-12T00:09:42.629 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-12T00:09:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-12T00:09:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.646 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.647 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2024-09-12T00:09:42.648 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.649 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.650 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.651 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.652 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.653 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.655 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.656 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.656 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.656 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.656 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.656 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.656 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.656 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.657 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.658 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.659 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.661 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.662 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.663 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.664 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.665 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.666 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.667 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.675 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.676 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.678 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.679 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.680 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.680 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.680 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.680 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.680 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.680 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.680 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.680 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.681 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.682 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.683 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.684 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.685 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.686 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.686 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.686 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.686 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.686 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.686 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2024-09-12T00:09:42.686 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.687 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.688 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2024-09-12T00:09:42.689 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.689 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.689 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.689 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.689 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.689 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.689 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.690 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.691 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.692 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2024-09-12T00:09:42.693 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.694 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.695 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2024-09-12T00:09:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2024-09-12T00:09:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2024-09-12T00:09:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2024-09-12T00:09:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2024-09-12T00:09:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_no_wait": { 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2024-09-12T00:09:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "modules": [ 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "dashboard", 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "iostat", 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nfs", 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "restful", 2024-09-12T00:09:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_schedule" 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "available_modules": [ 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "alerts", 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_destination": { 2024-09-12T00:09:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_destination", 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email address to send alerts to", 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_from_name": { 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_from_name", 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "Ceph", 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Email From: name", 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_host": { 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_host", 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP server", 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_password": { 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_password", 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Password to authenticate with", 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_port": { 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_port", 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "465", 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP port", 2024-09-12T00:09:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_sender": { 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_sender", 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SMTP envelope sender", 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_ssl": { 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_ssl", 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "smtp_user": { 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "smtp_user", 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "User to authenticate as", 2024-09-12T00:09:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "balancer", 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "active": { 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "active", 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_time": { 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_time", 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0000", 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "begin_weekday": { 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "begin_weekday", 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_max_iterations": { 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_max_iterations", 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "25", 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "250", 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T00:09:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_metrics": { 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_metrics", 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_compat_step": { 2024-09-12T00:09:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crush_compat_step", 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.5", 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0.001", 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "0.999", 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "aggressiveness of optimization", 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T00:09:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "end_time": { 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_time", 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2359", 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "end_weekday": { 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "end_weekday", 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "0", 2024-09-12T00:09:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "6", 2024-09-12T00:09:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T00:09:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T00:09:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "min_score": { 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_score", 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "upmap", 2024-09-12T00:09:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-compat", 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "none", 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "read", 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap", 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap-read" 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Balancer mode", 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_ids": { 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_ids", 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_deviation": { 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_deviation", 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "upmap_max_optimizations": { 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "upmap_max_optimizations", 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm", 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_down_multiplier": { 2024-09-12T00:09:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_down_multiplier", 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_refresh_rate": { 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_refresh_rate", 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "20", 2024-09-12T00:09:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "agent_starting_port": { 2024-09-12T00:09:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "agent_starting_port", 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4721", 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T00:09:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_ptrace": { 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_ptrace", 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_interval": { 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_interval", 2024-09-12T00:09:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "autotune_memory_target_ratio": { 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0.7", 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_log_destination": { 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephadm_log_destination", 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "file", 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "file,syslog", 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "syslog" 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "cgroups_split": { 2024-09-12T00:09:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cgroups_split", 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "config_checks_enabled": { 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_checks_enabled", 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "config_dashboard": { 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_dashboard", 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_alertmanager": { 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_alertmanager", 2024-09-12T00:09:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_base": { 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_base", 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Container image name, without the tag", 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_elasticsearch": { 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_elasticsearch", 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T00:09:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "elasticsearch container image", 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_grafana": { 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_grafana", 2024-09-12T00:09:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_haproxy": { 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_haproxy", 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "HAproxy container image", 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_agent": { 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_agent", 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger agent container image", 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_collector": { 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_collector", 2024-09-12T00:09:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger collector container image", 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_jaeger_query": { 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_jaeger_query", 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Jaeger query container image", 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_keepalived": { 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_keepalived", 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Keepalived container image", 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_loki": { 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_loki", 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Loki container image", 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_node_exporter": { 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_node_exporter", 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_nvmeof": { 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_nvmeof", 2024-09-12T00:09:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Nvme-of container image", 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_prometheus": { 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_prometheus", 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Prometheus container image", 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_promtail": { 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_promtail", 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Promtail container image", 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_samba": { 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_samba", 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Samba/SMB container image", 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image_snmp_gateway": { 2024-09-12T00:09:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_image_snmp_gateway", 2024-09-12T00:09:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T00:09:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "SNMP Gateway container image", 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "container_init": { 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "container_init", 2024-09-12T00:09:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "daemon_cache_timeout": { 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "daemon_cache_timeout", 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "default_cephadm_command_timeout": { 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "900", 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "default_registry": { 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "default_registry", 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "docker.io", 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T00:09:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "device_cache_timeout": { 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_cache_timeout", 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1800", 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache device inventory", 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "device_enhanced_scan": { 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_enhanced_scan", 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "facts_cache_timeout": { 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "facts_cache_timeout", 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "seconds to cache host facts data", 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "grafana_dashboards_path": { 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "grafana_dashboards_path", 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "host_check_interval": { 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "host_check_interval", 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to perform a host check", 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "hw_monitoring": { 2024-09-12T00:09:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hw_monitoring", 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.901 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "inventory_list_all": { 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "inventory_list_all", 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.902 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.903 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.904 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "log_refresh_metadata": { 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_refresh_metadata", 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.905 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.907 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.908 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.909 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.910 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.911 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.911 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.911 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T00:09:42.911 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T00:09:42.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.911 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.911 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "*", 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.913 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "max_count_per_host": { 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_count_per_host", 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.914 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of daemons per service per host", 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd_draining_count": { 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_osd_draining_count", 2024-09-12T00:09:42.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "migration_current": { 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "migration_current", 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.917 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "internal - do not modify", 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "mode": { 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mode", 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "root", 2024-09-12T00:09:42.918 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm-package", 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "root" 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.919 INFO:teuthology.orchestra.run.smithi060.stdout: "oob_default_addr": { 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "oob_default_addr", 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "169.254.1.1", 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T00:09:42.920 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "prometheus_alerts_path": { 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus_alerts_path", 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T00:09:42.921 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_insecure": { 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_insecure", 2024-09-12T00:09:42.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.923 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_password": { 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_password", 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.924 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_url": { 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_url", 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.925 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "registry_username": { 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "registry_username", 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.926 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.927 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: "secure_monitoring_stack": { 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "secure_monitoring_stack", 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.928 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: "service_discovery_port": { 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "service_discovery_port", 2024-09-12T00:09:42.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8765", 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "cephadm service discovery port", 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.930 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "ssh_config_file": { 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssh_config_file", 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.931 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "use_agent": { 2024-09-12T00:09:42.932 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_agent", 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T00:09:42.933 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "use_repo_digest": { 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "use_repo_digest", 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.934 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.935 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_failed_host_check": { 2024-09-12T00:09:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_failed_host_check", 2024-09-12T00:09:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.936 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_daemons": { 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_daemons", 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.937 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_on_stray_hosts": { 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_on_stray_hosts", 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.940 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crash", 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.941 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.942 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.943 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.944 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:42.945 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:42.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.947 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.947 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.947 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.947 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.947 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.947 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.947 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.947 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "retain_interval": { 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retain_interval", 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "31536000", 2024-09-12T00:09:42.948 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_recent_interval": { 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_recent_interval", 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.949 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1209600", 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:42.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dashboard", 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.952 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.953 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.954 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_ENABLED": { 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T00:09:42.956 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.957 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.958 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.959 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T00:09:42.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.962 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.963 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.965 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.968 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T00:09:42.968 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.970 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.971 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.973 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.974 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_URL": { 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_URL", 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.975 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.976 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.976 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.976 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.976 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.976 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.976 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T00:09:42.976 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.977 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.978 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.979 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.979 INFO:teuthology.orchestra.run.smithi060.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T00:09:42.979 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T00:09:42.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.979 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T00:09:42.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T00:09:42.981 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.982 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.983 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.984 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.985 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.986 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.987 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.989 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.989 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.989 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.989 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.989 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.989 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.989 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.990 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.991 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.992 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.993 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.994 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T00:09:42.995 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.996 INFO:teuthology.orchestra.run.smithi060.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8", 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "45", 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:42.998 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:42.999 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "admin", 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.000 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.001 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.002 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.003 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.004 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "cross_origin_url": { 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cross_origin_url", 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.006 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "crt_file": { 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "crt_file", 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.007 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "debug": { 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "debug", 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.008 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Enable/disable debug options", 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "jwt_token_ttl": { 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "jwt_token_ttl", 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "28800", 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.012 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.013 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.014 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.016 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "motd": { 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "motd", 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "The message of the day", 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.017 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect_resolve_ip_addr": { 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.018 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.019 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8080", 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.020 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.021 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl_server_port": { 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl_server_port", 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8443", 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.022 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "redirect", 2024-09-12T00:09:43.023 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "redirect" 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-12T00:09:43.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "url_prefix": { 2024-09-12T00:09:43.025 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url_prefix", 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_monitoring": { 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_monitoring", 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.027 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "monitor device health metrics", 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.028 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.030 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.031 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.032 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "mark_out_threshold": { 2024-09-12T00:09:43.033 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mark_out_threshold", 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "2419200", 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": { 2024-09-12T00:09:43.034 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pool_name", 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "device_health_metrics", 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.035 INFO:teuthology.orchestra.run.smithi060.stdout: "retention_period": { 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "retention_period", 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15552000", 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long to retain device health metrics", 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.036 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_frequency": { 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_frequency", 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.037 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "self_heal": { 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "self_heal", 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.038 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T00:09:43.039 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "warn_threshold": { 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "warn_threshold", 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7257600", 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.040 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "diskprediction_local", 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.042 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.043 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.044 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.046 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "predict_interval": { 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predict_interval", 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "86400", 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.047 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "predictor_model": { 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "predictor_model", 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "prophetstor", 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.048 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "600", 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "influx", 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": false, 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "influxdb python module not found", 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "batch_size": { 2024-09-12T00:09:43.050 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "batch_size", 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5000", 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.051 INFO:teuthology.orchestra.run.smithi060.stdout: "database": { 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "database", 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "ceph", 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.052 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "hostname": { 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "hostname", 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server hostname", 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.053 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "30", 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "5", 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T00:09:43.054 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.055 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.056 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.057 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.058 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.059 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "password": { 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "password", 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.060 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "password of InfluxDB server user", 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "port": { 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "port", 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "8086", 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.061 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "InfluxDB server port", 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "ssl": { 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ssl", 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "false", 2024-09-12T00:09:43.062 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "threads": { 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threads", 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:43.063 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "32", 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "username": { 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "username", 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.064 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "username of InfluxDB server user", 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "verify_ssl": { 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "verify_ssl", 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.065 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "true", 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "insights", 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.068 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.070 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.071 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "iostat", 2024-09-12T00:09:43.072 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.073 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.074 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.076 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.077 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "k8sevents", 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_event_retention_days": { 2024-09-12T00:09:43.078 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "ceph_event_retention_days", 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "7", 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "config_check_secs": { 2024-09-12T00:09:43.079 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "config_check_secs", 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "10", 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.081 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.082 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.083 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.084 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.085 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "localpool", 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "failure_domain": { 2024-09-12T00:09:43.086 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "failure_domain", 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "host", 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "failure domain for any created local pool", 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.087 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.088 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.089 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.090 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.091 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.092 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": { 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "min_size", 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default min_size for any created local pool", 2024-09-12T00:09:43.093 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "num_rep": { 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "num_rep", 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3", 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.094 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default replica count for any created local pool", 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": { 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_num", 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "128", 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.095 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "prefix": { 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prefix", 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.096 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "name prefix for any created local pool", 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "subtree": { 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "subtree", 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "rack", 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.097 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mds_autoscaler", 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.098 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.099 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.100 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.101 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.102 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirroring", 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.104 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.105 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.106 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.107 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.108 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.109 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "nfs", 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.110 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.111 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.112 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.113 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.114 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.115 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "fail_fs": { 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "fail_fs", 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.116 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.117 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.118 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.119 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator": { 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "orchestrator", 2024-09-12T00:09:43.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "rook", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "test_orchestrator" 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Orchestrator backend", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.123 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_perf_query", 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.124 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.125 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.126 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.127 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.128 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.129 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "osd_support", 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.130 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.132 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.133 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.134 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.135 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "pg_autoscaler", 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.136 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.137 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.138 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.139 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.140 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.141 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "threshold": { 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "threshold", 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:43.142 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "3.0", 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1.0", 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "scaling threshold", 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.143 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "progress", 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_pg_recovery_event": { 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_pg_recovery_event", 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.144 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.145 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.146 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.147 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.149 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.150 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "max_completed_events": { 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_completed_events", 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.151 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "50", 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "number of past completed events to remember", 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "sleep_interval": { 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "sleep_interval", 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "5", 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "how long the module is going to sleep", 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.153 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "prometheus", 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cache", 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.154 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "exclude_perf_counters": { 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "exclude_perf_counters", 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.155 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.156 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.158 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.159 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.160 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools": { 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools", 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.161 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T00:09:43.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "300", 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "scrape_interval": { 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "scrape_interval", 2024-09-12T00:09:43.163 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15.0", 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:43.164 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "::", 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.165 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "9283", 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.166 INFO:teuthology.orchestra.run.smithi060.stdout: "stale_cache_strategy": { 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stale_cache_strategy", 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "log", 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_behaviour": { 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_behaviour", 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "default", 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "default", 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "error" 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.168 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "standby_error_status_code": { 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "standby_error_status_code", 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "500", 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "400", 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "599", 2024-09-12T00:09:43.169 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.170 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.171 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.172 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.173 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.174 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.176 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.176 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.176 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.176 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.176 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.176 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_snap_create": { 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_snap_create", 2024-09-12T00:09:43.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10", 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "mirror_snapshot_schedule": { 2024-09-12T00:09:43.178 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "trash_purge_schedule": { 2024-09-12T00:09:43.179 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "trash_purge_schedule", 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "restful", 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_auth": { 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enable_auth", 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.181 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "key_file": { 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "key_file", 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.182 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.183 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.184 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.185 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.186 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.187 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "server_addr": { 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_addr", 2024-09-12T00:09:43.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "server_port": { 2024-09-12T00:09:43.189 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "server_port", 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rgw", 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.191 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.192 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.193 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.194 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rook", 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.197 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.199 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.200 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.201 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "storage_class": { 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "storage_class", 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.202 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "local", 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.203 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "selftest", 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.204 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.205 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.206 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.207 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.208 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "roption1": { 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption1", 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.209 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "roption2": { 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "roption2", 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.210 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "xyz", 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption1": { 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption1", 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.211 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption2": { 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption2", 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.212 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption3": { 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption3", 2024-09-12T00:09:43.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "float", 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption4": { 2024-09-12T00:09:43.214 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption4", 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption5": { 2024-09-12T00:09:43.215 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption5", 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.216 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption6": { 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption6", 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "rwoption7": { 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rwoption7", 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "1", 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "42", 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.218 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "testkey": { 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testkey", 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.219 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "testlkey": { 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testlkey", 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.220 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "testnewline": { 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "testnewline", 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.221 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_m_granularity": { 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "allow_m_granularity", 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.222 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "dump_on_update": { 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "dump_on_update", 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.223 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "dump database to debug log on update", 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.225 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.226 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.227 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.228 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.229 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "stats", 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.230 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.231 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.232 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.233 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.234 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "status", 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.236 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.237 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.238 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.239 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.240 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telegraf", 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "address": { 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "address", 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.242 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "15", 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.243 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.244 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.245 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.246 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "telemetry", 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_basic": { 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_basic", 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.250 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_crash": { 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_crash", 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.251 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_device": { 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_device", 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.252 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_ident": { 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_ident", 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.253 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "channel_perf": { 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "channel_perf", 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.254 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "contact": { 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "contact", 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.255 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "description": { 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "description", 2024-09-12T00:09:43.256 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "device_url": { 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_url", 2024-09-12T00:09:43.257 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "enabled": { 2024-09-12T00:09:43.258 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "enabled", 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:43.259 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "24", 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "8", 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.260 INFO:teuthology.orchestra.run.smithi060.stdout: "last_opt_revision": { 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "last_opt_revision", 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "1", 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard": { 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard", 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.262 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "leaderboard_description": { 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "leaderboard_description", 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.263 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.264 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.265 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.266 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.267 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.268 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "organization": { 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "organization", 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.269 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "proxy": { 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "proxy", 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.270 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "url": { 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "url", 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.271 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.272 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "test_orchestrator", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.273 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.274 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.276 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.277 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.278 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.279 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.280 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.282 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.283 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "max_concurrent_clones": { 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "max_concurrent_clones", 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "4", 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.284 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "periodic_async_work": { 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "periodic_async_work", 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.285 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Periodically check for async work", 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_delay": { 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_delay", 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "0", 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.286 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "snapshot_clone_no_wait": { 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "True", 2024-09-12T00:09:43.287 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix", 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "can_run": true, 2024-09-12T00:09:43.288 INFO:teuthology.orchestra.run.smithi060.stdout: "error_string": "", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "module_options": { 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "discovery_interval": { 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "discovery_interval", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "uint", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "100", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.289 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "identifier": { 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "identifier", 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.290 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "interval": { 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "interval", 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "secs", 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "60", 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.291 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "log_level": { 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_level", 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.292 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster": { 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster", 2024-09-12T00:09:43.293 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_cluster_level": { 2024-09-12T00:09:43.294 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_cluster_level", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "info", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [ 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "critical", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "debug", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "error", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "info", 2024-09-12T00:09:43.295 INFO:teuthology.orchestra.run.smithi060.stdout: "warning" 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": { 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "log_to_file", 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "bool", 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "False", 2024-09-12T00:09:43.296 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_host": { 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_host", 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "", 2024-09-12T00:09:43.297 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_port": { 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_port", 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "int", 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.298 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "10051", 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "zabbix_sender": { 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "zabbix_sender", 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "str", 2024-09-12T00:09:43.299 INFO:teuthology.orchestra.run.smithi060.stdout: "level": "advanced", 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 0, 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "min": "", 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "max": "", 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "enum_allowed": [], 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "desc": "", 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "long_desc": "", 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "tags": [], 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "see_also": [] 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.300 INFO:teuthology.orchestra.run.smithi060.stdout: "services": { 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "dashboard": "https://172.21.15.60:8443/" 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "always_on_modules": { 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "octopus": [ 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-12T00:09:43.301 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "pacific": [ 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-12T00:09:43.302 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "quincy": [ 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.303 INFO:teuthology.orchestra.run.smithi060.stdout: "reef": [ 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "squid": [ 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "balancer", 2024-09-12T00:09:43.304 INFO:teuthology.orchestra.run.smithi060.stdout: "crash", 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "devicehealth", 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "orchestrator", 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscaler", 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "progress", 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_support", 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "status", 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "telemetry", 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "volumes" 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "last_failure_osd_epoch": 83, 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: "active_clients": [ 2024-09-12T00:09:43.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "devicehealth", 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 514521529 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "libcephsqlite", 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1908451597 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd_support", 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2488393695 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.307 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2818785267 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.308 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "snap_schedule", 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2613327542 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "volumes", 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T00:09:43.309 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-12T00:09:43.310 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:0", 2024-09-12T00:09:43.310 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3479121430 2024-09-12T00:09:43.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.310 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:43.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:43.310 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T00:09:43.310 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:09:43.371 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T00:09:43.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T00:09:43.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:42 smithi060 ceph-mon[30953]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-12T00:09:43.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:42 smithi060 ceph-mon[30953]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-12T00:09:43.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:42 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3285860451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:09:43.373 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:42 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4227584376' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T00:09:43.373 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:42 smithi192 ceph-mon[35487]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-12T00:09:43.374 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:42 smithi192 ceph-mon[35487]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-12T00:09:43.374 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:42 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3285860451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:09:43.374 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:42 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4227584376' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T00:09:43.374 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:42 smithi105 ceph-mon[34805]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-12T00:09:43.374 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:42 smithi105 ceph-mon[34805]: Unable to set osd_memory_target on smithi060 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-12T00:09:43.374 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:42 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3285860451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T00:09:43.374 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:42 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4227584376' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T00:09:43.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:43 smithi060 ceph-mon[30953]: pgmap v321: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-12T00:09:43.641 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:43.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:43 smithi105 ceph-mon[34805]: pgmap v321: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-12T00:09:43.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:43 smithi192 ceph-mon[35487]: pgmap v321: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-12T00:09:44.120 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:09:44.120 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:44.120 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1837, 2024-09-12T00:09:44.120 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1839, 2024-09-12T00:09:44.120 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 7525211, 2024-09-12T00:09:44.120 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 584167, 2024-09-12T00:09:44.120 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2024-09-12T00:09:44.120 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.163722590, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.055615349, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.043480869, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.049677011, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1837, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.069116446, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000037624 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.121 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 484, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 450, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 10074423, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 200960, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:44.122 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.064284682, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.020803709, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.048287718, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.006131519, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 449, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.020178309, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000044940 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1624320, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 126480 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 46, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 197, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 4207910, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 448944, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.018167005, 2024-09-12T00:09:44.124 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.008328847, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.006816992, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000875158, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 195, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.018129768, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000092973 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.125 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 436224 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3570, 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.094709592, 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000026529 2024-09-12T00:09:44.126 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2024-09-12T00:09:44.127 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 2670, 2024-09-12T00:09:44.128 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 2670, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 2670, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 1, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 1, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:09:44.129 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2024-09-12T00:09:44.130 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:09:44.131 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2024-09-12T00:09:44.132 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-09-12T00:09:44.133 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2024-09-12T00:09:44.134 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 9101, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 14, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 23775328, 2024-09-12T00:09:44.135 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 23773240, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 9101 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 326, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 3820, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 3494, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 70, 2024-09-12T00:09:44.136 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 266, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 196, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 2670, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 6162, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 3492, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 58576, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 215328 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2024-09-12T00:09:44.137 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.138 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-09-12T00:09:44.140 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.141 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.142 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.143 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.144 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-09-12T00:09:44.145 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.147 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.148 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-09-12T00:09:44.149 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 2, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 1, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 2, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 2605, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:44.150 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:44.151 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 220239, 2024-09-12T00:09:44.153 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 436, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 8032, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 177, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:44.154 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 2795906, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 29247, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-09-12T00:09:44.155 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 2111, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 2111, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2111, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.228988703, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000582183 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-09-12T00:09:44.156 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2111, 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 2112 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 2111, 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 2111, 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 1341, 2024-09-12T00:09:44.157 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 768, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-09-12T00:09:44.158 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-09-12T00:09:44.159 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-09-12T00:09:44.160 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 91, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-09-12T00:09:44.161 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 9, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 7, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 7, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-09-12T00:09:44.162 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-09-12T00:09:44.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.163 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2024-09-12T00:09:44.163 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2024-09-12T00:09:44.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.163 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-09-12T00:09:44.163 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 0, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 2363, 2024-09-12T00:09:44.164 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 21579142, 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 2363, 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2363, 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 21579142, 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.165 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-12T00:09:44.166 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-12T00:09:44.167 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:44.167 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:44.167 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 2111, 2024-09-12T00:09:44.167 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 19583044, 2024-09-12T00:09:44.167 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2111, 2024-09-12T00:09:44.167 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 19583044, 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:44.168 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 2111, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 2111, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2111, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 2111, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.169 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-09-12T00:09:44.170 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-09-12T00:09:44.171 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:44.171 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.171 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.171 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.171 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:44.171 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x559417e76b40": { 2024-09-12T00:09:44.171 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-09-12T00:09:44.172 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:44.173 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:44.173 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:44.173 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:44.173 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.173 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:44.173 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:09:44.944 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-12T00:09:44.944 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-12T00:09:44.944 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-12T00:09:44.944 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-12T00:09:44.945 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-12T00:09:44.945 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:09:44.945 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:09:44.945 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T00:09:44.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T00:09:45.207 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:45.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:45 smithi060 ceph-mon[30953]: pgmap v322: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T00:09:45.709 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 217, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 207, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 1441712, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 127264, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.039930285, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.014637209, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.036233813, 2024-09-12T00:09:45.710 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 206, 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.011214857, 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000054441 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1441712, 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-12T00:09:45.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 6, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 160, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 3344, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 185488, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.014533433, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.008412612, 2024-09-12T00:09:45.712 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.004131424, 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 158, 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.014123452, 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000089388 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:45.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 185488 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 0, 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2, 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 0, 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 0, 2024-09-12T00:09:45.714 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.000273769, 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.000198242, 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:45.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.716 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:45.717 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:45.718 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:45.719 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 149017, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 31, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:45.720 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 928, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:45.721 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 219, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 1411129, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 219, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 219, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1411129, 2024-09-12T00:09:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:45.723 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:45.723 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:45.723 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:45.723 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:45.723 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:45.723 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:09:45.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:45 smithi105 ceph-mon[34805]: pgmap v322: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T00:09:45.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:45 smithi192 ceph-mon[35487]: pgmap v322: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-12T00:09:46.593 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T00:09:46.593 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T00:09:46.593 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-12T00:09:46.593 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-12T00:09:46.593 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-12T00:09:46.593 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-12T00:09:46.593 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-12T00:09:46.593 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T00:09:46.594 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T00:09:46.858 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:47.329 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:09:47.331 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:47.331 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 761, 2024-09-12T00:09:47.331 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 763, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 8641489, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 241999, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.085848952, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.034445721, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.022784144, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.019904464, 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:47.332 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 761, 2024-09-12T00:09:47.333 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.037641098, 2024-09-12T00:09:47.333 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000049462 2024-09-12T00:09:47.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.333 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:47.333 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.333 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.333 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1239, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1203, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 14458368, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 440537, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:47.334 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.121088077, 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.034430202, 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.070244594, 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.025042758, 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1203, 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.040990469, 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000034073 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.335 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1627616, 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 127568 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 428, 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 581, 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 2359581, 2024-09-12T00:09:47.336 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 571255, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.047430467, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.019090122, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.013226022, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.010156265, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 578, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.023862651, 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000041284 2024-09-12T00:09:47.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 435776 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-12T00:09:47.338 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3579, 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.087103065, 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000024337 2024-09-12T00:09:47.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.340 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2024-09-12T00:09:47.341 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 4872, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 0, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 4872, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 0, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 4872, 2024-09-12T00:09:47.342 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 1, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-09-12T00:09:47.343 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-09-12T00:09:47.344 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-09-12T00:09:47.345 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2024-09-12T00:09:47.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:09:47.347 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-09-12T00:09:47.348 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.349 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 10172, 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2024-09-12T00:09:47.350 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 14, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 27413007, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 27410919, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.351 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 10172 2024-09-12T00:09:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-09-12T00:09:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 911, 2024-09-12T00:09:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 4334, 2024-09-12T00:09:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 3423, 2024-09-12T00:09:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 93, 2024-09-12T00:09:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 310, 2024-09-12T00:09:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 217, 2024-09-12T00:09:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 4872, 2024-09-12T00:09:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 7279, 2024-09-12T00:09:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 2407, 2024-09-12T00:09:47.353 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2024-09-12T00:09:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2024-09-12T00:09:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2024-09-12T00:09:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 62888, 2024-09-12T00:09:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 215328 2024-09-12T00:09:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.354 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.355 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-09-12T00:09:47.356 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-09-12T00:09:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-09-12T00:09:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-09-12T00:09:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-09-12T00:09:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 2, 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 1, 2024-09-12T00:09:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 1, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 1618, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 242726, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 1045, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 8032, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 177, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 5757279, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 61927, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 2171, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 2171, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2171, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.508986134, 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000695065 2024-09-12T00:09:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2171, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 2172 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 2171, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 2171, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 1402, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2024-09-12T00:09:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 767, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:09:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-09-12T00:09:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 91, 2024-09-12T00:09:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 9, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 7, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 7, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:09:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 0, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2024-09-12T00:09:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 2424, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 25225494, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 2424, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2424, 2024-09-12T00:09:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 25225494, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-12T00:09:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 2171, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 23218708, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2171, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 23218708, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-09-12T00:09:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 2171, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 2171, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2171, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 2171, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-12T00:09:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x5578b6f76b40": { 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-12T00:09:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:47.389 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:09:47.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:47 smithi060 ceph-mon[30953]: pgmap v323: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-12T00:09:47.740 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:47 smithi105 ceph-mon[34805]: pgmap v323: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-12T00:09:47.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:47 smithi192 ceph-mon[35487]: pgmap v323: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-12T00:09:48.163 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-12T00:09:48.163 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-12T00:09:48.163 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-12T00:09:48.163 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-12T00:09:48.163 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-12T00:09:48.163 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:09:48.163 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:09:48.163 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T00:09:48.163 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T00:09:48.424 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 4, 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 4, 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 3024, 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 448, 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2024-09-12T00:09:48.933 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.003346575, 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000044839, 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.002389519, 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3, 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.004359398, 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001453132 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:48.934 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2, 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 160, 2024-09-12T00:09:48.935 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 320, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 185392, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.013590160, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.008759316, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.002296247, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 157, 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.015930375, 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000101467 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 185392 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 219, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 209, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 1442256, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 128528, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.039713964, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.014663947, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.036656592, 2024-09-12T00:09:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 208, 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.011735112, 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000056418 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:48.939 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1442256, 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 128528 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-12T00:09:48.940 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:48.941 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:48.942 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:48.943 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 149047, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 31, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:48.944 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:48.945 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 928, 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-12T00:09:48.946 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 221, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 1411389, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 221, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 221, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1411389, 2024-09-12T00:09:48.947 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-12T00:09:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-12T00:09:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-12T00:09:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-12T00:09:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:48.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T00:09:48.948 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T00:09:49.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:49 smithi060 ceph-mon[30953]: pgmap v324: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-12T00:09:49.622 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T00:09:49.622 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T00:09:49.623 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-12T00:09:49.623 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-12T00:09:49.623 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-12T00:09:49.623 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-12T00:09:49.623 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-12T00:09:49.623 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T00:09:49.623 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T00:09:49.652 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:49 smithi105 ceph-mon[34805]: pgmap v324: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-12T00:09:49.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:49 smithi192 ceph-mon[35487]: pgmap v324: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-12T00:09:49.884 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:09:50.509 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-12T00:09:50.509 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:50.509 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 26413, 2024-09-12T00:09:50.509 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 36472, 2024-09-12T00:09:50.509 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 11405576, 2024-09-12T00:09:50.509 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 35071035, 2024-09-12T00:09:50.509 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 18, 2024-09-12T00:09:50.509 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 5, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 1.357539478, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.585387261, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.890295867, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.077750675, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 36468, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.029218376, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000028222 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 51582, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.007301028, 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000141 2024-09-12T00:09:50.510 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 7319, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 6299, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 2759986, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 6609509, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 16, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 6, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.393694266, 2024-09-12T00:09:50.511 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.159413021, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.215829552, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.049130999, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 6299, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.209390313, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000033241 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 8917, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.001200694, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000134 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.512 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 7696, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 130704 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 9019, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 5221, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 5926302, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 12762847, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 38, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 6, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.439454212, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.194761557, 2024-09-12T00:09:50.513 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.284400197, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.027239448, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 5220, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.139701143, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000026762 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 11481, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.001367299, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000119 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 1657808, 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 449728 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2357, 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 6.401413631, 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.002715915 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.515 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 4195, 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.466137829, 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000111117 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 7435, 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 7260, 2024-09-12T00:09:50.516 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 7260, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 11.906056608, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001639952 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 175, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 0, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 29, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 2, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 985, 2024-09-12T00:09:50.517 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 0, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 6, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 979, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 982, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 3997, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 0, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 0, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 3, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 11379, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 9787, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 73, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 978, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2024-09-12T00:09:50.518 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 0, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 13, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 2448, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 16, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 2135, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 1992, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 0, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 4, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 234, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 6, 2024-09-12T00:09:50.519 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 1992, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 90, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 90, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 1902, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 83, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 2510, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 4401, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:09:50.520 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 5834, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 4042, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 244, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 3755 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 233, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 2640, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 1788, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 1720, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 419, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 22, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2024-09-12T00:09:50.521 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 2348, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 2326, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_path": 3, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_inode": 1826, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 13, 2024-09-12T00:09:50.522 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 2, 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 0, 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 12241, 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 0, 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 0, 2024-09-12T00:09:50.523 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 12241, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 0, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 17, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 0, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 0, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 17, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 2, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 0, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 4194304, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 37068952, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 0, 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2024-09-12T00:09:50.524 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1350, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 68.126296569, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.050463923 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 0 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 550, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 5854, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 5304, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 55, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 1009, 2024-09-12T00:09:50.525 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 954, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 985, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 7761, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 6776, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 0, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 5110, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 5110, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 86804, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 223520 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 8282, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 140, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 7435, 2024-09-12T00:09:50.526 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 28, 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 555, 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3061, 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.689244673, 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000551860 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3, 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.003177162, 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001059054 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1614, 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 3.903736915, 2024-09-12T00:09:50.528 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.002418672 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2024-09-12T00:09:50.529 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.530 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 16, 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.011792556, 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000737034 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.531 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.532 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 173, 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.121100476, 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000700002 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.533 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 47, 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.938808148, 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.019974641 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.534 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 45, 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.595425947, 2024-09-12T00:09:50.535 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.035453909 2024-09-12T00:09:50.536 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.536 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2024-09-12T00:09:50.536 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.536 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.536 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.536 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.536 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2024-09-12T00:09:50.536 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.537 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2301, 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 3.642770731, 2024-09-12T00:09:50.538 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001583125 2024-09-12T00:09:50.541 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.542 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:09:50.542 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:09:50.542 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2024-09-12T00:09:50.542 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 1, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 4, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 3, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 1, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 3627, 2024-09-12T00:09:50.543 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 3627, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 1842, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:50.544 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:50.545 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:50.546 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 492064, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 697, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 8032, 2024-09-12T00:09:50.547 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 177, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 2136709, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 31254, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2024-09-12T00:09:50.548 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 5927, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 33868193, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 28, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 5927, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 5927, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 20.661576602, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.003486009 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 5927, 2024-09-12T00:09:50.549 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 6032 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 5927, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 2042, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 3885, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 0, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 10, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 50, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 1400, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 34, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2024-09-12T00:09:50.550 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 2, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 2361, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 1992, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 20, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2024-09-12T00:09:50.551 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2024-09-12T00:09:50.552 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 91, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 11, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 12, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 12, 2024-09-12T00:09:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 127, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 0, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 36 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 1, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "osd-slow-ops": { 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 1829 2024-09-12T00:09:50.554 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 14, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 6, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed_ops": 2342, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 2326, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-12T00:09:50.555 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 42747, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 16226168, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 42747, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 42747, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 16226168, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.556 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 5927, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 34115599, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 5927, 2024-09-12T00:09:50.557 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 34115599, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:50.558 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 5927, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 5927, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 5927, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 5927, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:09:50.559 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 2326, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 247406, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 2326, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 50, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 247406, 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:50.560 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x5625957d4960": { 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 12241, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 32874648, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 12241, 2024-09-12T00:09:50.561 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 1350, 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 32874648, 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:50.562 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-12T00:09:51.418 INFO:tasks.check_counter:Daemon mds.b mds.exported=13 2024-09-12T00:09:51.418 INFO:tasks.check_counter:Daemon mds.b mds.imported=16 2024-09-12T00:09:51.419 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=233 2024-09-12T00:09:51.419 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=2640 2024-09-12T00:09:51.419 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-12T00:09:51.419 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:09:51.419 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:09:51.419 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T00:09:51.419 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T00:09:51.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:51 smithi060 ceph-mon[30953]: pgmap v325: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:51.653 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:51 smithi105 ceph-mon[34805]: pgmap v325: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:51.709 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:09:51.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:51 smithi192 ceph-mon[35487]: pgmap v325: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:52.373 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-12T00:09:52.373 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 1128, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 1128, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 25519616, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 357890, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 7, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.124337370, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.041356006, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.042721896, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.029101413, 2024-09-12T00:09:52.374 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 1127, 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.054283687, 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000048166 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.375 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 526, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 683, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 21108168, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 604794, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 8, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 6, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.066060853, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.020961048, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.024712918, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.015044786, 2024-09-12T00:09:52.376 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 680, 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.028956630, 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000042583 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 438096 2024-09-12T00:09:52.377 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 988, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 954, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 18875713, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 362939, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 5, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 4, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.120091672, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.032361756, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.067857985, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.029161033, 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:52.378 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 953, 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.039647303, 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000041602 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 1626112, 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 130480 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2024-09-12T00:09:52.379 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3933, 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.092185853, 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000023439 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2024-09-12T00:09:52.380 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 0, 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 0, 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.381 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 0, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 0, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 0, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 0, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 7534, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 90, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 7444, 2024-09-12T00:09:52.382 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 7405, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 2, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 0, 2024-09-12T00:09:52.383 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 0, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 4, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 234, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 6, 2024-09-12T00:09:52.384 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:09:52.385 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 0 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2024-09-12T00:09:52.386 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:09:52.387 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 24343, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2024-09-12T00:09:52.388 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 0, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 0, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 0, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 0, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 33, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 3, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 0, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 4194304, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 67393768, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 67393656, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.389 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 24343 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 2097, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 13515, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 11418, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 210, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 765, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 555, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 7534, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 16802, 2024-09-12T00:09:52.390 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 9268, 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 0, 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 0, 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 0, 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 70288, 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 215328 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 0, 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 0, 2024-09-12T00:09:52.391 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 0, 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 0, 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 0, 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.392 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.393 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.394 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.395 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.396 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.397 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2024-09-12T00:09:52.398 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.399 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.400 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.401 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.402 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.403 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 2, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 5, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 3, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 4, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 0, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 0, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 3058, 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2024-09-12T00:09:52.404 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:52.405 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:52.406 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 305996, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 2325, 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 8032, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 177, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:52.408 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 10609841, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 135543, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 2379, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 26, 2024-09-12T00:09:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 4, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 2379, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2379, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.568967856, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000659507 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2379, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 2380 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 2379, 2024-09-12T00:09:52.410 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 2379, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 1510, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 866, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 0, 2024-09-12T00:09:52.411 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 2, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2024-09-12T00:09:52.412 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2024-09-12T00:09:52.413 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 91, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 9, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 9, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 9, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 0, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 2, 2024-09-12T00:09:52.414 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 0 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 0, 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "osd-slow-ops": { 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 0 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2024-09-12T00:09:52.415 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 0, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed_ops": 0, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 0, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 2638, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 65249987, 2024-09-12T00:09:52.416 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 2638, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2638, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 65249987, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2024-09-12T00:09:52.417 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 2379, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 63208199, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2379, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 63208199, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.418 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 2379, 2024-09-12T00:09:52.419 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 2379, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2379, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 2379, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:52.420 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.421 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x557321e7ab40": { 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 0, 2024-09-12T00:09:52.422 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:52.423 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:52.423 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:52.423 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:52.423 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.423 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:52.423 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-12T00:09:53.299 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-12T00:09:53.300 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-12T00:09:53.300 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-12T00:09:53.300 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-12T00:09:53.300 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-12T00:09:53.300 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:09:53.300 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:09:53.300 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T00:09:53.300 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T00:09:53.549 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:09:53.586 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:53 smithi192 ceph-mon[35487]: pgmap v326: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:53.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:53 smithi060 ceph-mon[30953]: pgmap v326: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:53.670 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:53 smithi105 ceph-mon[34805]: pgmap v326: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:54.108 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-12T00:09:54.108 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:54.108 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 6751, 2024-09-12T00:09:54.108 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 10638, 2024-09-12T00:09:54.109 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 3692643, 2024-09-12T00:09:54.109 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 17522552, 2024-09-12T00:09:54.109 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 23, 2024-09-12T00:09:54.109 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 5, 2024-09-12T00:09:54.109 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.553442098, 2024-09-12T00:09:54.109 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.268636371, 2024-09-12T00:09:54.110 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.217553308, 2024-09-12T00:09:54.110 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.068398380, 2024-09-12T00:09:54.110 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:54.110 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 10636, 2024-09-12T00:09:54.110 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.267914681, 2024-09-12T00:09:54.110 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000025189 2024-09-12T00:09:54.110 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 11292, 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.001947412, 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000172 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.111 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 12490, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 23015, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 4047311, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 10744118, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 14, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 8, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.704671416, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.296699871, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.614869908, 2024-09-12T00:09:54.112 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.046954985, 2024-09-12T00:09:54.113 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:54.113 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 23010, 2024-09-12T00:09:54.113 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.448056288, 2024-09-12T00:09:54.113 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000019472 2024-09-12T00:09:54.113 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 27316, 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.004315072, 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000157 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 1904, 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 441104 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.114 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 13827, 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 15157, 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 8541913, 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 16137039, 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 34, 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 6, 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.738858825, 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.294603179, 2024-09-12T00:09:54.115 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.486115327, 2024-09-12T00:09:54.116 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.040306675, 2024-09-12T00:09:54.116 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:54.116 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 15159, 2024-09-12T00:09:54.116 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.345611836, 2024-09-12T00:09:54.116 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000022799 2024-09-12T00:09:54.116 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.117 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:54.117 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 24874, 2024-09-12T00:09:54.117 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.003609034, 2024-09-12T00:09:54.117 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000145 2024-09-12T00:09:54.117 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.117 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 1646240, 2024-09-12T00:09:54.117 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 137792 2024-09-12T00:09:54.118 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.118 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2024-09-12T00:09:54.118 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2024-09-12T00:09:54.118 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2024-09-12T00:09:54.118 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.118 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2024-09-12T00:09:54.118 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-12T00:09:54.118 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-12T00:09:54.119 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2320, 2024-09-12T00:09:54.119 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 3.823869133, 2024-09-12T00:09:54.119 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001648219 2024-09-12T00:09:54.119 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.119 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.119 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2024-09-12T00:09:54.119 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-12T00:09:54.119 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-12T00:09:54.120 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 4867, 2024-09-12T00:09:54.120 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.621281630, 2024-09-12T00:09:54.120 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000127651 2024-09-12T00:09:54.120 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.120 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.120 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2024-09-12T00:09:54.120 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 3374, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 3367, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3367, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 33.896018558, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.010067127 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 7, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 5, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2024-09-12T00:09:54.121 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 20, 2024-09-12T00:09:54.122 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 1, 2024-09-12T00:09:54.122 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2024-09-12T00:09:54.122 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 1468, 2024-09-12T00:09:54.122 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 53, 2024-09-12T00:09:54.122 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 27, 2024-09-12T00:09:54.122 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 1388, 2024-09-12T00:09:54.122 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 1391, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 1575, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 0, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 0, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 6, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 5665, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 4353, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 6, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 500, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:09:54.123 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 0, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 8, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 775, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 8, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 3957, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 3006, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 0, 2024-09-12T00:09:54.124 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 4, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 234, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 6, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 3006, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 243, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:09:54.125 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 243, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 2763, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 34, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 511, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 3348, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 2765, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 2146, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 54, 2024-09-12T00:09:54.126 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 3396 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 778, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 1717, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 1108, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 1163, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 1504, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 77, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:09:54.127 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 2885, 2024-09-12T00:09:54.128 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 2808, 2024-09-12T00:09:54.128 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 0, 2024-09-12T00:09:54.128 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 0, 2024-09-12T00:09:54.128 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2024-09-12T00:09:54.128 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:09:54.128 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:09:54.128 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_path": 3, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_inode": 357, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 8, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 1, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0 2024-09-12T00:09:54.129 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 2, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 10172, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 0, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 0, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 10172, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 0, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 14, 2024-09-12T00:09:54.130 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 0, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 0, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 14, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 2, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 0, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 4194304, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 27413007, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 0, 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2024-09-12T00:09:54.131 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 365, 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.993640540, 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.002722302 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 0 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 875, 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 4742, 2024-09-12T00:09:54.132 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 3867, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 114, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 894, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 780, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 1468, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 8005, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 6537, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 0, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 3153, 2024-09-12T00:09:54.133 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 3153, 2024-09-12T00:09:54.134 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 83260, 2024-09-12T00:09:54.134 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 223520 2024-09-12T00:09:54.134 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.134 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2024-09-12T00:09:54.134 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 5883, 2024-09-12T00:09:54.134 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 100, 2024-09-12T00:09:54.134 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 3374, 2024-09-12T00:09:54.134 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 14, 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 472, 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2, 2024-09-12T00:09:54.135 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000960844, 2024-09-12T00:09:54.136 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000480422 2024-09-12T00:09:54.136 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.136 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2024-09-12T00:09:54.136 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.136 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.136 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.136 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.137 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2024-09-12T00:09:54.137 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.137 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.137 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.137 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.137 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2024-09-12T00:09:54.137 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 279, 2024-09-12T00:09:54.137 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.083252982, 2024-09-12T00:09:54.138 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000298397 2024-09-12T00:09:54.138 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.138 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2024-09-12T00:09:54.138 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.138 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.138 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.138 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.139 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2024-09-12T00:09:54.139 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.139 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.139 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.139 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.139 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2024-09-12T00:09:54.139 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.140 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.140 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.140 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.140 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2024-09-12T00:09:54.140 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.140 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.141 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.141 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.141 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2024-09-12T00:09:54.141 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.141 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.141 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.142 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.143 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.143 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.143 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2024-09-12T00:09:54.143 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.143 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.143 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.143 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.144 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2024-09-12T00:09:54.144 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.144 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.144 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.144 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.144 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2024-09-12T00:09:54.144 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.144 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 201, 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.144457238, 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000718692 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2024-09-12T00:09:54.145 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.146 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 243, 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 3.734291687, 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.015367455 2024-09-12T00:09:54.147 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.148 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.149 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2024-09-12T00:09:54.149 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.149 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.149 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.149 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.149 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2024-09-12T00:09:54.149 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.149 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.150 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.150 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.150 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2024-09-12T00:09:54.150 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.150 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.150 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.150 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.150 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2024-09-12T00:09:54.151 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.151 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.151 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.151 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.151 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2024-09-12T00:09:54.151 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.151 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.151 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.152 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.152 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2024-09-12T00:09:54.152 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.152 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.152 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.152 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.152 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2642, 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 29.933055807, 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.011329695 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.153 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.154 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.154 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2024-09-12T00:09:54.154 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 1, 2024-09-12T00:09:54.154 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 2, 2024-09-12T00:09:54.154 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 1, 2024-09-12T00:09:54.154 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 1, 2024-09-12T00:09:54.154 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2024-09-12T00:09:54.154 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 2843, 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 2843, 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 631, 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:54.155 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:54.156 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:54.157 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 737443, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 1100, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2024-09-12T00:09:54.158 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 8032, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 177, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 3375847, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 49197, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2024-09-12T00:09:54.159 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 6445, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 23952545, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 33, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 6445, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 6445, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 11.230770041, 2024-09-12T00:09:54.160 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.001742555 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 6445, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 6526 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 6445, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 3082, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 3363, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 0, 2024-09-12T00:09:54.161 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 10, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 71, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 436, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 40, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 0, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 1, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 2825, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 3006, 2024-09-12T00:09:54.162 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 20, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2024-09-12T00:09:54.163 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2024-09-12T00:09:54.164 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 91, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 10, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 12, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 12, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 84, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 10, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 23 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.165 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 1, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "osd-slow-ops": { 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 361 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 6, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 6, 2024-09-12T00:09:54.166 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed_ops": 2808, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 2808, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 33064, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 13288086, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 33064, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:54.167 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 33064, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 13288086, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:54.168 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 6445, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 24238809, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 6445, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 24238809, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.169 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 6445, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 6445, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 6445, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 6445, 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:54.170 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 2808, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 286344, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 2808, 2024-09-12T00:09:54.171 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 71, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 286344, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x55f62284c960": { 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:54.172 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 10172, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 23218703, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 10172, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 365, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 23218703, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.173 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:54.174 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-12T00:09:54.893 INFO:tasks.check_counter:Daemon mds.h mds.exported=8 2024-09-12T00:09:54.893 INFO:tasks.check_counter:Daemon mds.h mds.imported=8 2024-09-12T00:09:54.893 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=778 2024-09-12T00:09:54.893 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=1717 2024-09-12T00:09:54.894 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-12T00:09:54.894 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:09:54.894 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:09:54.894 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T00:09:54.894 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T00:09:55.139 INFO:teuthology.orchestra.run.smithi105.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T00:09:55.515 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:55 smithi105 ceph-mon[34805]: pgmap v327: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:09:55.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:55 smithi060 ceph-mon[30953]: pgmap v327: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:09:55.743 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 717, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 719, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 4375245, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 228070, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 7, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.075399367, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.021827335, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.021012057, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.025398888, 2024-09-12T00:09:55.744 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 717, 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.029354035, 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000040940 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:09:55.745 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 925, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 891, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 9446840, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 344033, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 4, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.108632681, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.034391384, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.064381856, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.019611572, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 890, 2024-09-12T00:09:55.746 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.035898415, 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000040335 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 1626768, 2024-09-12T00:09:55.747 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 132240 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_messages": 779, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages": 937, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_bytes": 4454192, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_bytes": 686502, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_created_connections": 7, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_active_connections": 5, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_total_time": 0.102100202, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_send_time": 0.035204381, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_recv_time": 0.027867584, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_running_fast_dispatch_time": 0.028155898, 2024-09-12T00:09:55.748 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 935, 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.062220001, 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000066545 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "msgr_send_encrypted_bytes": 440688 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.749 INFO:teuthology.orchestra.run.smithi105.stdout: "cct": { 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "total_workers": 1, 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "unhealthy_workers": 0 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-MDSRank": { 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 3607, 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.108156123, 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000029985 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "finisher-PurgeQueue": { 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "queue_len": 0, 2024-09-12T00:09:55.750 INFO:teuthology.orchestra.run.smithi105.stdout: "complete_latency": { 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": { 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "request": 0, 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "reply": 0, 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "reply_latency": { 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.751 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_reply": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "forward": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_complete": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_fetch_keys": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_commit": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_split": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_merge": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes": 3084, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_top": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_bottom": 3084, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pin_tail": 0, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_pinned": 3084, 2024-09-12T00:09:55.752 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_expired": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "inodes_with_caps": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "subtrees": 1, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_hit": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_forward": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_discover": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_remote_ino": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "traverse_lock": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "load_cent": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "q": 0, 2024-09-12T00:09:55.753 INFO:teuthology.orchestra.run.smithi105.stdout: "exported": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "exported_inodes": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "imported": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "imported_inodes": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_dir_fetch": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "openino_peer_discover": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rfiles": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rbytes": 0, 2024-09-12T00:09:55.754 INFO:teuthology.orchestra.run.smithi105.stdout: "root_rsnaps": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_set_tag": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "scrub_file_inodes": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:09:55.755 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_cap_release": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "process_request_cap_release": 0 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_cache": { 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_update_receipt": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_try_discover": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_send_discover": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "dir_handle_discover": 0, 2024-09-12T00:09:55.756 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_delayed": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_created": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_enqueued": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_reintegrated": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "strays_migrated": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_processing": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:09:55.757 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_started": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "recovery_completed": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_exportdir": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_flush": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_fragstats": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "ireq_inodestats": 0 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_log": { 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "evlrg": 0, 2024-09-12T00:09:55.758 INFO:teuthology.orchestra.run.smithi105.stdout: "evadd": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "evex": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "evtrm": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "ev": 6281, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "evexg": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "evexd": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "segadd": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "segex": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "segtrm": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "seg": 9, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "segmjr": 2, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "segexg": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "segexd": 0, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "expos": 4194304, 2024-09-12T00:09:55.759 INFO:teuthology.orchestra.run.smithi105.stdout: "wrpos": 20230119, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "rdpos": 20228031, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "jlat": { 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "replayed": 6281 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_mem": { 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "ino": 967, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "ino+": 2601, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "ino-": 1634, 2024-09-12T00:09:55.760 INFO:teuthology.orchestra.run.smithi105.stdout: "dir": 56, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "dir+": 150, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "dir-": 94, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "dn": 3084, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "dn+": 3800, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "dn-": 716, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "cap": 0, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "cap+": 0, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "cap-": 0, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "rss": 57176, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "heap": 215328 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_server": { 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_client_request": 0, 2024-09-12T00:09:55.761 INFO:teuthology.orchestra.run.smithi105.stdout: "dispatch_server_request": 0, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_request": 0, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_client_session": 0, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "handle_peer_request": 0, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "req_create_latency": { 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getattr_latency": { 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.762 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getfilelock_latency": { 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "req_link_latency": { 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookup_latency": { 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.763 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookuphash_latency": { 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupino_latency": { 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupname_latency": { 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.764 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupparent_latency": { 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lookupsnap_latency": { 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.765 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "req_lssnap_latency": { 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mkdir_latency": { 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.766 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mknod_latency": { 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "req_mksnap_latency": { 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "req_open_latency": { 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.767 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "req_readdir_latency": { 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rename_latency": { 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "req_renamesnap_latency": { 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.768 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "req_snapdiff_latency": { 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmdir_latency": { 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.769 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmsnap_latency": { 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "req_rmxattr_latency": { 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setattr_latency": { 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.770 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setdirlayout_latency": { 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setfilelock_latency": { 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setlayout_latency": { 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "req_setxattr_latency": { 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "req_symlink_latency": { 2024-09-12T00:09:55.772 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: "req_unlink_latency": { 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:09:55.773 INFO:teuthology.orchestra.run.smithi105.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:09:55.774 INFO:teuthology.orchestra.run.smithi105.stdout: "req_getvxattr_latency": { 2024-09-12T00:09:55.774 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.774 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.774 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.774 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.774 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.774 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_sessions": { 2024-09-12T00:09:55.774 INFO:teuthology.orchestra.run.smithi105.stdout: "session_count": 2, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "session_add": 3, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "session_remove": 1, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_open": 2, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "sessions_stale": 0, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "total_load": 0, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "average_load": 0, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "avg_session_uptime": 1847, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "mdthresh_evicted": 0 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "mempool": { 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:55.775 INFO:teuthology.orchestra.run.smithi105.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:55.776 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:55.777 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_items": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_bytes": 243253, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_anon_items": 1058, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:55.778 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_bytes": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_items": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_bytes": 8032, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_items": 177, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "pgmap_items": 0, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_bytes": 4535812, 2024-09-12T00:09:55.779 INFO:teuthology.orchestra.run.smithi105.stdout: "mds_co_items": 56503, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_1_items": 0, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "unittest_2_items": 0 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "objecter": { 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "op_active": 0, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "op_laggy": 0, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send": 2156, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "op_send_bytes": 21, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "op_resend": 3, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "op_reply": 2156, 2024-09-12T00:09:55.780 INFO:teuthology.orchestra.run.smithi105.stdout: "op_latency": { 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2156, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 1.146976531, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000531992 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "op_inflight": 0, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "oplen_avg": { 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 2156, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 2157 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "op": 2156, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "op_r": 2156, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "op_w": 0, 2024-09-12T00:09:55.781 INFO:teuthology.orchestra.run.smithi105.stdout: "op_rmw": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "op_pg": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_stat": 1378, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_create": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_read": 776, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_write": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writefull": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_writesame": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_append": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_zero": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_truncate": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_delete": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_mapext": 0, 2024-09-12T00:09:55.782 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_sparse_read": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_clonerange": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_getxattr": 1, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_setxattr": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_rmxattr": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_call": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_watch": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_notify": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "osdop_other": 0, 2024-09-12T00:09:55.783 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_active": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_send": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_resend": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "linger_ping": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_active": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_send": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "poolop_resend": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_active": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_send": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "poolstat_resend": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_active": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_send": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "statfs_resend": 0, 2024-09-12T00:09:55.784 INFO:teuthology.orchestra.run.smithi105.stdout: "command_active": 0, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "command_send": 0, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "command_resend": 0, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "map_epoch": 91, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "map_full": 0, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "map_inc": 9, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_sessions": 7, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_open": 7, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_session_close": 0, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "osd_laggy": 0, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_wr": 0, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_rd": 2, 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_del": 0 2024-09-12T00:09:55.785 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "oft": { 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_objs": 0, 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_updates": 0, 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "omap_total_removes": 0 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "osd-slow-ops": { 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "slow_ops_count": 0 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "purge_queue": { 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops": 0, 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:09:55.786 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing": 0, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executing_high_water": 0, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed_ops": 0, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_executed": 0, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "pq_item_in_journal": 0 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 2417, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 18042547, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:55.787 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 2417, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2417, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 18042547, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_bytes": { 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:55.788 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 104857600, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 2156, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 16036795, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2156, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 16036795, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.789 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-objecter_ops": { 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 1024, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 2156, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 2156, 2024-09-12T00:09:55.790 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 2156, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 2156, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:55.791 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 0, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 0, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "throttle-write_buf_throttle-0x563af8708b40": { 2024-09-12T00:09:55.792 INFO:teuthology.orchestra.run.smithi105.stdout: "val": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "max": 3758096384, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "get_started": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "get": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "get_sum": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "take": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "take_sum": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "put": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "put_sum": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "wait": { 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "avgcount": 0, 2024-09-12T00:09:55.793 INFO:teuthology.orchestra.run.smithi105.stdout: "sum": 0.000000000, 2024-09-12T00:09:55.794 INFO:teuthology.orchestra.run.smithi105.stdout: "avgtime": 0.000000000 2024-09-12T00:09:55.794 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.794 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-12T00:09:55.794 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-12T00:09:55.794 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:55 smithi192 ceph-mon[35487]: pgmap v327: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:09:56.543 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T00:09:56.543 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T00:09:56.543 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-12T00:09:56.543 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-12T00:09:56.543 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-12T00:09:56.543 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:09:56.543 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:09:56.543 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T00:09:56.544 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T00:09:56.806 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 2896, 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 3321, 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 2639429, 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 5947438, 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 44, 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.225623075, 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.083634220, 2024-09-12T00:09:57.291 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.140465488, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.022422241, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3320, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.293547762, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000088418 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3932, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000665053, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000169 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1660304, 2024-09-12T00:09:57.292 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 188384 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 10359, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 14983, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 3605740, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 14145325, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 18, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.623535418, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.283653578, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.395812253, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.036073376, 2024-09-12T00:09:57.293 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 14980, 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.449127947, 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000096737 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 20066, 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.003362943, 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000167 2024-09-12T00:09:57.294 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.295 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:09:57.295 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 441616 2024-09-12T00:09:57.295 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.295 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:57.295 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 15989, 2024-09-12T00:09:57.295 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 18038, 2024-09-12T00:09:57.295 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 7205373, 2024-09-12T00:09:57.295 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 11004701, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 10, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 1.039091362, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.508378981, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.583026244, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.037389362, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 18037, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.388178580, 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000076962 2024-09-12T00:09:57.296 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 29741, 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.005107487, 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000171 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-12T00:09:57.297 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1424, 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.496324682, 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002455284 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2569, 2024-09-12T00:09:57.298 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.236287449, 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000091976 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 3174, 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 2776, 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2776, 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 17.768039231, 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.006400590 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-12T00:09:57.299 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 398, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 1653, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 6, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 1647, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 1650, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 1531, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 1, 2024-09-12T00:09:57.300 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 1, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 3, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 6402, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 4177, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 396, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 871, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 12, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 474, 2024-09-12T00:09:57.301 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 12, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 1536, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 1036, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 6, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 1036, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 57, 2024-09-12T00:09:57.302 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 57, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 979, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 27, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 1012, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 2645, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 2547, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 1579, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 293, 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 2072 2024-09-12T00:09:57.303 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 131, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 2419, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 1637, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 1493, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 271, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 34, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 1474, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 1440, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-12T00:09:57.304 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 3, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 792, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 12, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-12T00:09:57.305 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 6281, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 6281, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 9, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-12T00:09:57.306 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 9, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 20230119, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 672, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 21.208504374, 2024-09-12T00:09:57.307 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.031560274 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 980, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 3154, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 2174, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 67, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 919, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 852, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 1653, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 4802, 2024-09-12T00:09:57.308 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 3149, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 1, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 1981, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 1980, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 73240, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 223520 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 5662, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 92, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 3174, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 20, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 445, 2024-09-12T00:09:57.309 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 695, 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.489008954, 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000703610 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3, 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000639129, 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000213043 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.311 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.311 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-12T00:09:57.311 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.313 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.313 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.313 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.313 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-12T00:09:57.313 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 530, 2024-09-12T00:09:57.313 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.150214473, 2024-09-12T00:09:57.313 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000283423 2024-09-12T00:09:57.313 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.314 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.315 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.316 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-12T00:09:57.317 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 69, 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.057168339, 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000828526 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.318 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 59, 2024-09-12T00:09:57.319 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.153701123, 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.019554256 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.320 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 5, 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.255655456, 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.051131091 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.321 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-12T00:09:57.323 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.323 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.323 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.323 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.323 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-12T00:09:57.323 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1415, 2024-09-12T00:09:57.323 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 15.661651757, 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.011068305 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.324 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 2, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 3, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 2, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 1458, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 729, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 592, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:57.325 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:57.326 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:57.327 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 627786, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 1146, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:57.328 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 8032, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 177, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 3641481, 2024-09-12T00:09:57.329 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 58468, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 3351, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 16375360, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 33, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 3351, 2024-09-12T00:09:57.330 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3351, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 7.592844495, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002265844 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3351, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3427 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 3351, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 1083, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 2268, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-12T00:09:57.331 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 47, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 719, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 31, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 1455, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-12T00:09:57.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 1036, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-12T00:09:57.333 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-12T00:09:57.334 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 91, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 11, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 12, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 12, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 85, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 24 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.335 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 796 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 6, 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-12T00:09:57.336 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 6, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 1440, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 1440, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 29240, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 10800032, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 29240, 2024-09-12T00:09:57.337 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 29240, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 10800032, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:57.338 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 3351, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 16526312, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 3351, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 16526312, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.339 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 3351, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 3351, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 3351, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 3351, 2024-09-12T00:09:57.340 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 1440, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 150952, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:57.341 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 1440, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 47, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 150952, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x55cd244f2960": { 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:57.342 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 6281, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 16035815, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 6281, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 672, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 16035815, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:57.343 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.344 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:57.344 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-12T00:09:57.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:57 smithi192 ceph-mon[35487]: pgmap v328: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:57.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:57 smithi060 ceph-mon[30953]: pgmap v328: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:57.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:57 smithi105 ceph-mon[34805]: pgmap v328: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:09:58.235 INFO:tasks.check_counter:Daemon mds.c mds.exported=12 2024-09-12T00:09:58.235 INFO:tasks.check_counter:Daemon mds.c mds.imported=12 2024-09-12T00:09:58.235 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=131 2024-09-12T00:09:58.235 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2419 2024-09-12T00:09:58.235 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-12T00:09:58.235 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:09:58.235 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:09:58.235 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T00:09:58.236 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T00:09:58.485 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:09:59.063 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-12T00:09:59.063 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:09:59.063 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 7801, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 7079, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 3034606, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 11575339, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 16, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.480600961, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.193809757, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.223124279, 2024-09-12T00:09:59.064 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.075783956, 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 7077, 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.490885926, 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000069363 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 9234, 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.001544048, 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000167 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T00:09:59.065 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 317936 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 12788, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 22083, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 5747068, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 16931068, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 9, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 7, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.887008290, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.393839269, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.517105961, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.059644222, 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:59.066 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 22083, 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.728993078, 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000078295 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 25318, 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.004949418, 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000195 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.067 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1653568, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 153712 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 14797, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 15331, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 8529973, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 11176786, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 46, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 7, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.976212350, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.449343592, 2024-09-12T00:09:59.068 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.569315711, 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.067002944, 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 15328, 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.595826809, 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000038871 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 24792, 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.004209041, 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000169 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 124768 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3090, 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 5.784836415, 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001872115 2024-09-12T00:09:59.070 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3597, 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.696013904, 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000193498 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 4334, 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 3884, 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-12T00:09:59.071 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3884, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 6.009704944, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001547297 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 450, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 8, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 29, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 2, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 593, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-09-12T00:09:59.072 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 6, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 587, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 590, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 3783, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 1, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 1, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 3, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 9209, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 6186, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 450, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 831, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-12T00:09:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 1, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 104, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 2805, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 97, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 3744, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 2433, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 6, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 2433, 2024-09-12T00:09:59.074 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 109, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 109, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 2324, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 3533, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 2532, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:09:59.075 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 4089, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 2121, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 50, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 3745 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 607, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 2181, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 1502, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 1279, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 854, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 61, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-12T00:09:59.076 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 2146, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 2085, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 3, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 1868, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 104, 2024-09-12T00:09:59.077 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 2, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 9101, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 9101, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-12T00:09:59.078 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 14, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 14, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 23775328, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2242, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 57.183900460, 2024-09-12T00:09:59.079 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.025505753 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 338, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 4322, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 3984, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 80, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 818, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 738, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 593, 2024-09-12T00:09:59.080 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 6937, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 6344, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 1, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 3855, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 3854, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 79656, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 223520 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 6708, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 92, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 4334, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 13, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 1693, 2024-09-12T00:09:59.081 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.082 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1536, 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.373425904, 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000894157 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.083 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000128272, 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000128272 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.084 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.085 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-12T00:09:59.086 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 201, 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.148445393, 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000738534 2024-09-12T00:09:59.087 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-12T00:09:59.088 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 101, 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.436985180, 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.014227576 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.089 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-12T00:09:59.090 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.091 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2045, 2024-09-12T00:09:59.092 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.050720195, 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001491794 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-12T00:09:59.093 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 2195, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 2195, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 612, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-12T00:09:59.095 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:09:59.096 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 814191, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 604, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:09:59.097 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 8032, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 177, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 1406143, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 23974, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-12T00:09:59.098 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 7036, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 20320477, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 28, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 7036, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 7036, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 33.783307719, 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004801493 2024-09-12T00:09:59.099 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 7036, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 7147 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 7036, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 2498, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 4538, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-09-12T00:09:59.100 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 57, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 2299, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 38, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 2, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 2109, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 2433, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-09-12T00:09:59.101 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-12T00:09:59.102 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-12T00:09:59.103 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 91, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 11, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 12, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 12, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 136, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 16, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 27 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-09-12T00:09:59.104 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 1862 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 14, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 6, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 2093, 2024-09-12T00:09:59.105 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 2085, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 35382, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 14109159, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 35382, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:09:59.106 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 35382, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 14109159, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:09:59.107 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 7036, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 20530942, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 7036, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 20530942, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-12T00:09:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 7036, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 7036, 2024-09-12T00:09:59.109 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 7036, 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 7036, 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-12T00:09:59.110 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 2085, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 210593, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 2085, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 57, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 210593, 2024-09-12T00:09:59.112 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x562e7a466960": { 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 9101, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 19581024, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 9101, 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2242, 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 19581024, 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:09:59.114 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-12T00:09:59.654 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:09:59 smithi192 ceph-mon[35487]: pgmap v329: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:09:59.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:09:59 smithi105 ceph-mon[34805]: pgmap v329: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:09:59.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:09:59 smithi060 ceph-mon[30953]: pgmap v329: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T00:09:59.896 INFO:tasks.check_counter:Daemon mds.f mds.exported=104 2024-09-12T00:09:59.897 INFO:tasks.check_counter:Daemon mds.f mds.imported=97 2024-09-12T00:09:59.897 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=607 2024-09-12T00:09:59.897 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=2181 2024-09-12T00:09:59.897 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-12T00:09:59.897 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:09:59.897 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:09:59.897 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T00:09:59.897 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T00:10:00.146 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:10:00.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:00 smithi192 ceph-mon[35487]: overall HEALTH_OK 2024-09-12T00:10:00.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:00 smithi105 ceph-mon[34805]: overall HEALTH_OK 2024-09-12T00:10:00.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:00 smithi060 ceph-mon[30953]: overall HEALTH_OK 2024-09-12T00:10:00.877 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-12T00:10:00.877 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:10:00.877 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 10972, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 11150, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 5502099, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 22434509, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 17, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.729507182, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.305788879, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.430060625, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.052831232, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 11143, 2024-09-12T00:10:00.878 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.538632018, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000048338 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 17885, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.003210244, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000179 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1773728, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 510496 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 43880, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 71994, 2024-09-12T00:10:00.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 16019353, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 59404225, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 19, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 7, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 2.576124610, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 1.177703507, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 1.980726422, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.161350288, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 71995, 2024-09-12T00:10:00.880 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.751462892, 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000052107 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 100659, 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.016130970, 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000160 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 319168, 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 227136 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:10:00.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 19490, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 21476, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 7913382, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 27308002, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 139, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 9, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 1.223830288, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.539972227, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.775667468, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.066012430, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 21477, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.954018767, 2024-09-12T00:10:00.882 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000044420 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 35680, 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.006269497, 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000175 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 42544, 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 1136 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.883 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3592, 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 15.935075878, 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004436268 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 5174, 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.075842711, 2024-09-12T00:10:00.884 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000207932 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 14205, 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 13739, 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 13739, 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 29.821988617, 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002170608 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 466, 2024-09-12T00:10:00.885 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 26, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 129, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 13, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 2, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 4905, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 440, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 4192, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 273, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 4249, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 10595, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 2, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 3, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 6, 2024-09-12T00:10:00.886 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 16233, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 14800, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 354, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 633, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 120, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 8845, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 124, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 3975, 2024-09-12T00:10:00.887 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 1626, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 6, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 1626, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 385, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 16, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 369, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 1241, 2024-09-12T00:10:00.888 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 203, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 4114, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 14542, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 9154, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 5538, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 1951, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 4253 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 1616, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 1512, 2024-09-12T00:10:00.889 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 1069, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 855, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 3462, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 143, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 2908, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 2765, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:10:00.890 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 3, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 804, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 16, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 120, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 15, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 24350, 2024-09-12T00:10:00.891 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 24350, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 33, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 33, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 3, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 67396966, 2024-09-12T00:10:00.892 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1792, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 31.575853952, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.017620454 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 2128, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 14378, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 12250, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 241, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 1233, 2024-09-12T00:10:00.893 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 992, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 4905, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 18392, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 13487, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 3, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 10438, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 10435, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 104212, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 231712 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 16692, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 2226, 2024-09-12T00:10:00.894 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 14205, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 143, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 5124, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 9121, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 15.270082888, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001674167 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 126, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.060350785, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000478974 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-12T00:10:00.895 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 489, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.181490012, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000371145 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.896 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-12T00:10:00.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.897 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.897 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.897 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-12T00:10:00.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-09-12T00:10:00.897 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000153862, 2024-09-12T00:10:00.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000153862 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.898 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 11, 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.002081511, 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000189228 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 607, 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.607219744, 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001000362 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-12T00:10:00.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 11, 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.520719800, 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.320065436 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000654227, 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000327113 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 446, 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.061562320, 2024-09-12T00:10:00.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002380184 2024-09-12T00:10:00.902 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.902 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-12T00:10:00.902 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-09-12T00:10:00.902 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.002131592, 2024-09-12T00:10:00.902 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001065796 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 167, 2024-09-12T00:10:00.903 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.266627987, 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.019560646 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 5, 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.021491187, 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004298237 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.904 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3, 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.157112195, 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.052370731 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.905 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 7, 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.018984505, 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002712072 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-12T00:10:00.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2741, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 5.651326002, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002061775 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.907 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 2, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 5, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 3, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 2, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 74, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 37, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 618, 2024-09-12T00:10:00.908 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:10:00.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:10:00.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:10:00.911 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 1502914, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 2486, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 8032, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 177, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:10:00.912 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 8998123, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 136100, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 7226, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 66788780, 2024-09-12T00:10:00.913 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 32, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 7226, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 7226, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 34.105303318, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004719803 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 7226, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 7505 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 7226, 2024-09-12T00:10:00.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 1743, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 5483, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 11, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 75, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 1851, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 54, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 13, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 3340, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-12T00:10:00.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 1642, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 22, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:10:00.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-12T00:10:00.917 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 91, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 11, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 12, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 12, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 387, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 52, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 58 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.918 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 808 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 20, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 6, 2024-09-12T00:10:00.919 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 2797, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 2765, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 74338, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 22676306, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 74338, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:10:00.920 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:10:00.921 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 74338, 2024-09-12T00:10:00.921 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 22676306, 2024-09-12T00:10:00.921 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:00.921 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.921 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.921 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.921 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.921 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.922 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-12T00:10:00.922 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:00.922 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-12T00:10:00.922 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:00.922 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:10:00.923 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:10:00.923 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:00.923 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:10:00.923 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 7226, 2024-09-12T00:10:00.923 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 67082421, 2024-09-12T00:10:00.923 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 7226, 2024-09-12T00:10:00.923 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 67082421, 2024-09-12T00:10:00.923 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:10:00.924 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 7226, 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 7226, 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 7226, 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 7226, 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.925 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.926 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.926 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.926 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.926 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:10:00.926 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:00.926 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-12T00:10:00.926 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:00.926 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 2765, 2024-09-12T00:10:00.927 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 294057, 2024-09-12T00:10:00.927 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:00.927 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 2765, 2024-09-12T00:10:00.927 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:10:00.927 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:10:00.928 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 59, 2024-09-12T00:10:00.928 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 294057, 2024-09-12T00:10:00.928 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:00.928 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.928 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.928 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.928 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.929 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:00.929 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x562733c76960": { 2024-09-12T00:10:00.929 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 84, 2024-09-12T00:10:00.929 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-12T00:10:00.929 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:00.929 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 24350, 2024-09-12T00:10:00.929 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 63202662, 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 24350, 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1792, 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 63202578, 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:00.930 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:00.931 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:00.931 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.931 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:00.931 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-12T00:10:01.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:01 smithi105 ceph-mon[34805]: pgmap v330: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:10:01.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:01 smithi192 ceph-mon[35487]: pgmap v330: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:10:01.669 INFO:tasks.check_counter:Daemon mds.i mds.exported=120 2024-09-12T00:10:01.669 INFO:tasks.check_counter:Daemon mds.i mds.imported=124 2024-09-12T00:10:01.670 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1616 2024-09-12T00:10:01.670 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1512 2024-09-12T00:10:01.670 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-12T00:10:01.670 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-09-12T00:10:01.670 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-09-12T00:10:01.670 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T00:10:01.670 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T00:10:01.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:01 smithi060 ceph-mon[30953]: pgmap v330: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:10:01.917 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T00:10:02.408 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-12T00:10:02.408 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T00:10:02.408 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 2122, 2024-09-12T00:10:02.408 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 2124, 2024-09-12T00:10:02.409 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 20892625, 2024-09-12T00:10:02.409 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 674803, 2024-09-12T00:10:02.409 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 7, 2024-09-12T00:10:02.409 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-09-12T00:10:02.409 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.199450682, 2024-09-12T00:10:02.409 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.056095759, 2024-09-12T00:10:02.409 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.059770614, 2024-09-12T00:10:02.409 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.067160670, 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2122, 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.078349468, 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000036922 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.410 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 367, 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 331, 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 10045964, 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 166466, 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 4, 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-09-12T00:10:02.411 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.056783537, 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.017912194, 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.049680574, 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.002357902, 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 331, 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.022589781, 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000068247 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:10:02.412 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.413 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.413 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.413 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.413 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1630336, 2024-09-12T00:10:02.413 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 133968 2024-09-12T00:10:02.413 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 17, 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 178, 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 4198528, 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 445186, 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 7, 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.013329854, 2024-09-12T00:10:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.006801721, 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.004326345, 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000308376, 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 175, 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.014029501, 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000080168 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 440416 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-12T00:10:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3727, 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.106589591, 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000028599 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 0, 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 0, 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 0, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 0, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 3304, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-09-12T00:10:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 3304, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 3304, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 0, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 1, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 0, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 0, 2024-09-12T00:10:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 0, 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-12T00:10:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-09-12T00:10:02.423 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T00:10:02.424 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T00:10:02.424 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T00:10:02.424 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-09-12T00:10:02.424 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-09-12T00:10:02.425 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-09-12T00:10:02.425 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 0 2024-09-12T00:10:02.425 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.425 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-12T00:10:02.425 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-09-12T00:10:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-09-12T00:10:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-09-12T00:10:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-12T00:10:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-12T00:10:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-12T00:10:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-12T00:10:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-12T00:10:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-12T00:10:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-09-12T00:10:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 0, 2024-09-12T00:10:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 12241, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 17, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-12T00:10:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 37068952, 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 37066864, 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 12241 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 539, 2024-09-12T00:10:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 5207, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 4668, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 46, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 216, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 170, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 3304, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 6237, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 2933, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 0, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 61580, 2024-09-12T00:10:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 215328 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 0, 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 0, 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 0, 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 0, 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.434 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-12T00:10:02.434 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.434 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.434 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.434 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.434 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-12T00:10:02.434 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.434 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-12T00:10:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.437 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.438 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.438 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.438 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-12T00:10:02.438 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.438 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.438 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.440 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.441 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.442 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-12T00:10:02.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.444 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.444 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.444 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-12T00:10:02.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.444 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.445 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-12T00:10:02.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.445 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.445 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-12T00:10:02.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.447 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 4, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 3, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 0, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 0, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 1850, 2024-09-12T00:10:02.448 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T00:10:02.449 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-12T00:10:02.450 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-12T00:10:02.451 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 228143, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 631, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 8032, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 177, 2024-09-12T00:10:02.452 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 3688187, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 35930, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-12T00:10:02.453 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 2239, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 21, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 3, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 2239, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2239, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.582967594, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000706997 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2239, 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 2240 2024-09-12T00:10:02.454 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.455 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 2239, 2024-09-12T00:10:02.455 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 2239, 2024-09-12T00:10:02.455 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 0, 2024-09-12T00:10:02.455 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-12T00:10:02.455 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-12T00:10:02.455 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 1440, 2024-09-12T00:10:02.455 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 0, 2024-09-12T00:10:02.455 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 797, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 1, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-12T00:10:02.456 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-12T00:10:02.457 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 91, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-12T00:10:02.458 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 9, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 7, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 7, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 0, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 2, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 0 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 0, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-12T00:10:02.459 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.460 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 2502, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 34895633, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 2502, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2502, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 34895633, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.461 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:10:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 2239, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 32875269, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2239, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 32875269, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.463 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 2239, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 2239, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2239, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 2239, 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:10:02.465 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x564d3aaa8b40": { 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-12T00:10:02.466 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-12T00:10:02.467 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-12T00:10:02.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:02 smithi105 ceph-mon[34805]: pgmap v331: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:10:02.745 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:02 smithi192 ceph-mon[35487]: pgmap v331: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:10:02.839 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:02 smithi060 ceph-mon[30953]: pgmap v331: 97 pgs: 97 active+clean; 150 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T00:10:03.241 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T00:10:03.242 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T00:10:03.242 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-12T00:10:03.242 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-12T00:10:03.242 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-12T00:10:03.242 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-12T00:10:03.242 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T00:10:03.242 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T00:10:03.253 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T00:10:03.254 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T00:10:03.254 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T00:10:03.276 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T00:10:03.276 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T00:10:03.337 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T00:10:03.652 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:10:04.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 -- 172.21.15.60:0/376120718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff41008d0 msgr2=0x7f8ff4100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:04.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 --2- 172.21.15.60:0/376120718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff41008d0 0x7f8ff4100cb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009900 tx=0x7f8ff002a410 comp rx=0 tx=0).stop 2024-09-12T00:10:04.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 -- 172.21.15.60:0/376120718 shutdown_connections 2024-09-12T00:10:04.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 --2- 172.21.15.60:0/376120718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff410e480 0x7f8ff4110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 --2- 172.21.15.60:0/376120718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ff4101280 0x7f8ff410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 --2- 172.21.15.60:0/376120718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff41008d0 0x7f8ff4100cb0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 -- 172.21.15.60:0/376120718 >> 172.21.15.60:0/376120718 conn(0x7f8ff40fc7a0 msgr2=0x7f8ff40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 -- 172.21.15.60:0/376120718 shutdown_connections 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.130+0000 7f8ffb446640 1 -- 172.21.15.60:0/376120718 wait complete. 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ffb446640 1 Processor -- start 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ffb446640 1 -- start start 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ffb446640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ff41008d0 0x7f8ff419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ffb446640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff4101280 0x7f8ff419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ffb446640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff410e480 0x7f8ff419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ffb446640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4114320 con 0x7f8ff4101280 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ffb446640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41141a0 con 0x7f8ff41008d0 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ffb446640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41144a0 con 0x7f8ff410e480 2024-09-12T00:10:04.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff89e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff4101280 0x7f8ff419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff89e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff4101280 0x7f8ff419ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55898/0 (socket says 172.21.15.60:55898) 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff89e1640 1 -- 172.21.15.60:0/1664268270 learned_addr learned my addr 172.21.15.60:0/1664268270 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff91e2640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ff41008d0 0x7f8ff419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff99e3640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff410e480 0x7f8ff419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff89e1640 1 -- 172.21.15.60:0/1664268270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff410e480 msgr2=0x7f8ff419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff89e1640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff410e480 0x7f8ff419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff89e1640 1 -- 172.21.15.60:0/1664268270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ff41008d0 msgr2=0x7f8ff419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff89e1640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ff41008d0 0x7f8ff419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff89e1640 1 -- 172.21.15.60:0/1664268270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff419f6b0 con 0x7f8ff4101280 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.131+0000 7f8ff91e2640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ff41008d0 0x7f8ff419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.132+0000 7f8ff89e1640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff4101280 0x7f8ff419ac40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c920 tx=0x7f8fe400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:04.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.132+0000 7f8fea7fc640 1 -- 172.21.15.60:0/1664268270 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4007c70 con 0x7f8ff4101280 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.132+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff419f9a0 con 0x7f8ff4101280 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.132+0000 7f8fea7fc640 1 -- 172.21.15.60:0/1664268270 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fe4007e10 con 0x7f8ff4101280 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.132+0000 7f8fea7fc640 1 -- 172.21.15.60:0/1664268270 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4018940 con 0x7f8ff4101280 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.132+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff41a7280 con 0x7f8ff4101280 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.133+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff4100cb0 con 0x7f8ff4101280 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.134+0000 7f8fea7fc640 1 -- 172.21.15.60:0/1664268270 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8fe4018b20 con 0x7f8ff4101280 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.135+0000 7f8fea7fc640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8fe00a2cf0 0x7f8fe00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.135+0000 7f8ff91e2640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8fe00a2cf0 0x7f8fe00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.135+0000 7f8fea7fc640 1 -- 172.21.15.60:0/1664268270 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f8fe40cf6e0 con 0x7f8ff4101280 2024-09-12T00:10:04.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.135+0000 7f8ff91e2640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8fe00a2cf0 0x7f8fe00a51b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0005940 tx=0x7f8ff00058b0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:04.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.139+0000 7f8fea7fc640 1 -- 172.21.15.60:0/1664268270 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fe4014030 con 0x7f8ff4101280 2024-09-12T00:10:04.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.328+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8ff41a7520 con 0x7f8ff4101280 2024-09-12T00:10:04.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.328+0000 7f8fea7fc640 1 -- 172.21.15.60:0/1664268270 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v91) ==== 81+0+942 (secure 0 0 0) 0x7f8fe400de20 con 0x7f8ff4101280 2024-09-12T00:10:04.327 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/75586277 2024-09-12T23:59:21.380056+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/2313774435 2024-09-12T23:50:15.574174+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/2264238576 2024-09-12T23:50:39.288772+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3663020999 2024-09-12T23:59:21.380056+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/814308514 2024-09-12T23:50:15.574174+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2365716663 2024-09-12T23:50:15.574174+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3516356414 2024-09-12T23:50:39.288772+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3000754372 2024-09-12T23:50:15.574174+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/470113182 2024-09-12T23:50:39.288772+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/1180183286 2024-09-12T23:59:21.380056+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6801/2313774435 2024-09-12T23:50:15.574174+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2524722535 2024-09-12T23:59:21.380056+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/2901365948 2024-09-12T23:50:39.288772+0000 2024-09-12T00:10:04.328 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/1180183286 2024-09-12T23:59:21.380056+0000 2024-09-12T00:10:04.329 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:6800/2264238576 2024-09-12T23:50:39.288772+0000 2024-09-12T00:10:04.329 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60:0/3141588653 2024-09-12T23:59:21.380056+0000 2024-09-12T00:10:04.329 INFO:teuthology.orchestra.run.smithi060.stderr:listed 16 entries 2024-09-12T00:10:04.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.330+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8fe00a2cf0 msgr2=0x7f8fe00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:04.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.330+0000 7f8ffb446640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8fe00a2cf0 0x7f8fe00a51b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0005940 tx=0x7f8ff00058b0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.330+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff4101280 msgr2=0x7f8ff419ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.330+0000 7f8ffb446640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff4101280 0x7f8ff419ac40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c920 tx=0x7f8fe400cde0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.330+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 shutdown_connections 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.330+0000 7f8ffb446640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f8fe00a2cf0 0x7f8fe00a51b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.330+0000 7f8ffb446640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ff410e480 0x7f8ff419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.331+0000 7f8ffb446640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ff4101280 0x7f8ff419ac40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.331+0000 7f8ffb446640 1 --2- 172.21.15.60:0/1664268270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ff41008d0 0x7f8ff419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.331+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 >> 172.21.15.60:0/1664268270 conn(0x7f8ff40fc7a0 msgr2=0x7f8ff40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.331+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 shutdown_connections 2024-09-12T00:10:04.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:04.331+0000 7f8ffb446640 1 -- 172.21.15.60:0/1664268270 wait complete. 2024-09-12T00:10:04.880 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:04 smithi192 ceph-mon[35487]: pgmap v332: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:10:04.881 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:04 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1664268270' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:10:04.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:04 smithi105 ceph-mon[34805]: pgmap v332: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:10:04.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:04 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1664268270' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:10:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:04 smithi060 ceph-mon[30953]: pgmap v332: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T00:10:05.089 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:04 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1664268270' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T00:10:05.247 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T00:10:05.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:10:05.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T00:10:05.334 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T00:10:05.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:10:05.334 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T00:10:05.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:10:05.384 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T00:10:05.416 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T00:10:05.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:10:05.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T00:10:05.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T00:10:05.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-12T00:10:05.580 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T00:10:06.363 INFO:tasks.cephadm:Teardown begin 2024-09-12T00:10:06.364 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T00:10:06.364 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:10:06.639 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:10:06.760 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:06 smithi060 ceph-mon[30953]: pgmap v333: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:10:06.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:06 smithi105 ceph-mon[34805]: pgmap v333: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:10:07.034 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:06 smithi192 ceph-mon[35487]: pgmap v333: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T00:10:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 -- 172.21.15.60:0/3145775279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 msgr2=0x7f49e810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/3145775279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 0x7f49e810bb50 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009900 tx=0x7f49d002a480 comp rx=0 tx=0).stop 2024-09-12T00:10:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 -- 172.21.15.60:0/3145775279 shutdown_connections 2024-09-12T00:10:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/3145775279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49e810c170 0x7f49e810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/3145775279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 0x7f49e810bb50 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/3145775279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e8102d40 0x7f49e8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 -- 172.21.15.60:0/3145775279 >> 172.21.15.60:0/3145775279 conn(0x7f49e80fc7a0 msgr2=0x7f49e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 -- 172.21.15.60:0/3145775279 shutdown_connections 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.108+0000 7f49ecdd1640 1 -- 172.21.15.60:0/3145775279 wait complete. 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.109+0000 7f49ecdd1640 1 Processor -- start 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.109+0000 7f49ecdd1640 1 -- start start 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.109+0000 7f49ecdd1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e8102d40 0x7f49e81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.109+0000 7f49ecdd1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 0x7f49e8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.109+0000 7f49ecdd1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49e810c170 0x7f49e819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49ecdd1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8112090 con 0x7f49e8103660 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49ecdd1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8111f10 con 0x7f49e810c170 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49ecdd1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8112210 con 0x7f49e8102d40 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 0x7f49e8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 0x7f49e8198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55916/0 (socket says 172.21.15.60:55916) 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 -- 172.21.15.60:0/1949669730 learned_addr learned my addr 172.21.15.60:0/1949669730 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e659c640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e8102d40 0x7f49e81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e6d9d640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49e810c170 0x7f49e819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 -- 172.21.15.60:0/1949669730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e8102d40 msgr2=0x7f49e81984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e8102d40 0x7f49e81984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 -- 172.21.15.60:0/1949669730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49e810c170 msgr2=0x7f49e819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49e810c170 0x7f49e819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 -- 172.21.15.60:0/1949669730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e819d480 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49e5d9b640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 0x7f49e8198a10 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f49d0006010 tx=0x7f49d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49df7fe640 1 -- 172.21.15.60:0/1949669730 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d003f030 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e819d710 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49df7fe640 1 -- 172.21.15.60:0/1949669730 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f49d0003d00 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.110+0000 7f49df7fe640 1 -- 172.21.15.60:0/1949669730 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0035070 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.111+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e81a5050 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.111+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e806b070 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.113+0000 7f49df7fe640 1 -- 172.21.15.60:0/1949669730 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f49d0042030 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.113+0000 7f49df7fe640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49d40a2cf0 0x7f49d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.114+0000 7f49e659c640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49d40a2cf0 0x7f49d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.114+0000 7f49df7fe640 1 -- 172.21.15.60:0/1949669730 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f49d00ef940 con 0x7f49e8103660 2024-09-12T00:10:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.114+0000 7f49e659c640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49d40a2cf0 0x7f49d40a51b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49d80058c0 tx=0x7f49d800a250 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.117+0000 7f49df7fe640 1 -- 172.21.15.60:0/1949669730 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49d00bbf30 con 0x7f49e8103660 2024-09-12T00:10:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.329+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49e81a5220 con 0x7f49e8103660 2024-09-12T00:10:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.329+0000 7f49df7fe640 1 -- 172.21.15.60:0/1949669730 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7f49d00c0230 con 0x7f49e8103660 2024-09-12T00:10:07.329 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:10:07.329 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:10:07.330 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:10:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49d40a2cf0 msgr2=0x7f49d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49d40a2cf0 0x7f49d40a51b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f49d80058c0 tx=0x7f49d800a250 comp rx=0 tx=0).stop 2024-09-12T00:10:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 msgr2=0x7f49e8198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 0x7f49e8198a10 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f49d0006010 tx=0x7f49d00042f0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 shutdown_connections 2024-09-12T00:10:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f49d40a2cf0 0x7f49d40a51b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49e810c170 0x7f49e819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49e8103660 0x7f49e8198a10 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 --2- 172.21.15.60:0/1949669730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e8102d40 0x7f49e81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 >> 172.21.15.60:0/1949669730 conn(0x7f49e80fc7a0 msgr2=0x7f49e80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 shutdown_connections 2024-09-12T00:10:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:07.332+0000 7f49ecdd1640 1 -- 172.21.15.60:0/1949669730 wait complete. 2024-09-12T00:10:07.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:07 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1949669730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:10:08.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:07 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1949669730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:10:08.080 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:07 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1949669730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:10:08.119 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T00:10:08.386 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:10:08.801 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:08 smithi060 ceph-mon[30953]: pgmap v334: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-09-12T00:10:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 -- 172.21.15.60:0/1465349109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801036e0 msgr2=0x7f9580107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 --2- 172.21.15.60:0/1465349109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801036e0 0x7f9580107b90 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f9568009930 tx=0x7f956802a420 comp rx=0 tx=0).stop 2024-09-12T00:10:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 -- 172.21.15.60:0/1465349109 shutdown_connections 2024-09-12T00:10:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 --2- 172.21.15.60:0/1465349109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95801082a0 0x7f958010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 --2- 172.21.15.60:0/1465349109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801036e0 0x7f9580107b90 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 --2- 172.21.15.60:0/1465349109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9580102d30 0x7f9580103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 -- 172.21.15.60:0/1465349109 >> 172.21.15.60:0/1465349109 conn(0x7f95800fc7d0 msgr2=0x7f95800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 -- 172.21.15.60:0/1465349109 shutdown_connections 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 -- 172.21.15.60:0/1465349109 wait complete. 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 Processor -- start 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.884+0000 7f95868b8640 1 -- start start 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f95868b8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9580102d30 0x7f95801a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f95868b8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95801036e0 0x7f95801a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f95868b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801082a0 0x7f958010de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f95868b8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95801121c0 con 0x7f95801082a0 2024-09-12T00:10:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f95868b8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9580112040 con 0x7f95801036e0 2024-09-12T00:10:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f95868b8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9580112340 con 0x7f9580102d30 2024-09-12T00:10:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801082a0 0x7f958010de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9577fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95801036e0 0x7f95801a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801082a0 0x7f958010de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55934/0 (socket says 172.21.15.60:55934) 2024-09-12T00:10:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 -- 172.21.15.60:0/2109854255 learned_addr learned my addr 172.21.15.60:0/2109854255 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:10:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9577fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95801036e0 0x7f95801a4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:42112/0 (socket says 172.21.15.60:42112) 2024-09-12T00:10:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f957ffff640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9580102d30 0x7f95801a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 -- 172.21.15.60:0/2109854255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9580102d30 msgr2=0x7f95801a49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9580102d30 0x7f95801a49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 -- 172.21.15.60:0/2109854255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95801036e0 msgr2=0x7f95801a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95801036e0 0x7f95801a4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 -- 172.21.15.60:0/2109854255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958010e6c0 con 0x7f95801082a0 2024-09-12T00:10:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f957ffff640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9580102d30 0x7f95801a49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T00:10:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.885+0000 7f9584e55640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801082a0 0x7f958010de00 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f957800cad0 tx=0x7f957800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.886+0000 7f957dffb640 1 -- 172.21.15.60:0/2109854255 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957800ae20 con 0x7f95801082a0 2024-09-12T00:10:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.886+0000 7f957dffb640 1 -- 172.21.15.60:0/2109854255 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9578004b20 con 0x7f95801082a0 2024-09-12T00:10:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.886+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958010e9b0 con 0x7f95801082a0 2024-09-12T00:10:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.886+0000 7f957dffb640 1 -- 172.21.15.60:0/2109854255 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957800f780 con 0x7f95801082a0 2024-09-12T00:10:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.886+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95801ab980 con 0x7f95801082a0 2024-09-12T00:10:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.887+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958006a850 con 0x7f95801082a0 2024-09-12T00:10:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.889+0000 7f957dffb640 1 -- 172.21.15.60:0/2109854255 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f957800f940 con 0x7f95801082a0 2024-09-12T00:10:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.889+0000 7f957dffb640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f956c0a2d70 0x7f956c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.889+0000 7f957dffb640 1 -- 172.21.15.60:0/2109854255 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f95780cf770 con 0x7f95801082a0 2024-09-12T00:10:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.889+0000 7f957ffff640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f956c0a2d70 0x7f956c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.890+0000 7f957ffff640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f956c0a2d70 0x7f956c0a5230 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9570009c20 tx=0x7f9570005f90 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:08.893+0000 7f957dffb640 1 -- 172.21.15.60:0/2109854255 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9578014030 con 0x7f95801082a0 2024-09-12T00:10:08.978 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:08 smithi105 ceph-mon[34805]: pgmap v334: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-09-12T00:10:09.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:08 smithi192 ceph-mon[35487]: pgmap v334: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 31 op/s 2024-09-12T00:10:09.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.103+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9580103110 con 0x7f95801082a0 2024-09-12T00:10:09.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.104+0000 7f957dffb640 1 -- 172.21.15.60:0/2109854255 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+11974 (secure 0 0 0) 0x7f957809c430 con 0x7f95801082a0 2024-09-12T00:10:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:10:09.103 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":52,"btime":"2024-09-12T00:05:44:625546+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/84261893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":84261893},{"type":"v1","addr":"172.21.15.60:6835","nonce":84261893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/2489903500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2489903500},{"type":"v1","addr":"172.21.15.60:6837","nonce":2489903500}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T23:57:29.107465+0000","modified":"2024-09-12T00:05:43.969590+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24496,"mds_1":24485,"mds_2":24484,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14601":{"gid":14601,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6839/4061424559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":4061424559},{"type":"v1","addr":"172.21.15.60:6839","nonce":4061424559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6841/1402291177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6840","nonce":1402291177},{"type":"v1","addr":"172.21.15.60:6841","nonce":1402291177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6833/967941361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":967941361},{"type":"v1","addr":"172.21.15.105:6833","nonce":967941361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/1968112880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1968112880},{"type":"v1","addr":"172.21.15.192:6833","nonce":1968112880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.105:6835/3186850870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3186850870},{"type":"v1","addr":"172.21.15.105:6835","nonce":3186850870}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6837/2264507638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":2264507638},{"type":"v1","addr":"172.21.15.105:6837","nonce":2264507638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/968968600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":968968600},{"type":"v1","addr":"172.21.15.192:6835","nonce":968968600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/1338489089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1338489089},{"type":"v1","addr":"172.21.15.192:6837","nonce":1338489089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.105:6839/525386561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6838","nonce":525386561},{"type":"v1","addr":"172.21.15.105:6839","nonce":525386561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.192:6839/3310133932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":3310133932},{"type":"v1","addr":"172.21.15.192:6839","nonce":3310133932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24496,"qdb_cluster":[24496,24485,24484,24475,24467]},"id":1}]} 2024-09-12T00:10:09.103 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 52 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f956c0a2d70 msgr2=0x7f956c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f956c0a2d70 0x7f956c0a5230 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9570009c20 tx=0x7f9570005f90 comp rx=0 tx=0).stop 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801082a0 msgr2=0x7f958010de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801082a0 0x7f958010de00 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f957800cad0 tx=0x7f957800cf90 comp rx=0 tx=0).stop 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 shutdown_connections 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f956c0a2d70 0x7f956c0a5230 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95801082a0 0x7f958010de00 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95801036e0 0x7f95801a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 --2- 172.21.15.60:0/2109854255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9580102d30 0x7f95801a49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 >> 172.21.15.60:0/2109854255 conn(0x7f95800fc7d0 msgr2=0x7f95800fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 shutdown_connections 2024-09-12T00:10:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:09.106+0000 7f95868b8640 1 -- 172.21.15.60:0/2109854255 wait complete. 2024-09-12T00:10:09.807 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:09 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2109854255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:10:09.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T00:10:09.978 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:09 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2109854255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:10:10.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:09 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2109854255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T00:10:10.104 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:10:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 -- 172.21.15.60:0/3187009790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a4102d30 msgr2=0x7f96a4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:10.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 --2- 172.21.15.60:0/3187009790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a4102d30 0x7f96a4103110 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9694009900 tx=0x7f969402a480 comp rx=0 tx=0).stop 2024-09-12T00:10:10.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 -- 172.21.15.60:0/3187009790 shutdown_connections 2024-09-12T00:10:10.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 --2- 172.21.15.60:0/3187009790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a410c160 0x7f96a410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 --2- 172.21.15.60:0/3187009790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96a4103650 0x7f96a410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 --2- 172.21.15.60:0/3187009790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a4102d30 0x7f96a4103110 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 -- 172.21.15.60:0/3187009790 >> 172.21.15.60:0/3187009790 conn(0x7f96a40fc790 msgr2=0x7f96a40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:10.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 -- 172.21.15.60:0/3187009790 shutdown_connections 2024-09-12T00:10:10.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.595+0000 7f96a978a640 1 -- 172.21.15.60:0/3187009790 wait complete. 2024-09-12T00:10:10.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.596+0000 7f96a978a640 1 Processor -- start 2024-09-12T00:10:10.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.596+0000 7f96a978a640 1 -- start start 2024-09-12T00:10:10.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.596+0000 7f96a978a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96a4102d30 0x7f96a4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:10.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.596+0000 7f96a978a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a4103650 0x7f96a4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:10.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.596+0000 7f96a978a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a410c160 0x7f96a419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:10.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.596+0000 7f96a978a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96a4112080 con 0x7f96a410c160 2024-09-12T00:10:10.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.596+0000 7f96a978a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96a4111f00 con 0x7f96a4103650 2024-09-12T00:10:10.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.596+0000 7f96a978a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f96a4112200 con 0x7f96a4102d30 2024-09-12T00:10:10.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a410c160 0x7f96a419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:10.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a410c160 0x7f96a419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55948/0 (socket says 172.21.15.60:55948) 2024-09-12T00:10:10.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 -- 172.21.15.60:0/3507271750 learned_addr learned my addr 172.21.15.60:0/3507271750 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:10:10.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a27fc640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a4103650 0x7f96a4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:10.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a2ffd640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96a4102d30 0x7f96a4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:10.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 -- 172.21.15.60:0/3507271750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96a4102d30 msgr2=0x7f96a4198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:10.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96a4102d30 0x7f96a4198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 -- 172.21.15.60:0/3507271750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a4103650 msgr2=0x7f96a4198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a4103650 0x7f96a4198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 -- 172.21.15.60:0/3507271750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a419d4d0 con 0x7f96a410c160 2024-09-12T00:10:10.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a37fe640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a410c160 0x7f96a419cdf0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f969c00e970 tx=0x7f969c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:10.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f968bfff640 1 -- 172.21.15.60:0/3507271750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c00ccc0 con 0x7f96a410c160 2024-09-12T00:10:10.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a419d7c0 con 0x7f96a410c160 2024-09-12T00:10:10.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f968bfff640 1 -- 172.21.15.60:0/3507271750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f969c00ce60 con 0x7f96a410c160 2024-09-12T00:10:10.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f968bfff640 1 -- 172.21.15.60:0/3507271750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c010690 con 0x7f96a410c160 2024-09-12T00:10:10.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.597+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a41a50a0 con 0x7f96a410c160 2024-09-12T00:10:10.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.598+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a4103110 con 0x7f96a410c160 2024-09-12T00:10:10.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.600+0000 7f968bfff640 1 -- 172.21.15.60:0/3507271750 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f969c0046c0 con 0x7f96a410c160 2024-09-12T00:10:10.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.600+0000 7f968bfff640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f968c0a2cf0 0x7f968c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:10.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.601+0000 7f96a2ffd640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f968c0a2cf0 0x7f968c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:10.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.601+0000 7f968bfff640 1 -- 172.21.15.60:0/3507271750 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8528+0+0 (secure 0 0 0) 0x7f969c0cf9d0 con 0x7f96a410c160 2024-09-12T00:10:10.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.601+0000 7f96a2ffd640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f968c0a2cf0 0x7f968c0a51b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9694009230 tx=0x7f96940058d0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:10.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.603+0000 7f968bfff640 1 -- 172.21.15.60:0/3507271750 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f969c0541b0 con 0x7f96a410c160 2024-09-12T00:10:10.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.781+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96a4106c40 con 0x7f96a410c160 2024-09-12T00:10:10.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:10 smithi060 ceph-mon[30953]: pgmap v335: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-12T00:10:10.781 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:10 smithi060 ceph-mon[30953]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T00:10:10.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.783+0000 7f968bfff640 1 -- 172.21.15.60:0/3507271750 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+23178 (secure 0 0 0) 0x7f969c09c5f0 con 0x7f96a410c160 2024-09-12T00:10:10.782 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T00:10:10.782 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"fsid":"6b4d616e-7098-11ef-bcea-c7b262605968","created":"2024-09-11T23:49:46.707649+0000","modified":"2024-09-12T00:10:09.629327+0000","last_up_change":"2024-09-11T23:56:38.504745+0000","last_in_change":"2024-09-11T23:56:15.797150+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:52:53.812220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:57:25.194293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:57:27.402156+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1786002e-18f0-4bcc-97cc-315be3a3995f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6803","nonce":2876211481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6805","nonce":2876211481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6809","nonce":2876211481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":2876211481},{"type":"v1","addr":"172.21.15.60:6807","nonce":2876211481}]},"public_addr":"172.21.15.60:6803/2876211481","cluster_addr":"172.21.15.60:6805/2876211481","heartbeat_back_addr":"172.21.15.60:6809/2876211481","heartbeat_front_addr":"172.21.15.60:6807/2876211481","state":["exists","up"]},{"osd":1,"uuid":"df9e0ec7-eea3-4ae0-9d9e-70cc2e9ed5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6801","nonce":2839535181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6803","nonce":2839535181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6807","nonce":2839535181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":2839535181},{"type":"v1","addr":"172.21.15.105:6805","nonce":2839535181}]},"public_addr":"172.21.15.105:6801/2839535181","cluster_addr":"172.21.15.105:6803/2839535181","heartbeat_back_addr":"172.21.15.105:6807/2839535181","heartbeat_front_addr":"172.21.15.105:6805/2839535181","state":["exists","up"]},{"osd":2,"uuid":"8c58b9ec-e216-484b-b579-783f4e6a0a23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6801","nonce":4171786693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6803","nonce":4171786693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6807","nonce":4171786693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":4171786693},{"type":"v1","addr":"172.21.15.192:6805","nonce":4171786693}]},"public_addr":"172.21.15.192:6801/4171786693","cluster_addr":"172.21.15.192:6803/4171786693","heartbeat_back_addr":"172.21.15.192:6807/4171786693","heartbeat_front_addr":"172.21.15.192:6805/4171786693","state":["exists","up"]},{"osd":3,"uuid":"b4ea1fe8-4668-4a6b-bef9-b52f838be94b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6811","nonce":1798770509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6813","nonce":1798770509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6817","nonce":1798770509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1798770509},{"type":"v1","addr":"172.21.15.60:6815","nonce":1798770509}]},"public_addr":"172.21.15.60:6811/1798770509","cluster_addr":"172.21.15.60:6813/1798770509","heartbeat_back_addr":"172.21.15.60:6817/1798770509","heartbeat_front_addr":"172.21.15.60:6815/1798770509","state":["exists","up"]},{"osd":4,"uuid":"877161c8-96cd-4464-92f3-c19d4f06c754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6809","nonce":1760564347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6811","nonce":1760564347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6815","nonce":1760564347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":1760564347},{"type":"v1","addr":"172.21.15.105:6813","nonce":1760564347}]},"public_addr":"172.21.15.105:6809/1760564347","cluster_addr":"172.21.15.105:6811/1760564347","heartbeat_back_addr":"172.21.15.105:6815/1760564347","heartbeat_front_addr":"172.21.15.105:6813/1760564347","state":["exists","up"]},{"osd":5,"uuid":"da1e7304-48a6-4f9f-aa12-f1384eb2a389","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6809","nonce":3136840060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6811","nonce":3136840060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6815","nonce":3136840060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3136840060},{"type":"v1","addr":"172.21.15.192:6813","nonce":3136840060}]},"public_addr":"172.21.15.192:6809/3136840060","cluster_addr":"172.21.15.192:6811/3136840060","heartbeat_back_addr":"172.21.15.192:6815/3136840060","heartbeat_front_addr":"172.21.15.192:6813/3136840060","state":["exists","up"]},{"osd":6,"uuid":"fb057ead-4a04-43af-a276-78a3ce33a7b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6819","nonce":2796525273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6821","nonce":2796525273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6825","nonce":2796525273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2796525273},{"type":"v1","addr":"172.21.15.60:6823","nonce":2796525273}]},"public_addr":"172.21.15.60:6819/2796525273","cluster_addr":"172.21.15.60:6821/2796525273","heartbeat_back_addr":"172.21.15.60:6825/2796525273","heartbeat_front_addr":"172.21.15.60:6823/2796525273","state":["exists","up"]},{"osd":7,"uuid":"619f7189-29d8-481a-ac46-3196f2ecf4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6817","nonce":1526057205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6819","nonce":1526057205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6823","nonce":1526057205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":1526057205},{"type":"v1","addr":"172.21.15.105:6821","nonce":1526057205}]},"public_addr":"172.21.15.105:6817/1526057205","cluster_addr":"172.21.15.105:6819/1526057205","heartbeat_back_addr":"172.21.15.105:6823/1526057205","heartbeat_front_addr":"172.21.15.105:6821/1526057205","state":["exists","up"]},{"osd":8,"uuid":"9e3058f6-2733-4939-bc0e-5eb46604ee41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6817","nonce":4104765194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6819","nonce":4104765194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6823","nonce":4104765194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4104765194},{"type":"v1","addr":"172.21.15.192:6821","nonce":4104765194}]},"public_addr":"172.21.15.192:6817/4104765194","cluster_addr":"172.21.15.192:6819/4104765194","heartbeat_back_addr":"172.21.15.192:6823/4104765194","heartbeat_front_addr":"172.21.15.192:6821/4104765194","state":["exists","up"]},{"osd":9,"uuid":"0037e8d4-e270-4ac3-a8f0-24e19d972822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6827","nonce":3531170684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6829","nonce":3531170684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6833","nonce":3531170684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3531170684},{"type":"v1","addr":"172.21.15.60:6831","nonce":3531170684}]},"public_addr":"172.21.15.60:6827/3531170684","cluster_addr":"172.21.15.60:6829/3531170684","heartbeat_back_addr":"172.21.15.60:6833/3531170684","heartbeat_front_addr":"172.21.15.60:6831/3531170684","state":["exists","up"]},{"osd":10,"uuid":"0d94bbac-c12a-441d-b9b7-512ad1320413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6825","nonce":3699246515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6827","nonce":3699246515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6831","nonce":3699246515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":3699246515},{"type":"v1","addr":"172.21.15.105:6829","nonce":3699246515}]},"public_addr":"172.21.15.105:6825/3699246515","cluster_addr":"172.21.15.105:6827/3699246515","heartbeat_back_addr":"172.21.15.105:6831/3699246515","heartbeat_front_addr":"172.21.15.105:6829/3699246515","state":["exists","up"]},{"osd":11,"uuid":"d5b7201d-7b7c-4897-a701-1ef840aa17dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6825","nonce":885041669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6827","nonce":885041669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6831","nonce":885041669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":885041669},{"type":"v1","addr":"172.21.15.192:6829","nonce":885041669}]},"public_addr":"172.21.15.192:6825/885041669","cluster_addr":"172.21.15.192:6827/885041669","heartbeat_back_addr":"172.21.15.192:6831/885041669","heartbeat_front_addr":"172.21.15.192:6829/885041669","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:01.510726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:26.781005+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:52:51.175289+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:15.367378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:53:41.792199+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:07.160498+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:32.515979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:54:57.139274+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:21.017518+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:55:47.158214+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:12.043222+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:56:37.368919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.60:0/75586277":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6800/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:6801/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3663020999":"2024-09-12T23:59:21.380056+0000","172.21.15.60:0/814308514":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2365716663":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/3516356414":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3000754372":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/470113182":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6801/1180183286":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6801/2313774435":"2024-09-12T23:50:15.574174+0000","172.21.15.60:0/2524722535":"2024-09-12T23:59:21.380056+0000","172.21.15.60:0/2901365948":"2024-09-12T23:50:39.288772+0000","172.21.15.60:6800/1180183286":"2024-09-12T23:59:21.380056+0000","172.21.15.60:6800/2264238576":"2024-09-12T23:50:39.288772+0000","172.21.15.60:0/3141588653":"2024-09-12T23:59:21.380056+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:10:10.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f968c0a2cf0 msgr2=0x7f968c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f968c0a2cf0 0x7f968c0a51b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9694009230 tx=0x7f96940058d0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a410c160 msgr2=0x7f96a419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a410c160 0x7f96a419cdf0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f969c00e970 tx=0x7f969c00ed70 comp rx=0 tx=0).stop 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 shutdown_connections 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f968c0a2cf0 0x7f968c0a51b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96a410c160 0x7f96a419cdf0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a4103650 0x7f96a4198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 --2- 172.21.15.60:0/3507271750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96a4102d30 0x7f96a4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.785+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 >> 172.21.15.60:0/3507271750 conn(0x7f96a40fc790 msgr2=0x7f96a40fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.786+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 shutdown_connections 2024-09-12T00:10:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:10.786+0000 7f96a978a640 1 -- 172.21.15.60:0/3507271750 wait complete. 2024-09-12T00:10:10.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:10 smithi105 ceph-mon[34805]: pgmap v335: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-12T00:10:10.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:10 smithi105 ceph-mon[34805]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T00:10:11.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:10 smithi192 ceph-mon[35487]: pgmap v335: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 27 op/s 2024-09-12T00:10:11.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:10 smithi192 ceph-mon[35487]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T00:10:11.424 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T00:10:11.684 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:10:11.806 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:11 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3507271750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:10:11.979 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:11 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3507271750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:10:12.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:11 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3507271750' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T00:10:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2054920512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98106a80 msgr2=0x7efe98106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2054920512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98106a80 0x7efe98106e60 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7efe88009930 tx=0x7efe8802a420 comp rx=0 tx=0).stop 2024-09-12T00:10:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2054920512 shutdown_connections 2024-09-12T00:10:12.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2054920512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe98101420 0x7efe9810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2054920512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe98100a80 0x7efe98100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2054920512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98106a80 0x7efe98106e60 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2054920512 >> 172.21.15.60:0/2054920512 conn(0x7efe980fc7a0 msgr2=0x7efe980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2054920512 shutdown_connections 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.230+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2054920512 wait complete. 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.231+0000 7efe9d0fb640 1 Processor -- start 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.231+0000 7efe9d0fb640 1 -- start start 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.231+0000 7efe9d0fb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe98100a80 0x7efe98199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.231+0000 7efe9d0fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98101420 0x7efe981998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.231+0000 7efe9d0fb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe98106a80 0x7efe981a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.231+0000 7efe9d0fb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efe98110fa0 con 0x7efe98101420 2024-09-12T00:10:12.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.231+0000 7efe9d0fb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe98110e20 con 0x7efe98106a80 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.231+0000 7efe9d0fb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efe98111120 con 0x7efe98100a80 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98101420 0x7efe981998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98101420 0x7efe981998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47356/0 (socket says 172.21.15.60:47356) 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 -- 172.21.15.60:0/2766230979 learned_addr learned my addr 172.21.15.60:0/2766230979 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9759e640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe98106a80 0x7efe981a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe96d9d640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe98100a80 0x7efe98199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 -- 172.21.15.60:0/2766230979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe98100a80 msgr2=0x7efe98199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe98100a80 0x7efe98199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 -- 172.21.15.60:0/2766230979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe98106a80 msgr2=0x7efe981a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe98106a80 0x7efe981a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 -- 172.21.15.60:0/2766230979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe981a4930 con 0x7efe98101420 2024-09-12T00:10:12.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9659c640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98101420 0x7efe981998b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00e9f0 tx=0x7efe8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe7ffff640 1 -- 172.21.15.60:0/2766230979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c00cd80 con 0x7efe98101420 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe981a4b00 con 0x7efe98101420 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe7ffff640 1 -- 172.21.15.60:0/2766230979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efe8c010930 con 0x7efe98101420 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe7ffff640 1 -- 172.21.15.60:0/2766230979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c018b00 con 0x7efe98101420 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.232+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe981a5040 con 0x7efe98101420 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.233+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe98100ee0 con 0x7efe98101420 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.234+0000 7efe7ffff640 1 -- 172.21.15.60:0/2766230979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7efe8c018ca0 con 0x7efe98101420 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.235+0000 7efe7ffff640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efe800a2cf0 0x7efe800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.235+0000 7efe96d9d640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efe800a2cf0 0x7efe800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:12.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.235+0000 7efe7ffff640 1 -- 172.21.15.60:0/2766230979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8528+0+0 (secure 0 0 0) 0x7efe8c0cf8c0 con 0x7efe98101420 2024-09-12T00:10:12.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.236+0000 7efe96d9d640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efe800a2cf0 0x7efe800a51b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe88000c00 tx=0x7efe88005a20 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:12.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.239+0000 7efe7ffff640 1 -- 172.21.15.60:0/2766230979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe8c09c4a0 con 0x7efe98101420 2024-09-12T00:10:12.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.451+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7efe981a5210 con 0x7efe98101420 2024-09-12T00:10:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.453+0000 7efe7ffff640 1 -- 172.21.15.60:0/2766230979 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) ==== 161+0+0 (secure 0 0 0) 0x7efe8c09bda0 con 0x7efe98101420 2024-09-12T00:10:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T00:10:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efe800a2cf0 msgr2=0x7efe800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efe800a2cf0 0x7efe800a51b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe88000c00 tx=0x7efe88005a20 comp rx=0 tx=0).stop 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98101420 msgr2=0x7efe981998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98101420 0x7efe981998b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00e9f0 tx=0x7efe8c00eeb0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 shutdown_connections 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7efe800a2cf0 0x7efe800a51b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe98106a80 0x7efe981a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe98101420 0x7efe981998b0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 --2- 172.21.15.60:0/2766230979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe98100a80 0x7efe98199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 >> 172.21.15.60:0/2766230979 conn(0x7efe980fc7a0 msgr2=0x7efe980fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 shutdown_connections 2024-09-12T00:10:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:12.458+0000 7efe9d0fb640 1 -- 172.21.15.60:0/2766230979 wait complete. 2024-09-12T00:10:12.768 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g[71613]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.768 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g[71613]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.768 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mds[71617]: -- 172.21.15.60:0/149037065 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559bbab38d00 con 0x559bbab0d000 2024-09-12T00:10:12.768 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g[71613]: starting mds.g at 2024-09-12T00:10:12.768 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a[72027]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.768 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a[72027]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.769 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mds[72031]: -- 172.21.15.60:0/2434307814 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564718ab1860 con 0x564718a8f000 2024-09-12T00:10:12.769 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a[72027]: starting mds.a at 2024-09-12T00:10:12.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a[30949]: 2024-09-12T00:10:12.452+0000 7f9b1b020640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T00:10:12.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mon[30953]: pgmap v337: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 33 op/s 2024-09-12T00:10:12.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2766230979' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T00:10:12.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mon[30953]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T00:10:12.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mon[30953]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T00:10:12.769 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/2766230979' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T00:10:12.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mon[30953]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T00:10:12.770 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:12 smithi060 ceph-mon[30953]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T00:10:12.784 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l[65049]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.784 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l[65049]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.784 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mds[65053]: -- 172.21.15.192:0/611313013 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5563ed6df860 con 0x5563ed6bd000 2024-09-12T00:10:12.784 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l[65049]: starting mds.l at 2024-09-12T00:10:12.784 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.785 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.785 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mds[65959]: -- 172.21.15.192:0/2306542556 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef9f543860 con 0x55ef9f521400 2024-09-12T00:10:12.785 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: starting mds.i at 2024-09-12T00:10:12.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mon[35487]: pgmap v337: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 33 op/s 2024-09-12T00:10:12.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2766230979' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T00:10:12.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mon[35487]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T00:10:12.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mon[35487]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T00:10:12.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/2766230979' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T00:10:12.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mon[35487]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T00:10:12.786 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mon[35487]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T00:10:12.786 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f[65352]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.787 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f[65352]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.787 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mds[65356]: -- 172.21.15.192:0/2089061880 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56274683bc20 con 0x562746819400 2024-09-12T00:10:12.787 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f[65352]: starting mds.f at 2024-09-12T00:10:12.787 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-c[65653]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.787 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-c[65653]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.787 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-mds[65657]: -- 172.21.15.192:0/3630380591 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e4c8cd860 con 0x561e4c8ab000 2024-09-12T00:10:12.787 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:10:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-c[65653]: starting mds.c at 2024-09-12T00:10:12.979 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b[65264]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.979 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b[65264]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.979 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mds[65268]: -- 172.21.15.105:0/251979954 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56506b97f860 con 0x56506b95c800 2024-09-12T00:10:12.980 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b[65264]: starting mds.b at 2024-09-12T00:10:12.980 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e[64660]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.980 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e[64660]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.980 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mds[64664]: -- 172.21.15.105:0/658089921 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562a12867860 con 0x562a12844800 2024-09-12T00:10:12.980 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e[64660]: starting mds.e at 2024-09-12T00:10:12.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mon[34805]: pgmap v337: 97 pgs: 97 active+clean; 150 MiB data, 732 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 33 op/s 2024-09-12T00:10:12.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2766230979' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T00:10:12.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mon[34805]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T00:10:12.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mon[34805]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T00:10:12.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/2766230979' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T00:10:12.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mon[34805]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T00:10:12.981 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mon[34805]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k[64345]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k[64345]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mds[64349]: -- 172.21.15.105:0/816861237 <== mon.2 v2:172.21.15.105:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561129c1dc20 con 0x561129bfb400 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k[64345]: starting mds.k at 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h[64962]: ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h[64962]: ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mds[64966]: -- 172.21.15.105:0/1048583073 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c15cd46680 con 0x55c15cd1a800 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-mds[64966]: -- 172.21.15.105:0/1048583073 <== mon.0 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c15cd3d860 con 0x55c15cd1a800 2024-09-12T00:10:12.982 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:10:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h[64962]: starting mds.h at 2024-09-12T00:10:13.241 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T00:10:13.506 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:10:14.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 -- 172.21.15.60:0/2918700743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0810c180 msgr2=0x7f4c0810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 --2- 172.21.15.60:0/2918700743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0810c180 0x7f4c0810e600 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009ca0 tx=0x7f4c0002a950 comp rx=0 tx=0).stop 2024-09-12T00:10:14.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 -- 172.21.15.60:0/2918700743 shutdown_connections 2024-09-12T00:10:14.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 --2- 172.21.15.60:0/2918700743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c0810c180 0x7f4c0810e600 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 --2- 172.21.15.60:0/2918700743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c081036c0 0x7f4c0810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 --2- 172.21.15.60:0/2918700743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c08102da0 0x7f4c08103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 -- 172.21.15.60:0/2918700743 >> 172.21.15.60:0/2918700743 conn(0x7f4c080fc7a0 msgr2=0x7f4c080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:14.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 -- 172.21.15.60:0/2918700743 shutdown_connections 2024-09-12T00:10:14.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.093+0000 7f4c0d188640 1 -- 172.21.15.60:0/2918700743 wait complete. 2024-09-12T00:10:14.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0d188640 1 Processor -- start 2024-09-12T00:10:14.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0d188640 1 -- start start 2024-09-12T00:10:14.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0d188640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c08102da0 0x7f4c08100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0d188640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c081036c0 0x7f4c08100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0d188640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c0810c180 0x7f4c08101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0d188640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08112080 con 0x7f4c081036c0 2024-09-12T00:10:14.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0d188640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111f00 con 0x7f4c08102da0 2024-09-12T00:10:14.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0d188640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08112200 con 0x7f4c0810c180 2024-09-12T00:10:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c081036c0 0x7f4c08100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.094+0000 7f4c0659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c081036c0 0x7f4c08100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47410/0 (socket says 172.21.15.60:47410) 2024-09-12T00:10:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0659c640 1 -- 172.21.15.60:0/1561056043 learned_addr learned my addr 172.21.15.60:0/1561056043 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:10:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c06d9d640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c08102da0 0x7f4c08100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0759e640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c0810c180 0x7f4c08101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0659c640 1 -- 172.21.15.60:0/1561056043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c0810c180 msgr2=0x7f4c08101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0659c640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c0810c180 0x7f4c08101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0659c640 1 -- 172.21.15.60:0/1561056043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c08102da0 msgr2=0x7f4c08100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0659c640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c08102da0 0x7f4c08100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0659c640 1 -- 172.21.15.60:0/1561056043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c081a68c0 con 0x7f4c081036c0 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0659c640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c081036c0 0x7f4c08100f40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c920 tx=0x7f4bfc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4beffff640 1 -- 172.21.15.60:0/1561056043 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc007c70 con 0x7f4c081036c0 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c081a6bb0 con 0x7f4c081036c0 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4beffff640 1 -- 172.21.15.60:0/1561056043 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4bfc007e10 con 0x7f4c081036c0 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4beffff640 1 -- 172.21.15.60:0/1561056043 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc018940 con 0x7f4c081036c0 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.095+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c081a70f0 con 0x7f4c081036c0 2024-09-12T00:10:14.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.096+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c08103180 con 0x7f4c081036c0 2024-09-12T00:10:14.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.097+0000 7f4beffff640 1 -- 172.21.15.60:0/1561056043 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4bfc018b20 con 0x7f4c081036c0 2024-09-12T00:10:14.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.098+0000 7f4beffff640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4bf00a2cf0 0x7f4bf00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:14.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.098+0000 7f4c06d9d640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4bf00a2cf0 0x7f4bf00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:14.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.098+0000 7f4beffff640 1 -- 172.21.15.60:0/1561056043 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8914+0+0 (secure 0 0 0) 0x7f4bfc0cf660 con 0x7f4c081036c0 2024-09-12T00:10:14.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.099+0000 7f4c06d9d640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4bf00a2cf0 0x7f4bf00a51b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800bbe0 tx=0x7f4bf800b390 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:14.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.102+0000 7f4beffff640 1 -- 172.21.15.60:0/1561056043 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4bfc014030 con 0x7f4c081036c0 2024-09-12T00:10:14.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.318+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4c081a74c0 con 0x7f4c081036c0 2024-09-12T00:10:14.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.460+0000 7f4beffff640 1 -- 172.21.15.60:0/1561056043 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) ==== 104+0+0 (secure 0 0 0) 0x7f4bfc09c090 con 0x7f4c081036c0 2024-09-12T00:10:14.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4bf00a2cf0 msgr2=0x7f4bf00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4bf00a2cf0 0x7f4bf00a51b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4bf800bbe0 tx=0x7f4bf800b390 comp rx=0 tx=0).stop 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c081036c0 msgr2=0x7f4c08100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c081036c0 0x7f4c08100f40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc00c920 tx=0x7f4bfc00cde0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 shutdown_connections 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f4bf00a2cf0 0x7f4bf00a51b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c0810c180 0x7f4c08101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c081036c0 0x7f4c08100f40 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 --2- 172.21.15.60:0/1561056043 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c08102da0 0x7f4c08100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 >> 172.21.15.60:0/1561056043 conn(0x7f4c080fc7a0 msgr2=0x7f4c080fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 shutdown_connections 2024-09-12T00:10:14.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:14.463+0000 7f4c0d188640 1 -- 172.21.15.60:0/1561056043 wait complete. 2024-09-12T00:10:14.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.60:6838/3882002912,v1:172.21.15.60:6840/3882002912] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.60:6839/2848708843,v1:172.21.15.60:6841/2848708843] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6832/2747272226,v1:172.21.15.105:6833/2747272226] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6834/930259417,v1:172.21.15.105:6835/930259417] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6832/3565047543,v1:172.21.15.192:6834/3565047543] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6833/2886835060,v1:172.21.15.192:6835/2886835060] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6836/846090928,v1:172.21.15.105:6837/846090928] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.105:6838/1086606259,v1:172.21.15.105:6839/1086606259] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6836/4002722460,v1:172.21.15.192:6837/4002722460] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: mds.? [v2:172.21.15.192:6838/3541852378,v1:172.21.15.192:6839/3541852378] up:boot 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T00:10:14.589 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: pgmap v339: 97 pgs: 97 active+clean; 150 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-12T00:10:14.590 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:14 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1561056043' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:10:14.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.60:6838/3882002912,v1:172.21.15.60:6840/3882002912] up:boot 2024-09-12T00:10:14.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.60:6839/2848708843,v1:172.21.15.60:6841/2848708843] up:boot 2024-09-12T00:10:14.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6832/2747272226,v1:172.21.15.105:6833/2747272226] up:boot 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6834/930259417,v1:172.21.15.105:6835/930259417] up:boot 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6832/3565047543,v1:172.21.15.192:6834/3565047543] up:boot 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6833/2886835060,v1:172.21.15.192:6835/2886835060] up:boot 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6836/846090928,v1:172.21.15.105:6837/846090928] up:boot 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.105:6838/1086606259,v1:172.21.15.105:6839/1086606259] up:boot 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6836/4002722460,v1:172.21.15.192:6837/4002722460] up:boot 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: mds.? [v2:172.21.15.192:6838/3541852378,v1:172.21.15.192:6839/3541852378] up:boot 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:10:14.730 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:10:14.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:10:14.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:10:14.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:10:14.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:10:14.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:10:14.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: pgmap v339: 97 pgs: 97 active+clean; 150 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-12T00:10:14.731 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:14 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1561056043' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.60:6838/3882002912,v1:172.21.15.60:6840/3882002912] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.60:6839/2848708843,v1:172.21.15.60:6841/2848708843] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6832/2747272226,v1:172.21.15.105:6833/2747272226] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6834/930259417,v1:172.21.15.105:6835/930259417] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6832/3565047543,v1:172.21.15.192:6834/3565047543] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6833/2886835060,v1:172.21.15.192:6835/2886835060] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6836/846090928,v1:172.21.15.105:6837/846090928] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.105:6838/1086606259,v1:172.21.15.105:6839/1086606259] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6836/4002722460,v1:172.21.15.192:6837/4002722460] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: mds.? [v2:172.21.15.192:6838/3541852378,v1:172.21.15.192:6839/3541852378] up:boot 2024-09-12T00:10:14.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='mgr.15216 172.21.15.60:0/2323273077' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: pgmap v339: 97 pgs: 97 active+clean; 150 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-09-12T00:10:14.785 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:14 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1561056043' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T00:10:15.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T00:10:15.577 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:10:15.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:15 smithi060 ceph-mon[30953]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T00:10:15.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:15 smithi060 ceph-mon[30953]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T00:10:15.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:15 smithi060 ceph-mon[30953]: Cluster is now healthy 2024-09-12T00:10:15.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:15 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/1561056043' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:10:15.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:15 smithi060 ceph-mon[30953]: fsmap 12 up:standby 2024-09-12T00:10:15.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:15 smithi105 ceph-mon[34805]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T00:10:15.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:15 smithi105 ceph-mon[34805]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T00:10:15.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:15 smithi105 ceph-mon[34805]: Cluster is now healthy 2024-09-12T00:10:15.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:15 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/1561056043' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:10:15.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:15 smithi105 ceph-mon[34805]: fsmap 12 up:standby 2024-09-12T00:10:15.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:15 smithi192 ceph-mon[35487]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T00:10:15.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:15 smithi192 ceph-mon[35487]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T00:10:15.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:15 smithi192 ceph-mon[35487]: Cluster is now healthy 2024-09-12T00:10:15.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:15 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/1561056043' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T00:10:15.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:15 smithi192 ceph-mon[35487]: fsmap 12 up:standby 2024-09-12T00:10:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 -- 172.21.15.60:0/668991109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc10c180 msgr2=0x7f77dc10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 --2- 172.21.15.60:0/668991109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc10c180 0x7f77dc10e600 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009ca0 tx=0x7f77d402a950 comp rx=0 tx=0).stop 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 -- 172.21.15.60:0/668991109 shutdown_connections 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 --2- 172.21.15.60:0/668991109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc10c180 0x7f77dc10e600 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 --2- 172.21.15.60:0/668991109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77dc1036c0 0x7f77dc10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 --2- 172.21.15.60:0/668991109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc102da0 0x7f77dc103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 -- 172.21.15.60:0/668991109 >> 172.21.15.60:0/668991109 conn(0x7f77dc0fc7a0 msgr2=0x7f77dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 -- 172.21.15.60:0/668991109 shutdown_connections 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.073+0000 7f77e4009640 1 -- 172.21.15.60:0/668991109 wait complete. 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e4009640 1 Processor -- start 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e4009640 1 -- start start 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e4009640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc102da0 0x7f77dc1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e4009640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77dc1036c0 0x7f77dc198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e4009640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc10c180 0x7f77dc19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e4009640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc1120e0 con 0x7f77dc102da0 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e4009640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc111f60 con 0x7f77dc10c180 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e4009640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77dc112260 con 0x7f77dc1036c0 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e1da5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc102da0 0x7f77dc1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e1da5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc102da0 0x7f77dc1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47418/0 (socket says 172.21.15.60:47418) 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e1da5640 1 -- 172.21.15.60:0/4188338190 learned_addr learned my addr 172.21.15.60:0/4188338190 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e15a4640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77dc1036c0 0x7f77dc198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e25a6640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc10c180 0x7f77dc19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e1da5640 1 -- 172.21.15.60:0/4188338190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77dc1036c0 msgr2=0x7f77dc198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e1da5640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77dc1036c0 0x7f77dc198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e1da5640 1 -- 172.21.15.60:0/4188338190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc10c180 msgr2=0x7f77dc19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.074+0000 7f77e1da5640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc10c180 0x7f77dc19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.075+0000 7f77e1da5640 1 -- 172.21.15.60:0/4188338190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77dc19d470 con 0x7f77dc102da0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.075+0000 7f77e1da5640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc102da0 0x7f77dc1984c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c890 tx=0x7f77d800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.075+0000 7f77d2ffd640 1 -- 172.21.15.60:0/4188338190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004220 con 0x7f77dc102da0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.075+0000 7f77d2ffd640 1 -- 172.21.15.60:0/4188338190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f77d80043c0 con 0x7f77dc102da0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.075+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77dc19d760 con 0x7f77dc102da0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.075+0000 7f77d2ffd640 1 -- 172.21.15.60:0/4188338190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004a00 con 0x7f77dc102da0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.075+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77dc1a5040 con 0x7f77dc102da0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.076+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77dc103180 con 0x7f77dc102da0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.077+0000 7f77d2ffd640 1 -- 172.21.15.60:0/4188338190 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f77d8004c60 con 0x7f77dc102da0 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.078+0000 7f77d2ffd640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77c80a2d70 0x7f77c80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.078+0000 7f77e15a4640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77c80a2d70 0x7f77c80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.078+0000 7f77d2ffd640 1 -- 172.21.15.60:0/4188338190 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8914+0+0 (secure 0 0 0) 0x7f77d80cf730 con 0x7f77dc102da0 2024-09-12T00:10:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.078+0000 7f77e15a4640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77c80a2d70 0x7f77c80a5230 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77dc10d4c0 tx=0x7f77cc009110 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.081+0000 7f77d2ffd640 1 -- 172.21.15.60:0/4188338190 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77d8014030 con 0x7f77dc102da0 2024-09-12T00:10:16.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.256+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f77dc199820 con 0x7f77dc102da0 2024-09-12T00:10:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.466+0000 7f77d2ffd640 1 -- 172.21.15.60:0/4188338190 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7f77dc199820 con 0x7f77dc102da0 2024-09-12T00:10:16.465 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T00:10:16.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.469+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77c80a2d70 msgr2=0x7f77c80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:16.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.469+0000 7f77e4009640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77c80a2d70 0x7f77c80a5230 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77dc10d4c0 tx=0x7f77cc009110 comp rx=0 tx=0).stop 2024-09-12T00:10:16.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc102da0 msgr2=0x7f77dc1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:16.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc102da0 0x7f77dc1984c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c890 tx=0x7f77d800cc90 comp rx=0 tx=0).stop 2024-09-12T00:10:16.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 shutdown_connections 2024-09-12T00:10:16.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f77c80a2d70 0x7f77c80a5230 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77dc10c180 0x7f77dc19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77dc1036c0 0x7f77dc198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 --2- 172.21.15.60:0/4188338190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77dc102da0 0x7f77dc1984c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:16.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 >> 172.21.15.60:0/4188338190 conn(0x7f77dc0fc7a0 msgr2=0x7f77dc0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:16.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 shutdown_connections 2024-09-12T00:10:16.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:16.470+0000 7f77e4009640 1 -- 172.21.15.60:0/4188338190 wait complete. 2024-09-12T00:10:16.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:16 smithi060 ceph-mon[30953]: pgmap v340: 97 pgs: 97 active+clean; 150 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T00:10:16.588 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:16 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4188338190' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:10:16.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:16 smithi105 ceph-mon[34805]: pgmap v340: 97 pgs: 97 active+clean; 150 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T00:10:16.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:16 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4188338190' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:10:16.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:16 smithi192 ceph-mon[35487]: pgmap v340: 97 pgs: 97 active+clean; 150 MiB data, 737 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-12T00:10:16.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:16 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4188338190' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:10:17.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T00:10:17.378 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T00:10:17.729 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:17 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/4188338190' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:10:17.733 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:17 smithi105 ceph-mon[34805]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T00:10:17.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:17 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/4188338190' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:10:17.784 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:17 smithi192 ceph-mon[35487]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T00:10:17.785 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:17 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/4188338190' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:10:17.786 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:17 smithi060 ceph-mon[30953]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 -- 172.21.15.60:0/2488892739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498101450 msgr2=0x7f8498105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 --2- 172.21.15.60:0/2488892739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498101450 0x7f8498105920 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8488009900 tx=0x7f848802a470 comp rx=0 tx=0).stop 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 -- 172.21.15.60:0/2488892739 shutdown_connections 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 --2- 172.21.15.60:0/2488892739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8498105f40 0x7f84981063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 --2- 172.21.15.60:0/2488892739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498101450 0x7f8498105920 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 --2- 172.21.15.60:0/2488892739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8498100b30 0x7f8498100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 -- 172.21.15.60:0/2488892739 >> 172.21.15.60:0/2488892739 conn(0x7f84980fc7a0 msgr2=0x7f84980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 -- 172.21.15.60:0/2488892739 shutdown_connections 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.872+0000 7f849fa9e640 1 -- 172.21.15.60:0/2488892739 wait complete. 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849fa9e640 1 Processor -- start 2024-09-12T00:10:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849fa9e640 1 -- start start 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849fa9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498100b30 0x7f84981a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849fa9e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8498101450 0x7f84981a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849fa9e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8498105f40 0x7f849819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849fa9e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8498118700 con 0x7f8498100b30 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849fa9e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8498118580 con 0x7f8498101450 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849fa9e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8498118880 con 0x7f8498105f40 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849d83a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498100b30 0x7f84981a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849d83a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498100b30 0x7f84981a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47442/0 (socket says 172.21.15.60:47442) 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.873+0000 7f849d83a640 1 -- 172.21.15.60:0/3065193206 learned_addr learned my addr 172.21.15.60:0/3065193206 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849d039640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8498101450 0x7f84981a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849e03b640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8498105f40 0x7f849819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849d83a640 1 -- 172.21.15.60:0/3065193206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8498105f40 msgr2=0x7f849819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849d83a640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8498105f40 0x7f849819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849d83a640 1 -- 172.21.15.60:0/3065193206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8498101450 msgr2=0x7f84981a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849d83a640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8498101450 0x7f84981a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849d83a640 1 -- 172.21.15.60:0/3065193206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849819f070 con 0x7f8498100b30 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849e03b640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8498105f40 0x7f849819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849d83a640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498100b30 0x7f84981a4780 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f849400c920 tx=0x7f849400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f848effd640 1 -- 172.21.15.60:0/3065193206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494007c70 con 0x7f8498100b30 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f848effd640 1 -- 172.21.15.60:0/3065193206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8494007e10 con 0x7f8498100b30 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849819f360 con 0x7f8498100b30 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f848effd640 1 -- 172.21.15.60:0/3065193206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494018940 con 0x7f8498100b30 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.874+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84981ab650 con 0x7f8498100b30 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.875+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8498105920 con 0x7f8498100b30 2024-09-12T00:10:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.876+0000 7f848effd640 1 -- 172.21.15.60:0/3065193206 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8494018b20 con 0x7f8498100b30 2024-09-12T00:10:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.877+0000 7f848effd640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f84840a2cf0 0x7f84840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T00:10:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.877+0000 7f848effd640 1 -- 172.21.15.60:0/3065193206 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8360+0+0 (secure 0 0 0) 0x7f84940cf600 con 0x7f8498100b30 2024-09-12T00:10:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.877+0000 7f849d039640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f84840a2cf0 0x7f84840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T00:10:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.877+0000 7f849d039640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f84840a2cf0 0x7f84840a51b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84981a0130 tx=0x7f84880095f0 comp rx=0 tx=0).ready entity=mgr.15216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T00:10:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:17.882+0000 7f848effd640 1 -- 172.21.15.60:0/3065193206 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8494014030 con 0x7f8498100b30 2024-09-12T00:10:18.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:18.059+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84981ab910 con 0x7f8498100b30 2024-09-12T00:10:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.021+0000 7f848effd640 1 -- 172.21.15.60:0/3065193206 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7f849400de20 con 0x7f8498100b30 2024-09-12T00:10:19.021 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T00:10:19.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.025+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f84840a2cf0 msgr2=0x7f84840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.025+0000 7f849fa9e640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f84840a2cf0 0x7f84840a51b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84981a0130 tx=0x7f84880095f0 comp rx=0 tx=0).stop 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.025+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498100b30 msgr2=0x7f84981a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.025+0000 7f849fa9e640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498100b30 0x7f84981a4780 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f849400c920 tx=0x7f849400cde0 comp rx=0 tx=0).stop 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.026+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 shutdown_connections 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.026+0000 7f849fa9e640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:6800/1761817386,v1:172.21.15.60:6801/1761817386] conn(0x7f84840a2cf0 0x7f84840a51b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.026+0000 7f849fa9e640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8498105f40 0x7f849819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.026+0000 7f849fa9e640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8498101450 0x7f84981a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.026+0000 7f849fa9e640 1 --2- 172.21.15.60:0/3065193206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8498100b30 0x7f84981a4780 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.026+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 >> 172.21.15.60:0/3065193206 conn(0x7f84980fc7a0 msgr2=0x7f84981038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T00:10:19.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.026+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 shutdown_connections 2024-09-12T00:10:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T00:10:19.026+0000 7f849fa9e640 1 -- 172.21.15.60:0/3065193206 wait complete. 2024-09-12T00:10:19.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:19 smithi192 ceph-mon[35487]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:10:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:19 smithi192 ceph-mon[35487]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T00:10:19.284 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:19 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3065193206' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:10:19.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:19 smithi060 ceph-mon[30953]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:10:19.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:19 smithi060 ceph-mon[30953]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T00:10:19.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:19 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3065193206' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:10:19.478 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:19 smithi105 ceph-mon[34805]: pgmap v342: 65 pgs: 65 active+clean; 577 KiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T00:10:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:19 smithi105 ceph-mon[34805]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T00:10:19.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:19 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3065193206' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T00:10:19.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:10:19.718 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:10:19.750 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:10:19.782 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T00:10:19.782 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T00:10:19.800 DEBUG:teuthology.orchestra.run.smithi105:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T00:10:19.817 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T00:10:19.839 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T00:10:19.840 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T00:10:19.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a 2024-09-12T00:10:20.033 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:19 smithi060 systemd[1]: Stopping Ceph mon.a for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:20 smithi060 ceph-mon[30953]: from='client.? 172.21.15.60:0/3065193206' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:10:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:20 smithi060 ceph-mon[30953]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T00:10:20.338 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a[30949]: 2024-09-12T00:10:20.147+0000 7f9b2082b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:10:20.339 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a[30949]: 2024-09-12T00:10:20.147+0000 7f9b2082b640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T00:10:20.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:20 smithi105 ceph-mon[34805]: from='client.? 172.21.15.60:0/3065193206' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:10:20.479 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:20 smithi105 ceph-mon[34805]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T00:10:20.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:20 smithi192 ceph-mon[35487]: from='client.? 172.21.15.60:0/3065193206' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T00:10:20.533 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:20 smithi192 ceph-mon[35487]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T00:10:20.838 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:20 smithi060 podman[111979]: 2024-09-12 00:10:20.413818517 +0000 UTC m=+0.374604288 container died 7c49f3335b084105e0e86316605416d95560e54866ab831a8c9dbde39e86cc80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T00:10:21.156 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:20 smithi060 podman[111979]: 2024-09-12 00:10:20.931201719 +0000 UTC m=+0.891987495 container cleanup 7c49f3335b084105e0e86316605416d95560e54866ab831a8c9dbde39e86cc80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T00:10:21.156 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:20 smithi060 bash[111979]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a 2024-09-12T00:10:21.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T00:10:21.412 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:21 smithi060 podman[111991]: 2024-09-12 00:10:21.158305183 +0000 UTC m=+0.740014278 container remove 7c49f3335b084105e0e86316605416d95560e54866ab831a8c9dbde39e86cc80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T00:10:21.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:21 smithi060 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T00:10:21.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:21 smithi060 systemd[1]: Stopped Ceph mon.a for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-12T00:10:21.446 INFO:journalctl@ceph.mon.a.smithi060.stdout:Sep 12 00:10:21 smithi060 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.a.service: Consumed 21.420s CPU time. 2024-09-12T00:10:21.463 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:21.463 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T00:10:21.463 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T00:10:21.463 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.b 2024-09-12T00:10:21.788 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:21 smithi105 systemd[1]: Stopping Ceph mon.b for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:22.042 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b[34800]: 2024-09-12T00:10:21.788+0000 7f18aaf0e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:10:22.042 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b[34800]: 2024-09-12T00:10:21.788+0000 7f18aaf0e640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T00:10:22.346 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:22 smithi105 podman[70702]: 2024-09-12 00:10:22.044300233 +0000 UTC m=+0.381566799 container died 075629e84e6e791bb68933e612a454963628f2e9baf34e76de874c2ad607d4e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:10:22.672 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:22 smithi105 podman[70702]: 2024-09-12 00:10:22.45599368 +0000 UTC m=+0.793260233 container cleanup 075629e84e6e791bb68933e612a454963628f2e9baf34e76de874c2ad607d4e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T00:10:22.673 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:22 smithi105 bash[70702]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b 2024-09-12T00:10:22.937 INFO:journalctl@ceph.mon.b.smithi105.stdout:Sep 12 00:10:22 smithi105 podman[70715]: 2024-09-12 00:10:22.67446263 +0000 UTC m=+0.625524232 container remove 075629e84e6e791bb68933e612a454963628f2e9baf34e76de874c2ad607d4e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T00:10:22.941 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T00:10:23.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:23.029 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T00:10:23.029 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T00:10:23.029 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.c 2024-09-12T00:10:23.358 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:23 smithi192 systemd[1]: Stopping Ceph mon.c for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:23.780 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:23 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c[35483]: 2024-09-12T00:10:23.359+0000 7f1b51a13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:10:23.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:23 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c[35483]: 2024-09-12T00:10:23.359+0000 7f1b51a13640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T00:10:23.781 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:23 smithi192 podman[71347]: 2024-09-12 00:10:23.553803652 +0000 UTC m=+0.324189579 container died 6e6cfd1a1b590e304cfe7e74134b7bb43a63da5b0ce5c0fdaf61fdc33da77ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T00:10:24.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:23 smithi192 podman[71347]: 2024-09-12 00:10:23.951736569 +0000 UTC m=+0.722122453 container cleanup 6e6cfd1a1b590e304cfe7e74134b7bb43a63da5b0ce5c0fdaf61fdc33da77ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:10:24.033 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:23 smithi192 bash[71347]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c 2024-09-12T00:10:24.323 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 12 00:10:24 smithi192 podman[71359]: 2024-09-12 00:10:24.212122833 +0000 UTC m=+0.650608126 container remove 6e6cfd1a1b590e304cfe7e74134b7bb43a63da5b0ce5c0fdaf61fdc33da77ed6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mon-c, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T00:10:24.343 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T00:10:24.395 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:24.395 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T00:10:24.395 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T00:10:24.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x 2024-09-12T00:10:24.728 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:24 smithi060 systemd[1]: Stopping Ceph mgr.x for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:25.045 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:24 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x[31179]: 2024-09-12T00:10:24.728+0000 7fe581757640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:10:25.045 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:24 smithi060 podman[112102]: 2024-09-12 00:10:24.759521636 +0000 UTC m=+0.154605607 container died 7c8c10ab78abe291870593287b92cf1a807b12a4097cd66ea7303d84ab0a65fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T00:10:25.338 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:25 smithi060 podman[112102]: 2024-09-12 00:10:25.156332496 +0000 UTC m=+0.551416501 container cleanup 7c8c10ab78abe291870593287b92cf1a807b12a4097cd66ea7303d84ab0a65fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T00:10:25.339 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:25 smithi060 bash[112102]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x 2024-09-12T00:10:25.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T00:10:25.758 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:25 smithi060 podman[112115]: 2024-09-12 00:10:25.426445676 +0000 UTC m=+0.660947080 container remove 7c8c10ab78abe291870593287b92cf1a807b12a4097cd66ea7303d84ab0a65fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:10:25.759 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:25 smithi060 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-12T00:10:25.759 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:25 smithi060 systemd[1]: Stopped Ceph mgr.x for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-12T00:10:25.759 INFO:journalctl@ceph.mgr.x.smithi060.stdout:Sep 12 00:10:25 smithi060 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.x.service: Consumed 55.332s CPU time. 2024-09-12T00:10:25.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:25.772 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T00:10:25.772 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T00:10:25.772 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.y 2024-09-12T00:10:26.130 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 12 00:10:25 smithi105 systemd[1]: Stopping Ceph mgr.y for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:26.478 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 12 00:10:26 smithi105 podman[70821]: 2024-09-12 00:10:26.131795394 +0000 UTC m=+0.163101458 container died 55dbd2b8e62db77395f6c0c46ca4dddb9cd90823a8c8bc6d58e2be20d5d17792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:10:26.878 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 12 00:10:26 smithi105 podman[70821]: 2024-09-12 00:10:26.595030371 +0000 UTC m=+0.626336434 container cleanup 55dbd2b8e62db77395f6c0c46ca4dddb9cd90823a8c8bc6d58e2be20d5d17792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T00:10:26.879 INFO:journalctl@ceph.mgr.y.smithi105.stdout:Sep 12 00:10:26 smithi105 bash[70821]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-y 2024-09-12T00:10:27.024 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T00:10:27.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:27.061 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T00:10:27.061 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T00:10:27.061 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.z 2024-09-12T00:10:27.409 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:27 smithi192 systemd[1]: Stopping Ceph mgr.z for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:27.698 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:27 smithi192 podman[71481]: 2024-09-12 00:10:27.410780195 +0000 UTC m=+0.151277862 container stop cae99f383f4e58b288bf75014419de2409c253c9349ef2e7903758b652212b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T00:10:27.698 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:27 smithi192 podman[71481]: 2024-09-12 00:10:27.436650532 +0000 UTC m=+0.177148200 container died cae99f383f4e58b288bf75014419de2409c253c9349ef2e7903758b652212b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T00:10:28.000 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:27 smithi192 podman[71481]: 2024-09-12 00:10:27.807837594 +0000 UTC m=+0.548335262 container cleanup cae99f383f4e58b288bf75014419de2409c253c9349ef2e7903758b652212b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T00:10:28.000 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:27 smithi192 bash[71481]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z 2024-09-12T00:10:28.233 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T00:10:28.267 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:28 smithi192 podman[71493]: 2024-09-12 00:10:28.001486046 +0000 UTC m=+0.581484569 container remove cae99f383f4e58b288bf75014419de2409c253c9349ef2e7903758b652212b8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T00:10:28.267 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:28 smithi192 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-12T00:10:28.267 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:28 smithi192 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-12T00:10:28.267 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:28 smithi192 systemd[1]: Stopped Ceph mgr.z for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-12T00:10:28.267 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 12 00:10:28 smithi192 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mgr.z.service: Consumed 11.516s CPU time. 2024-09-12T00:10:28.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:28.281 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T00:10:28.281 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T00:10:28.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.0 2024-09-12T00:10:28.589 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:28 smithi060 systemd[1]: Stopping Ceph osd.0 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:29.088 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:28 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0[44668]: 2024-09-12T00:10:28.626+0000 7f61fbb03640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:10:29.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:28 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0[44668]: 2024-09-12T00:10:28.626+0000 7f61fbb03640 -1 osd.0 96 *** Got signal Terminated *** 2024-09-12T00:10:29.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:28 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0[44668]: 2024-09-12T00:10:28.626+0000 7f61fbb03640 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:10:34.468 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:34 smithi060 podman[112220]: 2024-09-12 00:10:34.118545135 +0000 UTC m=+5.635258333 container died b59fbfa09b1a88c33e94915c5f96a7b6695474cadd4fd4ac69b500085c88854c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T00:10:34.760 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:34 smithi060 podman[112220]: 2024-09-12 00:10:34.560159762 +0000 UTC m=+6.076872958 container cleanup b59fbfa09b1a88c33e94915c5f96a7b6695474cadd4fd4ac69b500085c88854c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-12T00:10:34.760 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:34 smithi060 bash[112220]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0 2024-09-12T00:10:35.088 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:34 smithi060 podman[112237]: 2024-09-12 00:10:34.761491648 +0000 UTC m=+0.641173072 container remove b59fbfa09b1a88c33e94915c5f96a7b6695474cadd4fd4ac69b500085c88854c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T00:10:35.588 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:35 smithi060 podman[112333]: 2024-09-12 00:10:35.091914358 +0000 UTC m=+0.016464787 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:10:35.588 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:35 smithi060 podman[112333]: 2024-09-12 00:10:35.196224871 +0000 UTC m=+0.120775331 container create 6f6bd656444a7ba7a7b34e6df41a58a2abacff72501c561bfb38f629c1976129 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T00:10:36.088 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:35 smithi060 podman[112333]: 2024-09-12 00:10:35.632607408 +0000 UTC m=+0.557157825 container init 6f6bd656444a7ba7a7b34e6df41a58a2abacff72501c561bfb38f629c1976129 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T00:10:36.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:35 smithi060 podman[112333]: 2024-09-12 00:10:35.636221183 +0000 UTC m=+0.560771601 container start 6f6bd656444a7ba7a7b34e6df41a58a2abacff72501c561bfb38f629c1976129 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:10:36.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:35 smithi060 podman[112333]: 2024-09-12 00:10:35.724245656 +0000 UTC m=+0.648796085 container attach 6f6bd656444a7ba7a7b34e6df41a58a2abacff72501c561bfb38f629c1976129 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T00:10:36.089 INFO:journalctl@ceph.osd.0.smithi060.stdout:Sep 12 00:10:35 smithi060 podman[112333]: 2024-09-12 00:10:35.833118367 +0000 UTC m=+0.757668798 container died 6f6bd656444a7ba7a7b34e6df41a58a2abacff72501c561bfb38f629c1976129 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:10:36.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T00:10:36.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:36.547 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T00:10:36.547 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T00:10:36.547 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.1 2024-09-12T00:10:36.857 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:36 smithi105 systemd[1]: Stopping Ceph osd.1 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:37.229 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1[39268]: 2024-09-12T00:10:36.858+0000 7fc10b8a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:10:37.229 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1[39268]: 2024-09-12T00:10:36.858+0000 7fc10b8a9640 -1 osd.1 96 *** Got signal Terminated *** 2024-09-12T00:10:37.229 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1[39268]: 2024-09-12T00:10:36.858+0000 7fc10b8a9640 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:10:42.479 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:42 smithi105 podman[70957]: 2024-09-12 00:10:42.188631946 +0000 UTC m=+5.454276718 container died 359c6a00ece886c52a9a991318bdebc464eab1725af7f00672d8871829b280f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-12T00:10:42.842 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:42 smithi105 podman[70957]: 2024-09-12 00:10:42.592382092 +0000 UTC m=+5.858026870 container cleanup 359c6a00ece886c52a9a991318bdebc464eab1725af7f00672d8871829b280f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-12T00:10:42.842 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:42 smithi105 bash[70957]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1 2024-09-12T00:10:43.203 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:42 smithi105 podman[70972]: 2024-09-12 00:10:42.843804288 +0000 UTC m=+0.657980338 container remove 359c6a00ece886c52a9a991318bdebc464eab1725af7f00672d8871829b280f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T00:10:43.481 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:43 smithi105 podman[71059]: 2024-09-12 00:10:43.107923497 +0000 UTC m=+0.016307813 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:10:43.481 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:43 smithi105 podman[71059]: 2024-09-12 00:10:43.236417909 +0000 UTC m=+0.144802271 container create 4b7d0afaa9c4c014a92487051bad083622fda50755093e0faa9ea0b445e3426c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T00:10:43.979 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:43 smithi105 podman[71059]: 2024-09-12 00:10:43.514386218 +0000 UTC m=+0.422770519 container init 4b7d0afaa9c4c014a92487051bad083622fda50755093e0faa9ea0b445e3426c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T00:10:43.979 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:43 smithi105 podman[71059]: 2024-09-12 00:10:43.518056109 +0000 UTC m=+0.426440411 container start 4b7d0afaa9c4c014a92487051bad083622fda50755093e0faa9ea0b445e3426c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T00:10:43.979 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:43 smithi105 podman[71059]: 2024-09-12 00:10:43.614450035 +0000 UTC m=+0.522834334 container attach 4b7d0afaa9c4c014a92487051bad083622fda50755093e0faa9ea0b445e3426c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T00:10:43.979 INFO:journalctl@ceph.osd.1.smithi105.stdout:Sep 12 00:10:43 smithi105 podman[71059]: 2024-09-12 00:10:43.705899801 +0000 UTC m=+0.614284103 container died 4b7d0afaa9c4c014a92487051bad083622fda50755093e0faa9ea0b445e3426c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T00:10:44.417 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T00:10:44.461 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:44.461 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T00:10:44.461 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T00:10:44.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.2 2024-09-12T00:10:44.783 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:44 smithi192 systemd[1]: Stopping Ceph osd.2 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:45.283 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2[40453]: 2024-09-12T00:10:44.787+0000 7f8c55d0a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:10:45.283 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2[40453]: 2024-09-12T00:10:44.787+0000 7f8c55d0a640 -1 osd.2 96 *** Got signal Terminated *** 2024-09-12T00:10:45.284 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2[40453]: 2024-09-12T00:10:44.787+0000 7f8c55d0a640 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:10:50.497 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:50 smithi192 podman[71606]: 2024-09-12 00:10:50.205601878 +0000 UTC m=+5.544020289 container died a6f5de50ce03d76c24670915d132c014679572aea806cfd2621dca85fa081293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T00:10:50.783 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:50 smithi192 podman[71606]: 2024-09-12 00:10:50.588452427 +0000 UTC m=+5.926870848 container cleanup a6f5de50ce03d76c24670915d132c014679572aea806cfd2621dca85fa081293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-12T00:10:50.783 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:50 smithi192 bash[71606]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2 2024-09-12T00:10:51.157 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:50 smithi192 podman[71620]: 2024-09-12 00:10:50.84016435 +0000 UTC m=+0.628011279 container remove a6f5de50ce03d76c24670915d132c014679572aea806cfd2621dca85fa081293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T00:10:51.435 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:51 smithi192 podman[71709]: 2024-09-12 00:10:51.061606121 +0000 UTC m=+0.016016274 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:10:51.435 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:51 smithi192 podman[71709]: 2024-09-12 00:10:51.174446628 +0000 UTC m=+0.128856818 container create 0e4fac9dc2ade2107666143c92fe944353cc284003ad6ef450dbc7600dd19e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T00:10:51.435 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:51 smithi192 podman[71709]: 2024-09-12 00:10:51.435454484 +0000 UTC m=+0.389864632 container init 0e4fac9dc2ade2107666143c92fe944353cc284003ad6ef450dbc7600dd19e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T00:10:51.784 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:51 smithi192 podman[71709]: 2024-09-12 00:10:51.439119507 +0000 UTC m=+0.393529654 container start 0e4fac9dc2ade2107666143c92fe944353cc284003ad6ef450dbc7600dd19e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T00:10:51.784 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:51 smithi192 podman[71709]: 2024-09-12 00:10:51.535750517 +0000 UTC m=+0.490160684 container attach 0e4fac9dc2ade2107666143c92fe944353cc284003ad6ef450dbc7600dd19e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:10:51.784 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 12 00:10:51 smithi192 podman[71709]: 2024-09-12 00:10:51.626061833 +0000 UTC m=+0.580471987 container died 0e4fac9dc2ade2107666143c92fe944353cc284003ad6ef450dbc7600dd19e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T00:10:52.281 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T00:10:52.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:10:52.323 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T00:10:52.323 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T00:10:52.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.3 2024-09-12T00:10:52.639 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:52 smithi060 systemd[1]: Stopping Ceph osd.3 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:10:53.088 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:52 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3[51546]: 2024-09-12T00:10:52.638+0000 7f480693f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:10:53.089 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:52 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3[51546]: 2024-09-12T00:10:52.638+0000 7f480693f640 -1 osd.3 96 *** Got signal Terminated *** 2024-09-12T00:10:53.089 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:52 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3[51546]: 2024-09-12T00:10:52.638+0000 7f480693f640 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:10:55.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:10:54 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:10:54.950+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:10:56.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:10:55 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:10:55.979+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:10:57.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:10:56 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:10:56.939+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:10:57.281 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:10:56 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:10:56.922+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:10:57.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:10:56 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:10:56.938+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:10:57.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:10:57 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:10:57.282+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:10:58.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:10:57 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:10:57.954+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:10:58.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:10:57 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:10:57.931+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:10:58.289 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:57 smithi060 podman[112437]: 2024-09-12 00:10:57.996328908 +0000 UTC m=+5.470589314 container died 3ed6065fcf6abe45255e6ff59f62820cc0206e7fe0f3f6c4836f9c58c651a6b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T00:10:58.290 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:10:57 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:10:57.966+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:10:58.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:10:58 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:10:58.306+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:10:58.588 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:58 smithi060 podman[112437]: 2024-09-12 00:10:58.482264096 +0000 UTC m=+5.956524501 container cleanup 3ed6065fcf6abe45255e6ff59f62820cc0206e7fe0f3f6c4836f9c58c651a6b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T00:10:58.589 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:58 smithi060 bash[112437]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3 2024-09-12T00:10:59.075 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:58 smithi060 podman[112451]: 2024-09-12 00:10:58.758993241 +0000 UTC m=+0.756006417 container remove 3ed6065fcf6abe45255e6ff59f62820cc0206e7fe0f3f6c4836f9c58c651a6b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T00:10:59.076 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:10:58 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:10:58.964+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:10:59.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:10:58 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:10:58.976+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:10:59.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:10:58 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:10:58.925+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:10:59.338 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:10:59 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:10:59.278+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:10:59.339 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:59 smithi060 podman[112539]: 2024-09-12 00:10:58.980064031 +0000 UTC m=+0.016738212 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:10:59.339 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:59 smithi060 podman[112539]: 2024-09-12 00:10:59.084929257 +0000 UTC m=+0.121603466 container create 2c95dd25d5bfd0c4486dd77438556b2138390f1b6d2b88196f6a68c089a96b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T00:10:59.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:10:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:10:59.392+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:10:59.838 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:59 smithi060 podman[112539]: 2024-09-12 00:10:59.379533528 +0000 UTC m=+0.416207707 container init 2c95dd25d5bfd0c4486dd77438556b2138390f1b6d2b88196f6a68c089a96b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T00:10:59.839 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:59 smithi060 podman[112539]: 2024-09-12 00:10:59.382945071 +0000 UTC m=+0.419619244 container start 2c95dd25d5bfd0c4486dd77438556b2138390f1b6d2b88196f6a68c089a96b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:10:59.839 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:59 smithi060 podman[112539]: 2024-09-12 00:10:59.471393386 +0000 UTC m=+0.508067570 container attach 2c95dd25d5bfd0c4486dd77438556b2138390f1b6d2b88196f6a68c089a96b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:10:59.839 INFO:journalctl@ceph.osd.3.smithi060.stdout:Sep 12 00:10:59 smithi060 podman[112539]: 2024-09-12 00:10:59.587705784 +0000 UTC m=+0.624379957 container died 2c95dd25d5bfd0c4486dd77438556b2138390f1b6d2b88196f6a68c089a96b30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T00:11:00.215 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:10:59 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:10:59.977+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:00.238 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T00:11:00.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:11:00.284 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T00:11:00.284 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T00:11:00.285 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.4 2024-09-12T00:11:00.285 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:10:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:10:59.926+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:00.311 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:00 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:00.006+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:00.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:00.257+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:00.603 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:00 smithi105 systemd[1]: Stopping Ceph osd.4 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:11:00.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:00.422+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:00.979 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:00 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-12T00:11:00.604+0000 7fb902131640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:11:00.979 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:00 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-12T00:11:00.604+0000 7fb902131640 -1 osd.4 96 *** Got signal Terminated *** 2024-09-12T00:11:00.979 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:00 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-12T00:11:00.604+0000 7fb902131640 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:11:01.268 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:00 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:00.942+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:01.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:00.972+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:01.479 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:00 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:00.985+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:01.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:01 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:01.268+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:01.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:01 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:01.422+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:02.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:02 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:02.003+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:02.281 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:01 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:01.965+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:02.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:01 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:01.980+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:02.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:02 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:02.281+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:02.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:02 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:02.386+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:03.228 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:02 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:02.958+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:03.274 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:02 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:02.927+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:03.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:03 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:03.001+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:03.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:03.275+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:03.729 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:03 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-12T00:11:03.504+0000 7fb8fe747640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.870208+0000 front 2024-09-12T00:10:39.870187+0000 (oldest deadline 2024-09-12T00:11:03.370311+0000) 2024-09-12T00:11:03.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:03 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:03.279+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:03.735 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:03 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:03.426+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:04.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:03 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:03.912+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:04.284 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:04 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:04.007+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:04.284 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:04 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:04.007+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:04.302 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:03.909+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:04.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:04.303+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:04.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:04 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:04.292+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:04.729 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:04 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-12T00:11:04.532+0000 7fb8fe747640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.870208+0000 front 2024-09-12T00:10:39.870187+0000 (oldest deadline 2024-09-12T00:11:03.370311+0000) 2024-09-12T00:11:04.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:04 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:04.415+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:05.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:04 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:04.962+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:05.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:05 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:05.013+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:05.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:05 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:05.013+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:05.335 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:04 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:04.865+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:05.510 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:05 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:05.338+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:05.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:05 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:05.336+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:05.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:05 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:05.336+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:05.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:05 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:05.367+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:05.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:05 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:05.495+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:05.938 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:05 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4[46180]: 2024-09-12T00:11:05.515+0000 7fb8fe747640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.870208+0000 front 2024-09-12T00:10:39.870187+0000 (oldest deadline 2024-09-12T00:11:03.370311+0000) 2024-09-12T00:11:06.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:05 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:05.938+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:06.229 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:05 smithi105 podman[71162]: 2024-09-12 00:11:05.97877706 +0000 UTC m=+5.496172263 container died 7ce59771b3fc61b5881a7f6cbb789eaaf4b1a28dc0a65454121a86b22e7a9ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T00:11:06.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:06 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:06.025+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:06.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:06 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:06.025+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:06.321 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:05 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:05.882+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:06.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:06 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:06.322+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:06.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:06 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:06.322+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:06.655 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:06 smithi105 podman[71162]: 2024-09-12 00:11:06.394018659 +0000 UTC m=+5.911413859 container cleanup 7ce59771b3fc61b5881a7f6cbb789eaaf4b1a28dc0a65454121a86b22e7a9ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:11:06.655 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:06 smithi105 bash[71162]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4 2024-09-12T00:11:06.656 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:06 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:06.354+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:06.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:06 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:06.449+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:06.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:06 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:06.322+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:06.914 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:06 smithi105 podman[71190]: 2024-09-12 00:11:06.656725083 +0000 UTC m=+0.675289459 container remove 7ce59771b3fc61b5881a7f6cbb789eaaf4b1a28dc0a65454121a86b22e7a9ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T00:11:07.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:06 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:06.835+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:07.208 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:07 smithi105 podman[71277]: 2024-09-12 00:11:06.959458094 +0000 UTC m=+0.015984995 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:11:07.208 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:07 smithi105 podman[71277]: 2024-09-12 00:11:07.082579807 +0000 UTC m=+0.139106695 container create 7295457ceba0a793484e721613cb2bb2b847f647c8757d9e05053701c3400296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T00:11:07.208 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:06 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:06.914+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:07.209 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:06 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:06.914+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:07.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:07 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:07.012+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:07.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:07 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:07.012+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:07.459 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:07 smithi105 podman[71277]: 2024-09-12 00:11:07.361047954 +0000 UTC m=+0.417574845 container init 7295457ceba0a793484e721613cb2bb2b847f647c8757d9e05053701c3400296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:11:07.459 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:07 smithi105 podman[71277]: 2024-09-12 00:11:07.364333444 +0000 UTC m=+0.420860347 container start 7295457ceba0a793484e721613cb2bb2b847f647c8757d9e05053701c3400296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T00:11:07.459 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:07 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:07.394+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:07.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:07 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:07.305+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:07.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:07 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:07.305+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:07.729 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:07 smithi105 podman[71277]: 2024-09-12 00:11:07.460989026 +0000 UTC m=+0.517515934 container attach 7295457ceba0a793484e721613cb2bb2b847f647c8757d9e05053701c3400296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T00:11:07.729 INFO:journalctl@ceph.osd.4.smithi105.stdout:Sep 12 00:11:07 smithi105 podman[71277]: 2024-09-12 00:11:07.553159804 +0000 UTC m=+0.609686704 container died 7295457ceba0a793484e721613cb2bb2b847f647c8757d9e05053701c3400296 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T00:11:07.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:07 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:07.447+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:07.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:07 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:07.318+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:07.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:07 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:07.318+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:08.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:07 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:07.797+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:08.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:07 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:07.797+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:08.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:07 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:07.939+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:08.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:07 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:07.939+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:08.257 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T00:11:08.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:08.019+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:08.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:08.019+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:08.340 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:11:08.340 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T00:11:08.340 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T00:11:08.340 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.5 2024-09-12T00:11:08.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:08 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:08.320+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:08.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:08 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:08.320+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:08.650 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:08.474+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:08.650 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:08 smithi192 systemd[1]: Stopping Ceph osd.5 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:11:08.651 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:08.651+0000 7fa6c4f63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:11:08.651 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:08.651+0000 7fa6c4f63640 -1 osd.5 96 *** Got signal Terminated *** 2024-09-12T00:11:08.651 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:08.651+0000 7fa6c4f63640 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:11:08.651 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:08.325+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:08.651 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:08.325+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:08.728 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:08 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:08.389+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:09.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:08 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:08.818+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:09.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:08 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:08.818+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:09.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:08 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:08.924+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:09.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:08 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:08.924+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:09.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:08.990+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:09.284 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:08 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:08.990+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:09.728 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:09 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:09.377+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:09.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:09 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:09.455+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:09.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:09 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:09.295+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:09.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:09 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:09.295+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:09.791 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:09 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:09.348+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:09.791 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:09 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:09.348+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:10.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:09 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:09.791+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:10.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:09 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:09.791+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:10.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:09 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:09.925+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:10.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:09 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:09.925+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:10.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:10 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:10.013+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:10.284 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:10 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:10.013+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:10.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:10 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:10.335+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:10.758 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:10.392+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:10.758 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:10.392+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:10.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:10 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:10.460+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:10.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:10 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:10.339+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:10.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:10 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:10.339+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:11.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:10.759+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:11.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:10 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:10.759+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:11.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:10 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:10.885+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:11.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:10 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:10.885+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:11.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:10 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:10.972+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:11.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:10 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:10.972+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:11.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:11 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:11.332+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:11.772 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:11.411+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:11.772 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:11.411+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:11.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:11 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:11.419+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:11.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:11 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:11.330+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:11.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:11 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:11.330+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:12.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:11.773+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:12.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:11 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:11.773+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:12.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:11 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:11.898+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:12.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:11 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:11.898+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:12.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:11 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:11.898+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:12.284 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:12.018+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:12.284 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:12.018+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:12.284 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:12.018+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.144358+0000 front 2024-09-12T00:10:47.144339+0000 (oldest deadline 2024-09-12T00:11:11.844432+0000) 2024-09-12T00:11:12.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:12.344+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:12.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:12.344+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:12.733 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:12.410+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:12.733 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:12.410+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:12.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:12.445+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:12.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:12.368+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:12.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:12.368+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:12.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:12 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:12.368+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:13.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:12.733+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:13.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:12 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:12.733+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:13.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:12.865+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:13.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:12.865+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:13.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:12 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:12.865+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:13.401 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:13 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:13.055+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:31.942717+0000 front 2024-09-12T00:10:31.942728+0000 (oldest deadline 2024-09-12T00:10:56.642502+0000) 2024-09-12T00:11:13.401 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:13 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:13.055+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.343386+0000 front 2024-09-12T00:10:41.343425+0000 (oldest deadline 2024-09-12T00:11:03.643452+0000) 2024-09-12T00:11:13.401 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:13 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5[47376]: 2024-09-12T00:11:13.055+0000 7fa6c1579640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.144358+0000 front 2024-09-12T00:10:47.144339+0000 (oldest deadline 2024-09-12T00:11:11.844432+0000) 2024-09-12T00:11:13.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:13 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:13.308+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:13.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:13 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:13.308+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:13.773 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:13.383+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:13.773 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:13.383+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:13.773 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:13.383+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:13.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:13 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:13.483+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:13.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:13 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:13.403+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:13.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:13 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:13.403+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:13.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:13 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:13.403+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:14.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:13.773+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:14.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:13.773+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:14.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:13 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:13.851+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:14.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:13 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:13.851+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:14.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:13 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:13.851+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:14.283 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:14 smithi192 podman[71824]: 2024-09-12 00:11:14.013349631 +0000 UTC m=+5.467893139 container died 576bd29f6a6ef4bd8aae0f7890777858ae4105d02b00e43b0b7763bdbe3973e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T00:11:14.661 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:14 smithi192 podman[71824]: 2024-09-12 00:11:14.387187397 +0000 UTC m=+5.841730901 container cleanup 576bd29f6a6ef4bd8aae0f7890777858ae4105d02b00e43b0b7763bdbe3973e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T00:11:14.662 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:14 smithi192 bash[71824]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5 2024-09-12T00:11:14.662 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:14 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:14.447+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:14.662 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:14 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:14.447+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:14.662 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:14 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:14.425+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:14.662 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:14 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:14.425+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:14.662 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:14 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:14.425+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:14.728 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:14 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:14.344+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:14.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:14 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:14.344+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:14.768 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:14.397+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:14.768 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:14.397+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:14.768 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:14.397+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:15.004 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:14 smithi192 podman[71839]: 2024-09-12 00:11:14.663445583 +0000 UTC m=+0.644002744 container remove 576bd29f6a6ef4bd8aae0f7890777858ae4105d02b00e43b0b7763bdbe3973e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD) 2024-09-12T00:11:15.109 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:14.769+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:15.110 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:14.769+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:15.110 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:14 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:14.769+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.947023+0000 front 2024-09-12T00:10:47.946987+0000 (oldest deadline 2024-09-12T00:11:13.847037+0000) 2024-09-12T00:11:15.233 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:14 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:14.845+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:15.233 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:14 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:14.845+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:15.233 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:14 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:14.845+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:15.287 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:15 smithi192 podman[71928]: 2024-09-12 00:11:14.908709123 +0000 UTC m=+0.016106200 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:11:15.287 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:15 smithi192 podman[71928]: 2024-09-12 00:11:15.039496125 +0000 UTC m=+0.146893190 container create 995cddb5a58fe5762c5f3f2b3b5e95fc290953b0d7d9f23890b3d4c57f30cf90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T00:11:15.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:15 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:15.308+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:15.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:15 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:15.308+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:15.772 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:15.397+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:15.772 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:15.397+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:15.772 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:15.397+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:15.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:15 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:15.454+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:15.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:15 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:15.454+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:15.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:15 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:15.461+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:15.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:15 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:15.461+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:15.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:15 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:15.461+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:15.785 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:15 smithi192 podman[71928]: 2024-09-12 00:11:15.348063035 +0000 UTC m=+0.455460099 container init 995cddb5a58fe5762c5f3f2b3b5e95fc290953b0d7d9f23890b3d4c57f30cf90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T00:11:15.785 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:15 smithi192 podman[71928]: 2024-09-12 00:11:15.351461693 +0000 UTC m=+0.458858758 container start 995cddb5a58fe5762c5f3f2b3b5e95fc290953b0d7d9f23890b3d4c57f30cf90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T00:11:15.785 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:15 smithi192 podman[71928]: 2024-09-12 00:11:15.458789995 +0000 UTC m=+0.566187060 container attach 995cddb5a58fe5762c5f3f2b3b5e95fc290953b0d7d9f23890b3d4c57f30cf90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:11:15.785 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 12 00:11:15 smithi192 podman[71928]: 2024-09-12 00:11:15.544746055 +0000 UTC m=+0.652143134 container died 995cddb5a58fe5762c5f3f2b3b5e95fc290953b0d7d9f23890b3d4c57f30cf90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T00:11:16.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:15.773+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:16.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:15.773+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:16.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:15 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:15.773+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.947023+0000 front 2024-09-12T00:10:47.946987+0000 (oldest deadline 2024-09-12T00:11:13.847037+0000) 2024-09-12T00:11:16.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:15 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:15.874+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:16.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:15 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:15.874+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:16.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:15 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:15.874+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:16.242 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T00:11:16.282 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:11:16.282 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T00:11:16.282 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T00:11:16.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.6 2024-09-12T00:11:16.552 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:16.274+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:16.552 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:16.274+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:16.589 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:16 smithi060 systemd[1]: Stopping Ceph osd.6 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:11:16.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:16.375+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:16.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:16.376+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:16.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:16.376+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:16.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:16.476+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:16.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:16.476+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:16.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:16.487+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:16.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:16.487+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:16.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:16 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:16.487+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:17.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:16.606+0000 7f1fe0007640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:11:17.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:16.606+0000 7f1fe0007640 -1 osd.6 96 *** Got signal Terminated *** 2024-09-12T00:11:17.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:16.606+0000 7f1fe0007640 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:11:17.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:16.813+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:17.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:16.813+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:17.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:16 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:16.813+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.947023+0000 front 2024-09-12T00:10:47.946987+0000 (oldest deadline 2024-09-12T00:11:13.847037+0000) 2024-09-12T00:11:17.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:16.840+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:17.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:16.840+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:17.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:16 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:16.840+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:17.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:17.301+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:17.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:17.301+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:17.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:17 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:17.454+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:17.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:17 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:17.454+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:17.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:17 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:17.497+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:17.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:17 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:17.497+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:17.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:17 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:17.497+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:17.822 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:17.380+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:17.822 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:17.380+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:17.822 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:17.380+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:18.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:17.823+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:18.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:17.823+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:18.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:17 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:17.823+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.947023+0000 front 2024-09-12T00:10:47.946987+0000 (oldest deadline 2024-09-12T00:11:13.847037+0000) 2024-09-12T00:11:18.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:17.793+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:18.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:17.793+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:18.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:17.793+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:18.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:18.321+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:18.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:18.321+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:18.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:18 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:18.413+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:18.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:18 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:18.413+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:18.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:18 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:18.472+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:18.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:18 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:18.472+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:18.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:18 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:18.472+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:18.793 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:18.405+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:18.793 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:18.405+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:18.793 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:18.405+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:19.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:18.794+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:19.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:18.794+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:19.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:18 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:18.794+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.947023+0000 front 2024-09-12T00:10:47.946987+0000 (oldest deadline 2024-09-12T00:11:13.847037+0000) 2024-09-12T00:11:19.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:18.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:19.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:18.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:19.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:18.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:19.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:18 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:18.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:19.709 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:19.348+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:19.709 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:19.348+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:19.752 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:19.361+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:19.752 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:19.361+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:19.752 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:19.361+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:19.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:19.386+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:19.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:19.386+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:19.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:19.386+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:19.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:19.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:19.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:19.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:19.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:19 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:19.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:19.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:19.710+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:19.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:19.710+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:19.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:19.710+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:19.980 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:19 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:19.710+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:20.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:19.752+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:20.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:19.752+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:20.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:19.752+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.947023+0000 front 2024-09-12T00:10:47.946987+0000 (oldest deadline 2024-09-12T00:11:13.847037+0000) 2024-09-12T00:11:20.089 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:19 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:19.752+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.847529+0000 front 2024-09-12T00:10:53.847578+0000 (oldest deadline 2024-09-12T00:11:19.147687+0000) 2024-09-12T00:11:20.723 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:20.395+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:20.723 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:20.395+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:20.723 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:20.395+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:20.766 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:20.382+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:20.766 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:20.382+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:20.766 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:20.382+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:20.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:20.399+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:20.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:20.399+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:20.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:20.399+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:20.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:20.489+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:20.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:20.489+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:20.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:20 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:20.489+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:20.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:20.724+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:20.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:20.724+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:20.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:20.724+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:20.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:20 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:20.724+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:21.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:20.767+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.144660+0000 front 2024-09-12T00:10:32.144793+0000 (oldest deadline 2024-09-12T00:10:56.244733+0000) 2024-09-12T00:11:21.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:20.767+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.545883+0000 front 2024-09-12T00:10:41.545829+0000 (oldest deadline 2024-09-12T00:11:06.845869+0000) 2024-09-12T00:11:21.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:20.767+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.947023+0000 front 2024-09-12T00:10:47.946987+0000 (oldest deadline 2024-09-12T00:11:13.847037+0000) 2024-09-12T00:11:21.088 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:20 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6[58293]: 2024-09-12T00:11:20.767+0000 7f1fd8615640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.847529+0000 front 2024-09-12T00:10:53.847578+0000 (oldest deadline 2024-09-12T00:11:19.147687+0000) 2024-09-12T00:11:21.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:21.368+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:21.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:21.368+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:21.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:21.368+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:21.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:21.446+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:21.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:21.446+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:21.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:21.446+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:21.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:21.477+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:21.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:21.477+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:21.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:21 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:21.477+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:21.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:21.395+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:21.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:21.395+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:21.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:21 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:21.395+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:22.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:21.765+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:22.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:21.765+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:22.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:21.765+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:22.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:21.765+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:22.335 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:22 smithi060 podman[112642]: 2024-09-12 00:11:22.043215765 +0000 UTC m=+5.552267507 container died 3cce3f41e9ba6fa836cf9872088ba17ffb7cfac2558067a4c4b83eaa20efcf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-12T00:11:22.588 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:22 smithi060 podman[112642]: 2024-09-12 00:11:22.411367706 +0000 UTC m=+5.920419447 container cleanup 3cce3f41e9ba6fa836cf9872088ba17ffb7cfac2558067a4c4b83eaa20efcf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:11:22.589 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:22 smithi060 bash[112642]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6 2024-09-12T00:11:22.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:22 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:22.395+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:22.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:22 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:22.395+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:22.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:22 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:22.395+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:22.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:22 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:22.332+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:22.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:22 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:22.332+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:22.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:22 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:22.332+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:22.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:22 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:22.411+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:22.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:22 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:22.411+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:22.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:22 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:22.411+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:22.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:22 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:22.452+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:22.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:22 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:22.452+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:22.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:22 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:22.452+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:23.040 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:22 smithi060 podman[112660]: 2024-09-12 00:11:22.721200334 +0000 UTC m=+0.674138271 container remove 3cce3f41e9ba6fa836cf9872088ba17ffb7cfac2558067a4c4b83eaa20efcf73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T00:11:23.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:22 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:22.735+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:23.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:22 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:22.735+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:23.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:22 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:22.735+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:23.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:22 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:22.735+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:23.298 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:23 smithi060 podman[112749]: 2024-09-12 00:11:22.94496658 +0000 UTC m=+0.016295296 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:11:23.298 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:23 smithi060 podman[112749]: 2024-09-12 00:11:23.076445949 +0000 UTC m=+0.147774654 container create 4f327d807fca36aaea72e92a7cf2c96c7b96298cebdd118f28a0a053ba91bce9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:11:23.298 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:23 smithi060 podman[112749]: 2024-09-12 00:11:23.29957324 +0000 UTC m=+0.370901943 container init 4f327d807fca36aaea72e92a7cf2c96c7b96298cebdd118f28a0a053ba91bce9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T00:11:23.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:23.437+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:23.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:23.437+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:23.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:23 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:23.437+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:23.589 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:23 smithi060 podman[112749]: 2024-09-12 00:11:23.303134766 +0000 UTC m=+0.374463470 container start 4f327d807fca36aaea72e92a7cf2c96c7b96298cebdd118f28a0a053ba91bce9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T00:11:23.589 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:23 smithi060 podman[112749]: 2024-09-12 00:11:23.399756365 +0000 UTC m=+0.471085074 container attach 4f327d807fca36aaea72e92a7cf2c96c7b96298cebdd118f28a0a053ba91bce9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:11:23.589 INFO:journalctl@ceph.osd.6.smithi060.stdout:Sep 12 00:11:23 smithi060 podman[112749]: 2024-09-12 00:11:23.499662919 +0000 UTC m=+0.570991623 container died 4f327d807fca36aaea72e92a7cf2c96c7b96298cebdd118f28a0a053ba91bce9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:11:23.685 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:23 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:23.391+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:23.685 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:23 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:23.391+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:23.685 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:23 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:23.391+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:23.685 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:23 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:23.407+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:23.685 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:23 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:23.407+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:23.686 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:23 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:23.407+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:23.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:23 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:23.322+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:23.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:23 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:23.322+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:23.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:23 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:23.322+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:24.190 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T00:11:24.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:23 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:23.751+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:24.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:23 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:23.751+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:24.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:23 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:23.751+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:24.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:23 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:23.751+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:24.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:11:24.238 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T00:11:24.238 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T00:11:24.238 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.7 2024-09-12T00:11:24.560 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:24.287+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:24.560 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:24.287+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:24.560 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:24.287+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:24.561 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:24 smithi105 systemd[1]: Stopping Ceph osd.7 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:11:24.561 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:24.559+0000 7f62cf8d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:11:24.561 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:24.559+0000 7f62cf8d6640 -1 osd.7 96 *** Got signal Terminated *** 2024-09-12T00:11:24.785 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:24 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:24.387+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:24.785 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:24 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:24.387+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:24.785 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:24 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:24.387+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:24.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:24 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:24.369+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:24.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:24 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:24.369+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:24.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:24 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:24.369+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:24.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:24 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:24.480+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:24.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:24 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:24.480+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:24.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:24 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:24.480+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:24.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:24 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:24.480+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:24.979 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:24.559+0000 7f62cf8d6640 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:11:24.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:24.724+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:24.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:24.724+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:24.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:24.724+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:24.980 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:24 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:24.724+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:25.718 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:25.316+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:25.718 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:25.316+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:25.719 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:25.316+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:25.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:25 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:25.340+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:25.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:25 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:25.340+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:25.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:25 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:25.340+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:25.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:25 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:25.419+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:25.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:25 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:25.419+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:25.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:25 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:25.419+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:25.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:25 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:25.484+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:25.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:25 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:25.484+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:25.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:25 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:25.484+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:25.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:25 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:25.484+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:25.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:25.719+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:25.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:25.719+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:25.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:25.719+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:25.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:25.719+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:26.727 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:26 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:26.327+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:26.727 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:26 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:26.327+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:26.727 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:26 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:26.327+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:26.783 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:26 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:26.309+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:26.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:26 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:26.309+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:26.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:26 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:26.309+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:26.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:26 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:26.423+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:26.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:26 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:26.423+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:26.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:26 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:26.423+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:26.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:26 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:26.449+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:26.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:26 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:26.449+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:26.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:26 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:26.449+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:26.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:26 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:26.449+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:26.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:26 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:26.727+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:26.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:26 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:26.727+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:26.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:26 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:26.727+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:26.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:26 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:26.727+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:27.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:27 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:27.264+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:27.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:27 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:27.264+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:27.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:27 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:27.264+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:27.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:27 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:27.264+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:27.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:27 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:27.387+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:27.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:27 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:27.387+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:27.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:27 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:27.387+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:27.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:27 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:27.387+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:27.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:27.352+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:27.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:27.352+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:27.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:27.352+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:27.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:27 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:27.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:27.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:27 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:27.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:27.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:27 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:27.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:27.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:27 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:27.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:28.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:27.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:28.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:27.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:28.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:27.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:28.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:27.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:28.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:27 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:27.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:28.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:28 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:28.217+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:28.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:28 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:28.217+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:28.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:28 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:28.217+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:28.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:28 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:28.217+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:28.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:28 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:28.338+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:28.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:28 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:28.338+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:28.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:28 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:28.338+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:28.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:28 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:28.338+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:28.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:28.340+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:28.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:28.340+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:28.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:28.340+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:28.729 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:28.340+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.518553+0000 front 2024-09-12T00:11:05.518570+0000 (oldest deadline 2024-09-12T00:11:27.818658+0000) 2024-09-12T00:11:28.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:28 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:28.429+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:28.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:28 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:28.429+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:28.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:28 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:28.429+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:28.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:28 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:28.429+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:29.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:28.734+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:29.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:28.734+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:29.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:28.734+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:29.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:28.734+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:29.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:28 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:28.734+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:29.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:29 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:29.175+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:29.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:29 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:29.175+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:29.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:29 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:29.175+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:29.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:29 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:29.175+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:29.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:29 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:29.357+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:29.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:29 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:29.357+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:29.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:29 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:29.357+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:29.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:29 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:29.357+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:29.702 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:29.377+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.215202+0000 front 2024-09-12T00:10:39.215339+0000 (oldest deadline 2024-09-12T00:11:02.715375+0000) 2024-09-12T00:11:29.702 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:29.377+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.016526+0000 front 2024-09-12T00:10:48.016662+0000 (oldest deadline 2024-09-12T00:11:12.116440+0000) 2024-09-12T00:11:29.702 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:29.377+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.017630+0000 front 2024-09-12T00:10:55.017686+0000 (oldest deadline 2024-09-12T00:11:19.717458+0000) 2024-09-12T00:11:29.703 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7[53107]: 2024-09-12T00:11:29.377+0000 7f62cbeec640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.518553+0000 front 2024-09-12T00:11:05.518570+0000 (oldest deadline 2024-09-12T00:11:27.818658+0000) 2024-09-12T00:11:29.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:29 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:29.456+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:29.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:29 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:29.456+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:29.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:29 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:29.456+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:29.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:29 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:29.456+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:29.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:29.703+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:29.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:29.703+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:29.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:29.703+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:29.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:29.703+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:29.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:29.703+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:30.401 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:30 smithi105 podman[71379]: 2024-09-12 00:11:30.104972237 +0000 UTC m=+5.669617547 container died 331c41d24a25cedef117cab1745d5335712b274bfce3d771cc9063729fff8608 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T00:11:30.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:30 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:30.181+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:30.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:30 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:30.181+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:30.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:30 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:30.181+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:30.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:30 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:30.181+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:30.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:30 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:30.371+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:30.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:30 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:30.371+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:30.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:30 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:30.371+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:30.535 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:30 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:30.371+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:30.660 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:30 smithi105 podman[71379]: 2024-09-12 00:11:30.501313386 +0000 UTC m=+6.065958686 container cleanup 331c41d24a25cedef117cab1745d5335712b274bfce3d771cc9063729fff8608 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T00:11:30.660 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:30 smithi105 bash[71379]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7 2024-09-12T00:11:30.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:30 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:30.501+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:30.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:30 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:30.501+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:30.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:30 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:30.501+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:30.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:30 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:30.501+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:30.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:30 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:30.501+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:30.979 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:30 smithi105 podman[71396]: 2024-09-12 00:11:30.76918474 +0000 UTC m=+0.655492348 container remove 331c41d24a25cedef117cab1745d5335712b274bfce3d771cc9063729fff8608 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T00:11:30.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:30 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:30.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:30.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:30 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:30.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:30.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:30 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:30.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:30.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:30 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:30.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:30.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:30 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:30.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:31.370 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:31 smithi105 podman[71487]: 2024-09-12 00:11:31.111772116 +0000 UTC m=+0.106658768 container create f3d8873c86e5e8977b1259e433880bf18f78fa787fea80a5749d928fc9f210f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T00:11:31.371 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:31 smithi105 podman[71487]: 2024-09-12 00:11:31.020598018 +0000 UTC m=+0.015484629 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:11:31.371 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:31 smithi105 podman[71487]: 2024-09-12 00:11:31.372431122 +0000 UTC m=+0.367317732 container init f3d8873c86e5e8977b1259e433880bf18f78fa787fea80a5749d928fc9f210f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T00:11:31.533 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:31 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:31.193+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:31.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:31 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:31.193+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:31.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:31 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:31.193+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:31.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:31 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:31.193+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:31.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:31 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:31.386+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:31.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:31 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:31.386+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:31.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:31 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:31.386+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:31.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:31 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:31.386+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:31.640 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:31 smithi105 podman[71487]: 2024-09-12 00:11:31.375891263 +0000 UTC m=+0.370777873 container start f3d8873c86e5e8977b1259e433880bf18f78fa787fea80a5749d928fc9f210f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T00:11:31.640 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:31 smithi105 podman[71487]: 2024-09-12 00:11:31.464159498 +0000 UTC m=+0.459046117 container attach f3d8873c86e5e8977b1259e433880bf18f78fa787fea80a5749d928fc9f210f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T00:11:31.640 INFO:journalctl@ceph.osd.7.smithi105.stdout:Sep 12 00:11:31 smithi105 podman[71487]: 2024-09-12 00:11:31.564917546 +0000 UTC m=+0.559804159 container died f3d8873c86e5e8977b1259e433880bf18f78fa787fea80a5749d928fc9f210f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T00:11:31.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:31 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:31.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:31.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:31 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:31.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:31.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:31 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:31.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:31.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:31 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:31.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:31.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:31 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:31.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:31.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:31 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:31.640+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:31.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:31 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:31.640+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:31.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:31 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:31.640+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:31.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:31 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:31.640+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:31.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:31 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:31.640+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:32.205 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T00:11:32.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:11:32.245 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T00:11:32.245 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T00:11:32.245 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.8 2024-09-12T00:11:32.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:32.412+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:32.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:32.412+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:32.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:32.412+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:32.535 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:32.412+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:32.535 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:32.201+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:32.535 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:32.201+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:32.535 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:32.201+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:32.535 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:32.201+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:32.535 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:32 smithi192 systemd[1]: Stopping Ceph osd.8 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:11:32.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:32 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:32.617+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:32.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:32 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:32.617+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:32.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:32 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:32.617+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:32.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:32 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:32.617+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:32.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:32 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:32.617+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:32.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:32 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:32.500+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:32.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:32 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:32.500+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:32.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:32 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:32.500+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:32.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:32 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:32.500+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:32.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:32 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:32.500+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:33.033 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:32.564+0000 7fbb36d96640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:11:33.033 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:32.564+0000 7fbb36d96640 -1 osd.8 96 *** Got signal Terminated *** 2024-09-12T00:11:33.033 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:32 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:32.564+0000 7fbb36d96640 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:11:33.533 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:33.435+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:33.533 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:33.435+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:33.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:33.435+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:33.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:33.435+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:33.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:33.199+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:33.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:33.199+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:33.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:33.199+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:33.534 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:33.199+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:33.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:33 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:33.580+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:33.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:33 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:33.580+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:33.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:33 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:33.580+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:33.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:33 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:33.580+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:33.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:33 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:33.580+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:33.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:33 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:33.454+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:33.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:33 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:33.454+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:33.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:33 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:33.454+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:33.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:33 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:33.454+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:33.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:33 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:33.454+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:34.423 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:34.161+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:34.423 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:34.161+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:34.423 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:34.161+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:34.424 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:34.161+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:34.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:34.471+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:34.889 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:34.471+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:34.889 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:34.471+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:34.889 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:34 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:34.471+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:34.890 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:34.477+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:34.890 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:34.477+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:34.890 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:34.477+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:34.890 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:34.477+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:34.890 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:34 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:34.477+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:34.990 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:34 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:34.572+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:34.991 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:34 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:34.572+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:34.991 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:34 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:34.572+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:34.991 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:34 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:34.572+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:34.991 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:34 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:34.572+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:34.991 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:34 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:34.572+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:35.283 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:35.119+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:35.283 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:35.119+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:35.283 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:35.119+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:35.284 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:35.119+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:35.284 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:35.119+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.094098+0000 front 2024-09-12T00:11:12.094028+0000 (oldest deadline 2024-09-12T00:11:34.894731+0000) 2024-09-12T00:11:35.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:35.450+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:35.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:35.450+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:35.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:35.450+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:35.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:35 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:35.450+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:35.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:35 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:35.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:35.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:35 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:35.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:35.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:35 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:35.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:35.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:35 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:35.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:35.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:35 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:35.502+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:35.880 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:35 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:35.584+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:35.880 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:35 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:35.584+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:35.880 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:35 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:35.584+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:35.880 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:35 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:35.584+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:35.881 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:35 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:35.584+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:35.881 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:35 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:35.584+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:36.482 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:36.071+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:36.482 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:36.071+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:36.482 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:36.071+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:36.482 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:36.071+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:36.482 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:36.071+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.094098+0000 front 2024-09-12T00:11:12.094028+0000 (oldest deadline 2024-09-12T00:11:34.894731+0000) 2024-09-12T00:11:36.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:36.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:36.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:36.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:36.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:36.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:36.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:36 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:36.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:36.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:36 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:36.519+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:36.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:36 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:36.519+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:36.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:36 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:36.519+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:36.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:36 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:36.519+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:36.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:36 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:36.519+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:36.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:36.600+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:36.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:36.600+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:36.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:36.600+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:36.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:36.600+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:36.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:36.600+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:36.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:36 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:36.600+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:37.503 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:37.046+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.290318+0000 front 2024-09-12T00:10:39.290298+0000 (oldest deadline 2024-09-12T00:11:04.590277+0000) 2024-09-12T00:11:37.503 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:37.046+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:48.591693+0000 front 2024-09-12T00:10:48.591656+0000 (oldest deadline 2024-09-12T00:11:13.892030+0000) 2024-09-12T00:11:37.503 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:37.046+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:53.892429+0000 front 2024-09-12T00:10:53.892559+0000 (oldest deadline 2024-09-12T00:11:19.192358+0000) 2024-09-12T00:11:37.503 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:37.046+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:01.493232+0000 front 2024-09-12T00:11:01.493161+0000 (oldest deadline 2024-09-12T00:11:26.793325+0000) 2024-09-12T00:11:37.503 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8[53872]: 2024-09-12T00:11:37.046+0000 7fbb333ac640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.094098+0000 front 2024-09-12T00:11:12.094028+0000 (oldest deadline 2024-09-12T00:11:34.894731+0000) 2024-09-12T00:11:37.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:37.503+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:37.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:37.503+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:37.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:37.503+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:37.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:37.503+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:37.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:37.503+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:37.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:37.473+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:37.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:37.473+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:37.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:37.473+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:37.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:37.473+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:37.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:37 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:37.473+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:37.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:37 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:37.598+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:37.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:37 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:37.598+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:37.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:37 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:37.598+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:37.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:37 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:37.598+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:37.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:37 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:37.598+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:37.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:37 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:37.598+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:38.206 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:37 smithi192 podman[72042]: 2024-09-12 00:11:37.89323633 +0000 UTC m=+5.443689087 container died 3900b469a1f46435b8afda219db68626743b221e67a8f0c7e8c9e12bb23a9a46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T00:11:38.531 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:38 smithi192 podman[72042]: 2024-09-12 00:11:38.298564399 +0000 UTC m=+5.849017154 container cleanup 3900b469a1f46435b8afda219db68626743b221e67a8f0c7e8c9e12bb23a9a46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T00:11:38.532 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:38 smithi192 bash[72042]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8 2024-09-12T00:11:38.532 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:38.454+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:38.532 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:38.454+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:38.532 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:38.454+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:38.532 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:38.454+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:38.532 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:38 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:38.454+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:38.784 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:38 smithi192 podman[72059]: 2024-09-12 00:11:38.533409982 +0000 UTC m=+0.633076112 container remove 3900b469a1f46435b8afda219db68626743b221e67a8f0c7e8c9e12bb23a9a46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:11:38.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:38.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:38.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:38.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:38.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:38.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:38.840 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:38.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:38.840 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:38 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:38.450+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:38.980 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:38.641+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:38.981 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:38.641+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:38.981 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:38.641+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:38.981 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:38.641+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:38.981 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:38.641+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:38.981 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:38 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:38.641+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:39.126 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:38 smithi192 podman[72143]: 2024-09-12 00:11:38.765078935 +0000 UTC m=+0.016254382 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:11:39.127 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:38 smithi192 podman[72143]: 2024-09-12 00:11:38.892690942 +0000 UTC m=+0.143866426 container create cc0eb0b7091cdb0222c4a95f71c113ac4b9d652caa26b91854ae6fe854898406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:11:39.127 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:39 smithi192 podman[72143]: 2024-09-12 00:11:39.128465548 +0000 UTC m=+0.379640988 container init cc0eb0b7091cdb0222c4a95f71c113ac4b9d652caa26b91854ae6fe854898406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T00:11:39.449 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:39 smithi192 podman[72143]: 2024-09-12 00:11:39.131897778 +0000 UTC m=+0.383073221 container start cc0eb0b7091cdb0222c4a95f71c113ac4b9d652caa26b91854ae6fe854898406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-12T00:11:39.449 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:39 smithi192 podman[72143]: 2024-09-12 00:11:39.236681213 +0000 UTC m=+0.487856678 container attach cc0eb0b7091cdb0222c4a95f71c113ac4b9d652caa26b91854ae6fe854898406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T00:11:39.449 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 12 00:11:39 smithi192 podman[72143]: 2024-09-12 00:11:39.313809064 +0000 UTC m=+0.564984506 container died cc0eb0b7091cdb0222c4a95f71c113ac4b9d652caa26b91854ae6fe854898406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T00:11:39.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:39.449+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:39.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:39.449+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:39.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:39.449+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:39.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:39.449+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:39.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:39 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:39.449+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:39.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:39 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:39.453+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:39.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:39 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:39.453+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:39.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:39 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:39.453+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:39.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:39 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:39.453+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:39.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:39 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:39.453+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:39.953 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T00:11:39.978 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:39.638+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:39.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:39.638+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:39.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:39.638+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:39.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:39.638+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:39.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:39.638+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:39.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:39 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:39.638+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:39.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:11:39.993 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T00:11:39.994 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T00:11:39.994 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.9 2024-09-12T00:11:40.305 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 systemd[1]: Stopping Ceph osd.9 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:11:40.306 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:40.306+0000 7f09f8782640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:11:40.306 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:40.306+0000 7f09f8782640 -1 osd.9 96 *** Got signal Terminated *** 2024-09-12T00:11:40.307 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:40.306+0000 7f09f8782640 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:11:40.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:40.441+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:40.588 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:40.441+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:40.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:40.441+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:40.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:40.441+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:40.589 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:40 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:40.441+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:40.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:40 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:40.461+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:40.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:40 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:40.461+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:40.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:40 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:40.461+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:40.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:40 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:40.461+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:40.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:40 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:40.461+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:40.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:40.659+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:40.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:40.659+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:40.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:40.659+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:40.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:40.659+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:40.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:40.659+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:40.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:40 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:40.659+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:41.533 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:41 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:41.463+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:41.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:41 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:41.463+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:41.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:41 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:41.463+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:41.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:41 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:41.463+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:41.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:41 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:41.463+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:41.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:41.399+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:41.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:41.399+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:41.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:41.399+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:41.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:41.399+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:41.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:41 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:41.399+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:41.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:41.612+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:41.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:41.612+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:41.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:41.612+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:41.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:41.612+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:41.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:41.612+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:41.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:41 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:41.612+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:42.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:42 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:42.473+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:42.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:42 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:42.473+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:42.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:42 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:42.473+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:42.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:42 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:42.473+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:42.785 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:42 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:42.473+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:42.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:42.396+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:42.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:42.396+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:42.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:42.396+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:42.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:42.396+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:42.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:42 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:42.396+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:42.912 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:42.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:42.912 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:42.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:42.912 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:42.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:42.913 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:42.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:42.913 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:42.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:42.913 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:42 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:42.661+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:43.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:43 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:43.441+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:43.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:43 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:43.441+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:43.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:43 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:43.441+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:43.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:43 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:43.441+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:43.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:43 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:43.441+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:43.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:43 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:43.367+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:43.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:43 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:43.367+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:43.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:43 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:43.367+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:43.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:43 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:43.367+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:43.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:43 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:43.367+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:43.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:43 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:43.681+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:43.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:43 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:43.681+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:43.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:43 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:43.681+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:43.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:43 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:43.681+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:43.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:43 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:43.681+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:43.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:43 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:43.681+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:44.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:44.477+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:44.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:44.477+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:44.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:44.477+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:44.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:44.477+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:44.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:44 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:44.477+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:44.838 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:44 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:44.340+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.875669+0000 front 2024-09-12T00:10:32.875648+0000 (oldest deadline 2024-09-12T00:10:56.876540+0000) 2024-09-12T00:11:44.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:44 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:44.340+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:39.777699+0000 front 2024-09-12T00:10:39.777593+0000 (oldest deadline 2024-09-12T00:11:04.978166+0000) 2024-09-12T00:11:44.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:44 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:44.340+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.179877+0000 front 2024-09-12T00:10:47.179903+0000 (oldest deadline 2024-09-12T00:11:12.479674+0000) 2024-09-12T00:11:44.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:44 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:44.340+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.380544+0000 front 2024-09-12T00:10:55.380490+0000 (oldest deadline 2024-09-12T00:11:23.581373+0000) 2024-09-12T00:11:44.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:44 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:44.340+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:03.581991+0000 front 2024-09-12T00:11:03.582021+0000 (oldest deadline 2024-09-12T00:11:29.482000+0000) 2024-09-12T00:11:44.839 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:44 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9[65259]: 2024-09-12T00:11:44.340+0000 7f09f4d98640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.783902+0000 front 2024-09-12T00:11:18.783848+0000 (oldest deadline 2024-09-12T00:11:44.083995+0000) 2024-09-12T00:11:44.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:44 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:44.686+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:44.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:44 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:44.686+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:44.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:44 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:44.686+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:44.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:44 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:44.686+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:44.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:44 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:44.686+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:44.979 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:44 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:44.686+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:45.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:45 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:45.468+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:45.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:45 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:45.468+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:45.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:45 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:45.468+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:45.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:45 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:45.468+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:45.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:45 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:45.468+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:45.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:45 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:45.468+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:45.989 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:45 smithi060 podman[112850]: 2024-09-12 00:11:45.73645871 +0000 UTC m=+5.542024075 container died 30286caa36f9a785d9a06a771a06bc4319f279282a027120e0b47828e3dbd5e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:11:46.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:45 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:45.731+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:46.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:45 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:45.731+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:46.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:45 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:45.731+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:46.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:45 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:45.731+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:46.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:45 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:45.731+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:46.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:45 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:45.731+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:46.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:45 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:45.731+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:19.762154+0000 front 2024-09-12T00:11:19.762187+0000 (oldest deadline 2024-09-12T00:11:45.062104+0000) 2024-09-12T00:11:46.338 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:46 smithi060 podman[112850]: 2024-09-12 00:11:46.156392282 +0000 UTC m=+5.961957647 container cleanup 30286caa36f9a785d9a06a771a06bc4319f279282a027120e0b47828e3dbd5e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T00:11:46.338 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:46 smithi060 bash[112850]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9 2024-09-12T00:11:46.781 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:46 smithi060 podman[112866]: 2024-09-12 00:11:46.353517419 +0000 UTC m=+0.612842801 container remove 30286caa36f9a785d9a06a771a06bc4319f279282a027120e0b47828e3dbd5e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T00:11:46.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:46 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:46.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:46.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:46 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:46.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:46.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:46 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:46.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:46.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:46 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:46.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:46.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:46 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:46.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:46.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:46 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:46.482+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:47.088 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:46 smithi060 podman[112957]: 2024-09-12 00:11:46.685842313 +0000 UTC m=+0.016553161 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:11:47.089 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:46 smithi060 podman[112957]: 2024-09-12 00:11:46.783834996 +0000 UTC m=+0.114545843 container create 6cb8cfd7f995042f6fa5a6d5b08b8e0dcfe7d6ec91c9e985090583f464f92c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T00:11:47.089 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:47 smithi060 podman[112957]: 2024-09-12 00:11:47.019412496 +0000 UTC m=+0.350123345 container init 6cb8cfd7f995042f6fa5a6d5b08b8e0dcfe7d6ec91c9e985090583f464f92c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T00:11:47.089 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:47 smithi060 podman[112957]: 2024-09-12 00:11:47.022831419 +0000 UTC m=+0.353542264 container start 6cb8cfd7f995042f6fa5a6d5b08b8e0dcfe7d6ec91c9e985090583f464f92c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:11:47.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:46 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:46.736+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:47.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:46 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:46.736+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:47.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:46 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:46.736+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:47.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:46 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:46.736+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:47.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:46 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:46.736+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:47.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:46 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:46.736+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:47.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:46 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:46.736+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:19.762154+0000 front 2024-09-12T00:11:19.762187+0000 (oldest deadline 2024-09-12T00:11:45.062104+0000) 2024-09-12T00:11:47.503 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:47 smithi060 podman[112957]: 2024-09-12 00:11:47.094561719 +0000 UTC m=+0.425272570 container attach 6cb8cfd7f995042f6fa5a6d5b08b8e0dcfe7d6ec91c9e985090583f464f92c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T00:11:47.504 INFO:journalctl@ceph.osd.9.smithi060.stdout:Sep 12 00:11:47 smithi060 podman[112957]: 2024-09-12 00:11:47.215435334 +0000 UTC m=+0.546146174 container died 6cb8cfd7f995042f6fa5a6d5b08b8e0dcfe7d6ec91c9e985090583f464f92c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T00:11:47.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:47 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:47.520+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:47.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:47 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:47.520+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:47.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:47 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:47.520+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:47.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:47 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:47.520+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:47.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:47 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:47.520+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:47.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:47 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:47.520+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:47.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T00:11:47.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:11:47.845 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T00:11:47.845 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T00:11:47.845 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.10 2024-09-12T00:11:48.171 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:47 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:47.777+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:48.171 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:47 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:47.777+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:48.171 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:47 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:47.777+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:48.171 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:47 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:47.777+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:48.171 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:47 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:47.777+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:48.171 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:47 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:47.777+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:48.172 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:47 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:47.777+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:19.762154+0000 front 2024-09-12T00:11:19.762187+0000 (oldest deadline 2024-09-12T00:11:45.062104+0000) 2024-09-12T00:11:48.172 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:47 smithi105 systemd[1]: Stopping Ceph osd.10 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:11:48.172 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.172+0000 7fb40ff72640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:11:48.172 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.172+0000 7fb40ff72640 -1 osd.10 96 *** Got signal Terminated *** 2024-09-12T00:11:48.172 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.172+0000 7fb40ff72640 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:11:49.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:48 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:48.538+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:49.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:48 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:48.538+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:49.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:48 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:48.538+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:49.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:48 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:48.538+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:49.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:48 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:48.538+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:49.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:48 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:48.538+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:49.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.766+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:49.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.766+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:49.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.766+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:49.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.766+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:49.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.766+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:49.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.766+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:49.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:48 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:48.766+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:19.762154+0000 front 2024-09-12T00:11:19.762187+0000 (oldest deadline 2024-09-12T00:11:45.062104+0000) 2024-09-12T00:11:49.783 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:49 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:49.512+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:49.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:49 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:49.512+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:49.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:49 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:49.512+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:49.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:49 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:49.512+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:49.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:49 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:49.512+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:49.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:49 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:49.512+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:50.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:49 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:49.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:50.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:49 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:49.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:50.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:49 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:49.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:50.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:49 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:49.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:50.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:49 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:49.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:50.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:49 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:49.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:50.230 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:49 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:49.746+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:19.762154+0000 front 2024-09-12T00:11:19.762187+0000 (oldest deadline 2024-09-12T00:11:45.062104+0000) 2024-09-12T00:11:51.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:50 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:50.545+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:51.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:50 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:50.545+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:51.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:50 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:50.545+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:51.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:50 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:50.545+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:51.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:50 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:50.545+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:51.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:50 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:50.545+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:51.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:50 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:50.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:51.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:50 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:50.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:51.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:50 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:50.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:51.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:50 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:50.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:51.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:50 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:50.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:51.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:50 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:50.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:51.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:50 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:50.741+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:19.762154+0000 front 2024-09-12T00:11:19.762187+0000 (oldest deadline 2024-09-12T00:11:45.062104+0000) 2024-09-12T00:11:52.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:51 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:51.569+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:52.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:51 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:51.569+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:52.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:51 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:51.569+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:52.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:51 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:51.569+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:52.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:51 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:51.569+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:52.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:51 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:51.569+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:52.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:51 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:51.783+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:52.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:51 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:51.783+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:52.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:51 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:51.783+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:52.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:51 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:51.783+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:52.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:51 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:51.783+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:52.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:51 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:51.783+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:52.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:51 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:51.783+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:19.762154+0000 front 2024-09-12T00:11:19.762187+0000 (oldest deadline 2024-09-12T00:11:45.062104+0000) 2024-09-12T00:11:52.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:52 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:52.526+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:52.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:52 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:52.526+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:52.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:52 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:52.526+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:52.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:52 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:52.526+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:52.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:52 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:52.526+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:52.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:52 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:52.526+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:52.784 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:52 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:52.526+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:11:53.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:52 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:52.792+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:32.455654+0000 front 2024-09-12T00:10:32.455570+0000 (oldest deadline 2024-09-12T00:10:54.155569+0000) 2024-09-12T00:11:53.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:52 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:52.792+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:40.557005+0000 front 2024-09-12T00:10:40.557043+0000 (oldest deadline 2024-09-12T00:11:06.457196+0000) 2024-09-12T00:11:53.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:52 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:52.792+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:46.457623+0000 front 2024-09-12T00:10:46.457649+0000 (oldest deadline 2024-09-12T00:11:11.157650+0000) 2024-09-12T00:11:53.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:52 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:52.792+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6814 osd.3 since back 2024-09-12T00:10:55.258749+0000 front 2024-09-12T00:10:55.258865+0000 (oldest deadline 2024-09-12T00:11:18.158580+0000) 2024-09-12T00:11:53.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:52 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:52.792+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:05.160067+0000 front 2024-09-12T00:11:05.160087+0000 (oldest deadline 2024-09-12T00:11:27.460215+0000) 2024-09-12T00:11:53.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:52 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:52.792+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:10.961359+0000 front 2024-09-12T00:11:10.961261+0000 (oldest deadline 2024-09-12T00:11:34.461171+0000) 2024-09-12T00:11:53.229 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:52 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10[60077]: 2024-09-12T00:11:52.792+0000 7fb40c588640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:19.762154+0000 front 2024-09-12T00:11:19.762187+0000 (oldest deadline 2024-09-12T00:11:45.062104+0000) 2024-09-12T00:11:53.778 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:53 smithi105 podman[71601]: 2024-09-12 00:11:53.492972325 +0000 UTC m=+5.440713297 container died bffa296b1485e797393252e9377867a1199508053cbb5536e90202832dfe59bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T00:11:54.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:53 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:53.568+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:54.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:53 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:53.568+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:54.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:53 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:53.568+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:54.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:53 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:53.568+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:54.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:53 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:53.568+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:54.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:53 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:53.568+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:54.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:53 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:53.568+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:11:54.145 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:53 smithi105 podman[71601]: 2024-09-12 00:11:53.85354184 +0000 UTC m=+5.801282812 container cleanup bffa296b1485e797393252e9377867a1199508053cbb5536e90202832dfe59bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T00:11:54.145 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:53 smithi105 bash[71601]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10 2024-09-12T00:11:54.461 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:54 smithi105 podman[71618]: 2024-09-12 00:11:54.147000974 +0000 UTC m=+0.644203062 container remove bffa296b1485e797393252e9377867a1199508053cbb5536e90202832dfe59bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T00:11:54.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:54 smithi105 podman[71704]: 2024-09-12 00:11:54.366170487 +0000 UTC m=+0.015858522 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:11:54.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:54 smithi105 podman[71704]: 2024-09-12 00:11:54.464143744 +0000 UTC m=+0.113831766 container create 94b350fdcb09929daf3c88b640d761cbd8f4aaeb414fb1d80447963ec0d6d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-12T00:11:54.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:54 smithi105 podman[71704]: 2024-09-12 00:11:54.700188823 +0000 UTC m=+0.349876844 container init 94b350fdcb09929daf3c88b640d761cbd8f4aaeb414fb1d80447963ec0d6d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:11:54.729 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:54 smithi105 podman[71704]: 2024-09-12 00:11:54.703399604 +0000 UTC m=+0.353087626 container start 94b350fdcb09929daf3c88b640d761cbd8f4aaeb414fb1d80447963ec0d6d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T00:11:55.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:54 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:54.556+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:55.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:54 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:54.556+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:55.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:54 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:54.556+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:55.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:54 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:54.556+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:55.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:54 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:54.556+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:55.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:54 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:54.556+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:55.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:54 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:54.556+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:11:55.201 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:54 smithi105 podman[71704]: 2024-09-12 00:11:54.774981722 +0000 UTC m=+0.424669760 container attach 94b350fdcb09929daf3c88b640d761cbd8f4aaeb414fb1d80447963ec0d6d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T00:11:55.201 INFO:journalctl@ceph.osd.10.smithi105.stdout:Sep 12 00:11:54 smithi105 podman[71704]: 2024-09-12 00:11:54.896816612 +0000 UTC m=+0.546504646 container died 94b350fdcb09929daf3c88b640d761cbd8f4aaeb414fb1d80447963ec0d6d522 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:11:55.493 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T00:11:55.532 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:11:55.532 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T00:11:55.533 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T00:11:55.533 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.11 2024-09-12T00:11:55.825 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 systemd[1]: Stopping Ceph osd.11 for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:11:55.825 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.599+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:55.825 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.599+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:55.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.599+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:55.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.599+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:55.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.599+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:55.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.599+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:55.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.599+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:11:55.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.826+0000 7fb950e56640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:11:55.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.826+0000 7fb950e56640 -1 osd.11 96 *** Got signal Terminated *** 2024-09-12T00:11:55.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:55 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:55.826+0000 7fb950e56640 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T00:11:57.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:56 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:56.575+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:57.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:56 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:56.575+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:57.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:56 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:56.575+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:57.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:56 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:56.575+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:57.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:56 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:56.575+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:57.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:56 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:56.575+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:57.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:56 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:56.575+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:11:58.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:57 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:57.579+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:58.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:57 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:57.579+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:58.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:57 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:57.579+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:58.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:57 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:57.579+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:58.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:57 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:57.579+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:58.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:57 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:57.579+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:58.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:57 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:57.579+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:11:59.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:58 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:58.614+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:11:59.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:58 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:58.614+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:11:59.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:58 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:58.614+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:11:59.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:58 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:58.614+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:11:59.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:58 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:58.614+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:11:59.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:58 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:58.614+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:11:59.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:58 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:58.614+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:12:00.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:59.587+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:12:00.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:59.587+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:12:00.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:59.587+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:12:00.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:59.587+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:12:00.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:59.587+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:12:00.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:59.587+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:12:00.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:59.587+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:12:00.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:11:59 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:11:59.587+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6820 osd.8 since back 2024-09-12T00:11:35.644541+0000 front 2024-09-12T00:11:35.644564+0000 (oldest deadline 2024-09-12T00:11:59.144503+0000) 2024-09-12T00:12:01.033 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:12:00.540+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6806 osd.0 since back 2024-09-12T00:10:29.834768+0000 front 2024-09-12T00:10:29.834778+0000 (oldest deadline 2024-09-12T00:10:58.635345+0000) 2024-09-12T00:12:01.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:12:00.540+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6804 osd.1 since back 2024-09-12T00:10:41.437127+0000 front 2024-09-12T00:10:41.437173+0000 (oldest deadline 2024-09-12T00:11:06.737098+0000) 2024-09-12T00:12:01.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:12:00.540+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-12T00:10:47.238236+0000 front 2024-09-12T00:10:47.238088+0000 (oldest deadline 2024-09-12T00:11:11.338210+0000) 2024-09-12T00:12:01.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:12:00.540+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6812 osd.4 since back 2024-09-12T00:11:04.740292+0000 front 2024-09-12T00:11:04.740328+0000 (oldest deadline 2024-09-12T00:11:26.440394+0000) 2024-09-12T00:12:01.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:12:00.540+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-12T00:11:12.341123+0000 front 2024-09-12T00:11:12.341156+0000 (oldest deadline 2024-09-12T00:11:37.041192+0000) 2024-09-12T00:12:01.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:12:00.540+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.60:6822 osd.6 since back 2024-09-12T00:11:18.742163+0000 front 2024-09-12T00:11:18.742126+0000 (oldest deadline 2024-09-12T00:11:44.642046+0000) 2024-09-12T00:12:01.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:12:00.540+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.105:6820 osd.7 since back 2024-09-12T00:11:26.343033+0000 front 2024-09-12T00:11:26.343111+0000 (oldest deadline 2024-09-12T00:11:52.242901+0000) 2024-09-12T00:12:01.034 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:00 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11[60681]: 2024-09-12T00:12:00.540+0000 7fb94d46c640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.192:6820 osd.8 since back 2024-09-12T00:11:35.644541+0000 front 2024-09-12T00:11:35.644564+0000 (oldest deadline 2024-09-12T00:11:59.144503+0000) 2024-09-12T00:12:01.568 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:01 smithi192 podman[72258]: 2024-09-12 00:12:01.286079752 +0000 UTC m=+5.562817059 container died 1812f045490e51dc5eca1013c6e8fc6e0ec844405bbd5e80c4070d18afd7c833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T00:12:01.867 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:01 smithi192 podman[72258]: 2024-09-12 00:12:01.667427929 +0000 UTC m=+5.944165236 container cleanup 1812f045490e51dc5eca1013c6e8fc6e0ec844405bbd5e80c4070d18afd7c833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T00:12:01.867 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:01 smithi192 bash[72258]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11 2024-09-12T00:12:02.192 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:01 smithi192 podman[72273]: 2024-09-12 00:12:01.868379501 +0000 UTC m=+0.580454751 container remove 1812f045490e51dc5eca1013c6e8fc6e0ec844405bbd5e80c4070d18afd7c833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T00:12:02.533 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:02 smithi192 podman[72362]: 2024-09-12 00:12:02.194324233 +0000 UTC m=+0.104996568 container create 16c6141e5162fd3b8653cdeec86fc9fa81d2b3bf20259d2edf1fef0ea8a51a07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T00:12:02.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:02 smithi192 podman[72362]: 2024-09-12 00:12:02.105204242 +0000 UTC m=+0.015876591 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T00:12:02.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:02 smithi192 podman[72362]: 2024-09-12 00:12:02.380137389 +0000 UTC m=+0.290809725 container init 16c6141e5162fd3b8653cdeec86fc9fa81d2b3bf20259d2edf1fef0ea8a51a07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T00:12:02.534 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:02 smithi192 podman[72362]: 2024-09-12 00:12:02.383306081 +0000 UTC m=+0.293978428 container start 16c6141e5162fd3b8653cdeec86fc9fa81d2b3bf20259d2edf1fef0ea8a51a07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T00:12:02.864 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:02 smithi192 podman[72362]: 2024-09-12 00:12:02.538578986 +0000 UTC m=+0.449251398 container attach 16c6141e5162fd3b8653cdeec86fc9fa81d2b3bf20259d2edf1fef0ea8a51a07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T00:12:02.864 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 12 00:12:02 smithi192 podman[72362]: 2024-09-12 00:12:02.576740927 +0000 UTC m=+0.487413273 container died 16c6141e5162fd3b8653cdeec86fc9fa81d2b3bf20259d2edf1fef0ea8a51a07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-12T00:12:03.154 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T00:12:03.192 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:03.192 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T00:12:03.193 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T00:12:03.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.a 2024-09-12T00:12:03.491 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:12:03 smithi060 systemd[1]: Stopping Ceph mds.a for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:03.838 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:12:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a[72027]: 2024-09-12T00:12:03.492+0000 7f7eaa5d1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:03.838 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:12:03 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a[72027]: 2024-09-12T00:12:03.492+0000 7f7eaa5d1640 -1 mds.a *** got signal Terminated *** 2024-09-12T00:12:04.774 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:12:04 smithi060 podman[113057]: 2024-09-12 00:12:04.516130108 +0000 UTC m=+1.124643039 container died 1492d6ffa433f53fc09dc28c05b5ea2fef4ba82b4fda5859ada28810274a776e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-12T00:12:05.032 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:12:04 smithi060 podman[113057]: 2024-09-12 00:12:04.858034751 +0000 UTC m=+1.466547674 container cleanup 1492d6ffa433f53fc09dc28c05b5ea2fef4ba82b4fda5859ada28810274a776e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T00:12:05.032 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:12:04 smithi060 bash[113057]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a 2024-09-12T00:12:05.290 INFO:journalctl@ceph.mds.a.smithi060.stdout:Sep 12 00:12:05 smithi060 podman[113069]: 2024-09-12 00:12:05.034116766 +0000 UTC m=+0.513181756 container remove 1492d6ffa433f53fc09dc28c05b5ea2fef4ba82b4fda5859ada28810274a776e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T00:12:05.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T00:12:05.330 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:05.330 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T00:12:05.330 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T00:12:05.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.d 2024-09-12T00:12:05.588 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 12 00:12:05 smithi060 systemd[1]: Stopping Ceph mds.d for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:06.088 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 12 00:12:05 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d[70843]: 2024-09-12T00:12:05.678+0000 7f89c9b3a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:06.089 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 12 00:12:05 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d[70843]: 2024-09-12T00:12:05.678+0000 7f89c9b3a640 -1 mds.d *** got signal Terminated *** 2024-09-12T00:12:07.935 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 12 00:12:07 smithi060 podman[113176]: 2024-09-12 00:12:07.619791918 +0000 UTC m=+2.064402685 container died 91df50013e27162d87dd01c22ad0db4166ecaf5dcaa599ec451d2be7a461f255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T00:12:08.338 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 12 00:12:07 smithi060 podman[113176]: 2024-09-12 00:12:07.937123623 +0000 UTC m=+2.381734392 container cleanup 91df50013e27162d87dd01c22ad0db4166ecaf5dcaa599ec451d2be7a461f255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:12:08.338 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 12 00:12:07 smithi060 bash[113176]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d 2024-09-12T00:12:08.338 INFO:journalctl@ceph.mds.d.smithi060.stdout:Sep 12 00:12:08 smithi060 podman[113190]: 2024-09-12 00:12:08.130233474 +0000 UTC m=+0.511083088 container remove 91df50013e27162d87dd01c22ad0db4166ecaf5dcaa599ec451d2be7a461f255 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T00:12:08.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T00:12:08.400 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:08.400 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T00:12:08.400 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T00:12:08.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.g 2024-09-12T00:12:08.740 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:08 smithi060 systemd[1]: Stopping Ceph mds.g for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:09.088 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:08 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g[71613]: 2024-09-12T00:12:08.741+0000 7f84bb1b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:09.088 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:08 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g[71613]: 2024-09-12T00:12:08.741+0000 7f84bb1b5640 -1 mds.g *** got signal Terminated *** 2024-09-12T00:12:12.773 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:12 smithi060 podman[113296]: 2024-09-12 00:12:12.520028852 +0000 UTC m=+3.886748522 container died 7020f48b604159d92bb2c564f04aad885420d6a8fe3b7806a5124408e53638d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:12:13.032 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:12 smithi060 podman[113296]: 2024-09-12 00:12:12.849415809 +0000 UTC m=+4.216135479 container cleanup 7020f48b604159d92bb2c564f04aad885420d6a8fe3b7806a5124408e53638d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T00:12:13.032 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:12 smithi060 bash[113296]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g 2024-09-12T00:12:13.282 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:13 smithi060 podman[113307]: 2024-09-12 00:12:13.033958502 +0000 UTC m=+0.512813471 container remove 7020f48b604159d92bb2c564f04aad885420d6a8fe3b7806a5124408e53638d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-g, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T00:12:13.282 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:13 smithi060 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-12T00:12:13.282 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:13 smithi060 systemd[1]: Stopped Ceph mds.g for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-12T00:12:13.282 INFO:journalctl@ceph.mds.g.smithi060.stdout:Sep 12 00:12:13 smithi060 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.g.service: Consumed 3.710s CPU time. 2024-09-12T00:12:13.284 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T00:12:13.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:13.318 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T00:12:13.318 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T00:12:13.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.j 2024-09-12T00:12:13.588 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 12 00:12:13 smithi060 systemd[1]: Stopping Ceph mds.j for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:14.088 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 12 00:12:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j[70445]: 2024-09-12T00:12:13.644+0000 7f8fa1e6f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:14.088 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 12 00:12:13 smithi060 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j[70445]: 2024-09-12T00:12:13.644+0000 7f8fa1e6f640 -1 mds.j *** got signal Terminated *** 2024-09-12T00:12:16.660 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 12 00:12:16 smithi060 podman[113419]: 2024-09-12 00:12:16.396467375 +0000 UTC m=+2.846293293 container died 88d5c272bd1df3ff41982151af810328626034824c466b5b3078df3ea988d406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T00:12:17.020 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 12 00:12:16 smithi060 podman[113419]: 2024-09-12 00:12:16.811705524 +0000 UTC m=+3.261531396 container cleanup 88d5c272bd1df3ff41982151af810328626034824c466b5b3078df3ea988d406 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:12:17.020 INFO:journalctl@ceph.mds.j.smithi060.stdout:Sep 12 00:12:16 smithi060 bash[113419]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-j 2024-09-12T00:12:17.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T00:12:17.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:17.191 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T00:12:17.191 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T00:12:17.191 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.b 2024-09-12T00:12:17.479 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:12:17 smithi105 systemd[1]: Stopping Ceph mds.b for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:17.819 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:12:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b[65264]: 2024-09-12T00:12:17.487+0000 7f9011750640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:17.819 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:12:17 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b[65264]: 2024-09-12T00:12:17.487+0000 7f9011750640 -1 mds.b *** got signal Terminated *** 2024-09-12T00:12:20.871 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:12:20 smithi105 podman[71807]: 2024-09-12 00:12:20.52854237 +0000 UTC m=+3.147430583 container died d5501e64e6b737823c56496fe0048149a35b2025037b37ce353e19646bad080c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-12T00:12:21.187 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:12:20 smithi105 podman[71807]: 2024-09-12 00:12:20.970905611 +0000 UTC m=+3.589793873 container cleanup d5501e64e6b737823c56496fe0048149a35b2025037b37ce353e19646bad080c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T00:12:21.187 INFO:journalctl@ceph.mds.b.smithi105.stdout:Sep 12 00:12:20 smithi105 bash[71807]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-b 2024-09-12T00:12:21.396 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T00:12:21.431 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:21.431 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T00:12:21.432 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T00:12:21.432 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.e 2024-09-12T00:12:21.749 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:12:21 smithi105 systemd[1]: Stopping Ceph mds.e for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:22.229 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:12:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e[64660]: 2024-09-12T00:12:21.749+0000 7f3497cc4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:22.229 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:12:21 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e[64660]: 2024-09-12T00:12:21.749+0000 7f3497cc4640 -1 mds.e *** got signal Terminated *** 2024-09-12T00:12:24.799 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:12:24 smithi105 podman[71941]: 2024-09-12 00:12:24.516024282 +0000 UTC m=+2.863737899 container died 15045d79e23bb1cfd61a4490f77b466e1b746019d8639d561f71f7b9671c1170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T00:12:25.174 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:12:24 smithi105 podman[71941]: 2024-09-12 00:12:24.908178485 +0000 UTC m=+3.255892062 container cleanup 15045d79e23bb1cfd61a4490f77b466e1b746019d8639d561f71f7b9671c1170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T00:12:25.174 INFO:journalctl@ceph.mds.e.smithi105.stdout:Sep 12 00:12:24 smithi105 bash[71941]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-e 2024-09-12T00:12:25.332 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T00:12:25.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:25.366 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T00:12:25.366 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T00:12:25.366 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.h 2024-09-12T00:12:25.686 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:25 smithi105 systemd[1]: Stopping Ceph mds.h for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:25.979 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h[64962]: 2024-09-12T00:12:25.687+0000 7f0fd291b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:25.979 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:25 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h[64962]: 2024-09-12T00:12:25.687+0000 7f0fd291b640 -1 mds.h *** got signal Terminated *** 2024-09-12T00:12:28.869 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:28 smithi105 podman[72063]: 2024-09-12 00:12:28.523146893 +0000 UTC m=+2.941103426 container died 5fca091dea741e0af9d5badf5a2ee2f9fb02f14b3cdbc91426ede402773d0737 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T00:12:29.136 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:28 smithi105 podman[72063]: 2024-09-12 00:12:28.962274087 +0000 UTC m=+3.380230665 container cleanup 5fca091dea741e0af9d5badf5a2ee2f9fb02f14b3cdbc91426ede402773d0737 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T00:12:29.136 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:28 smithi105 bash[72063]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h 2024-09-12T00:12:29.377 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T00:12:29.398 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:29 smithi105 podman[72075]: 2024-09-12 00:12:29.13817343 +0000 UTC m=+0.612727991 container remove 5fca091dea741e0af9d5badf5a2ee2f9fb02f14b3cdbc91426ede402773d0737 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T00:12:29.398 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:29 smithi105 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-12T00:12:29.399 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:29 smithi105 systemd[1]: Stopped Ceph mds.h for 6b4d616e-7098-11ef-bcea-c7b262605968. 2024-09-12T00:12:29.399 INFO:journalctl@ceph.mds.h.smithi105.stdout:Sep 12 00:12:29 smithi105 systemd[1]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.h.service: Consumed 21.996s CPU time. 2024-09-12T00:12:29.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:29.410 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T00:12:29.410 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T00:12:29.410 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.k 2024-09-12T00:12:29.728 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:12:29 smithi105 systemd[1]: Stopping Ceph mds.k for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:30.228 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:12:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k[64345]: 2024-09-12T00:12:29.740+0000 7f662b2ea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:30.229 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:12:29 smithi105 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k[64345]: 2024-09-12T00:12:29.740+0000 7f662b2ea640 -1 mds.k *** got signal Terminated *** 2024-09-12T00:12:32.798 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:12:32 smithi105 podman[72185]: 2024-09-12 00:12:32.526597599 +0000 UTC m=+2.889777710 container died 6d0218333b605eb0ea2c331d08bfecd6975899d99032e3b5334d05eb327cf6af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T00:12:33.156 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:12:32 smithi105 podman[72185]: 2024-09-12 00:12:32.890640467 +0000 UTC m=+3.253820581 container cleanup 6d0218333b605eb0ea2c331d08bfecd6975899d99032e3b5334d05eb327cf6af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T00:12:33.157 INFO:journalctl@ceph.mds.k.smithi105.stdout:Sep 12 00:12:32 smithi105 bash[72185]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-k 2024-09-12T00:12:33.314 DEBUG:teuthology.orchestra.run.smithi105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T00:12:33.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:33.347 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T00:12:33.347 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T00:12:33.347 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.c 2024-09-12T00:12:33.640 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:12:33 smithi192 systemd[1]: Stopping Ceph mds.c for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:33.899 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:12:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-c[65653]: 2024-09-12T00:12:33.640+0000 7fdd4a6d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:33.900 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:12:33 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-c[65653]: 2024-09-12T00:12:33.640+0000 7fdd4a6d3640 -1 mds.c *** got signal Terminated *** 2024-09-12T00:12:36.784 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:12:36 smithi192 podman[72464]: 2024-09-12 00:12:36.52846806 +0000 UTC m=+2.990739948 container died d940b80e1672face1a0cb8cc2537c097f37541bb9fe224c26ebdc81d01f0f61a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T00:12:37.157 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:12:36 smithi192 podman[72464]: 2024-09-12 00:12:36.890736677 +0000 UTC m=+3.353008555 container cleanup d940b80e1672face1a0cb8cc2537c097f37541bb9fe224c26ebdc81d01f0f61a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T00:12:37.158 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 12 00:12:36 smithi192 bash[72464]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-c 2024-09-12T00:12:37.321 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T00:12:37.356 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:37.357 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T00:12:37.357 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T00:12:37.357 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.f 2024-09-12T00:12:37.669 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:12:37 smithi192 systemd[1]: Stopping Ceph mds.f for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:38.033 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:12:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f[65352]: 2024-09-12T00:12:37.669+0000 7fd236d06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:38.033 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:12:37 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f[65352]: 2024-09-12T00:12:37.669+0000 7fd236d06640 -1 mds.f *** got signal Terminated *** 2024-09-12T00:12:40.783 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:12:40 smithi192 podman[72599]: 2024-09-12 00:12:40.517778648 +0000 UTC m=+2.945913705 container died 787b82838218805abc34957dc4ea8980267827548c26f1acaf7f9d909bbf0ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T00:12:41.144 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:12:40 smithi192 podman[72599]: 2024-09-12 00:12:40.919658465 +0000 UTC m=+3.347793564 container cleanup 787b82838218805abc34957dc4ea8980267827548c26f1acaf7f9d909bbf0ba2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T00:12:41.144 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 12 00:12:40 smithi192 bash[72599]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-f 2024-09-12T00:12:41.273 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T00:12:41.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:41.308 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T00:12:41.308 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T00:12:41.308 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.i 2024-09-12T00:12:41.783 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:12:41 smithi192 systemd[1]: Stopping Ceph mds.i for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:41.783 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:12:41 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: 2024-09-12T00:12:41.638+0000 7fa7b04a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:41.783 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:12:41 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i[65955]: 2024-09-12T00:12:41.639+0000 7fa7b04a3640 -1 mds.i *** got signal Terminated *** 2024-09-12T00:12:44.783 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:12:44 smithi192 podman[72721]: 2024-09-12 00:12:44.531690016 +0000 UTC m=+2.996461606 container died 309f4e53aaf6c88645c820ef8cb0f9e525cba7c925269b7795c20a51f2f0a10b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T00:12:45.055 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:12:44 smithi192 podman[72721]: 2024-09-12 00:12:44.872669082 +0000 UTC m=+3.337440660 container cleanup 309f4e53aaf6c88645c820ef8cb0f9e525cba7c925269b7795c20a51f2f0a10b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T00:12:45.056 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 12 00:12:44 smithi192 bash[72721]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-i 2024-09-12T00:12:45.276 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T00:12:45.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:45.309 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T00:12:45.309 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T00:12:45.309 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.l 2024-09-12T00:12:45.642 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:12:45 smithi192 systemd[1]: Stopping Ceph mds.l for 6b4d616e-7098-11ef-bcea-c7b262605968... 2024-09-12T00:12:46.033 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:12:45 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l[65049]: 2024-09-12T00:12:45.644+0000 7f9ca9cea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T00:12:46.050 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:12:45 smithi192 ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l[65049]: 2024-09-12T00:12:45.644+0000 7f9ca9cea640 -1 mds.l *** got signal Terminated *** 2024-09-12T00:12:48.783 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:12:48 smithi192 podman[72842]: 2024-09-12 00:12:48.52274931 +0000 UTC m=+2.986811641 container died 514f0b36f1bb00a2b1001077a4ee0461786fb6c03f74e2277bafcb27876ceaff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T00:12:49.159 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:12:48 smithi192 podman[72842]: 2024-09-12 00:12:48.876756656 +0000 UTC m=+3.340818989 container cleanup 514f0b36f1bb00a2b1001077a4ee0461786fb6c03f74e2277bafcb27876ceaff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T00:12:49.159 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 12 00:12:48 smithi192 bash[72842]: ceph-6b4d616e-7098-11ef-bcea-c7b262605968-mds-l 2024-09-12T00:12:49.298 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6b4d616e-7098-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T00:12:49.330 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T00:12:49.330 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T00:12:49.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T00:12:49.541 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-12T00:12:52.043 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T00:12:52.246 INFO:teuthology.orchestra.run.smithi105.stdout:Deleting cluster with fsid: 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-12T00:12:54.714 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T00:12:54.917 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-12T00:12:57.273 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:12:57.306 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:12:57.339 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T00:12:57.367 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T00:12:57.368 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi060/crash 2024-09-12T00:12:57.369 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash -- . 2024-09-12T00:12:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T00:12:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2024-09-12T00:12:57.401 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi105/crash 2024-09-12T00:12:57.402 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash -- . 2024-09-12T00:12:57.503 INFO:teuthology.orchestra.run.smithi105.stderr:tar: /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T00:12:57.503 INFO:teuthology.orchestra.run.smithi105.stderr:tar: Error is not recoverable: exiting now 2024-09-12T00:12:57.506 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi192/crash 2024-09-12T00:12:57.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash -- . 2024-09-12T00:12:57.539 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T00:12:57.539 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2024-09-12T00:12:57.540 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T00:12:57.541 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-12T00:12:57.583 INFO:tasks.cephadm:Compressing logs... 2024-09-12T00:12:57.583 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:12:57.626 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:12:57.629 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:12:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T00:12:57.652 INFO:teuthology.orchestra.run.smithi060.stderr:: No such file or directory 2024-09-12T00:12:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T00:12:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T00:12:57.654 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T00:12:57.655 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T00:12:57.655 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T00:12:57.655 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T00:12:57.665 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T00:12:57.666 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.a.log: 84.6% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T00:12:57.666 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T00:12:57.666 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T00:12:57.666 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log 2024-09-12T00:12:57.666 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T00:12:57.666 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log: 88.0% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T00:12:57.666 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T00:12:57.668 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T00:12:57.668 INFO:teuthology.orchestra.run.smithi192.stderr:: No such file or directory 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr: 82.0% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log 2024-09-12T00:12:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T00:12:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T00:12:57.670 INFO:teuthology.orchestra.run.smithi192.stderr: 88.1% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T00:12:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T00:12:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T00:12:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T00:12:57.673 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T00:12:57.673 INFO:teuthology.orchestra.run.smithi060.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T00:12:57.673 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T00:12:57.673 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T00:12:57.674 INFO:teuthology.orchestra.run.smithi105.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T00:12:57.674 INFO:teuthology.orchestra.run.smithi105.stderr:: No such file or directory 2024-09-12T00:12:57.674 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T00:12:57.675 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.0% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T00:12:57.676 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log 2024-09-12T00:12:57.676 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.y.log: 91.1% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T00:12:57.676 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T00:12:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.5% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T00:12:57.677 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T00:12:57.678 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log: 91.8% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T00:12:57.678 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T00:12:57.679 INFO:teuthology.orchestra.run.smithi105.stderr: 88.1% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T00:12:57.679 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T00:12:57.680 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T00:12:57.688 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T00:12:57.690 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.z.log: 91.9% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T00:12:57.693 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T00:12:57.707 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T00:12:57.716 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T00:12:57.722 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T00:12:57.726 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T00:12:58.050 INFO:teuthology.orchestra.run.smithi060.stderr: 90.2% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T00:12:58.120 INFO:teuthology.orchestra.run.smithi192.stderr: 91.8% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T00:12:58.132 INFO:teuthology.orchestra.run.smithi105.stderr: 91.8% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T00:12:58.268 INFO:teuthology.orchestra.run.smithi105.stderr: 95.4% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T00:12:58.537 INFO:teuthology.orchestra.run.smithi060.stderr: 94.8% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T00:12:58.560 INFO:teuthology.orchestra.run.smithi060.stderr: 95.3% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T00:12:58.813 INFO:teuthology.orchestra.run.smithi192.stderr: 95.4% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T00:12:58.931 INFO:teuthology.orchestra.run.smithi060.stderr: 90.4% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T00:12:59.961 INFO:teuthology.orchestra.run.smithi105.stderr: 95.4% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T00:13:00.335 INFO:teuthology.orchestra.run.smithi060.stderr: 91.7% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T00:13:01.146 INFO:teuthology.orchestra.run.smithi192.stderr: 91.5% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T00:13:01.245 INFO:teuthology.orchestra.run.smithi060.stderr: 91.9% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T00:13:01.792 INFO:teuthology.orchestra.run.smithi105.stderr: 91.8% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T00:13:01.816 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T00:13:01.911 INFO:teuthology.orchestra.run.smithi060.stderr: 92.0% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T00:13:01.913 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T00:13:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:real 0m4.272s 2024-09-12T00:13:01.913 INFO:teuthology.orchestra.run.smithi060.stderr:user 0m17.597s 2024-09-12T00:13:01.914 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m0.547s 2024-09-12T00:13:02.125 INFO:teuthology.orchestra.run.smithi105.stderr: 91.8% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T00:13:02.160 INFO:teuthology.orchestra.run.smithi105.stderr: 91.6% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T00:13:02.680 INFO:teuthology.orchestra.run.smithi192.stderr: 91.6% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T00:13:02.718 INFO:teuthology.orchestra.run.smithi105.stderr: 91.9% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T00:13:03.531 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T00:13:03.570 INFO:teuthology.orchestra.run.smithi192.stderr: 92.0% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T00:13:04.172 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T00:13:05.926 INFO:teuthology.orchestra.run.smithi192.stderr: 94.1% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T00:13:06.188 INFO:teuthology.orchestra.run.smithi105.stderr: 93.7% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T00:13:08.495 INFO:teuthology.orchestra.run.smithi105.stderr: 93.8% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T00:13:08.497 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-12T00:13:08.497 INFO:teuthology.orchestra.run.smithi105.stderr:real 0m10.853s 2024-09-12T00:13:08.497 INFO:teuthology.orchestra.run.smithi105.stderr:user 0m39.223s 2024-09-12T00:13:08.497 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m1.168s 2024-09-12T00:13:18.938 INFO:teuthology.orchestra.run.smithi192.stderr: 93.3% -- replaced with /var/log/ceph/6b4d616e-7098-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T00:13:18.940 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-12T00:13:18.940 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m21.296s 2024-09-12T00:13:18.940 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m55.741s 2024-09-12T00:13:18.940 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m1.683s 2024-09-12T00:13:18.941 INFO:tasks.cephadm:Archiving logs... 2024-09-12T00:13:18.941 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi060/log 2024-09-12T00:13:18.942 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:13:24.283 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi105/log 2024-09-12T00:13:24.284 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:13:29.090 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi192/log 2024-09-12T00:13:29.091 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:13:36.793 INFO:tasks.cephadm:Removing cluster... 2024-09-12T00:13:36.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 --force 2024-09-12T00:13:37.008 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-12T00:13:37.293 DEBUG:teuthology.orchestra.run.smithi105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 --force 2024-09-12T00:13:37.497 INFO:teuthology.orchestra.run.smithi105.stdout:Deleting cluster with fsid: 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-12T00:13:37.796 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6b4d616e-7098-11ef-bcea-c7b262605968 --force 2024-09-12T00:13:37.999 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 6b4d616e-7098-11ef-bcea-c7b262605968 2024-09-12T00:13:38.368 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T00:13:38.369 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T00:13:38.389 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T00:13:38.407 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T00:13:38.424 INFO:tasks.cephadm:Teardown complete 2024-09-12T00:13:38.424 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T00:13:38.452 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T00:13:38.452 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:13:38.455 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:13:38.458 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:13:38.601 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T00:13:38.685 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T00:13:38.685 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:13:38.688 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:13:38.691 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:13:38.704 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:13:38.704 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:13:38.705 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:13:38.708 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:13:38.708 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-12T00:13:38.708 INFO:teuthology.orchestra.run.smithi105.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +1543us[+1550us] +/- 49ms 2024-09-12T00:13:38.708 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 -1347us[-1339us] +/- 65ms 2024-09-12T00:13:38.708 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -1223us[-1223us] +/- 100ms 2024-09-12T00:13:38.708 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:13:38.710 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:13:38.710 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-12T00:13:38.710 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 +1584us[+1560us] +/- 49ms 2024-09-12T00:13:38.710 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 -1322us[-1346us] +/- 65ms 2024-09-12T00:13:38.710 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -1195us[-1219us] +/- 100ms 2024-09-12T00:13:38.710 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:13:38.711 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:13:38.711 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-12T00:13:38.712 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +1631us[+1629us] +/- 49ms 2024-09-12T00:13:38.712 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -1269us[-1272us] +/- 65ms 2024-09-12T00:13:38.712 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 83 -1119us[-1123us] +/- 99ms 2024-09-12T00:13:38.712 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:13:38.712 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T00:13:38.722 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T00:13:38.722 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T00:13:38.751 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T00:13:38.843 DEBUG:teuthology.orchestra.run.smithi105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T00:13:38.913 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T00:13:38.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:13:39.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:39.015 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:13:39.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:39.044 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T00:13:39.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:39.074 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T00:13:39.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T00:13:39.125 INFO:teuthology.task.internal:Duration was 1821.293324 seconds 2024-09-12T00:13:39.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T00:13:39.158 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T00:13:39.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:13:39.161 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:13:39.164 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:13:39.203 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:13:39.204 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:13:39.204 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:13:39.628 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T00:13:39.628 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T00:13:39.629 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:13:39.694 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T00:13:39.694 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:13:39.717 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-09-12T00:13:39.717 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:13:39.738 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T00:13:39.738 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:13:39.741 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:13:39.759 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:13:39.805 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T00:13:39.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:13:39.813 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:13:39.827 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:13:41.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T00:13:41.363 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T00:13:41.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:13:41.390 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:13:41.420 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:13:41.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T00:13:41.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:13:41.465 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:13:41.467 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:13:41.487 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-09-12T00:13:41.491 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2024-09-12T00:13:41.518 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-09-12T00:13:41.581 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:13:41.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:41.597 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:13:41.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:41.614 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:13:41.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:41.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T00:13:41.649 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T00:13:41.649 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi060 2024-09-12T00:13:41.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:13:41.714 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi105 2024-09-12T00:13:41.714 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:13:41.754 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901496/remote/smithi192 2024-09-12T00:13:41.754 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:13:41.793 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T00:13:41.793 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:13:41.796 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:13:41.798 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:13:41.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T00:13:41.857 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T00:13:41.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T00:13:41.909 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T00:13:41.909 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:13:41.912 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:13:41.915 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:13:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: 265863 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:13 /home/ubuntu/cephtest 2024-09-12T00:13:41.929 INFO:teuthology.orchestra.run.smithi105.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:13 /home/ubuntu/cephtest 2024-09-12T00:13:41.932 INFO:teuthology.orchestra.run.smithi192.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:13 /home/ubuntu/cephtest 2024-09-12T00:13:41.934 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T00:13:41.946 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T00:13:42.013 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1821.2933237552643 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T00:13:42.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:13:42.102 INFO:teuthology.run:pass